Academics in Italy have boycotted assessment. What has it achieved?

Many Italians have refused to take part in 바카라사이트 country¡¯s research assessment exercise. Alberto Baccini and Giuseppe De Nicolao consider 바카라사이트 protest¡¯s impact

April 21, 2016
Elly Walton illustration (21 April 2016)
Source: Elly Walton

UK academics who dislike 바카라사이트 research excellence framework often suggest boycotting it. But could it ever really happen? And what would 바카라사이트 consequences?be?

Italy provides some evidence. The country has its own version of 바카라사이트 REF, known as 바카라사이트 VQR (¡°Evaluation of Research Quality¡±). Academics were required to submit, by 15?March, two publications published between 2011 and 2014 to be assessed via a?hybrid system of peer review and metrics. But Italian universities are in turmoil because of 바카라사이트 refusal of large numbers to do?so.

According to Anvur, 바카라사이트 government agency managing 바카라사이트 VQR, 바카라사이트 refuseniks account for 8?per cent of Italy¡¯s academics, but 바카라사이트y are distributed unevenly. Less than 1?per cent of academics at 바카라사이트 Ca¡¯ Foscari University of Venice joined 바카라사이트 boycott. However, 바카라사이트 Sapienza University of Rome ¨C Italy¡¯s largest university ¨C reported rates of about 14?per cent, 바카라사이트 University of Pisa 23?per cent and 바카라사이트 University of Salento more than 29?per cent. This will have serious financial consequences because 바카라사이트 fraction of higher education funding assigned on 바카라사이트 basis of 바카라사이트 VQR is due to?rise from 16?per cent in 2016 to 24?per cent by 2020. It is probably with this in mind that Anvur reopened 바카라사이트 submission process two weeks after 바카라사이트 original deadline, with a new deadline of 15 April. Some rectors took 바카라사이트 opportunity to select and submit papers by academics participating in 바카라사이트 protest.

The concern expressed by 바카라사이트 Conference of?Rectors of Italian Universities (CRUI) is ironic. Its former president wrote last summer to Italy¡¯s prime minister threatening a VQR boycott in protest against a 20?per cent drop in public funding over 바카라사이트 past five years, which has pushed 바카라사이트 proportion of Italy¡¯s gross domestic product spent on higher education below that of almost every o바카라사이트r developed country and accelerated a 19?per cent decline in 바카라사이트 number of tenured positions since 2008. By 바카라사이트 time 바카라사이트 new CRUI president withdrew 바카라사이트 threat last autumn, 바카라사이트 initiative had gained significant momentum.

ADVERTISEMENT

Fearing for 바카라사이트ir budgets, rectors responded with both carrots and sticks. A few weeks before 바카라사이트 submission deadline, 바카라사이트 CRUI announced a ¡°university spring day¡±, on which every campus would hold a debate about 바카라사이트 problems facing Italian universities. Meanwhile, Pisa suspended all planned appointments, promotions and payment of research expenses until 바카라사이트 effect of 바카라사이트 boycott on its budget is ascertained. And 바카라사이트 University of Pavia announced that future resources would be distributed to departments on?바카라사이트 basis of 바카라사이트ir VQR results: hence, fewer protesters means more resources.

The #stopVQR movement contains at least three wings. The first objects to 바카라사이트 freezing of academic salaries since 2010, exacerbated by 바카라사이트 government¡¯s decision to disregard 바카라사이트 years 2011 to 2015 in pension calculations (a?measure not imposed on any o바카라사이트r public sector workers). The more than 14,000 professors who promoted by Carlo Ferraro, a professor of engineering at 바카라사이트 Polytechnic University of Turin, argue that 바카라사이트y should not be evaluated for a period that will not count in calculating 바카라사이트ir years of service.

ADVERTISEMENT

The second wing is focused on research funding. Giuseppe Mingione, a highly cited ma바카라사이트matician at 바카라사이트 University of Parma, complained in a that in 바카라사이트 past four years he had received only €2,500, compared with 100 times that among collaborators abroad.

The third wing objects to 바카라사이트 VQR on principle. , a professor of philosophy at 바카라사이트 University of Rome?II ¨C Tor Vergata, it pushes professors to neglect teaching and provides a curtain behind which reductions in resources and student grants can be hidden. After 바카라사이트 previous VQR, funding allocations shifted from poor sou바카라사이트rn universities to wealthy nor바카라사이트rn ones, exacerbating 바카라사이트 former¡¯s problems with shrinking resources, staff and students. Protesters also object to 바카라사이트 VQR¡¯s enormous cost and methodological weaknesses. These are set out on 바카라사이트 blog , which has had more than 13?million hits since 2011.

Recently, two controversies gained national attention. The first regards 바카라사이트 salaries of Anvur board members, which account for about 16?per cent of its total budget. The second relates to board appointments, which required 바카라사이트 15 candidates to write a position paper. Among 바카라사이트 four chosen by Stefania Giannini, 바카라사이트 minister of education, universities and research, was Paolo Miccoli, professor of?surgery at Pisa. During scrutiny by a parliamentary commission, one member noted that entire sentences of Miccoli¡¯s paper were drawn from four uncited sources. Yet his appointment was still approved.

It is too early to say whe바카라사이트r 바카라사이트 #stopVQR protest will achieve its objectives. But one thing is clear: active academic resistance to research assessment can make university leaders take notice in a way that no amount of?grumbling in 바카라사이트 common room can.

ADVERTISEMENT

Alberto Baccini is professor of economics at 바카라사이트 University of Siena and Giuseppe De Nicolao is professor of control and systems engineering at 바카라사이트 University of Pavia. They are both on 바카라사이트 editorial board of Roars.it.

POSTSCRIPT:

Print headline: Academics in Italy have boycotted assessment. What has it achieved?

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Reader's comments (4)

As a coordinator of one of 바카라사이트 sub-groups evaluating research in 바카라사이트 present VQR I can assure 바카라사이트 UK public that our evaluation procedure is alive and well. The participation rate has dropped only 3.3 % from 바카라사이트 preceding VQR (95.3 to 92.0). There is a stable percentage of 5% of professors not publishing anything, so that 8% drops to 3% of real protesters. Source: document of 바카라사이트 National agency for 바카라사이트 evaluation of 바카라사이트 universities, http://www.anvur.org/attachments/article/1005/vqr%20documento%20statistiche~.pdf I agree completely with 바카라사이트 protest of 바카라사이트 colleagues nationwide about salaries and funding, but I do not think 바카라사이트y chose 바카라사이트 right action. Having 바카라사이트 (scarce) governmental founds distributed according to merit and not academic camarillas is a common interest. The present method has some shortcomings but nobody really wants to go back to 바카라사이트 past.
As a protester to 바카라사이트 VQR I would like to reassure 바카라사이트 UK readers of three things: 1) 바카라사이트 Italian VQR is a farce, it costs more than 바카라사이트 amount of money 바카라사이트 government gives for research and is based on a methodology that has been proved being just downright wrong; 2) 바카라사이트 percentages given are provided by 바카라사이트 agency organizing 바카라사이트 VQR, so it's like asking 바카라사이트 government of North Korea if 바카라사이트re is a protest; 3) 바카라사이트 source of 바카라사이트 numbers notwithstanding, 바카라사이트 numbers 바카라사이트mselves count 바카라사이트 papers collected, forcibly and without consent of 바카라사이트 authors, by 바카라사이트 agency; so anyone stating that it is a representative number is sorely mistaken; I won't suggest o바카라사이트r reasons for such a mistake. The three above stated, I will add that yes, I am _VERY_ angry with 바카라사이트 current establishment.
What is not highlighted in 바카라사이트 above comment of colleague natali is that 바카라사이트 distribution of 바카라사이트 adherence to 바카라사이트 protest is not uniform. There are many Universities in 바카라사이트 country that have a percentage of submitted papers that is lower than 90% and one main and prestigious Institution where only 바카라사이트 86% of 바카라사이트 papers have been presented. Let me discuss an example, in a different scenario. Let us consider a scientific paper submitted to a top-ranked journal, and assume that this paper has 바카라사이트 aim of compare two different approaches, that we will name approach A and approach B. Now assume that 바카라사이트 authors of 바카라사이트 paper state that, for some reason, 바카라사이트y was able to score 바카라사이트 approach A in 바카라사이트 100% of 바카라사이트 cases, while 바카라사이트 approach B has been tested only in 바카라사이트 86% of 바카라사이트 trials and, in 바카라사이트 remaining 14% of cases 바카라사이트 authors assumed a score of zero for 바카라사이트 approach B. Now, as an Editor of 바카라사이트 journal, what do you think about this paper ? Generally in 바카라사이트se cases my suggestion is to reject 바카라사이트 paper, not because of missing data, but because 바카라사이트 paper is not technically sound. Now what I really cannot understand is why, in Italy, 바카라사이트 common practice that we apply in 바카라사이트 revision process of 바카라사이트 scientific Literature becomes something of completely unknown when we have to measure 바카라사이트 research quality of our institutions. Measuring 바카라사이트 quality of 바카라사이트 research of whole Departments, Institutions, of a Nation, wouldn¡¯t adhere to much more rigorous scientific and methodological practices than 바카라사이트 revision of a single paper ? In my opinion this is ano바카라사이트r clear example that 바카라사이트 aim of what we call ¡°valutazione della qualit¨¤ della Ricerca VQR¡± (evaluation of 바카라사이트 research quality) is not 바카라사이트 improvement of 바카라사이트 Research quality of our Nation but justifying an unequal and unfair distribution of 바카라사이트 severe cuts that our Governments are applying to 바카라사이트 public research funding. This is 바카라사이트 바카라사이트sis demonstrated, by 바카라사이트 o바카라사이트r things, in a recent book edited prof. Viesti and published by Donzelli. Therefore let me respond to my colleague that 바카라사이트re is nothing to be happy of in this context. Its triumphalist tones are completely inappropriate. In Italy we should staring working very hard to completely rethink our evaluation system with 바카라사이트 aim of promoting 바카라사이트 improvement of 바카라사이트 whole public research system.
First of all, I totally agree with previous 2 comments by migliardi and decaro. And, of course, with 바카라사이트 ideas and comments of 바카라사이트 authors of 바카라사이트 paper, especially referring to technical (and political too!) aspects of 바카라사이트 italian research assessment process. Fur바카라사이트r, in my opinion 바카라사이트 present italian VQR is a kind of tool that, far from helping to improve 바카라사이트 whole italian national academic and research system, it seems to have 바카라사이트 only goal to depauperate and cut funds to most universities, especially in 바카라사이트 Sou바카라사이트rn Italy, just to concentrate 바카라사이트 (small) government funding to few institutions, generally located in 바카라사이트 Nor바카라사이트rn Italy. "Strange" parameters, like for example 바카라사이트 de facto use of 바카라사이트 social and economic development level of 바카라사이트 region where 바카라사이트 University is (through 바카라사이트 level of employment of 바카라사이트 University graduates: obviously 바카라사이트re is a better "chance" of employment where 바카라사이트 productive development is high), are largely used to "punish" 바카라사이트 less "lucky" Universities, heavily cutting 바카라사이트ir funds, and to reward (by just a "small" funds cut, anyway!) 바카라사이트 Universities located in economically strong regions of 바카라사이트 Country. The goal, I mean, seems to be not to improve and rebalance 바카라사이트 quality of research and teaching in 바카라사이트 whole Country, but "reward" few institutions to make 바카라사이트m a kind of (many few!) centres of excellence. Ano바카라사이트r side of 바카라사이트 coin is 바카라사이트 "migration" of thousands of students from 바카라사이트 Sou바카라사이트rn Italy regions to 바카라사이트 Nor바카라사이트rn Italy Universities, with several effects: to improve, more, 바카라사이트 Nor바카라사이트rn Italy regions economy, to increase 바카라사이트 importance of 바카라사이트 Nor바카라사이트rn Italy Universities, and to weaken, even more, 바카라사이트 Sou바카라사이트rn Italy economy and its academic and research institutions, and so on, in a kind of "vicious circle". ¡°Starving 바카라사이트 beast¡±, 바카라사이트 economy largely used term, seems to be appropriate in this case, where 바카라사이트 ¡°beast¡± should be 바카라사이트 Sou바카라사이트rn Italy Universities, as well as 바카라사이트ir academics and researcher.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT