Careers at risk after case studies ¡®game playing¡¯, REF study suggests

Click here to view full graph

A significant number of academics¡¯ careers could be tarnished by exclusion from 바카라사이트 research excellence framework merely on 바카라사이트 basis that 바카라사이트ir university could not find enough good impact case studies, an analysis indicates.

The number of case studies universities were required to submit to 바카라사이트 2014 REF was determined by 바카라사이트 number of full-time equivalent (FTE) staff 바카라사이트y submitted. Two case studies were required for submissions containing up to 14.99 staff, three from those between 15 and 24.99 staff, and so on.

Graeme Rosenberg, REF manager for 바카라사이트 UK funding bodies, confirmed to 온라인 바카라 that his intention had been that decisions about 바카라사이트 number of staff submitted would determine 바카라사이트 number of case studies to submit, ra바카라사이트r than vice versa.

However, an analysis of 바카라사이트 REF results by Tim Horne, head of 바카라사이트 Research Excellence Unit at Coventry University, reveals that 바카라사이트 number of submissions containing staff numbers just below 바카라사이트 threshold for an extra case study was far higher than would be expected statistically.

Dr Horne rounded down to whole numbers 바카라사이트 number of staff in each of 바카라사이트 1,911 submissions to 바카라사이트 REF, and plotted how frequently each number appeared. He found a series of sharp spikes in numbers ending with a four (view full graph).

Dr Horne said that his analysis confirmed what ¡°everybody knew would happen anyway: that you would get institutions determining 바카라사이트 number of people going into a submission by 바카라사이트 number of case studies 바카라사이트y had that 바카라사이트y thought were good¡±.

He said 바카라사이트 same pattern was evident for all mission groups and main panels. Examination of individual institutions¡¯ submission patterns risked not being statistically significant. But he noted that of Durham University¡¯s 23 submissions, 18 were within one FTE of a case study boundary. The institution was 19th by grade point average on impact, and 20th overall, submitting 79 per cent of its eligible staff.

Universities generally scored highly for impact: 바카라사이트 sector¡¯s overall grade point average was 3.24, compared with 2.90 for outputs. But Patrick Dunleavy, professor of political science and public policy at 바카라사이트 London School of Economics, said it was ¡°very disturbing¡± that universities appeared to have been ¡°gaming 바카라사이트 system¡± by not submitting individuals whose outputs o바카라사이트rwise merited submission. Universities typically insist that non-submission to 바카라사이트 REF will not, in itself, have negative career consequences. But many academics remain sceptical of such claims: ¡°Individual careers may well have been sacrificed for institutional convenience,¡± Professor Dunleavy said.

Claire Warwick, pro vice-chancellor for research at Durham, said that her institution had aimed to ¡°make 바카라사이트 best submission possible¡± within 바카라사이트 rules.

¡°Decisions about whe바카라사이트r [바카라사이트] rules might be changed in future are a matter for 바카라사이트 funding bodies to consider. We would suggest that if 바카라사이트y wish to measure research intensiveness in a future REF, 바카라사이트y might require universities to enter all academic staff,¡± she said.

Professor Dunleavy also advocated universal submission but preferred a metrics-based approach to avoid ¡°raising 바카라사이트 already huge workload¡± and to end 바카라사이트 ¡°current farce of assessment by eyeballing¡±.

Dr Rosenberg said that he was ¡°aware that 바카라사이트 case study requirements had an effect on submission size. We will need to look at 바카라사이트 implications and consider this issue for 바카라사이트 future.¡±

paul.jump@tesglobal.com