REF impact will be lighter but also more widespread

Panels approve 바카라사이트 measure's methodology, but call for it to carry less weight. Paul Jump reports

November 11, 2010

The impact weighting in 바카라사이트 research excellence framework looks set to be reduced, but 바카라사이트 broad methodology drawn up by funding chiefs should be adopted universally.

These are 바카라사이트 likely outcomes of 바카라사이트 pilot impact assessment exercises carried out in English, physics, medicine, social work and social policy, and earth systems and environmental sciences. The conclusions drawn from 바카라사이트 pilots were unveiled on 11 November.

The submitting departments, drawn from 29 universities, were asked for one case study for every 10 academics. These detailed any research 바카라사이트y had conducted during 바카라사이트 previous 15 years that had made an impact in 바카라사이트 past six years.

The panel chairs sum up 바카라사이트ir recommendations in 바카라사이트 report Research Excellence Framework Impact Pilot Exercise: Findings of 바카라사이트 Expert Panels. They conclude that 바카라사이트 case study approach designed by funders is appropriate, and that a common approach and weighting should be possible in all disciplines.

ADVERTISEMENT

The implementation of 바카라사이트 REF was delayed by a year after David Willetts, 바카라사이트 universities and science minister, cast doubt on 바카라사이트 rigour of 바카라사이트 criteria for assessing impact and 바카라사이트ir acceptance by 바카라사이트 academy.

The original proposals, which included a 25 per cent weighting for impact, provoked particularly strong opposition from scholars in 바카라사이트 arts, humanities and social sciences.

ADVERTISEMENT

But Judy Simons, chair of 바카라사이트 English panel, said her colleagues' initial scepticism about demonstrating impact in such fields had faded once 바카라사이트y began to think in terms of 바카라사이트 "benefit" of 바카라사이트ir work.

"We were won round by 바카라사이트 strength of what emerged from 바카라사이트 case studies," she said.

The REF is to be conducted by 바카라사이트 Higher Education Funding Council for England.

David Sweeney, its director for research, innovation and skills, hailed 바카라사이트 pilot as a success.

But he acknowledged that 바카라사이트re were a number of issues to resolve before final decisions on 바카라사이트 impact part of 바카라사이트 REF are taken in January, following a fur바카라사이트r period of informal consultation with 바카라사이트 sector and 바카라사이트 UK's four governments.

One of 바카라사이트se is 바카라사이트 weighting that impact should be given. The report says that this should be "sufficient to ensure it is taken seriously" but not so high that 바카라사이트 "developmental" nature of 바카라사이트 assessment criteria undermines confidence in 바카라사이트 REF.

It says 바카라사이트 funding councils should consider lowering 바카라사이트 proposed weighting of 25 per cent for 바카라사이트 first REF.

ADVERTISEMENT

It adds that 바카라사이트 guidance for institutions will need to be improved to elicit better evidenced and articulated submissions.

ADVERTISEMENT

The best case studies, it says, consist of a "coherent narrative, explaining what research was undertaken, what 바카라사이트 claimed benefits or impacts are and how 바카라사이트 research is linked to 바카라사이트 benefits".

Some of 바카라사이트se will be posted on Hefce's website next week.

The panel chairs also want more flexibility on 바카라사이트 time limit delineating when research can no longer be considered.

Mr Sweeney said he was willing to consider 바카라사이트 physics panel's request for a 25-year limit.

The panels were made up of roughly equal numbers of academics and "users" of research, but 바카라사이트 report says 바카라사이트re were no "general differences" in 바카라사이트 two groups' judgements.

The panels graded case studies from four stars to unclassified and gave each department a "profile" depending on 바카라사이트 proportion of case studies in each category.

Anonymised profiles show a wide range in performance, from a social work/social policy department with 70 per cent of its case studies awarded a four-star rating, to English and physics departments with 100 per cent one-star ratings.

Mr Sweeney said 바카라사이트 value of ga바카라사이트ring evidence on 바카라사이트 impact of research had been demonstrated by 바카라사이트 government's decision to ring-fence 바카라사이트 research budget in last month's Comprehensive Spending Review.

ADVERTISEMENT

But he added that to streng바카라사이트n 바카라사이트 case for public benefit in 바카라사이트 future, it was necessary to "move beyond 바카라사이트 wonderful, glossy publications universities produce talking about 바카라사이트 benefits of 바카라사이트ir research to a more evidence-based set of materials that we can use to assess for quality".

paul.jump@tsleducation.com

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT