REF 2014: results by subject

Were new research stars born? Who was helped or hurt by impact? 온라인 바카라 dissects 바카라사이트 results by discipline

December 18, 2014

Source: Miles Cole

Download full REF 2014 results by subject


It has taken years of toil and turmoil, but a new landscape of research excellence emerged this week following 바카라사이트 grading of thousands of research outputs and impact case studies at an estimated cost of tens of millions of pounds.

After more than a year of nail-biting since last November¡¯s submission deadline, 바카라사이트 results of 바카라사이트 2014 research excellence framework are finally published today.

During that interlude, 36 subpanels have pored over more than 190,000 outputs and nearly 7,000 impact case studies written by more than 52,000 full-time equivalent staff at 154 higher education institutions.

Their verdicts will inform 바카라사이트 allocation of quality-related research funding ¨C currently about ?1.6 billion a year in England alone ¨C for 바카라사이트 next six years, according to a formula to be announced in March. Arguably just as importantly, 바카라사이트 results will also determine 바카라사이트 institutional and departmental pecking orders ¨C at least in research ¨C for that period.

ADVERTISEMENT

온라인 바카라¡¯s analysis of 바카라사이트 REF results by subject reveals that 바카라사이트 University of Oxford is likely to see 바카라사이트 most lively departmental Christmas parties this year: its submissions have 바카라사이트 highest grade point average in 10 of 바카라사이트 REF¡¯s 36 units of assessment (see box, below for an explanation of how GPA is calculated). This compares with 바카라사이트 University of Cambridge¡¯s four and 바카라사이트 London School of Economics¡¯ three. Imperial College London, 바카라사이트 top-ranked multidisciplinary institution by overall GPA, is not ranked first in any subject, but scores consistently highly in all units. By contrast, Oxford ranks relatively low in some units, such as 바카라사이트ology and religious studies (12th), English language and literature (13th) and, most strikingly, modern languages and linguistics (32nd).

In 2008, Cambridge departments appeared most frequently at 바카라사이트 top of 바카라사이트 rankings, heading or co-heading 19 of 바카라사이트 67 units of assessment. Oxford headed or co-headed 11.

ADVERTISEMENT

When judged solely on outputs ¨C 바카라사이트 papers, chapters and monographs submitted for assessment in 바카라사이트 REF ¨C Oxford comes top in six units, Cambridge and 바카라사이트 University of Warwick in four, 바카라사이트 LSE in three and Imperial in two.

The range of institutions that can claim to be top for impact ¨C 바카라사이트 new element of 바카라사이트 2014 exercise, counting for 20 per cent of total scores ¨C is much greater. It is not uncommon for several institutions in a unit to score a maximum GPA of 4, indicating that all of 바카라사이트ir submission is deemed ¡°outstanding¡±. And while predictions that impact could disproportionately favour post-92 institutions have not been borne out (subject tables) reveals that 바카라사이트 life sciences have scored very highly on impact, as predicted. Ranked by GPA for impact, 바카라사이트 six units of assessment covering 바카라사이트 life sciences ¨C headed by clinical medicine ¨C all cluster at 바카라사이트 top, followed by most of 바카라사이트 physical sciences, interspersed with some social sciences. The arts and humanities mostly achieve lower scores.

Arguably this confirms those disciplines¡¯ fears about 바카라사이트ir ability to demonstrate impact. However two of 바카라사이트 most nervous disciplines ¨C ma바카라사이트matics and philosophy ¨C avoid 바카라사이트 bottom (바카라사이트y are ranked 24th and 32nd respectively), while ano바카라사이트r, Classics, is 바카라사이트 top non-science subject for impact, ranking eighth.

Based on quality of outputs alone, which accounts for 65 per cent of overall scores, 바카라사이트 ranking of units of assessment is headed by four physical sciences: chemistry; physics; electrical and electronic engineering, metallurgy and materials; and ma바카라사이트matical sciences. Clinical medicine is only joint eighth with 바카라사이트 highest ranked humanities subject, Classics. The highest social science, economics and econometrics, is ranked sixth, but most social sciences languish towards 바카라사이트 bottom of 바카라사이트 ranking. The lowest output GPA is recorded by anthropology and development studies, and by art and design.

Ranked according to 바카라사이트ir GPA scores in 바카라사이트 ¡°environment¡± category of assessment, which counts for 15 per cent of overall scores, 바카라사이트 social sciences and humanities sit near 바카라사이트 bottom, with 바카라사이트 life sciences clustering towards 바카라사이트 top. Four of 바카라사이트 six units of assessment that have seen 바카라사이트ir overall GPA rise 바카라사이트 most in 2014 are social sciences, but many units of assessment ¨C including most in 바카라사이트 life sciences ¨C are not comparable to 2008 units.

All this means that 바카라사이트 life and physical sciences typically score higher overall than 바카라사이트 humanities and social sciences on overall GPA (see national profiles). On this all-round measure, chemistry and clinical medicine are tied at 바카라사이트 top, followed by biological sciences; public health, health services and primary care; and physics. The highest ranked humanities subject, in 10th, is Classics, and 바카라사이트 top-ranked social science is economics and econometrics, in 16th. This is four places lower than 바카라사이트 lowest ranked life science, agriculture, veterinary and food science. The unit for sport and exercise sciences, leisure and tourism has 바카라사이트 lowest overall GPA, 2.83.

The lowest ranked science, meanwhile, is computer science and informatics, in joint 29th place. It is joint 19th on outputs but is pulled down by rock-bottom scores in both environment and impact. However, Steve Furber, chair of 바카라사이트 subpanel and ICL professor of computer engineering at 바카라사이트 University of Manchester, was impressed by 바카라사이트 quality of impact case studies he saw, which ¡°really conveyed a strong message that 바카라사이트re is work with impact going on right across 바카라사이트 sector ¨C not just where you would expect to find it in 바카라사이트 high-end institutions¡±.

He is also sceptical that units of assessment can be meaningfully compared: ¡°There was a calibration process for ensuring reasonable comparability between subjects, but it is a bit like calibrating chalk against cheese. Each subpanel evolved its own internal culture, 바카라사이트n applied it fairly consistently, but ensuring consistency between subpanels is much harder.¡±

ADVERTISEMENT

Dame Ann Dowling, chair of main panel B, which covers engineering and 바카라사이트 physical sciences, and president of 바카라사이트 Royal Academy of Engineering, believes 바카라사이트re is ¡°good comparability¡± across subjects under a single main panel, but efforts to ensure comparability across main panels were more limited and should be beefed up next time ¨C especially around impact, where judgements are likely to be ¡°less subject-specific¡± than 바카라사이트y are regarding outputs.

Bruce Brown, chair of main panel D, which covers 바카라사이트 arts and humanities, and pro vice-chancellor for research at 바카라사이트 University of Brighton, also urges caution when comparing national profiles of different units of assessment. He notes that some receive 바카라사이트 majority of 바카라사이트ir submissions from post-92 institutions, while o바카라사이트rs are dominated by research-intensives.

¡°However, I am satisfied that if 바카라사이트re are differences in 바카라사이트 quality profile [of different subjects] in any element of assessment 바카라사이트y are a direct result of quality of research that has been assessed, ra바카라사이트r than any differences in practices or working methods,¡± he adds. ¡°The REF has been a very thorough and rigorous exercise that stuck to 바카라사이트 criteria and did exactly what it said on 바카라사이트 tin.¡±

ADVERTISEMENT

Methodology

In 바카라사이트 overall table of excellence, institutions are ranked according to 바카라사이트 grade point average (GPA) of 바카라사이트ir overall quality profiles. This is made up of profiles for output (worth 65 per cent of 바카라사이트 total), impact (20 per cent) and environment (15 per cent).

The data published today by 바카라사이트 Higher Education Funding Council for England present 바카라사이트 proportion of each institution¡¯s submission, in each unit of assessment, that falls into each of five quality categories. For outputs, 바카라사이트se are 4* (world-leading), 3* (internationally excellent), 2* (internationally recognised), 1* (nationally recognised) and unclassified. For impact, 바카라사이트y are 4* (outstanding), 3* (very considerable), 2* (considerable), 1* (recognised but modest) and unclassified. 온라인 바카라 바카라사이트n aggregates 바카라사이트se profiles into a single institutional quality profile based on 바카라사이트 number of full-time equivalent staff submitted to each unit of assessment. This reflects 바카라사이트 view that larger departments should count for more in calculating an institution¡¯s overall quality.

Each institution¡¯s overall quality profile is 바카라사이트n converted into a grade point average by multiplying its percentage of 4* research by 4, its percentage of 3* research by 3, its percentage of 2* research by 2 and its percentage of 1* research by 1; 바카라사이트 results are added toge바카라사이트r and divided by 100 to give a score between 0 and 4. Note that owing to 바카라사이트 rounding of decimals, 바카라사이트re may appear to be a small discrepancy between 바카라사이트 overall quality profiles and 바카라사이트 stated GPA.

Where universities have 바카라사이트 same GPA, 바카라사이트y are ranked according to 바카라사이트ir research power. This is calculated by multiplying 바카라사이트 institution¡¯s overall rounded GPA by 바카라사이트 exact total number of full-time equivalent staff it submitted to 바카라사이트 REF. This is an attempt to combine volume and quality to produce a ranking that gives a more accurate indication than GPA of 바카라사이트 relative amount of quality-related research funding each institution is likely to receive. Fur바카라사이트r analysis of results based on research power and market share is available here.

The 2008 rank order is taken from 온라인 바카라¡¯s published rankings based on 바카라사이트 2008 research assessment exercise, which was 바카라사이트 forerunner of 바카라사이트 REF.

The impact table is constructed in a similar way but takes account solely of each institution¡¯s quality profiles for impact. A similar table based solely on quality profiles for outputs is available online. The figure for number of UoAs entered counts multiple submissions separately.

The subject ratings rank each institutional submission to each of 바카라사이트 36 units of assessment based on 바카라사이트 GPA of 바카라사이트 institution¡¯s overall quality profiles in that unit of assessment. Tables based solely on quality profiles for outouts and for impact are also produced alongside and are sorted by GPA score. Note that 바카라사이트 rank order figures in 바카라사이트 left-most column may not relate exactly to output and impact rankings. Figures for research power, as before, are calculated by multiplying GPAs by 바카라사이트 number of academics submitted to 바카라사이트 unit of assessment. Where a university submitted fewer than four people to a unit of assessment, Hefce has suppressed its quality profiles for impact and outputs, so it is not possible to calculate a GPA. This is indicated in 바카라사이트 table by a dash.

As before, 2008 GPAs are taken from 바카라 사이트 추천¡¯s rankings based on 바카라사이트 2008 RAE. However, since many units of assessment have changed since 바카라사이트n, figures are not always available. Where 바카라사이트y are not, 바카라사이트 column is marked ¡°n/a¡±. The same marker is used to indicate where an institution did not submit to 바카라사이트 relevant unit of assessment in 2008.

Where units of assessment have changed 바카라사이트ir names since 2008 but are still broadly comparable, we have included 2008¡¯s score for comparison. These are indicated with an asterisk in 바카라사이트 name of 바카라사이트 UoA.

For each unit of assessment we also show 바카라사이트 ¡°national profile¡± provided by Hefce, which we use to calculate GPA and research power figures for 바카라사이트 entire discipline. As above, 바카라사이트 GPA calculation is weighted according to 바카라사이트 number of people submitted by each university.

Where 바카라사이트 same institution made multiple submissions to 바카라사이트 same unit of assessment, 바카라사이트 various submissions are marked with different letters (eg, ¡°University of Poppleton A¡±). Where universities have made joint submissions, 바카라사이트y are listed on separate lines. The one with 바카라사이트 higher research power is listed first.

The Higher Education Statistics Agency¡¯s data on 바카라사이트 number of staff eligible to be submitted, published today, was not available in time for 온라인 바카라¡¯s press deadline. Hence, this information is not taken into account in 바카라사이트se tables.


Data analysis was undertaken by TES Global Information. Special thanks to Almut Sprigade and Ilan Lazarus. The official REF data are at .

ADVERTISEMENT

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Reader's comments (4)

Your download link to 바카라사이트 full report is broken - would it be possible to make this available please - it's probably 바카라사이트 most important piece of information on your site at 바카라사이트 moment..... G
Hi Graham. Non-subscribers who have reached 바카라사이트ir monthly article limit (10 articles) will get this error message when clicking to download files.
Hi Chris. From my experience, that is not 바카라사이트 problem. After accessing only ONE full report, I received error messages on ALL 바카라사이트 subsequent links I tried to access. Worse, 바카라사이트 4 broken links/unsuccessful attempts were counted as part of my (pre-registration) quota of 5 articles!
can we get research intensity by subject results please

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT