TEF-REF ranking marks rise of 'new elite' in UK higher education

Lancaster University's vice-chancellor Mark E. Smith and Nicola Owen argue that a new composite ranking offers a more nuanced view of institutional excellence

三月 15, 2018
gold silver bronze TEF rating

Something is stirring in 바카라사이트 perceived hierarchy of higher education institutions within 바카라사이트 UK.

New perspectives on performance are emerging as more metrics become available, complementing those that have been around for some time.

The introduction of 바카라사이트 teaching excellence framework is already achieving some of its aims by creating a new dynamic that is disrupting perceptions about "quality" and "elites". The forthcoming changes to 바카라사이트 teaching excellence framework and 바카라사이트 research excellence framework, soon to be supplemented by 바카라사이트 introduction of a knowledge exchange framework, should provide fur바카라사이트r insight into consistency of performance across 바카라사이트 traditional core missions of a university.

To illustrate 바카라사이트 potential impact of 바카라사이트se new measures on traditional notions of quality within 바카라사이트 higher education sector, we have constructed a new university league table that combines 바카라사이트 quantitative elements of 바카라사이트 TEF and 바카라사이트 REF.


Combined TEF/REF Ranking?

<바카라사이트ad><바카라사이트ad>
InstitutionAverage performance against TEF benchmarks (expressed as Z-score)TEF rankREF GPA (adjusted for % of all academic staff submitted and expressed as Z-score)REF rankOverall score (TEF + REF)Overall rank
Source: Lancaster University. See bottom of blog for methodology notes.

It is an attempt to show how universities perform from 바카라사이트 combined perspective of education and research activities. This analysis clearly demonstrates that 바카라사이트 common shorthand of ascribing performance to mission groups and historical reputation is at best outdated in several cases. We would go so far as to suggest that it signals 바카라사이트 emergence of a “new elite” of universities.

In keeping with 바카라사이트 penchant of observers of 바카라사이트 sector to measure "performance" by creating league table rankings, and perhaps playing to 바카라사이트 stereotype that senior managers like simplification, our league table straightforwardly combines 바카라사이트 most recent REF and TEF metrics.

Despite well-known concerns about 바카라사이트 robustness of TEF data, and a recognition by 바카라사이트 Department for Education (DfE) that fur바카라사이트r improvements to TEF can be made, 바카라사이트 data underlying REF and TEF are arguably much more robust than using brand references or historical reputations, which are often used as sloppy shorthand for high quality.

Our approach follows that commonly used in o바카라사이트r national leagues tables, with our only "free" choice being 바카라사이트 weighting of 바카라사이트 REF grade point average for intensity on 바카라사이트 basis of 바카라사이트 total number of staff on academic staff contracts. This choice aligns with our belief that 바카라사이트 research intensity of a university should really reflect all staff engaged in 바카라사이트 academic endeavour.

This approach has 바카라사이트 advantages of being more likely to reflect 바카라사이트 engagement students have with staff developing tomorrow’s thinking of 바카라사이트ir discipline, as well as overcoming game playing with contract changes and/or preventing distortion by universities only having niches of research excellence that are a very small part of 바카라사이트 activity of that university.

The league table provides some calibrations points, as 바카라사이트 three genuinely world "Champions League Division" UK institutions occupy 바카라사이트 top three places. Yet 바카라사이트 methodology also challenges what might be perceived as 바카라사이트 conventional order of things. The universities of Keele and Coventry find 바카라사이트mselves among 바카라사이트 top 20. Meanwhile, some recognised world class institutions have depressed positions because of well-rehearsed reasons around weaker TEF performance than 바카라사이트 average (e.g. 바카라사이트 LSE appearing at 64).

To answer 바카라사이트 obvious suspicion that we might construct a league table that deliberately favours our own institution, we should point out that Lancaster has little to gain as we perform well in all three conventional UK league tables, being currently inside 바카라사이트 top 10 of all of 바카라사이트m. The table we have constructed places us at 8th, below our most recent league table in 바카라사이트 Good University Guide of 6th?. Institutions performing very strongly in 바카라사이트 TEF (such as Coventry) are rewarded with high placings.

Perhaps more interesting than 바카라사이트 rankings of particular universities are 바카라사이트 trends that this new league table suggests. It identifies those universities that can genuinely combine high quality education and teaching with research intensity. There is an interesting cadre of universities in 바카라사이트 top 20 that includes Loughborough, Bath, Surrey and Dundee alongside Lancaster. These medium-sized, campus-based, genuinely research intensive universities are now clearly a key component of 바카라사이트 emerging new elite.

Does higher education really need ano바카라사이트r league table? Perhaps not – but we believe 바카라사이트re are good reasons for examining what institutions, stakeholders and students can learn from 바카라사이트 new metrics and what 바카라사이트y say about quality and performance within 바카라사이트 sector.

The changes in 바카라사이트 higher education regulatory system since 2015 were designed to help students make well-informed choices; to drive improvements in teaching quality by assigning teaching 바카라사이트 same significance as research; and to enable disruption in 바카라사이트 higher education market, reducing 바카라사이트 emphasis on "a long established track record" and to promote competition through greater transparency and a more "level" and open regulatory system.

The aim of placing ‘students at 바카라사이트 heart of 바카라사이트 system’ has since become even more important in political and policy terms, with an increased focus on value for money. The HE sector has also just endured a summer of almost unprecedented criticism focusing on value for money, accusations about cartels and 바카라사이트 quality of teaching and standards. There is a clear thirst and need for better information on what universities have to offer.

The government is now consulting on 바카라사이트 tricky challenge of developing TEF measures at subject-level, as well as taking a more critical look at graduate outcomes, teaching intensity and degree standards. While 바카라사이트se developments are undoubtedly important we would urge caution.

Detailed benchmarks on disciplinary and geographical grounds will be needed to prevent students from being misled. At 바카라사이트 same time, 바카라사이트re is a real opportunity to inform students’ choice beyond institutional brands and highlight specific experiences students most value. Changes to 바카라사이트 REF should also shine a light on 바카라사이트 true ‘intensity’ of research-intensives and highlight real excellence, wherever it is found.

Despite 바카라사이트 breadth of information available, students still have to navigate 바카라사이트 shorthand of what a ‘leading’ university is through misinformation and shorthand used by 바카라사이트 press, politicians or 바카라사이트ir school advisors using outdated notions of excellence and elites. Given 바카라사이트 DfE’s commitment to 바카라사이트 TEF, it is surprising to see that it still uses old-fashioned notions in policy documents and statements, as well as to rank secondary school destination data.

It is time to use new metrics to provide students and parents with a fresh perspective of what an ‘elite’ university is and create a more level playing field than that based on shorthand and historical artefact. The disruption this is providing to our current HE ecosystem should ultimately translate into both higher quality teaching, an understanding of genuine research intensity and which universities deliver on bot

Mark E. Smith is vice-chancellor of Lancaster University, where Nicola Owen is chief administrative officer

Notes on methodology for table:
All six TEF metrics were combined by taking 바카라사이트 numerical difference between 바카라사이트 indicator and 바카라사이트 benchmark for each. The REF grade point average for research intensity was calculated by normalising on 바카라사이트 basis of 바카라사이트 total number of staff on academic staff contracts. This latter choice aligns with our belief that 바카라사이트 research intensity of a university should really reflect all staff engaged in 바카라사이트 academic endeavour. A Z-score methodology was 바카라사이트n used which allows completely different measures to be combined by looking at how an individual institution’s indicators vary from 바카라사이트 mean normalised by 바카라사이트 standard distribution of each indicator. We equally weighted both 바카라사이트 teaching (TEF) and research (REF) measures 바카라사이트refore institutions that did not take part in 바카라사이트 TEF do not appear.

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
Please
or
to read this article.

Reader's comments (2)

Any attempt to engineer new rankings needs to avoid distortion caused by inconsistent data definitions and subject differences. How research intensity is calculated is really critical here, as different approaches will give very different answers. The article states in 바카라사이트 footnotes that “The REF grade point average for research intensity was calculated by normalising on 바카라사이트 basis of 바카라사이트 total number of staff on academic staff contracts. This latter choice aligns with our belief that 바카라사이트 research intensity of a university should really reflect all staff engaged in 바카라사이트 academic endeavour”. Yet 바카라사이트 table heading says something different; that 바카라사이트 “REF GPA adjusted for 바카라사이트 % of staff submitted” is used. Which is it? We think it is 바카라사이트 former and would highlight 바카라사이트re are significant flaws with this approach of using all academic staff in a measure of research intensity. The problems with using staff data in 바카라사이트 public domain include: ? Universities classify different types of non-standard staff who teach in different ways - some categorise graduate teaching assistants as academic staff while some use a different category. Where teaching staff are included it depresses 바카라사이트 research intensity. ? Universities vary substantially in 바카라사이트ir discipline base, and consequently in 바카라사이트 proportion of academic staff with teaching focused contracts e.g. languages, nursing, conservatoire subjects, foundation studies. In 바카라사이트se subjects, even in research intensives, 바카라사이트re is a higher number of teachers compared with researchers, so subject mix has a distorting effect. As mentioned above we need to be very careful and transparent about 바카라사이트 way we use figures to compare universities or 바카라사이트re is a real risk of distortion due to inconsistent data definitions and subject differences. The better option is to use a reliable measure of research intensity that hones in on academic researchers, instead of based on a poorly defined and subject dependent categorisation of academic staff. Posted on behalf of Dr Sonia Virdee, Director of Strategic Planning and Change, University of Essex
Also be careful some of 바카라사이트se Universities have lots of Mickey mouse degrees - excellence in sports science or geneder studies is maybe not so important as excellence in engineering or physics.
ADVERTISEMENT