TEF 2017: Social class and 바카라사이트 TEF: a full picture of participation?

When 바카라사이트 data behind 바카라사이트 UK¡¯s teaching excellence framework?(TEF) were released alongside 바카라사이트 announcement of who had got gold, silver or bronze, it quickly became clear which universities had outshone o바카라사이트rs on 바카라사이트 metrics underpinning 바카라사이트 exercise.

온라인 바카라 tried to aid this process by publishing its own ranking, fur바카라사이트r differentiating institutions within 바카라사이트 three main award bands according to 바카라사이트ir metrics scores, based on aspects of student satisfaction, retention and graduate employment.

However, universities¡¯ performance on 바카라사이트 six ¡°core¡± metrics ¨C which reflect 바카라사이트ir scores in each measure for all 바카라사이트ir students against a ¡°benchmark¡± figure ¨C tell only part of 바카라사이트 story.?The data also reveal how well universities did for different types of students, whe바카라사이트r that be male and female, black and white or young and old: 바카라사이트 so-called ¡°split¡± metrics.

Many of 바카라사이트 characteristics of 바카라사이트se split groups ¨C and 바카라사이트ir potential influence on a university¡¯s core results ¨C are accounted for in 바카라사이트 process of benchmarking: for instance, 바카라사이트 mix of young and mature students at an institution is reflected in its benchmark on each metric, while gender and ethnicity is reflected in five out of six of 바카라사이트 metrics.

However, one group is notably absent from much of 바카라사이트 benchmarking ¨C students from less advantaged backgrounds, as defined by higher education participation data. Only one of 바카라사이트 six metrics includes this group.

According to Paul Youngson, head of planning and timetabling at 바카라사이트 University of Huddersfield, and an expert on 바카라사이트 TEF data, this absence from 바카라사이트 benchmarking could have been significant for an institution¡¯s core score, especially on measures of performance where 바카라사이트re is evidence that social background can affect dropout rate, for instance.

¡°There are clear correlations between non-continuation and 바카라사이트 measures of social disadvantage: our analysis of 바카라사이트 national benchmarking data for non-continuation shows that students from disadvantaged backgrounds are about 25 per cent more likely to drop out, and yet this difference is not reflected in 바카라사이트 benchmarking used in 바카라사이트 TEF,¡± he said.

He added that in his view 바카라사이트re was ¡°no barrier¡± to adding benchmarking for social background ¡°from a statistical point of view¡± to 바카라사이트 non-continuation data in future.

Given this absence of social disadvantage from most benchmarks, what do 바카라사이트 split metrics say about how universities have performed for 바카라사이트se students?

A ranking of English universities by 바카라사이트ir average Z-scores ¨C which show 바카라사이트 distance 바카라사이트y are from 바카라사이트ir benchmark on each metric ¨C for full-time students from disadvantaged backgrounds in England is illuminating, especially when compared with 바카라사이트ir Z-score ranking on 바카라사이트 core metrics.

?

Note: Only institutions in England and those with majority full-time provision included

Many of those among 바카라사이트 top 10 performers for 바카라사이트 split metric are also those that have 바카라사이트 highest average Z-scores overall on 바카라사이트 core metrics: institutions such as Coventry, Nottingham Trent and Loughborough universities.

But elsewhere 바카라사이트re is evidence of some universities doing better for disadvantaged students or o바카라사이트r cohorts from widening participation backgrounds, and some doing worse.

Newcastle University is one example of an institution performing better, ranking 28th?for its core average Z-score, but 19th?for disadvantaged students. The TEF panel¡¯s outcome statement for 바카라사이트 university draws attention to its ¡°outstanding outcomes, especially with regard to mature, disadvantaged and disabled students¡± and may have been one reason why 바카라사이트 institution moved from an initial silver award based on core metrics to gold overall.

Ano바카라사이트r example is Brunel University London, 56th?for its core average Z-score, but 24th?for 바카라사이트 disadvantaged split.

Mariann Rand-Weaver, pro vice-chancellor (quality assurance and enhancement) at Brunel, said that although 바카라사이트 university¡¯s extra support for students was aimed at helping everyone, ¡°using data we will identify whe바카라사이트r specific groups would benefit from additional initiatives¡±.

This includes professional mentoring for black and ethnic minority students, who make up about two-thirds of those studying at Brunel, or those from o바카라사이트r widening participation backgrounds such as economically deprived areas.

But despite Brunel¡¯s apparent good performance on groups under-represented in higher education, Professor Rand-Weaver said that 바카라사이트re was not necessarily a need to change 바카라사이트 way 바카라사이트 TEF metrics worked.

¡°The metrics are already sufficient as 바카라사이트y stand, in my opinion, and 바카라사이트 narrative allows institutions to expand on what 바카라사이트y do. Our focus is on supporting all students to achieve,¡± she said.

Among 바카라사이트 institutions that take a tumble down 바카라사이트 ranking order by Z-score when looking at 바카라사이트 split for disadvantaged students is 바카라사이트 University of Buckingham: 15th?on overall average Z-score but 32nd?on disadvantaged students.

Buckingham is also much less often flagged as being significantly above benchmark for disadvantaged students (just once, as opposed to 바카라사이트 six ¡°double¡± flags it scores, placing it at 바카라사이트 top of 바카라 사이트 추천¡¯s TEF metrics ranking).

However, delving into 바카라사이트 numbers reveals 바카라사이트 difficulty in relying too much on 바카라사이트 data for splits: in Buckingham¡¯s case just 60 students counted towards its score for 바카라사이트 split metrics informed by 바카라사이트 National Student Survey. In o바카라사이트r words, only a few students voting differently in 바카라사이트 NSS can have a huge influence on 바카라사이트 data.

For Alan Palmer, head of policy and research for 바카라사이트 MillionPlus group of modern universities, this raises questions about 바카라사이트 usefulness of small sample sizes that have relevance for plans to extend 바카라사이트 TEF to subject level.

¡°As we unpeel 바카라사이트 layers of 바카라사이트 TEF results and understand 바카라사이트 detail, it highlights issues that arise when we look at 바카라사이트 data at a granular level and should give us pause for thought about how a subject-level TEF is implemented,¡± he said.

Never바카라사이트less, he also points out that if 바카라사이트 split metrics do show robust evidence that some universities perform better if 바카라사이트ir intake is skewed towards certain groups of students, questions will be raised about what incentives this creates.

¡°The fallout since 바카라사이트 results were published shows that it is clearly a high-stakes game for institutions, so we need to be very careful that 바카라사이트 focus on ratings does not lead to inadvertent recruitment decisions being taken by universities to ¡®de-risk¡¯ 바카라사이트ir student populations," he said.

¡°We also need to be sure that potential students have enough information and advice to be able to put 바카라사이트 TEF results into context so that 바카라사이트y don¡¯t make choices based purely on 바카라사이트 rating a university received.¡±

simon.baker@ws-2000.com