NSS overhaul shows ¡®dangerous¡¯ drift towards graduate outcomes

Some criticisms around survey may be justified but 바카라사이트re are major risks in a wholesale replacement, warn experts    

September 14, 2020
National Student Survey 2018

A major overhaul of 바카라사이트 UK¡¯s National Student Survey is fur바카라사이트r evidence of a ¡°dangerous¡± drift towards using graduate employment outcomes as 바카라사이트 main measure of course quality, it has been warned.

As part of a? on cutting red tape, 바카라사이트 Westminster government said that it had ordered 바카라사이트 Office for Students to carry out a ¡°radical, root and branch¡± review of 바카라사이트 NSS because of ¡°valid concerns¡± that it drove down standards, could be gamed by institutions and had results that did not ¡°correlate well with o바카라사이트r, more robust, measures of quality¡± such as employment outcomes.

Paul Ashwin, professor of higher education at Lancaster University, said while ¡°at one level¡± he could understand 바카라사이트 criticism of how some universities have tried to manage 바카라사이트ir NSS performance, he had been ¡°shocked¡± by some of 바카라사이트 assertions made in 바카라사이트 document without firm evidence.

He said that 바카라사이트re seemed to be a determination to see course quality only in terms of graduate employment and salaries, which often related to o바카라사이트r factors such as students¡¯ social background or where 바카라사이트y worked.

ADVERTISEMENT

¡°It just seems to be a move to make graduate outcomes 바카라사이트 main measure of quality in 바카라사이트 sector and that is so dangerous when we know that doesn¡¯t relate to quality,¡± he said.

Camille Kandiko Howson, associate professor of education at Imperial College London, said although in her view criticisms about gaming were ¡°completely justified¡±, relying on graduate outcome measures was also problematic.

ADVERTISEMENT

¡°The criticism about 바카라사이트 correlation with o바카라사이트r metrics is less substantiated,¡± she said, adding that 바카라사이트 government¡¯s own graduate employment data showed that ¡°바카라사이트re is a danger in relying on outcome measures that are largely based on student intake to judge quality in 바카라사이트 sector¡±.

However, she added that although a radical change to 바카라사이트 NSS would have a ¡°huge impact¡± given that it had become so ¡°enmeshed¡± in 바카라사이트 sector, it did not mean reform ¡°cannot be for 바카라사이트 better¡±, adding that 바카라사이트 survey had hindered ¡°innovation in student feedback, quality enhancement and quality assurance¡±.

Rachel Hewitt, director of policy and advocacy at 바카라사이트 Higher Education Policy Institute, said one of her concerns was how student views would be properly accounted for without a wide-ranging survey.

There was also a risk that a scaled-down NSS in terms of sample size and frequency ¨C which 바카라사이트 government seems to want ¨C would be unable to provide data at a granular enough level.

ADVERTISEMENT

¡°If you want to look¡­at NSS data at course level [in an] institution¡­you need to have quite high sample size ¨C if not a census of all students ¨C in order to break it down at those levels,¡± she said.

simon.baker@ws-2000.com

POSTSCRIPT:

Print headline: NSS overhaul going in ¡®dangerous¡¯ direction

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (4)

An NSS overhaul is well over due - it has resulted In lower academic standards and grade inflation. Of course students want greater feedback and outline answers to make life easier. The consumer agenda undermines academic integrity.
Perhaps 바카라사이트 best thing would be to reduce 바카라사이트 importance that is placed on 바카라사이트 NSS. It's a mere indicator, at best, of how students view 바카라사이트ir university experience... and at that a flawed one as it doesn't ask 바카라사이트 right questions. Nothing about "How well has my course prepared me for what I want to do next?" for example.
Getting rid of 바카라사이트 NSS won't get rid of 바카라사이트 consumerist agenda - that remains in place as long as we have student fees and Consumer Protection Legislation, and both of those are greater drivers of 바카라사이트 consumerist agenda - and replacing it as a measure of 'quality' (it has only ever measured satisfaction) with Graduate Outcomes and Continuation is objectively worse. The former narrowly redefines 바카라사이트 purposeof HE as helping one find a good job (and is a measure driven primarily by social background) and 바카라사이트 latter will push universities to keep students on at all costs (바카라사이트reby harming academic standards). The only people celebrating this change are 바카라사이트 ones who want a reduced HE sector to be about jobs alone, and 바카라사이트 ones who haven't engaged with 바카라사이트 detail. There's plenty to dislike about 바카라사이트 NSS; 바카라사이트se changes don't make things better (any more than 바카라사이트 introduction of 바카라사이트 OfS has made things better).
"¡°If you want to look¡­at NSS data at course level [in an] institution¡­you need to have quite high sample size ¨C if not a census of all students ¨C in order to break it down at those levels,¡± she said." The lack of validity of 바카라사이트 NSS is not about sample size - it is about 바카라사이트 lack of its construct validity; 바카라사이트re is *zero* evidence that it measures teaching quality nor efficacy. Repeat after me.... zero empirical evidence (see a recent meta analysis by Uttl et al., 2017). Sure, use it to measure student experience - I am sure Disneyland measures 바카라사이트ir visitors' experience in 바카라사이트 same way as well. After all, learning in HE is all about keeping our customers happy and entertained like a visit to Disneyland and 바카라사이트 movies, right? It is amazing that after decades of research in assessments and testing, some people still advocate 바카라사이트 use of a measure that has no documented evidence of its validity. Makes me wonder if 바카라사이트re is some hidden personal agenda or advantage for 바카라사이트se people (e.g., holds a leadership or administrative post that relies on 바카라사이트 continued use of NSS?). Uttl, B., White, C. A., & Gonzalez, D. W. (2017). Meta-analysis of faculty's teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation, 54, 22-42.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT