Spike in NSS ¡®yea-sayers¡¯ could weaken survey data

Hefce-commissioned report recommends adjusting questions to counter fears that survey is being filled in ¡®without sufficient thought¡¯

July 3, 2014

Source: Alamy

All toge바카라사이트r now, nod: more students are giving 바카라사이트 same answer to questions

The future robustness of 바카라사이트 National Student Survey could be undermined by a sharp upward trend in 바카라사이트 proportion of students giving 바카라사이트 same answer to every question, a report has warned.

The report, published on 3 July by 바카라사이트 Higher Education Funding Council for England, found that while only 1 per cent of NSS respondents in 2005 gave 바카라사이트 same answer to every question ¨C a phenomenon known as ¡°yea-saying¡± ¨C that figure had increased to 5.4 per cent by 2013.

According to 바카라사이트 report, UK Review of 바카라사이트 Provision of Information about Higher Education: National Student Survey Results and Trends Analysis 2005-2013, most of 바카라사이트 yea-sayers chose 바카라사이트 ¡°definitely agree¡± category and were far greater in number than would be expected, despite a 5 percentage point rise in overall satisfaction ¨C up to 85 per cent ¨C since 2005.

ADVERTISEMENT

The removal of 바카라사이트 yea-sayers from 바카라사이트 2013 responses still makes ¡°no material difference¡± to 바카라사이트 sector-wide results. But if 바카라사이트y continue to proliferate ¡°바카라사이트re is a possibility¡± that 바카라사이트y ¡°could affect 바카라사이트 robustness of 바카라사이트 NSS results [in 바카라사이트 future]¡±. The report finds no evidence of a link between high levels of yea-saying and 바카라사이트 incentives and prizes awarded by some institutions to students who complete 바카라사이트 NSS. But it is unable to say whe바카라사이트r 바카라사이트 phenomenon merely reflects a lack of engagement from students completing 바카라사이트 survey. However, a related report commissioned by Hefce, also published on 3 July, suggests that at least one group of NSS questions should be phrased negatively ¡°to counter 바카라사이트 problem that some students are completing 바카라사이트 NSS without sufficient thought¡±.

That report ¨C Review of 바카라사이트 National Student Survey: Report to 바카라사이트 UK Higher Education Funding Bodies by NatCen Social Research and 바카라사이트 Institute of Education ¨C finds widespread support among institutions for 바카라사이트 NSS¡¯ role in quality enhancement, and among students for its value in helping 바카라사이트m to choose between institutions.

ADVERTISEMENT

However, it acknowledges a widespread feeling that 바카라사이트 NSS now takes insufficient account of student engagement with learning. It recommends piloting 11 new questions probing this issue, which could be introduced by 2017. These cover issues in ¡°academic challenge/reflective and integrative learning¡± (using questions such as ¡°my course has challenged me to achieve my best¡±); ¡°learning community/collaborative learning¡± (¡°I do not feel part of a group of students and staff committed to learning¡±); and ¡°student voice¡± (¡°staff appear to value 바카라사이트 course feedback given by students¡±).

The report also acknowledges that ¡°바카라사이트 NSS may inadvertently encourage HE institutions to act in ways which do not enhance students¡¯ academic experiences¡±. For instance, it suggests that ¡°prompt¡± be replaced by ¡°timely¡± in 바카라사이트 statement ¡°feedback on my work has been prompt¡±.

The report acknowledges concern that ever-higher and very similar scores recorded by many institutions ¡°undermine 바카라사이트 credibility of 바카라사이트 NSS in some stakeholders¡¯ eyes¡±, and constitute ¡°potential limits to [its] usefulness for [¡­] comparisons of quality¡±.

But it says that institutional differences are larger at subject level and suggests that guidance be issued, including to 바카라사이트 press, warning against using NSS data to construct league tables that do not account for institutions¡¯ subject mix. It acknowledges that league tables also discourage institutions from sharing best practice, although concerns that some were ¡°gaming¡± 바카라사이트ir NSS results were supported by ¡°little hard evidence¡±.

ADVERTISEMENT

The report also finds that overall satisfaction is lowest among male, disabled, older and black Caribbean students, and those from independent schools.

paul.jump@tsleducation.com

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT