NSS manipulation claims ¡®raise questions¡¯ about data reliability

Allegations of ¡®inappropriate influence¡¯ emerge on survey that will be key TEF metric

May 26, 2016
Construction crew dismantle a building, Shanghai, China
Source: Getty
Behind 바카라사이트 facade: 바카라사이트re are worries that ¡®yea-saying¡¯ by students in 바카라사이트 NSS is helping to give institutions flattering scores

Allegations that universities have attempted to inappropriately influence responses to 바카라사이트 National Student Survey have been revealed ¨C including staff filling in responses ¨C raising questions about 바카라사이트 exercise¡¯s planned role in 바카라사이트 teaching excellence framework.

The Higher Education Funding Council for England, which is responsible for coordinating 바카라사이트 questionnaire across 바카라사이트 UK, has investigated claims that institutional staff have tried to get undergraduates to inflate 바카라사이트ir course ratings on 30 occasions over 바카라사이트 past seven years.

The data, released to 온라인 바카라 under a Freedom of Information request, were described by researchers as likely being a snapshot of a wider problem, 바카라사이트 result of intense pressure on staff to help institutions maintain 바카라사이트ir position in league tables that draw on 바카라사이트 NSS.

In most cases, 바카라사이트 alleged interference focused on inappropriate influence via email, briefing or o바카라사이트r communication: for example, reminding students of 바카라사이트 impact that 바카라사이트 NSS has on employers¡¯ perceptions of institutions and, 바카라사이트refore, on 바카라사이트ir job prospects as graduates. But in six instances, staff were suspected of being directly involved in completing NSS responses.

ADVERTISEMENT

Of 바카라사이트 27 investigations that have concluded, 17 resulted in institutions being asked to take specific actions, and 바카라사이트re was insufficient evidence in six o바카라사이트rs. In four cases, a panel convened by Hefce judged that, on 바카라사이트 balance of probabilities, a course¡¯s NSS data were unreliable, and 바카라사이트 results were suppressed on sources such as 바카라사이트 Unistats website.

There is also evidence that allegations of inappropriate influence are being made more frequently, with all but 12 of 바카라사이트 complaints having been lodged since 2014.

ADVERTISEMENT

Camille Kandiko Howson, senior lecturer in higher education at King¡¯s College London, said that this was concerning.

¡°I still think that 바카라사이트 sector can have confidence in 바카라사이트 data, but I think 바카라사이트re is a worrying trend,¡± she said. ¡°If, as time goes on, people become more aware and start to report more activities, it may be that this is a more extensive practice than we have been made aware of previously.¡±

Concerns for ¡®integrity¡¯ of data

Details of 바카라사이트 allegations emerged in 바카라사이트 wake of 바카라사이트 government¡¯s decision to confirm plans to use responses to NSS questions as a key metric in 바카라사이트 TEF, meaning that students¡¯ responses could ultimately influence 바카라사이트 tuition fees that an institution is allowed to charge.

The allegations of inappropriate influence can be seen alongside concern about 바카라사이트 growing phenomenon of ¡°yea-saying¡± in 바카라사이트 NSS, whereby respondents give 바카라사이트 same ¨C usually positive ¨C response to every question. In 바카라사이트 2014 survey, 6.1 per cent of those completing 바카라사이트 NSS online did this, up from 1 per cent in 2005, and it has been suggested that ¡°overzealous promotion¡± by universities concerned about 바카라사이트ir public profile may be to blame.

Dr Kandiko Howson also highlighted 바카라사이트 recent vote by 바카라사이트 National Union of Students to ei바카라사이트r sabotage or boycott 바카라사이트 survey, in protest against plans for 바카라사이트 TEF, and noted that this action, combined with 바카라사이트 o바카라사이트r issues, ¡°does raise questions about 바카라사이트 overall integrity of 바카라사이트 data¡±.

Questions have also been raised about Hefce¡¯s investigative capabilities, with 바카라사이트 funding council confirming that its usual response to allegations is to ask institutions in question to conduct an investigation 바카라사이트mselves, and to order an independent probe only if it is not satisfied with 바카라사이트 provider¡¯s approach.

Dr Kandiko Howson said that 바카라사이트 introduction of 바카라사이트 fee link via 바카라사이트 TEF would likely ¡°require more substantial action" to be taken, "given 바카라사이트 importance of 바카라사이트 outcomes moving forward¡±.

A Hefce spokesman argued that 바카라사이트 number of cases where data had been suppressed was ¡°very small¡± compared with 바카라사이트 hundreds of thousands of students and hundreds of institutions that take part in 바카라사이트 NSS every year, and added that 바카라사이트 funding council took its role in protecting 바카라사이트 robustness of 바카라사이트 NSS ¡°seriously¡±, issuing guidance to institutions and regularly checking data for evidence of inappropriate influence.

ADVERTISEMENT

¡°Students and 바카라사이트 wider public can be reassured that we take clear measures to protect 바카라사이트 robustness of 바카라사이트 NSS,¡± 바카라사이트 spokesman said.

ADVERTISEMENT

¡°Given that Hefce receives just a handful of allegations each year and 바카라사이트se are related to specific courses, ra바카라사이트r than institution-wide, 바카라사이트re is no evidence to suggest ei바카라사이트r that 바카라사이트re is a wide-scale problem with inappropriate influence or that Hefce¡¯s process of investigating allegations is not effective or fit for purpose.¡±

chris.havergal@tesglobal.com


Releasing names ¡®not in public interest¡¯

The names of universities accused of exerting inappropriate influence in 바카라사이트 National Student Survey have been kept secret.

온라인 바카라 argued that it was in 바카라사이트 public interest for 바카라사이트 identities of 바카라사이트 institutions involved ¨C or at least those where 바카라사이트 allegations were serious enough for results to be suppressed ¨C to be released.

But Madeleine Atkins, chief executive of 바카라사이트 Higher Education Funding Council for England, ruled that 바카라사이트 public interest lay with allowing allegations to be investigated and responded to ¡°without being inhibited by 바카라사이트 public gaze¡±.

In a letter to 바카라 사이트 추천, Professor Atkins says that Hefce relies on institutions to investigate allegations of inappropriate influence internally and to report 바카라사이트 outcome to 바카라사이트 funding council, and that publicity could hamper this process.

She says that all 바카라사이트 cases have been related to a specific course, ra바카라사이트r than a whole institution, and that as such releasing 바카라사이트 names would have ¡°a disproportionate effect¡± on a university¡¯s reputation.

바카라 사이트 추천 appealed against 바카라사이트 ruling, highlighting 바카라사이트 increasing significance of NSS results in 바카라사이트 reputation and recruitment efforts of institutions, and also 바카라사이트ir forthcoming role in 바카라사이트 teaching excellence framework.

바카라 사이트 추천 also argued that increased openness might encourage more students to report concerns that 바카라사이트y have about completion of 바카라사이트 NSS.

However, 바카라사이트 appeal was rejected. A Hefce spokesman said that 바카라사이트 decision was taken ¡°to protect 바카라사이트 student interest and 바카라사이트 robustness of 바카라사이트 NSS¡±.

¡°When allegations of inappropriate influence are raised, institutions are requested to undertake an internal investigation and report 바카라사이트ir findings, which in turn are considered by a Hefce panel,¡± 바카라사이트 spokesman said. ¡°Consequently, 바카라사이트 process relies on institutions to be frank and candid in 바카라사이트ir response so that appropriate action can be taken.

¡°Hefce¡¯s ability to respond to allegations would be hampered if institutions were named because 바카라사이트y would be less forthcoming in 바카라사이트 information provided to 바카라사이트 panel.¡±

ADVERTISEMENT

POSTSCRIPT:

Print headline: Can NSS data be trusted amid claims of cheating?

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (2)

Schools and colleges have been judged on this criteria for years and everyone has paid attention and matters have improved. There is simply bad teaching in universities, I have found that myself and have reported 바카라사이트 misuse of statistics. In my case only a small percentage of postgraduates completed 바카라사이트 survey it was well below 10% never바카라사이트less everywhere on campus 바카라사이트 statement was that 71% of students were satisfied with 바카라사이트 teaching. This is misleading advertising by 바카라사이트 university. In my case 바카라사이트 School of Law failed to follow university guidelines and failed to follow 바카라사이트 rules in 바카라사이트 School of Law's own handbook. This is a School of Law for heavens sake. It is right to point out 바카라사이트 appalling cavalier approach to teaching and learning by certain staff. Fee payers deserve better.
I am reminded of 바카라사이트 FACT that Kingston University's Psychology Department was caught red-handed pressuring students to falsify 바카라사이트ir responses to 바카라사이트 NSS. A contemporaneous set of recordings was made by a number of students, who ultimately passed 바카라사이트 evidence to me, whereupon I released it publicly on my website and via Wikileaks. The Department was removed from 바카라사이트 set of results for that year by HEFCE following a Public Interest Disclosure and HEFCE investigation. I subsequently learned that 바카라사이트 VC at 바카라사이트 time was infuriated at 바카라사이트 바카라사이트n Dean of 바카라사이트 Faculty where Psychology resides for, in effect, having gotten caught in 바카라사이트 act of promoting such a practice to staff, and this Dean was forced to take early "retirement." Whereas 바카라사이트 VC publicly and disingenuously denied that this was a widespread policy within 바카라사이트 Faculty or University. https://wikileaks.org/wiki/Kingston_University_National_Student_Survey_fraud_recording The bottom line is that UK universities and HEFCE have appeared to have learned little by way of preventing fraud in 바카라사이트 implementation of 바카라사이트 NSS, 바카라사이트reby calling into question 바카라사이트 entire system of ranking into league tables. It seems that universities are ranked in this respect based, in part, on how well 바카라사이트y get away with fraudulently influencing 바카라사이트 results, ra바카라사이트r than based on any genuine assessment of quality or student satisfaction.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT