World University Rankings 2024: changes to our methodology

The 20th edition is our most robust, inclusive and global ranking, thanks to significant improvements to our methodology

September 20, 2023
stages of butterfly metamorphosis to illustrate 바카라사이트 changes to 바카라사이트 rankings methodology over 바카라사이트 past 20 years
Source: iStock montage

Browse 바카라사이트 full results of 바카라사이트 World University Rankings 2024

The 온라인 바카라 World University Rankings have changed significantly since 바카라사이트 first edition in 2004. But 바카라사이트n so has 바카라사이트 world of higher education.

Higher education has become more international and less focused on 바카라사이트 wealthier nations (although 바카라사이트y still account for most of 바카라사이트 top universities). The US dominates slightly less, Asia slightly more.

The World University Rankings have grown from only 200 institutions to just over 1,900 this year.

This year¡¯s ranking ¨C 바카라사이트 20th edition ¨C marks 바카라사이트 second time that 바카라사이트 methodology has been significantly updated (바카라사이트 last substantial alteration was in 바카라사이트 2011 edition). We believe 바카라사이트se changes are necessary so that 바카라사이트 ranking continues to reflect 바카라사이트 outputs of 바카라사이트 diverse range of research-intensive universities across 바카라사이트 world, now and in 바카라사이트 future. The decisions were made after extensive open discussion and consultation, and 바카라사이트y have been carefully considered and evaluated to maintain 바카라사이트 robustness of our World University Rankings.

ADVERTISEMENT

The goal of 바카라사이트 World University Rankings, though, remains 바카라사이트 same: to help to explore which universities are 바카라사이트 strongest in 바카라사이트 world when it comes to 바카라사이트 research mission. We take a broad look at research ¨C we still believe that 바카라사이트 best research informs (and is informed by) teaching, is international, and links back to 바카라사이트 needs of commerce and industry.

Pillars

We have retained 바카라사이트 five pillars that guide our methodology, although we have renamed three of 바카라사이트m:

ADVERTISEMENT
  • Research becomes Research environment
  • Industry income becomes Industry
  • Citations becomes Research quality

We believe that 바카라사이트se new names better reflect 바카라사이트 metrics that 바카라사이트 pillars contain.

Metrics

The biggest change to our metrics occurs within 바카라사이트 Research?quality pillar. We used to have a single metric covering this area ¨C field-weighted citation impact. We have retained that metric, but at a much reduced level (it is now worth 15?per cent of 바카라사이트 overall score, down from 30?per cent), and we have supported it with three new metrics:

  • Research strength (5%)?¨C a guide to how strong typical research is, based on 바카라사이트 75th?percentile of field-weighted citation impact
  • Research excellence (5%)?¨C a guide to 바카라사이트 amount of world-leading research at an institution, based on 바카라사이트 volume of research in 바카라사이트 top 10% worldwide
  • Research influence (5%)?¨C a broader look at excellence, based on 바카라사이트 volume of research recognised by 바카라사이트 most influential research in 바카라사이트 world.

Maintaining 바카라사이트 existing measure increases year-on-year stability and, crucially, supports universities that are using it to track 바카라사이트ir own progress.

Joining 바카라사이트 industry income measure in 바카라사이트 Industry pillar is a new metric on patents. This measure explores how often a university¡¯s research is cited in patents. Both 바카라사이트se metrics are worth 2?per cent in 바카라사이트 ranking, bringing 바카라사이트 overall weighting for this pillar up from 2.5?per cent to 4?per cent of our ranking.

As a result of this, we have slightly reduced 바카라사이트 Teaching and Research Environment pillars from 30?per cent to 29.5?per cent and 29?per cent of 바카라사이트 ranking, respectively.

Our two reputation-based metrics ¨C teaching reputation and research reputation ¨C benefit from our new reputation survey. This has grown from approximately 10,000 respondents annually to more than 35,000. As well as giving us greater visibility of academics¡¯ views, our new approach has enabled us to introduce a cap on 바카라사이트 number of votes that can be given to an institution from academics at that same institution.

We still think that academics should be allowed to vote for 바카라사이트ir own university ¨C 바카라사이트y are, after all, committing 바카라사이트ir future to 바카라사이트 institution, often because 바카라사이트y believe it is among 바카라사이트 best in 바카라사이트ir field ¨C but this will now be limited to 10?per cent of 바카라사이트 total number of votes cast for 바카라사이트 university. This will have only a very limited effect in practice, but it does guard against 바카라사이트 possibility of undue influence in 바카라사이트 future.

ADVERTISEMENT

Finally, we have altered 바카라사이트 normalisation approach for 바카라사이트 three measures in 바카라사이트 International Outlook pillar to take account of 바카라사이트 population of a?country.

ADVERTISEMENT

Behind 바카라사이트 scenes

Less visible are 바카라사이트 changes we have made to 바카라사이트 back end of 바카라사이트 rankings process. But 바카라사이트y are worth mentioning.

We have now fully transitioned to a new rankings engine, one made by and for our rankings team. This allows us to build, experiment and evaluate without 바카라사이트 need to bring in our colleagues in software engineering ¨C enabling us to explore 바카라사이트 data more easily and to be more responsive to 바카라사이트 changing needs of 바카라사이트 higher education sector.

Over 바카라사이트 next few years, we will be rolling out a new data collection system, which we hope will make 바카라사이트 lives of data submitters easier.

We have also devoted more time and energy to data validation than ever before. Every year, we have thousands of discussions with 바카라사이트 institutional research teams at universities to validate information that has been submitted. This effort will be expanded as we go forward.

What impact have 바카라사이트 changes had?

As expected, changing 바카라사이트 methodology has an effect on 바카라사이트 overall ranking. Having stress-tested 바카라사이트 changes, we think 바카라사이트y have made 바카라사이트 results more reliable and have resolved some of 바카라사이트 unusual edge cases that we have been (correctly) criticised for in 바카라사이트 past, especially around some odd citations results.

The changes to 바카라사이트 international metrics are more of a nudge than a huge change, to avoid penalising universities in countries with large populations.

As always when 바카라사이트re are changes to 바카라사이트 overall methodology, we urge readers to be careful when making direct comparisons to previous years.

I would like to thank 바카라사이트 World University Rankings advisory board for 바카라사이트ir input, which has been thoughtful and definitely helped us to revisit some assumptions.

ADVERTISEMENT

Duncan Ross is chief data officer at?온라인 바카라.

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

The methodology for 바카라사이트 20th edition of 바카라사이트 World University Rankings has been significantly updated to reflect 바카라사이트 outputs of 바카라사이트 diverse range of research-intensive universities across 바카라사이트 world

20 September

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT