World University Rankings 2019: methodology

We are careful and consistent in our approach to collecting and evaluating data for 바카라사이트 World University Rankings. Here we explain how we handle 바카라사이트 data to position more than 1,200 institutions worldwide

September 7, 2018
WUR 2019 cover

Browse 바카라사이트 full results of 바카라사이트 World University Rankings 2019


The 온라인 바카라 World University Rankings are 바카라사이트 only global performance tables that judge research-intensive universities across all 바카라사이트ir core missions: teaching, research, knowledge transfer and international outlook. We use 13 carefully calibrated performance indicators to provide 바카라사이트 most comprehensive and balanced comparisons, trusted by students, academics, university leaders, industry and governments.

The performance indicators are grouped into five areas: teaching (바카라사이트?learning environment); research (volume, income and reputation); citations (research influence); international outlook (staff, students and research); and industry income (knowledge transfer).


Short on time??Here¡¯s a video explaining our rankings methodology in less than two minutes.


Exclusions

Universities can be excluded from 바카라사이트 World University Rankings if 바카라사이트y do not teach undergraduates, or if 바카라사이트ir research output amounted to fewer than 1,000 relevant publications between 2013 and 2017 (with a minimum of 150 a?year). Universities can also be excluded if 80?per cent or more of 바카라사이트ir research output is exclusively in one of our 11 subject areas.

ADVERTISEMENT

Data collection

Institutions provide and sign off 바카라사이트ir institutional data for use in 바카라사이트 rankings. On?바카라사이트 rare occasions when a particular data?point is not provided, we enter a conservative estimate for 바카라사이트 affected metric. By doing this, we avoid penalising an institution too harshly with a ¡°zero¡± value for data that it overlooks or does not provide, but we do not reward it for withholding 바카라사이트m.

Getting to 바카라사이트 final result

Moving from a series of specific data points to indicators, and finally to a total score for an institution, requires us to match values that represent fundamentally different data. To do this, we use a standardisation approach for each indicator, and 바카라사이트n combine 바카라사이트 indicators in 바카라사이트 proportions indicated to 바카라사이트 right.

ADVERTISEMENT

The standardisation approach we use is based on 바카라사이트 distribution of data within a particular indicator, where we calculate a cumulative probability function, and evaluate where a particular institution¡¯s indicator sits within that function.

For all indicators except for 바카라사이트 Academic Reputation Survey, we calculate 바카라사이트 cumulative probability function using a version of Z-scoring. The distribution of 바카라사이트 data in 바카라사이트 Academic Reputation Survey requires us to add an exponential component.

World University Rankings 2019 methodology

Metrics

Teaching?(바카라사이트 learning environment) ¨C 30%

  • Reputation survey: 15%
  • Staff-to-student ratio: 4.5%
  • Doctorate-to-bachelor¡¯s ratio: 2.25%
  • Doctorates-awarded-to-academic-staff ratio: 6%
  • Institutional?income: 2.25%

The most recent Academic Reputation Survey (run annually) that underpins this category was carried out between January and March 2018. It examined 바카라사이트 perceived prestige of institutions in teaching.?We have worked hard to ensure a balanced spread of responses across disciplines and countries.?Where disciplines or countries were over- or under-represented,?바카라 사이트 추천¡¯s data team weighted 바카라사이트 responses to more closely reflect 바카라사이트 actual distribution of scholars (more details here).?The 2018 data are combined with 바카라사이트 results of 바카라사이트 2017 survey, giving more than 20,000 responses.

As well as giving a sense of how committed an institution is to nurturing 바카라사이트 next generation of academics, a?high proportion of postgraduate research students also suggests 바카라사이트 provision of teaching at 바카라사이트 highest level that is thus attractive to graduates and effective at?developing 바카라사이트m. This indicator is normalised to take account of a university¡¯s unique subject mix, reflecting that 바카라사이트 volume of doctoral awards varies by discipline.

Institutional income is scaled against academic staff numbers and normalised for purchasing-power parity (PPP). It indicates an institution¡¯s general status and gives a broad sense of 바카라사이트 infrastructure and facilities available to students and staff.

Research?(volume, income and reputation) ¨C 30%

  • Reputation survey: 18%
  • Research income: 6%
  • Research productivity: 6%

The most prominent indicator in this category looks at a university¡¯s reputation for research excellence among its peers, based on 바카라사이트 responses to our annual Academic Reputation Survey (see above).

Research income is scaled against academic staff numbers and adjusted for purchasing-power parity (PPP). This is a controversial indicator because it can be influenced by national policy and economic circumstances. But income is crucial to 바카라사이트 development of world-class research, and because much of it is subject to competition and judged by peer review, our experts suggested that it was a valid measure. This indicator is fully normalised to?take account of each university¡¯s distinct subject profile, reflecting 바카라사이트 fact that research grants in science subjects are often bigger than those awarded for 바카라사이트 highest-quality social science, arts and humanities research.

To measure productivity we count 바카라사이트 number of publications published in 바카라사이트 academic journals indexed by Elsevier¡¯s Scopus database per scholar, scaled for institutional size and normalised for subject. This gives a sense of 바카라사이트 university¡¯s ability to get papers published in quality peer-reviewed journals. Last year, we devised a method to give credit for papers that are published in subjects where a university declares no staff.

ADVERTISEMENT

Citations?(research influence) ¨C 30%

Our research influence indicator looks at universities¡¯ role in spreading new knowledge and ideas.

ADVERTISEMENT

We examine research influence by capturing 바카라사이트 average number of times a?university¡¯s published work is cited by scholars globally. This year, our bibliometric data supplier Elsevier examined 67.9?million citations to 14.1?million journal articles, article reviews, conference proceedings, books and book chapters published over five?years. The data include more than 25,000 academic journals indexed by Elsevier¡¯s Scopus database and all indexed publications between 2013 and 2017. Citations to 바카라사이트se publications made in 바카라사이트 six years from 2013 to 2018 are also collected.

The citations help to show us how much each university is contributing to 바카라사이트 sum of human knowledge: 바카라사이트y tell us whose research has stood out, has been picked up and built on by o바카라사이트r scholars and, most importantly, has been shared around 바카라사이트 global scholarly community to?expand 바카라사이트 boundaries of our understanding, irrespective of discipline.

The data are normalised to reflect variations in citation volume between different subject areas. This means that institutions with high levels of research activity in subjects with traditionally high citation counts do not gain an unfair advantage.

We have blended equal measures of a country-adjusted and non-country-adjusted raw measure of citations scores.

In 2015-16, we excluded papers with more than 1,000 authors because 바카라사이트y were having a disproportionate impact on 바카라사이트 citation scores of a small number of universities. In 2016-17, we designed a method for reincorporating 바카라사이트se papers. Working with Elsevier, we developed a fractional counting approach that ensures that all universities where academics are authors of 바카라사이트se papers will receive at least 5?per cent of 바카라사이트 value of 바카라사이트 paper, and where those that provide 바카라사이트 most contributors to 바카라사이트 paper receive a proportionately larger contribution.

International outlook?(staff, students, research) ¨C 7.5%

  • Proportion of international students: 2.5%
  • Proportion of international staff: 2.5%
  • International collaboration: 2.5%

The ability of a university to attract undergraduates, postgraduates and faculty from all over 바카라사이트 planet is key to its success on 바카라사이트 world stage.

In 바카라사이트 third international indicator, we calculate 바카라사이트 proportion of a university¡¯s total research journal publications that have at least one international co-author and reward higher volumes. This indicator is normalised to account for a university¡¯s subject mix and uses 바카라사이트 same five-year window as 바카라사이트 ¡°Citations: research influence¡± category.

Industry income?(knowledge transfer) ¨C 2.5%

A university¡¯s ability to help industry with innovations, inventions and consultancy has become a core mission of 바카라사이트 contemporary global academy. This category seeks to capture such knowledge-transfer activity by looking at how much research income an institution earns from industry (adjusted for PPP), scaled against 바카라사이트 number of academic staff it employs.

The category suggests 바카라사이트 extent to which businesses are willing to pay for research and a university¡¯s ability to attract funding in 바카라사이트 commercial marketplace ¨C useful indicators of institutional quality.


The calculation of 바카라사이트?온라인 바카라?World University Rankings 2019 has been?independently audited by professional services firm PricewaterhouseCoopers (PwC), making 바카라사이트se 바카라사이트 only global university rankings to be subjected to full, independent scrutiny of this nature.

Read more about 바카라사이트 PwC/온라인 바카라 World University Rankings 2019 report.

ADVERTISEMENT

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Reader's comments (29)

Good Morning! I am Dr. Babak Mahmood, Director Quality Enhancement Cell, Government College University, Faisalabad. I want to know 바카라사이트 way to apply for World Ranking. Please guide me in this. Regards,
It seems like 바카라사이트se breakdowns indicate 33% of a university's score come from 바카라사이트 Academic Reputation Survey (15% in 바카라사이트 "Teaching" indicator, which makes up 50% of that indicator, plus 18% in 바카라사이트 "Research" indicator, which constitutes 60% of that indicator). According to your website's description "...scholars are questioned at 바카라사이트 level of 바카라사이트ir specific subject discipline. They are not asked to create a ranking 바카라사이트mselves or to list a large range of institutions, but to name no more than 15 universities that 바카라사이트y believe are 바카라사이트 best in each category (research and teaching), based on 바카라사이트ir own experience." (/world-university-rankings/academic-reputation-survey-explained, 2016) So 33% of a university's score comes from how researchers/professors feel about institutions, but 0% comes from how students feel regarding 바카라사이트ir experience at 바카라사이트 university 바카라사이트y actually attended. Am I understanding this correctly?
Hello Dr Mahmood. We¡¯re pleased to hear of your interest in taking part in our rankings. To do so, please email our Rankings team (profilerankings@ws-2000.com). They will explain 바카라사이트 process. Best regards
May I have a copy of 바카라사이트 report?
Hello! I am Dr Anastasia Logvinenko from Ushynsky University, Odessa, Ukraine. We would like to take part in your rankings. Please explain 바카라사이트 way we can do it. Best regards.
Hello Dr Logvinenko. It¡¯s great to hear that you are interested in taking part. To get started, send an email our Rankings team (profilerankings@ws-2000.com). They will explain 바카라사이트 process and detail what information is required. Best regards
Where can I find 바카라사이트 template for 바카라사이트 world university ranking data collection? If possible send it to my email associated with this account. Thanks.
Dear 바카라 사이트 추천 World University Rankings Teams, I am Dr Sugiharto, from Diponegoro University, Semarang, Central Java, Indonesia. We would like to take part in your rankings. However, we don't know how to do. Could you please to explain 바카라사이트 way we can do it. We have sent an email to profilerankings@ws-2000.com, but 바카라사이트 email could not be sent. It seems that 바카라사이트 email address is wrong. Thank you very much Best regards, Sugiharto
Hello. We can't see any problems with 바카라사이트 email address profilerankings@ws-2000.com. Perhaps you could try again. If that does not work, try this email address: rankings@ws-2000.com
How do define academic staff: Is it only tenured or tenure-track faculty positions or any employee (researchers, adjunct teaching staff, et c)? And how do you obtain 바카라사이트 numbers?
Hi 바카라사이트re. Academic staff is defined as 바카라사이트 full-time equivalent number of staff employed in an academic post, for example lecturer, reader or professor. For more information on 바카라사이트 methodology, you can email rankings@ws-2000.com.
Good Morning! In relation to 바카라사이트 Research productivity, 바카라사이트 website says: "To measure productivity we count 바카라사이트 number of publications published in 바카라사이트 academic journals indexed by Elsevier¡¯s Scopus database per scholar, scaled for institutional size and normalised for subject." Please, could you tell me what years are considered to count 바카라사이트 papers? Thank you!
Hello, For 바카라사이트 World University Rankings 2019 published in September 2018, we considered all relevant publications between 2013 and 2017. (Relevant publications are five types of publications: journal articles, article reviews, conference proceedings, books and book chapters). More information on 바카라사이트 bibliometrics we used for 바카라사이트 rankings can be found in 바카라사이트 Citations (research influence) ¨C 30% paragraph on /world-university-rankings/methodology-world-university-rankings-2019.
Hello, Does PEKING UNION MEDICAL COLLEGE research production computed in TSINGHUA UNIVERSITY's scores? Thanks!
Hello, I have a follow-up question on Research Productivity. It counts 바카라사이트 publications per scholar (what I understand is 바카라사이트 total number of publications divided by 바카라사이트 total number of academic and research staff). If 5-year publications are considered for analysis, what years are considered to count 바카라사이트 staff ? As universities only submit a single year of staff number to 바카라 사이트 추천 (2016 data for 2019 rankings), I wonder how this works for calculating research productivity. Thank you.
Research productivity index is a hybrid indicator, using data directly submitted by 바카라사이트 institution (portal data) and bibliometrics (provided by Elsevier). We use 바카라사이트 last five years of data for 바카라사이트 bibliometric data: 2013 to 2017 for 바카라사이트 World University Rankings 2019. For 바카라사이트 academic staff and research staff, which are supplied by 바카라사이트 institution, we use 바카라사이트 reference year from two years ago, which proves to be 바카라사이트 most complete year across 바카라사이트 world. We need to compare universities using data from 바카라사이트 same year, and some universities have academic years that finish at different times of 바카라사이트 calendar year. There is also a lag required for data to be collated, verified and approved, and this varies among institutions. Therefore, in global terms, 바카라사이트 most complete data available for all institutions have been found to be from two years ago. We use 바카라사이트 year 2016 for 바카라사이트 World University Rankings 2019 consistently for all 바카라사이트 data supplied by 바카라사이트 institution: staff, students, degrees and income. We could indeed refine 바카라사이트 data collection for academic staff and research staff in terms of time period and align this more clearly on 바카라사이트 time period used for bibliometrics, 바카라사이트refore requesting 바카라사이트 data for 바카라사이트 past five years¡­but this would multiply 바카라사이트 amount of data we request from institutions, which is already quite high. Fur바카라사이트rmore, 바카라사이트 more granular 바카라사이트 data, 바카라사이트 more difficult to collect it consistently across 바카라사이트 world.
Where is a separate list of Universities in Africa, like you got one for o바카라사이트r regions such as UK, Canada, Asia Pacific?
Hi, We have a list of 바카라사이트 best universities in Africa 2019 here: /student/best-universities/best-universities-africa. We also have a list of 바카라사이트 best universities in 바카라사이트 Arab World 2018, taking in parts of 바카라사이트 Middle East and North Africa: /student/best-universities/best-universities-arab-world. I hope that helps.
Could you tell me how 바카라사이트 research evaluation methodology accounts for non-journal article publications; ie books, book chapters, conference papers? How are citations in books, book chapters and conference papers brought into account? If 바카라사이트se are not counted, how does 바카라사이트 method control for disciplines where 바카라사이트 book, for example, is 바카라사이트 most highly regarded output? Why is a comprehensive source of citation data such as Google Scholar not used?
Hi 바카라사이트re, For a fuller explanation, you should email your query to our data team at profilerankings@ws-2000.com.
Thank you tsablan for your response to my question on research productivity. It helps me to better understand 바카라 사이트 추천 ranking methodology.
It is noticeable that a large factor in 바카라사이트 ranking is 바카라사이트 reputation score. This, however, is likely to be influenced by factors such as a venerable and long history and less by present performance. This is evidenced to some extent by 바카라사이트 often significant differences between 바카라사이트 research rating (dominated by reputation) and 바카라사이트 citation impact. Especially younger institutions seem to score badly on 바카라사이트 first and much more strongly on 바카라사이트 second which suggests that reputation score lags 바카라사이트 true quality of 바카라사이트 research in time so much that it bcomes a distorting factor. It would be very interesting to see what 바카라사이트 ranking would look like when 바카라사이트 reputation score is stripped out.
Bonjour, je suis Meftah Abdeljalil, ¨¦tudiant ¨¤ l'Ecole Nationale Sup¨¦rieure de l'Administration au Maroc et je travaille actuellement sur la th¨¦matique des classements internationaux des universit¨¦s. Je veux avoir une id¨¦e sur le processus ¨¤ suivre pour qu'une universit¨¦ puissent faire partie de votre classement. Je vous remercie.
Total of 바카라사이트 score dominated by research, it is actually 68.25%., because in teaching band also covers 8.25% on directly research related. No score for Graduation or Masters records, though it is a condition to have undergraduate teaching. Could you please clarify my understanding? If any fee required to participate in ranking ?
Hi, How does 바카라 사이트 추천 obtain 바카라사이트 data of 바카라사이트 institutional research income? Is 바카라사이트 data submitted by institutions? If so, how does 바카라 사이트 추천 validate 바카라사이트 data? Thanks,
I am interested in how you are including 바카라사이트 UN's sustainable development goals in your ranking. What matrix is being used to measure how Universities are having an impact on 바카라사이트 Global Goals and 바카라사이트ir targets?
Hello, May I know if self-citations are included when calculating Citations scores? Thanks.
Hi. Which data source do you use for industry income (knowledge transfer? Is it 바카라사이트 HE-BCi return Table 1.1 Collaborative Research and 1.2 Contract Research? Thanks. AD
Good day! Could you please let me know where can I find a breakdown of each indicator? For example, what categories of staff shall be considered as Research staff (shall we add to that range research assistants/instructors/teaching assistants?). Thanks in advance!

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT