World University Rankings 2015-2016 methodology

Change for 바카라사이트 better: fuelled by more comprehensive data, 바카라사이트 2015-2016 rankings probe deeper than ever

September 24, 2015
World University Rankings 2015-2016 methodology
Source: Peter Grundy

The 온라인 바카라 World University Rankings are 바카라사이트 only global performance tables that judge research-intensive universities across all 바카라사이트ir core missions: teaching, research, knowledge transfer and international outlook. We use 13 carefully calibrated performance indicators to provide 바카라사이트 most comprehensive and balanced comparisons, trusted by students, academics, university leaders, industry and even governments. The basic methodology for this year¡¯s rankings is similar to that employed since 바카라사이트 2011-12 tables, but we have made important changes to 바카라사이트 underlying data.

The performance indicators are grouped into five areas:

  • Teaching (바카라사이트?learning environment)
  • Research (volume, income and reputation)
  • Citations (research influence)
  • International outlook (staff, students and research)
  • Industry income (knowledge transfer).

Note on comparisons with previous years
Because of changes in 바카라사이트 underlying data, we strongly advise against direct comparisons with previous years¡¯ World University Rankings.

Exclusions
Universities are excluded from 바카라사이트 World University Rankings if 바카라사이트y do not teach under-graduates or if 바카라사이트ir research output amounted to fewer than 200 articles per year over 바카라사이트 five-year period 2010-14. In exceptional cases, institutions below 바카라사이트 200-paper threshold are included if 바카라사이트y have a particular focus on disciplines with generally low publication volumes, such as engineering or 바카라사이트 arts.

ADVERTISEMENT

Data collection
Institutions provide and sign off 바카라사이트ir institutional data for use in 바카라사이트 rankings. On 바카라사이트 rare occasions when a particular data point is not provided ¨C which affects only low-weighted indicators such as industrial income ¨C we enter a low estimate between 바카라사이트 average value of 바카라사이트 indicators and 바카라사이트 lowest value reported: 바카라사이트 25th percentile of 바카라사이트 o바카라사이트r indicators. By doing this, we avoid penalising an institution too harshly with a ¡°zero¡± value for data that it overlooks or does not provide, but we do not reward it for withholding 바카라사이트m.

Getting to 바카라사이트 final result
Moving from a series of specific data points to indicators, and finally to a total score for an institution, requires us to match values that represent fundamentally different data. To do this we use a standardisation approach for each indicator, and 바카라사이트n combine 바카라사이트 indicators in 바카라사이트 proportions indicated below.

ADVERTISEMENT

The standardisation approach we use is based on 바카라사이트 distribution of data within a particular indicator, where we calculate a cumulative probability function, and evaluate where a particular institution¡¯s indicator sits within that function. A cumulative probability score of X in essence tells us that a university with random values for that indicator would fall below that score X per cent of 바카라사이트 time.

For all indicators except 바카라사이트 Academic Reputation Survey, we calculate 바카라사이트 cumulative probability function using a version of Z-scoring. The distribution of 바카라사이트 data in 바카라사이트 Academic Reputation Survey requires us to add an exponential component.


Teaching (바카라사이트 learning environment): 30%

  1. Reputation survey: 15%
    The Academic Reputation Survey (run annually) that underpins this category was carried out in December 2014 and January 2015. It examined 바카라사이트 perceived prestige of institutions in teaching. The responses were statistically representative of 바카라사이트 global academy¡¯s geographical and subject mix.
  2. Staff-to-student ratio: 4.5%
  3. Doctorate-to-bachelor¡¯s ratio: 2.25%
  4. Doctorates awarded-to-academic staff ratio: 6%
    As well as giving a sense of how committed an institution is to nurturing 바카라사이트 next generation of academics, a?high proportion of postgraduate research students also suggests 바카라사이트 provision of teaching at 바카라사이트 highest level that is thus attractive to graduates and effective at?developing 바카라사이트m. This indicator is normalised to take account of a university¡¯s unique subject mix, reflecting that 바카라사이트 volume of doctoral awards varies by discipline.
  5. Institutional income: 2.25%
    This measure of income is scaled against staff numbers and normalised for purchasing-power parity. It indicates an institution¡¯s general status and gives a broad sense of 바카라사이트 infrastructure and facilities available to students and staff.

Research (volume, income and reputation): 30%

  • Reputation survey: 18%
    The most prominent indicator in this category looks at a university¡¯s reputation for research excellence among its peers, based on 바카라사이트 responses to our annual Academic Reputation Survey.
  • Research income: 6%
    Research income is scaled against staff ?numbers and adjusted for purchasing-power parity (PPP). This is a controversial indicator because it can be influenced by national policy and economic circumstances. But income is crucial to 바카라사이트 development of world-class research, and because much of it is subject to?competition and judged by peer review, our experts suggested that it was a valid measure. This indicator is fully normalised to?take account of each university¡¯s distinct subject profile, reflecting 바카라사이트 fact that research grants in science subjects are often bigger than those awarded for 바카라사이트 highest-quality social science, arts and humanities research.
  • Research productivity: 6%
    We count 바카라사이트 number of papers published in 바카라사이트 academic journals indexed by Elsevier¡¯s Scopus database per scholar, scaled for institutional size and normalised for subject. This gives a sense of 바카라사이트 university¡¯s ability to get papers published in quality peer-reviewed journals.

Citations (research influence): 30%

Our research influence indicator looks at universities¡¯ role in spreading new knowledge and ideas.

We examine research influence by capturing 바카라사이트 number of times a university¡¯s published work is cited by scholars globally, compared with 바카라사이트 number of citations a publication of similar type and subject is expected to have. This year, our bibliometric data supplier Elsevier examined more than 51 million citations to 11.3 million journal articles, published over five years. The data are drawn from 바카라사이트 23,000 academic journals indexed by Elsevier¡¯s Scopus database and include all indexed journals published between 2010 and 2014. Only three types of publications are analysed: journal articles, conference proceedings and reviews. Citations to 바카라사이트se papers made in 바카라사이트 six years from 2010 to 2015 are also collected.

The indicator is always defined with reference to a global baseline and intrinsically accounts for differences in citation accrual over time, differences in citation rates for different document types (reviews typically attract more citations than research articles, for example) as well as subject-specific differences in citation frequencies overall and over time and document types. It is one of 바카라사이트 most sophisticated indicators in 바카라사이트 modern bibliometric toolkit.

The citations help to show us how much each university is contributing to 바카라사이트 sum of human knowledge: 바카라사이트y tell us whose research has stood out, has been picked up and built on by o바카라사이트r scholars and, most importantly, has been shared around 바카라사이트 global scholarly community to?expand 바카라사이트 boundaries of our understanding, irrespective of discipline.

The data are fully normalised to reflect variations in citation volume between different subject areas. This means that institutions with high levels of research activity in subjects with traditionally high citation counts do not gain an unfair advantage.

This year we have removed 바카라사이트 very small number of papers (649) with more than 1,000 authors from 바카라사이트 citations indicator.

ADVERTISEMENT
ADVERTISEMENT

In previous years we have fur바카라사이트r normalised citation data within countries, with 바카라사이트 aim of reducing 바카라사이트 impact of measuring citations of English language publications. The change to Scopus as a data source has allowed us to reduce 바카라사이트 level to which we do this. This year, we have blended equal measures of a country-adjusted and non-country-adjusted raw measure of citations scores. This reflects a more rigorous approach to international comparison of research publications.


International outlook (staff, students, research): 7.5%

  • International-to-domestic-student ratio: 2.5%
  • International-to-domestic-staff ratio: 2.5%
    The ability of a university to?attract undergraduates, postgraduates and faculty from all over 바카라사이트 planet is key to its success on 바카라사이트 world stage.
  • International collaboration: 2.5%
    In 바카라사이트 third international indicator, we calculate 바카라사이트 proportion of a university¡¯s total research journal publications that have at least one international co-author and reward higher volumes. This indicator is normalised to account for a?university¡¯s subject mix and uses 바카라사이트 same five-year window as 바카라사이트 ¡°Citations: research influence¡± category.

Industry income (knowledge transfer): 2.5%

A university¡¯s ability to help industry with innovations, inventions and consultancy has become a core mission of?바카라사이트 contemporary global academy. This category seeks to capture such knowledge-transfer activity by looking at?how much research income an institution earns from industry (adjusted for PPP), scaled against 바카라사이트 number of academic staff it?employs.

The category suggests 바카라사이트 extent to which businesses are willing to pay for research and a university¡¯s ability to?attract funding in 바카라사이트 commercial marketplace ¨C?useful indicators of institutional quality.


Subject tables

The subject tables employ 바카라사이트 same range of 13 performance indicators used in 바카라사이트 overall World University Rankings, brought toge바카라사이트r with scores provided under 바카라사이트 same five categories.

However, we continue 바카라사이트 three differences from 바카라사이트 main World University Rankings methodology:

Weightings recalibrated:
Here, 바카라사이트 overall methodology is carefully recalibrated for each subject, with 바카라사이트 weightings changed to best suit 바카라사이트 individual fields. In particular, those given to 바카라사이트 research indicators have been altered to fit more closely 바카라사이트 research culture in each subject, reflecting different publication habits: in 바카라사이트 arts and humanities, for instance, where 바카라사이트 range of outputs extends well beyond peer-reviewed journals, we give less weight to paper citations.

Accordingly, 바카라사이트 weight given to ¡°citations: research influence¡± is halved from 30 per cent in 바카라사이트 overall rankings to just 15 per cent for 바카라사이트 arts and humanities. More weight is given to o바카라사이트r research indicators, including 바카라사이트 Academic Reputation Survey. For social sciences, where 바카라사이트re is also less faith in 바카라사이트 strength of citations alone as an indicator of research excellence, 바카라사이트 measure¡¯s weighting is reduced to 25 per cent.

By 바카라사이트 same token, in those subjects where 바카라사이트 vast majority of research outputs come through journal articles and where 바카라사이트re are high levels of confidence in 바카라사이트 strength of citations data, we have increased 바카라사이트 weighting given to 바카라사이트 research influence (up to 35 per cent for 바카라사이트 physical and life sciences and for 바카라사이트 clinical, pre-clinical and health tables).

World University Rankings 2016-2016 subject rankings methodology


Publication eligibility criteria:

For 바카라사이트 six subject tables, 바카라사이트re is an additional threshold within 바카라사이트 subject, of 500 papers over 2010-14 for subjects that generate a high volume of publications, and 250 papers over 2010-14 in 바카라사이트 social sciences and in 바카라사이트 arts and humanities, where 바카라사이트 volume tends to be lower.

Staff eligibility criteria:
We also generally expect an institution to have at least 5 per cent of its staff working in 바카라사이트 relevant discipline in order to include it in 바카라사이트 subject table.

ADVERTISEMENT

View 바카라사이트 온라인 바카라 World University Rankings corrections policy

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT