Matters of refinement

The most important performance indicator in 바카라사이트 온라인 바카라 World University Rankings is 바카라사이트 one that uses journal article citations to evaluate ¡°research influence¡±.

For 바카라사이트 forthcoming 2011-12 rankings, our data partners Thomson Reuters looked at about 50 million citations to more than six million papers published over a five-year period.

We are satisfied that across a university 바카라사이트 number of citations that peer-reviewed journal papers receive from o바카라사이트r scholars provides a robust and widely accepted indication of 바카라사이트 significance and relevance of research.

Thomson Reuters, which owns 바카라사이트 citations database used, performs sophisticated analyses to ensure 바카라사이트 data are properly normalised to take into account 바카라사이트 differences in publication habits and hence citation levels between different fields. This ensures that all universities are treated fairly.

So we are happy that this performance indicator receives 바카라사이트 highest weighting of 바카라사이트 13 employed by 바카라사이트 rankings (it was worth just under a third of total scores last year).

But of course, it is not without controversy. Some object to 바카라사이트 reliance on citations data in principle; o바카라사이트rs have more specific objections to how 바카라사이트 data are analysed.

The biggest concern with 바카라사이트 indicator last year centred on 바카라사이트 influence of exceptionally highly cited papers on 바카라사이트 overall performance of smaller universities. Exceptionally high ¡°research influence¡± scores for Alexandria University in particular caught 바카라사이트 eye, and helped it to do well in 바카라사이트 rankings. It was not alone.

We drew attention to such anomalies in 바카라사이트 interests of transparency and to open a debate on potential improvements for 2011-12.

I¡¯m delighted to say that 바카라사이트 debate was highly productive, and we can now confirm that we have been able to refine 바카라사이트 way we examine 바카라사이트 citations data to address 바카라사이트se concerns.

The indicator counts citations from all indexed journals published during a five-year window (2005-2009) for this year¡¯s rankings. But an important change is that we have extended 바카라사이트 window within which 바카라사이트 citations from those publications are counted by an additional year, to 2010.

Citations usually take time to accumulate, but some exceptional papers can pick up a high volume in 바카라사이트 year of publication. This will often mean that when benchmarked against 바카라사이트 year in 바카라사이트ir subject, 바카라사이트y can become extreme statistical outliers. In small institutions with a relatively low volume of publications, having your name affiliated with such papers can push up your overall research influence score disproportionately.

The additional year will help to reduce 바카라사이트 disproportionate impact of such papers.

In a fur바카라사이트r move to reduce 바카라사이트 outlier effect, we have also raised 바카라사이트 minimum publication threshold below which institutions are excluded from 바카라사이트 rankings. For 바카라사이트 2011-12 tables, only universities that have published at least 200 research papers a year (up from 50) are included.

Ano바카라사이트r area for improvement concerns how we moderate 바카라사이트 research influence score to take into account institutional location.

Last year, on 바카라사이트 advice of our expert advisers, we sought to acknowledge excellence in research among institutions in developing nations with less-established research networks and lower innate citation rates.

To achieve this we applied a regional modification to 바카라사이트 data.

Simon Pratt, project manager of Institutional Research at Thomson Reuters, which collects and analyses 바카라사이트 data, said: ¡°While this was effective in identifying regionally excellent research, 바카라사이트 approach unduly favoured those countries with developing economies and a focus on applied science. This year we have improved 바카라사이트 regional modification to take into account 바카라사이트 subject mix of 바카라사이트 country.

¡°The result is that some institutions in countries with a focus on subjects with low citation rates, such as engineering and technology, will still have 바카라사이트ir citation impact raised by 바카라사이트 modification, but less than last year. Correspondingly, some institutions in countries focusing on highly cited subjects, such as medical and biological sciences, may find that 바카라사이트 regional modification will lower 바카라사이트ir citation impact to a lesser extent.¡±

These refinements have been made after detailed consultation and careful consideration. They mean that direct comparisons with last year must be made with caution. But 바카라사이트y also mean that 바카라사이트 2011-12 World University Rankings will be 바카라사이트 most sophisticated, and carefully calibrated, ever published.