The World University Rankings 2023 – submit your university to participate!29 July 2021 8 min reading
The results of THE World University Rankings 2022, the most recognizable and relevant ranking of universities in the world, will be announced at THE World Academic Summit organized by Times Higher Education on September 1-3, 2021 in Toronto.
At the same time, Times Higher Education and PCG Academia have planned a separate meeting, dedicated to the analysis and interpretation of the results achieved by Polish universities in this year’s edition of THE World University Rankings. The meeting in the form of a webinar will be held on October 21, 2021 at 1 p.m. Details will be available soon at pcgacademia.pl.
Submission of applications for THE World University Rankings 2022 has already been cclosed, but the universities you represent will be able to apply for the next edition of the ranking in December 2021. Information about the start of the recruitment will be published at timeshighereducation.com. As a reminder, we encourage you to get to know the methodology used by Times Higher Education to classify universities in THE World University Rankings.
Methodology of THE World University Rankings 2023
The Times Higher Education World University Rankings are the only global ranking that assess universities across all their core missions: teaching, research, knowledge transfer and international outlook. THE use 13 carefully calibrated performance indicators to provide the most comprehensive and balanced comparisons, trusted by students, academics, university leaders, industry and governments around the world.
The performance indicators are grouped into five areas: Teaching (the learning environment); Research (volume, income and reputation); Citations (research influence); International outlook (staff, students and research); and Industry income (knowledge transfer).
Teaching (the learning environment): 30%
- Reputation survey: 15%
- Staff-to-student ratio: 4.5%
- Doctorate-to-bachelor’s ratio: 2.25%
- Doctorates-awarded-to-academic-staff ratio: 6%
- Institutional income: 2.25%
The basis for this category is annually Academic Reputation Survey, that examines the perceived prestige of institutions in teaching and research. The most recent survey was carried out between November 2020 and February 2021. The responses were statistically representative of the geographical and subject mix of academics globally. The 2021 data are combined with the results of the 2020 survey, giving almost 22,000 responses.
As well as giving a sense of how committed an institution is to nurturing the next generation of academics, a high proportion of postgraduate research students also suggests the provision of teaching at the highest level that is thus attractive to graduates and effective at developing them. This indicator is normalised to take account of a university’s unique subject mix, reflecting that the volume of doctoral awards varies by discipline.
Institutional income is scaled against academic staff numbers and normalised for purchasing-power parity (PPP). It indicates an institution’s general status and gives a broad sense of the infrastructure and facilities available to students and staff.
Research (volume, income and reputation): 30%
- Reputation survey: 18%
- Research income: 6%
- Research productivity: 6%
The most prominent indicator in this category looks at a university’s reputation for research excellence among its peers, based on the responses to our annual Academic Reputation Survey (see above).
Research income is scaled against academic staff numbers and adjusted for purchasing-power parity (PPP). This is a controversial indicator because it can be influenced by national policy and economic circumstances. But income is crucial to the development of world-class research, and because much of it is subject to competition and judged by peer review, THE experts suggested that it was a valid measure. This indicator is fully normalised to take account of each university’s distinct subject profile, reflecting the fact that research grants in science subjects are often bigger than those awarded for the highest-quality social science, arts and humanities research.
To measure productivity we count the number of publications published in the academic journals indexed by Elsevier’s Scopus database per scholar, scaled for institutional size and normalised for subject. This gives a sense of the university’s ability to get papers published in quality peer-reviewed journals. From the 2018 rankings, THE devised a method to give credit for papers that are published in subjects where a university declares no staff.
Citations (research influence): 30%
The research influence indicator looks at universities’ role in spreading new knowledge and ideas.
THE examine research influence by capturing the average number of times a university’s published work is cited by scholars globally. This year, THE’s bibliometric data supplier Elsevier examined more than 108 million citations to 14.4 million journal articles, article reviews, conference proceedings, books and book chapters published over five years. The data include more than 24,600 academic journals indexed by Elsevier’s Scopus database and all indexed publications between 2016 and 2020. Citations to these publications made in the six years from 2016 to 2021 are also collected.
The citations help to show how much each university is contributing to the sum of human knowledge: they tell us whose research has stood out, has been picked up and built on by other scholars and, most importantly, has been shared around the global scholarly community to expand the boundaries of our understanding, irrespective of discipline.
The data are normalised to reflect variations in citation volume between different subject areas. This means that institutions with high levels of research activity in subjects with traditionally high citation counts do not gain an unfair advantage.
THE have blended equal measures of a country-adjusted and non-country-adjusted raw measure of citations scores.
In 2015-16, THE excluded papers with more than 1,000 authors because they were having a disproportionate impact on the citation scores of a small number of universities. In 2016-17, THE designed a method for reincorporating these papers. Working with Elsevier, THE developed a fractional counting approach that ensures that all universities where academics are authors of these papers will receive at least 5 per cent of the value of the paper, and where those that provide the most contributors to the paper receive a proportionately larger contribution.
International outlook (staff, students, research): 7.5%
- Proportion of international students: 2.5%
- Proportion of international staff: 2.5%
- International collaboration: 2.5%
The ability of a university to attract undergraduates, postgraduates and faculty from all over the planet is key to its success on the world stage.
In the third international indicator, THE calculate the proportion of a university’s total relevant publications that have at least one international co-author and reward higher volumes. This indicator is normalised to account for a university’s subject mix and uses the same five-year window as the “Citations: research influence” category.
Industry income (knowledge transfer): 2.5%
A university’s ability to help industry with innovations, inventions and consultancy has become a core mission of the contemporary global academy. This category seeks to capture such knowledge-transfer activity by looking at how much research income an institution earns from industry (adjusted for PPP), scaled against the number of academic staff it employs.
The category suggests the extent to which businesses are willing to pay for research and a university’s ability to attract funding in the commercial marketplace – useful indicators of institutional quality.
Universities can be excluded from the World University Rankings if they do not teach undergraduates, or if their research output amounted to fewer than 1,000 relevant publications between 2016 and 2020 (with a minimum of 150 a year). Universities can also be excluded if 80 per cent or more of their research output is exclusively in one of THE 11 subject areas.
Universities at the bottom of the ranking table that are listed as having “reporter” status provided data but did not meet THE eligibility criteria to receive a rank.
Institutions provide and sign off their institutional data for use in the rankings. On the rare occasions when a particular data point is not provided, THE enter a conservative estimate for the affected metric. By doing this, THE avoid penalising an institution too harshly with a “zero” value for data that it overlooks or does not provide, but do not reward it for withholding them.
Getting to the final result
Moving from a series of specific data points to indicators, and finally to a total score for an institution, requires THE to match values that represent fundamentally different data. To do this, THE use a standardisation approach for each indicator, and then combine the indicators in the proportions detailed above.
The standardisation approach used by THE is based on the distribution of data within a particular indicator, where THE calculate a cumulative probability function, and evaluate where a particular institution’s indicator sits within that function.
For all indicators except for the Academic Reputation Survey, THE calculate the cumulative probability function using a version of Z-scoring. The distribution of the data in the Academic Reputation Survey requires THE to add an exponential component.