Study of the multidimensional academic ranking U-Multirank
DOI:
https://doi.org/10.18222/eae.v34.9117Keywords:
Multidimensional Academic Evaluations, Evaluation of the Education System, Academic Rankings, International Evaluation, University ManagementAbstract
The present paper explores the dimensions and indicators of the international multidimensional academic ranking U-Multirank. Studying this ranking is important in Brazil today, as the new evaluation of graduate programs in the country is incorporating several aspects of multidimensional evaluation, including concepts from U-Multirank. This ranking reveals the strengths and weaknesses of each academic institution through 5 dimensions formed by 36 indicators. While this large set of dimensions and indicators provides a comprehensive view of universities, it raises questions regarding their independence and data availability. The analysis focuses on the top 300 European academic institutions listed in the 2020 edition, describing the dimensions and indicators and calculating statistical correlations between them.
Downloads
References
Aguillo, I. F., Bar-Ilan, J., Levene, M., & Ortega, J. L. (2010). Comparing university rankings. Scientometrics, 85, 243-256. https://doi.org/10.1007/s11192-010-0190-z DOI: https://doi.org/10.1007/s11192-010-0190-z
Aguillo, I. F., Granadino, B., Ortega, J. L., & Prieto, J. A. (2006). Scientific research activity and communication measured with cybermetric indicators. Journal of the American Society of Information Science and Technology, 57(10), 1296-1302. https://doi.org/10.1002/asi.20433 DOI: https://doi.org/10.1002/asi.20433
Aguillo, I. F., Ortega, J. L., & Fernandez, M. (2008). Webometric ranking of world universities: Introduction, methodology, and future developments. Higher Education in Europe, 33(2/3), 234-244. https://doi.org/10.1080/03797720802254031 DOI: https://doi.org/10.1080/03797720802254031
Bernhard, A. (2012). Quality assurance in an international higher education area: A case study approach and comparative analysis. Springer. DOI: https://doi.org/10.1007/978-3-531-94298-8
Billaut, J., Bouyssou, D., & Vinke, P. (2010). Should we believe the Shanghai ranking? An MCDM view. Scientometrics, 84, 237-263. https://doi.org/10.1007/s11192-009-0115-x DOI: https://doi.org/10.1007/s11192-009-0115-x
Calderón, A. I., & França, C. M. (2018a). Os rankings acadêmicos da educação superior: Apontamentos no campo da avaliação educacional. In J. C. Rothen, & A. C. M. Santana (Ed.), Avaliação da educação: Referências para uma primeira conversa (pp. 95-114). Editora UFSCar.
Calderón, A. I., & França, C. M. (2018b). Rankings acadêmicos na educação superior: Tendências da literatura ibero-americana. Avaliação: Revista da Avaliação da Educação Superior, 23(2), 448-466. https://doi.org/10.1590/S1414-40772018000200010 DOI: https://doi.org/10.1590/s1414-40772018000200010
Calderón, A. I., França, C. M., & Gonçalves, A. (2017). Tendências dos rankings acadêmicos de abrangência nacional de países do espaço ibero-americano: Os rankings dos jornais El Mundo (Espanha), El Mercurio (Chile), Folha de São Paulo (Brasil), Reforma (México) e El Universal (México). EccoS Revista Científica, (44), 117-142. https://doi.org/10.5585/eccos. n44.7943 DOI: https://doi.org/10.5585/eccos.n44.7943
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Capes). (2019). Avaliação multidimensional de programas de pós-graduação: Relatório DAV. Capes.
Dill, D. D., & Soo, M. (2005). Academic quality, league tables and public policy: A cross national analysis of university ranking systems. Higher Education, 49, 499-533. https://doi.org/10.1007/s10734-004-1746-8 DOI: https://doi.org/10.1007/s10734-004-1746-8
Eccles, C. (2002). The use of university rankings in the United Kingdom. Higher Education in Europe, 27(4), 423-432. https://doi.org/10.1080/0379772022000071904 DOI: https://doi.org/10.1080/0379772022000071904
Ganga-Contreras, F., Sáez, W., Calderón, A. I., Calderón, Á., & Rodríguez-Ponce, E. (2020). Principales rankings académicos internacionales: El caso de Chile. Ensaio: Avaliação e Políticas Públicas em Educação, 28(107), 407-434. https://doi.org/10.1590/S0104-40362019002701964 DOI: https://doi.org/10.1590/s0104-40362019002701964
Gonçalves, A., & Calderón, A. I. (2017). Academic rankings in higher education: Trends of international scientific literature. Revista Diálogo Educacional, 17(54), 1125-1145. https://doi.org/10.7213/1981-416x.17.054.ds03 DOI: https://doi.org/10.7213/1981-416X.17.054.DS03
Guimarães, E. R., & Esteves, M. (2018). Sistemas de avaliação da educação superior em Portugal e Brasil. Estudos em Avaliação Educacional, 29(72), 509-630. https://doi.org/10.18222/eae. v29i72.5200 DOI: https://doi.org/10.18222/eae.v29i72.5200
Herting, H. P. (2016). Universities, rankings and the dynamics of global higher education: Perspectives from Asia, Europe and North America. Palgrave Macmillan London.
Liu, N. C., & Cheng, Y. (2005). The academic ranking of world universities. Higher Education in Europe, 30(2), 127-136. https://doi.org/10.1080/03797720500260116 DOI: https://doi.org/10.1080/03797720500260116
Marginson, S., & Wende, M. van der. (2007). To rank or to be ranked: The impact of global rankings in higher education. Journal of Studies in International Education, 11(3/4), 306-329. https://doi.org/10.1177/1028315307303544 DOI: https://doi.org/10.1177/1028315307303544
Prado, A. F. B. A. (2021). Performances of the Brazilian universities in the “U-Multirank” in the Period 2017-2020. SciELO Preprints. https://doi.org/10.1590/SciELOPreprints.2351 DOI: https://doi.org/10.1590/SciELOPreprints.2351
Prado, A. F. B. A. (2022). Multidimensional academic evaluation using the ‘U-Multirank’. Avaliação: Revista da Avaliação da Educação Superior, 27(1), 159-182. https://doi.org/10.1590/S1414-40772022000100009 DOI: https://doi.org/10.1590/s1414-40772022000100009
QS World University Rankings. (2023). University Rankings 2023. https://www.topuniversities.com/university-rankings
Raan, A. F. J. van. (2005). Fatal attraction-conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1), 133-143. https://doi.org/10.1007/s11192-005-0008-6 DOI: https://doi.org/10.1007/s11192-005-0008-6
Ranking Web of Universities. (2023). https://www.webometrics.info/en
Righetti, S. (2019). O jogo dos rankings: Como surgiram e o que medem as principais classificações de universidades do mundo. Estante Labjor.
Rodrigues, L. M. A., Moreira, K. D., & Martins, C. B. (2020). Estratégias organizacionais no contexto da avaliação da pós-graduação brasileira. Estudos em Avaliação Educacional, 31(77), 287-317. https://doi.org/10.18222/eae.v31i77.7383 DOI: https://doi.org/10.18222/eae.v31i77.7383
Shanghai Ranking. (2023). Academic ranking of world universities 2023. http://www.shanghairanking.com/rankings/arwu/2023
Shin, J. C., & Toutkoushian, R. K. (2011). The past, present, and future of University Rankings. In J. C. Shin, R. K. Toutkoushian, & U. Teichler (Eds.), University rankings, the changing academy: The changing academic profession in international comparative perspective (vol. 3). Springer Science. DOI: https://doi.org/10.1007/978-94-007-1116-7_1
Shin, J. C. L., Toutkoushian, R. K., & Teicher, U. (2011). University rankings, theoretical basis, methodology and impacts on global higher education. Springer. DOI: https://doi.org/10.1007/978-94-007-1116-7
Sorz, J., Wallner, B., Seidler, H., & Fieder, M. (2015). Inconsistent year-to-year fluctuations limit the conclusiveness of global higher education rankings for university management. PeerJ, 3, Article e1217. https://doi.org/10.7717/peerj.1217 DOI: https://doi.org/10.7717/peerj.1217
Stack, M. (2016). Global university rankings and the mediatization of higher education, palgrave studies in global higher education. Palgrave Macmillan. DOI: https://doi.org/10.1057/9781137475954
Théry, H. (2010). Classificações de universidades mundiais, “Xangai” e outras. Estudos Avançados, 24(70), 185-205. https://doi.org/10.1590/S0103-40142010000300012 DOI: https://doi.org/10.1590/S0103-40142010000300012
Times Higher Education. (2023). World university rankings 2023. https://www.timeshighereducation.com/world-university-rankings
U-Multirank. (2020a). U-Multirank 2020: British universities in global comparison. https://www.umultirank.org/export/sites/default/press-media/media-center/universities/2020/country-reports/UK-Country-report-2020.pdf
U-Multirank. (2020b). U-Multirank 2020: Indicator book 2020. https://www.umultirank.org/export/sites/default/press-media/documents/Indicator-Book-2020.pdf
U-Multirank. (2023a). Frequently asked questions about U-Multirank world university rankings. https://www.umultirank.org/about/u-multirank/frequently-asked-questions/
U-Multirank. (2023b). U-Multirank: Universities compared. Your way. https://www.umultirank.org/
Vught, F. A. van, & Ziegele, F. (Ed.). (2012). Multidimensional ranking: The design and development of U-Multirank. Springer. DOI: https://doi.org/10.1007/978-94-007-3005-2
Webster, T. J. (2001). A principal component analysis of the US News & World Report tier rankings of colleges and universities. Economics of Education Review, 20(3), 235-244. https://doi.org/10.1016/S0272-7757(99)00066-7 DOI: https://doi.org/10.1016/S0272-7757(99)00066-7
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Estudos em Avaliação Educacional
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish in this journal agree to the following terms:
a. Authors retain the copyright and grant the journal the right to first publication, with the paper simultaneously licensed under the Creative Commons Attribution license that allows the sharing of the paper with acknowledgment of authorship and initial publication in this journal.
b. Authors are authorized to assume additional contracts separately, for non-exclusive distribution of the version of the paper published in this journal (for example publishing in institutional repository or as a book chapter), with acknowledgment of authorship and initial publication in this journal.
c. Authors are allowed and encouraged to publish and distribute their paper on-line (for example in institutional repositories or on their personal page) at any moment before or during the editorial process, as this can generate productive changes, as well as increase the impact and citation of the published paper (See The Effect of Open Access).
