Глобальные и национальные рейтинги университетов: многомерный анализ

Введение. В условиях глобализации и интернационализации высшего образования рейтинги университетов становятся важным инструментом оценки качества образования, получаемого студентами в различных вузах мира. Эти процессы актуализируют вопросы возможностей практического использования методологий расчета глобальных и национальных рейтингов высших учебных заведений.
Цель исследования – разработка и применение методического подхода к многомерному анализу процедур классификации вузов, построение и анализ критериев, агрегированных индикаторов глобальных и национальных рейтинговых систем организаций высшего образования, оценка связи между ними.
Методология и методики. В работе проведены системный анализ баз данных рейтинговых систем и агрегирование независимых оценок глобальных и национальных рейтингов вузов с применением методики анализа лиг на базе математического аппарата теории голосования. Исследование связи индикаторов глобальных и национальных рейтингов вузов проведено с использованием корреляционного, кластерного, факторного, регрессионного (линейного и полиномиального) и дисперсионного методов анализа.
Результаты и научная новизна. Проведен комплексный сравнительный анализ рейтинговых систем и их результатов. Решена проблема агрегирования множества разнородных исследований мировых и национальных систем ранжирования с их качественным и количественным разнообразием критериев, показателей и методов оценки. Выявлена корреляция между показателями агрегированных глобальных и национальных рейтингов, определена регрессионная зависимость интегрального национального рейтинга с результатами ведущих мировых рейтинговых систем.
Практическая значимость. Разработанный методический подход является удобным и эффективным механизмом комплексного мониторинга субъектов образовательной деятельности.

1. Soh K. What the Overall doesn’t tell about world university rankings: examples from ARWU, QSWUR, and THEWUR in 2013 // Journal of Higher Education Policy and Management. 2015. Vol. 37, № 3. P. 295–307. DOI: 10.1080/1360080X.2015.1035523

2. Marconi G., Ritzen J. Determinants of international university rankings scores // Applied Economics. 2015. Vol. 47, № 7. P. 6211–6227. DOI: 10.1080/00036846.2015.1068921

3. Huang Z., Qiu R. A quantitative and model-driven approach to assessing higher education in the United States of America // Quality in Higher Education. 2016. Vol. 22, № 1. P. 78–95. DOI: 10.1080/13538322.2016.1147215

4. Peters M. A. Global university rankings: Metrics, performance, governance // Educational Philosophy and Theory. 2019. Vol. 51, № 1. P. 5–13. DOI: 10.1080/00131857.2017.1381472

5. Motova G., Navodnov V. Twenty years of accreditation in Russian higher education: lessons learnt // Higher Education Evaluation and Development. 2020. Vol. 14, № 1. P. 33–51. DOI: 10.1108/HEED-05-2019-0023

6. Salimova T. A., Biryukova L. I., Shilkina A. T., Khakhaleva E. V. Towards a methodology of sustainable competitiveness of organization // International Journal of Civil Engineering and Technology. 2018. Vol. 9, № 11. P. 161–172. Available from: https://www.elibrary.ru/item.asp?id=36518513& (date of access: 22.03.2021).

7. Hossain M. N., Zabed Ahmed S. M. Use of scholarly communication and citation- based metrics as a basis for university ranking in developing country perspective // Global Knowledge, Memory and Communication. 2019. Vol. 69, № 6/7. P. 461–482. DOI: 10.1108/GKMC-09-2019-0112

8. Berbegal-Mirabent J., Ribeiro-Soriano D. E. Behind league tables and ranking systems: A critical perspective of how university quality is measured // Journal of Service Theory and Practice. 2013. Vol. 25, № 3. P. 242–266. DOI: 10.1108/JSTP-04-2013-0059

9. Kusumastuti D., Idrus N. Nurturing quality of higher education through national ranking: a potential empowerment model for developing countries // Quality in Higher Education. 2017. Vol. 23, № 3. P. 230–248. DOI: 10.1080/13538322.2017.1407400

10. Jin J. C., Kim D. A. Higher education in South Korea: recent changes in school competitiveness and research productivity // Journal of Asian Public Policy. 2019. Vol. 14, № 7144. P. 1–23. DOI: 10.1080/17516234.2019.1622181

11. Donetskaia S. S. The Berlin Principles in Russian University Rankings // Problems of Economic Transition. 2017. Vol. 59, № 7–9. P. 614–626. DOI: 10.1080/10611991.2017.1394756

12. Köse M. F., Korkmaz M. Why are some universities better? An evaluation in terms of organizational culture and academic performance // Higher Education Research & Development. 2019. Vol. 38, № 6. P. 1213–1226. DOI: 10.1080/07294360.2019.1634679

13. Hosier M., Hoolash K. A. The effect of methodological variations on university rankings and associated decision-making and policy // Studies in Higher Education. 2019. Vol. 44, № 1. P. 201–214. DOI: 10.1080/03075079.2017.1356282

14. Rybinski K. Are rankings and accreditation related? Examining the dynamics of higher education in Poland // Quality Assurance in Education. 2020. Vol. 28, № 3. P. 193–204. DOI: 10.1108/QAE-03-2020-0032

15. Doğan G., Al U. Is it possible to rank universities using fewer indicators? A study on five international university rankings. // Aslib Journal of Information Management. 2019. Vol. 71, № 1. P. 18–37. DOI: 10.1108/AJIM-05-2018-0118

16. Hauptman Komotar M. Discourses on quality and quality assurance in higher education from the perspective of global university rankings. // Quality Assurance in Education. 2020. Vol. 28, № 1. P. 78–88. DOI: 10.1108/QAE-05-2019-0055

17. Gao X., Zheng Y. ‘Heavy mountains’ for Chinese humanities and social science academics in the quest for world-class universities // Compare: Journal of Comparative and International Education. 2020. Vol. 50, № 1. P. 1–19. DOI: 10.1080/03057925.2018.1538770

18. Shattock M. The ‘world class’ university and international ranking systems: what are the policy implications for governments and institutions? // Policy Reviews in Higher Education. 2017. Vol. 1, № 1. P. 4–21. DOI: 10.1080/23322969.2016.1236669

19. Jabnoun N. The influence of wealth, transparency, and democracy on the number of top ranked universities. // Quality Assurance in Education. 2015. Vol. 23, № 2. P. 108–122. DOI: 10.1108/QAE-07-2013-0033

20. Huang M. Exploring the h-index at the institutional level: A practical application in world university rankings // Online Information Review. 2012. Vol. 36, № 4. P. 534–547. DOI: 10.1108/14684521211254059

21. Van Raan A. F. J. Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods // Scientometrics. 2005. Vol. 62, № 1. P. 133–143. DOI: 10.1007/s11192-005-0008-6

22. Ioannidis J. P. A., et al. International ranking systems for universities and institutions: a critical appraisal // BMC Medicine. 2007. Available from: http://www.biomedcentral.com/1741-7015/5/30 (date of access: 22.03.2021).

23. Holmes R. The THES university rankings: Are they really world class // Asian Journal of University Education. 2006. Vol. 1, № 1. P. 1–14. Available from: https://www.researchgate.net/publication/301781569_The_THES_University_Rankings_Are_They_Really_World_Class (date of access: 22.03.2021).

24. Waltman L., et al. The Leiden Ranking 2011/2012: Data collection, indicators, and interpretation. 2012. Available from: http://arxiv.org/abs/1202.3941 (date of access: 22.03.2021).

25. Billaut J.-C., Bouyssou D., Vincke P. Should you believe in the Shanghai ranking? // Scientometrics. 2010. Vol. 84, № 1. P. 237–263. DOI: 10.1007/s11192-009-0115-x

26. Van Raan A. F. J. Challenges in ranking of universities // Invited paper for the First International Conference on World Class Universities. Jaio Tong University. Shanghai. June 2005. P. 19–50. Available from: https://www.researchgate.net/publication/250794968_Challenges_in_Ranking_of_Universities (date of access: 22.03.2021).

27. Zitt M., Filliatreau G. Big is (made) beautiful: Some comments about the Shanghai ranking of world-class universities // The World-Class University and Ranking: Aiming Beyond Status. Shanghai, China: Cluj University Press, 2007. P. 17–24. Available from: https://www.researchgate.net/publication/252727031_Big_is_made_Beautiful_Some_comments_about_the_Shanghai_ranking_of_world-class_universities (date of access: 22.03.2021).

28. Moed H. F. Bibliometric rankings of world universities. CWTS Report 2006-01. 2006. Available from: http://www.cwts.nl/hm/bibl_rnk_wrld_univ_full.pdf. (date of access: 22.03.2021).

29. Soh K. The seven deadly sins of world university ranking: a summary from several papers // Journal of Higher Education Policy and Management. 2017. Vol. 39, № 1. P. 104–115. DOI: 10.1080/1360080X.2016.1254431

30. Soh K. Rectifying an honest error in world university rankings: a solution to the problem of indicator weight discrepancies // Journal of Higher Education Policy and Management. 2013. Vol. 35. № 6. P.574-585. DOI: 10.1080/1360080X.2013.844670

31. Sheeja N. K., Susan Mathew K., Surendran Cherukodan. Impact of scholarly output on university ranking // Global Knowledge, Memory and Communication. 2018. Vol. 67, № 3. P. 154–165. DOI: 10.1108/GKMC-11-2017-0087

32. McCoy C. G., Nelson M. L., Weigle M. C. Mining the Web to approximate university rankings // Information Discovery and Delivery. 2018. Vol. 46, № 3. P. 173–183. DOI: 10.1108/IDD-05-2018-0014

33. Qureshi M. S., Daud A., Hayat M. K., Afzal M. T. OpenRank – a novel approach to rank universities using objective and publicly verifiable data sources // Library Hi Tech. 2021. DOI: 10.1108/LHT-07-2019-0131

34. Brusca I., Cohen S., Manes-Rossi F., Nicolò G. Intellectual capital disclosure and academic rankings in European universities: Do they go hand in hand? // Meditari Accountancy Research. 2019. Vol. 28, № 1. P. 51–71. DOI: 10.1108/MEDAR-01-2019-0432

35. Jin J. C., Kim D. Higher education in South Korea: recent changes in school competitiveness and research productivity // Journal of Asian Public Policy. 2019. Vol. 14, № 3. P. 291–313. DOI: 10.1080/17516234.2019.1622181

36. Tutterow C., Evans J. A. Reconciling the Small Effect of Rankings on University Performance with the Transformational Cost of Conformity // The University Under Pressure. 2016. Vol. 46, P. 265–301. DOI: 10.1108/S0733-558X20160000046009

37. Salimova T., Guskova N., Neretina E. Title: Education for sustainable development in Russia: problems and challenges // International Journal of Innovation and Sustainable Development. 2015. Vol. 9, № 3/4. P. 246–261. DOI: 10.1504/IJISD.2015.071855

38. Marconi G., Ritzen J. Determinants of international university rankings scores // Applied Economics. 2015. Vol. 47, № 57. P. 6211–6227. DOI: 10.1080/00036846.2015.1068921

39. Zhu Y. Social media engagement and Chinese international student recruitment: understanding how UK HEIs use Weibo and WeChat // Journal of Marketing for Higher Education. 2019. Vol. 29, № 2. P. 173–190. DOI: 10.1080/08841241.2019.1633003

40. Çakır M. P., Acartürk C., Alkan S., Akbulut U. Multi-authoring and its impact on university rankings: a case study of CERN effect on Turkish universities // Studies in Higher Education. 2019. Vol. 44, № 6. P. 1052–1068. DOI: 10.1080/03075079.2017.1414780

41. Paruolo P., Saltelli A., Saisana M. Ratings and rankings: Voodoo or Science? // Journal of the Royal Statistical Society. Series A (Statistics in Society). 2011. Vol. 176, № 3. P. 609–634. Available from: https://www.researchgate.net/publication/51887919_Ratings_and_rankings_Voodoo_or_Science (date of access: 22.03.2021).

42. Angelis L., Bassiliades N., Manolopoulos Y. On the necessity of multiple university rankings // Journal of Scientometrics and Information Management. 2019. Vol. 13, № 1. P. 11–36. DOI: 10.1080/09737766.2018.1550043

43. Hosier M., Hoolash B.K. The effect of methodological variations on university rankings and associated decision-making and policy // Studies in Higher Education. 2019. Vol. 44, № 1. P. 201–214. DOI: 10.1080/03075079.2017.1356282

44. Hallinger P. Riding the tiger of world university rankings in East Asia: where are we heading? // International Journal of Educational Management. 2014. Vol. 28, № 2. P. 230–245. DOI: 10.1108/IJEM-11-2012-0126

45. Tofallis С. A different approach to university rankings // Higher Education. 2012. Vol. 63, № 1. P. 1–18. DOI: 10.1007/s10734-011-9417-z

46. Nethal K. J., Harrison J. World university ranking systems: an alternative approach using partial least squares path modelling // Journal of Higher Education Policy and Management. 2014. Vol. 36, № 5. P. 471–482. DOI: 10.1080/1360080X.2014.936090

47. Luque-Martínez T., Faraoni N. Meta-ranking to position world universities // Studies in Higher Education. 2020. Vol. 45, № 4. P. 819–833. DOI: 10.1080/03075079.2018.1564260

48. Эрганова Н. Е., Колясникова Л. В. Построение рейтинга профессиональных образовательных организаций с учетом основных положений теории измерения латентных переменных // Образование и наука. 2016. № 4. C. 46–64. DOI: 10.17853/1994-5639- 2016-4-46-64

49. Yurin A. Y. Group decision-making methods for adapting solutions derived from case-based reasoning // Scientific and Technical Information Processing. 2015. Vol. 42. P. 375–381. DOI: 10.3103/S014768821505010X

50. Наводнов В. Г., Мотова Г. Н., Рыжакова О. Е. Сравнение международных рейтингов и результатов российского Мониторинга эффективности деятельности вузов по методике анализа лиг [Электрон. ресурс] // Вопросы образования. 2019. № 3. С. 130–151. Режим доступа: https://vo.hse.ru/data/2019/09/16/1541237741/05%20Navodnov.pdf (дата обращения: 22.03.2021).

51. Фурсов В. В. О возможности вхождения медицинских вузов в глобальные рейтинги. // Образование и наука. 2017. Т. 19, № 5. С. 138–152. DOI: 10.17853/1994-5639-2017-5-138-152