Game format of the exam as an effective tool for assessing competence development

Introduction. The relevance of this study stems from the necessity to develop a new examination format that accommodates a comprehensive range of tasks aligned with contemporary realities. The foundation of this examination format is a role-playing game tailored for educational purposes. Aim. This research aims to evaluate the effectiveness of the innovative examination format based on role-playing games, focusing on the objectivity and completeness of assessment, student engagement and motivation, levels of stress, and the potential for utilising this exam format to assess competence development and enhance soft skills. Methodology and research methods. The study employs an activity-based approach to learning and assessment. A systematic analysis of theoretical sources was conducted to address these issues. Additionally, game modelling was utilised to create an exam in the format of a role-playing game. The empirical foundation of the study comprises the results of an online survey conducted among students who participated in the exam in this game format, as well as the findings from a content analysis of their responses to open-ended questions. Results. The results of the study encompassed the methodology for creating an exam in a game format, the approach to conducting the exam, and the criteria for evaluating the competencies being assessed. Additionally, the study identified the potential of the game format for fostering supplementary, supra-professional skills (soft skills) that are currently in high demand in the labour market. Scientific novelty. The scientific novelty of this work lies in the comprehensive description of the pedagogical design of the exam in a game format developed by the authors, as well as the results of its testing, which demonstrate its validity and effectiveness. Practical significance. The results contribute to the advancement of gamification in higher education by utilising game techniques as assessment tools in the educational process.

1. Ivanova S.V., Ivanov O.B. Systemic transformation on the sphere of education in the context of the digital technologies introduction. Tsennosti i smysly = Values and Meanings. 2020;5(69):6–27. (In Russ.) Accessed May 18, 2024. https://cyberleninka.ru/article/n/sistemnye-transformatsii-v-sfere-obrazovaniya-v-usloviyah-vnedreniya-tsifrovyh-tehnologiy?ysclid=lgfb1gzdet47636155

2. Khanin Ph.G. The impact of globalization on the formation of the modern education system in the context of the fifth technological revolution. Social’no-politicheskie nauki = Sociopolitical Sciences. 2023;1. (In Russ.) doi:10.33693/2223-0092-2023-13-1-129-137

3. Bordovskaia N.V., Koshkina E.A., Melkaya L.A., Tikhomirova M.A. Criteria for assessing the effectiveness of blended learning technologies used at the university. Integracija obrazovanija = Integration of Education. 2023;27(1). (In Russ.) doi:10.15507/1991-9468.110.027.202301.064-081

4. Bordovskaia N.V., Koshkina E.A., Tikhomirova M.A., Iskhakova M.P. The effectiveness of blended learning technologies in higher education: assessment methodology. Obrazovanie i nauka = The Education and Science Journal. 2023;25(7):69–102. (In Russ.) doi:10.17853/1994-5639-2023-7-69-102

5. Bijieva S.Kh., Urusova F.A.-A. Gamification of education: problems of use and development prospects. Mir nauki. Pedagogika i psihologija = World of Science. Pedagogy and Psychology. 2020;4. (In Russ.) Accessed May 18, 2024. https://cyberlenin ka.ru/article/n/geymifikatsiya-obrazovaniya-problemy-ispolzovaniya-i-perspektivy-razvitiya

6. Wang Y.-C. Gamification in a News English Course. Education Sciences. 2023;13(90):1–14. doi:10.3390/educsci13010090

7. Balakina K.D. Role-playing games as a key technology for developing students’ speaking skills outside the language environment. Rusistika = Russian Language Studies. 2020;18(4):439–453. (In Russ.) doi:10.22363/2618-8163-2020-18-4-439-453

8. Zapata-Rivera D., Bauer M. Exploring the role of games in educational assessment. In: Clarke-Midura J., Mayrath M., and Robinson D., eds. Technology-Based Assessments for 21st Century Skills: Theoretical and Practical Implications from Modern Research. 2012:147–169. Accessed May 18, 2024. https://www.academia.edu/19536643/EXPLORING_THE_ROLE_OF_GAMES_IN_EDUCATIONAL_ASSESSMENT

9. Ifenthaler D., Eseryel D., Ge X. Assessment in Game-Based Learning. Foundations, Innovations, and Perspectives. New York: Springer; 2012:3–10. Accessed March 14, 2024. https://www.researchgate.net/publication/234035558_Ifenthaler_D_Eseryel_D_Ge_X_2012_Assessment_in_game-based_learning_In_D_Ifenthaler_D_Eseryel_X_Ge_Eds_Assessment_in_game-based_learning_Foundations_innovations_and_perspectives_pp_18_New_York_Springer

10. Shmigirilova I.B., Rvanova A.S., Grigorenko O.V. Assessment in education: current trends, problems and contradictions (review of scientific publications). Obrazovanie i nauka = The Education and Sci ence Journal. 2021;23(6):43–83. (In Russ.) doi:10.17853/1994-5639-2021-6-43-83

11. Chagin S.S. Gamification of vocational education: is the game worth the candle? Professional’noe obrazovanie i rynok truda = Vocational Education and Labor Market. 2021;1(44). (In Russ.) Accessed April 25, 2024. https://cyberleninka.ru/article/n/geymifikatsiya-professionalnogo-obrazovaniya-stoit-li-igra-svech

12. Mantulenko V.V. Comprehension of the digitalization practice in the Russian education: actual challenges and tasks. Nauchno-metodicheskij jelektronnyj zhurnal “Koncept” = Scientific-methodolog ical electronic journal “Koncept”. 2023;3. (In Russ.) Accessed April 25, 2024. https://cyberleninka.ru/article/n/osmyslenie-opyta-tsifrovizatsii-rossiyskogo-obrazovaniya-aktualnye-vyzovy-i-zadachi

13. Cegolon A. Soft skills and general education. Form@re – Open Journal per la Formazione in Rete. 2023;23(1):112–122. doi:10.36253/form-13757

14. Da Silva L., Nunes Costa Reis P., Da Silva Ramos M., Fernandes Narduche E. Soft skills e sua de manda no mercado de trabalho. Cadernos UniFOA, Volta Redonda. 2023;18(51). (In Portuguese) doi:10.47385/cadunifoa.v18.n51.4321

15. Caponetto I., Earp Je., Ott M. Gamification and education: a literature review. In: Proceedings of the 8th European Conference on Games-Based Learning – ECGBL 2014. 2014;1:50–57. Accessed March 14, 2024. https://www.itd.cnr.it/download/gamificationECGBL2014.pdf

16. Yu-Kai C. Actionable Gamification. New York: Packt Publishing Ltd.; 2019. 500 p.

17. Almeida C., Kalinowski M., Uchôa A., Feijó B. Negative effects of gamification in education soft ware: systematic mapping and practitioner perceptions. Information and Software Technology. 2023;156:107142. doi:10.1016/j.infsof.2022.107142

18. Johnson D., Deterding S., Kuhn K.-A., Staneva A., Stoyanov S., Hides L. Gamification for health and wellbeing: a systematic review of the literature. Internet Interventions. 2016;6. doi:10.1016/j.invent.2016.10.002

19. Astashova N.A., Bondyreva S.K., Popova O.S. Gamification resources in education: a theoretical approach. Obrazovanie i nauka = The Education and Science Journal. 2023;25(1):15–49. (In Russ.) doi:10.17853/1994-5639-2023-1-15-49

20. Guaqueta C.A., Castro-Graces A.Y. The use of language learning apps as a didactic tool for EFL vocabulary building. English Language Teaching. 2018;11. doi:10.5539/elt.v11n2p61

21. Wu T.T., Huang Y.M. A mobile game-based English vocabulary practice system based on portfolio analysis. Educational Technology & Society. 2017;20:265–277. Accessed March 14, 2024. https://www.researchgate.net/publication/317027212_A_mobile_game-based_English_vocabulary_practice_system_based_on_portfolio_analysis

22. Goltsova T.A., Protsenko E.A. Gamification as an effective technology for teaching foreign languages in a digitalized educational process. Otechestvennaja i zarubezhnaja pedagogika = Domestic and Foreign Pedagogy. 2020;3(68). (In Russ.) Accessed April 25, 2024. https://cyberleninka.ru/article/n/geymifikatsiya-kak-effektivnaya-tehnologiya-obucheniya-inostrannym-yazykam-v-usloviyah-tsifrovizatsii-obrazovatelnogo-protsessa

23. Deterding S., Dixon D., Khaled R., Nacke L. From game design elements to gamefulness: Defining gamification. In: Proceedings of the 15th international Academic MindTrek Conference: Envisioning Future Media Environments. 2011;11:9–15. doi:10.1145/2181037.2181040

24. Sailer M., Hense J.U., Mayr S.K., Mandl H. How gamification motivates: an experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Hu man Behavior. 2017;69(2). doi:10.1016/j.chb.2016.12.033

25. Arnold B.J. Gamification in education. In: Proceedings of the American Society of Business and Be havioral Sciences. 2014;21:32–39. Accessed March 14, 2024. https://www.academia.edu/5490146/Gamification_in_Education

26. Kapkaev Ju.Sh., Leshinina V.V., Benc D.S. Gamification of the educational process. Problemy sovremennogo pedagogicheskogo obrazovanija = Problems of Modern Pedagogical Education. 2019;63(2). (In Russ.) Accessed April 25, 2024. https://cyberleninka.ru/article/n/geymifikatsiya-obrazovatelnogo-protsessa

27. Samarskaya S.V. Development of soft skills in the process of teaching foreign languages based on gaming technologies. Mezhdunarodnyj nauchno-issledovatel’skij zhurnal = International Research Journal. 2022;2(116). (In Russ.) Accessed April 25, 2024. https://research-journal.org/archive/2-116-2022-february/razvitie-softskills-v-processe-obucheniya-inostrannym-yazykam-na-osnove-igrovyx-texnologij

28. Shcheglova I.A., Koreshnikova Yu.A., Parshina O.A. The role of engagement in the development of critical thinking in undergraduates. Voprosy obrazovanija = Educational Studies Moscow. 2019;1. (In Russ.) Accessed March 15, 2024. https://cyberleninka.ru/article/n/rol-studencheskoy-vovlechennosti-v-razvitii-kriticheskogo-myshleniya?ysclid=lguyf191io710813337

29. Koval E.A., Sychev A.A., Zhadunova N.V., Fomina L.Yu. “To follow the law and conscience”: hard skills and soft skills in the legal education. Integratsiya obrazovaniya = Integration of Education. 2020;2(24). (In Russ.) doi:10.15507/1991-9468.099.024.202002.276-295

30. Anufriyeva T.N. Content analysis of the concept of soft skills. Vestnik Tomskogo gosudarstvennogo pedagogicheskogo universiteta = Tomsk State Pedagogical University Bulletin. 2023;2(226). (In Russ.) doi:10.23951/1609-624X-2023-2-120-132

31. Raitskaya L., Tikhonova E. Skills and competencies in higher education and beyond. Journal of Language and Education. 2019;5(4):4–8. doi:10.17323/jle.2019.10186

32. Rumiantseva O.V. soft skills research in higher education: top 100 Scopus-indexed publications. In tegracija obrazovanija = Integration of Education. 2021;25(4):593–607. (In Russ.) doi:10.15507/1991-9468.105.025.202104.593-607

33. Elkonin D.B. Psihologija igry = Psychology of the Game. 2–3 ed. Moscow: VLADOS Humanitarian Publishing Centre; 1999. 360 p. (In Russ.) Accessed March 15, 2024. https://psychlib.ru/mgppu/EPi-1999/EPI-001.HTM?ysclid=lguxqync6j56649394#$p1

34. Suvorova N.N. The system of students’ creative competences assessment in teaching the stylistics of the Russian language. Nauchno-metodicheskij jelektronnyj zhurnal “Koncept” = Scientific-methodological electronic journal “Koncept”. 2021;11. (In Russ.) Accessed March 15, 2024. https://cyberleninka.ru/article/n/sistema-otsenivaniya-tvorcheskih-kompetentsiy-studentov-pri-prepodavanii-stilistiki-russkogo-yazyka?ysclid=lgfb33cmta162334057

35. Muran O.V. Pragmalinguistic aspect in teaching the course “Stylistics of the Russian language” in a foreign audience. Molodoj uchenyj = Young Scientist. 2019;21(259). (In Russ.) Accessed March 15, 2024. https://moluch.ru/archive/259/59629/

36. Podosinnikova A.A. About the problem of teaching foreign philologist to stylistics of Russian colloguie speech. Izvestija Tul’skogo gosudarstvennogo universiteta. Gumanitarnye nauki = Izves tiya Tula State University. 2012;1(2). (In Russ.) Accessed March 15, 2024. https://cyberleninka.ru/article/n/k-probleme-obucheniya-inostrannyh-studentov-filologov-stilistike-russkoy-razgovornoy-rechi?ysclid=lguxsygujw285443132

37. Krysin L.P. Sociolingvisticheskie aspekty izuchenija sovremennogo russkogo jazyka = Sociolinguistic As pects of the Study of the Modern Russian Language. Moscow: Publishing House Nauka; 1989: 186 p. (In Russ.)

38. Shmeleva E.Ja. “New Russian” as a folklore character. In: Russkij jazyk segodnja: sb. Statej = Russian Language Today: A Collection of Articles. Moscow: Publishing House Azbukovnik; 2003;2:565–575. (In Russ.)

39. Shpilman M.V. Kommunikativnaja strategija “rechevaja maska”: na materiale proizvedenij A. i B. Strugackih = Communicative Strategy “Speech Mask”: Based on the Works of A. and B. Strugatsky. Thesis dissertation. Novosibirsk; 2006. 23 p. (In Russ.) Accessed March 15, 2024. https://www.dissercat.com/content/kommunikativnaya-strategiya-rechevaya-maska-na-materiale-proizvedenii-i-b-strugatskikh?ysclid=lgv1oaja5576648774

40. Karasik V.I. Lingvokul’turnyj tipazh “anglijskij chudak” = Linguocultural Type “English Eccentric”. Moscow: Publishing House Gnozis; 2006. 238 p. (In Russ.)

41. Dubrovskaja E.M., Mandrikova G.M. Types and quasi-types: on the development of the theory of linguistic and cultural types. In: Pushkinskie chtenija – 2020. Hudozhestvennye strategii klassicheskoj i novoj slovesnosti: zhanr, avtor, tekst: Materialy XXV Mezhdunarodnoj nauchnoj konferencii = Pushkin Readings – 2020. Artistic Strategies of Classical and New Literature: Genre, Author, Text. Materials of the XXV International Scientific Conference; June 05–06, 2020; St. Petersburg. St. Petersburg: A.S. Pushkin Leningrad State University; 2020:344–350. (In Russ.)

42. Krylova O.A. Lingvisticheskaja stilistika = Linguistic stylistics. In 2 books. In: Book 1. Teorija = Theory. Moscow: Publishing House Vysshaja shkola; 2006. 319 p. (In Russ.)

43. Sadler D.R. Interpretations of criteria-based assessment and grading in higher education. Assessment & Evaluation in Higher Education. 2005;30(2):175–194. doi:10.1080/0260293042000264262

44. Dixson D.D., Worrell F.C. Formative and summative assessment in the classroom. Theory into Practice. 2016;55(2):153–159. doi:10.1080/00405841.2016.1148989

45. Lok B., McNaught C., Young K. Criterion-referenced and norm-referenced assessments: compatibility and complementarity. Assessment & Evaluation in Higher Education. 2016;41(3):450−465. doi:10.1080/02602938.2015.1022136

46.