International Journal of Academic Research in Progressive Education and Development

search-icon

Determinants of Twenty-First-Century Competency Development in the Age of Artificial Intelligence: The Mediating Role of Student Engagement among Chinese University Students

Open access
The rapid diffusion of artificial intelligence (AI) into higher education has intensified concern over how universities can cultivate the twenty-first-century competencies, namely critical thinking, creativity, collaboration, and communication, that graduates increasingly require. This study examined how five antecedents, namely AI literacy, perceived teacher support, academic self-efficacy, growth mindset, and facilitating conditions, relate to these competencies among Chinese university students, and the extent to which student engagement mediates these relationships. Integrating Social Cognitive Theory, Self-Determination Theory, and the unified theory of acceptance and use of technology within a presage-process-product logic, the study tested sixteen hypotheses using partial least squares structural equation modelling on cross-sectional survey data from 400 undergraduates. The measurement model demonstrated satisfactory reliability and validity, and the structural model explained 49.1% of the variance in student engagement and 58.4% in twenty-first-century competencies. Eleven hypotheses were supported. AI literacy, perceived teacher support, academic self-efficacy, and growth mindset each predicted engagement; engagement predicted competencies; and engagement mediated the effects of all four antecedents, fully mediating perceived teacher support and growth mindset. Facilitating conditions showed no significant association with either engagement or competencies. The findings position student engagement as the common behavioural pathway through which personal and social antecedents are converted into competency, and they suggest that institutional strategy should prioritise the cultivation of AI literacy and supportive teaching over the provision of technological infrastructure alone.
An, F., Xi, L., & Yu, J. (2024). The relationship between technology acceptance and self-regulated learning: The mediation roles of intrinsic motivation and learning engagement. Education and Information Technologies, 29(3), 2605–2623. https://doi.org/10.1007/s10639-023-11959-3
Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Prentice-Hall.
Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman.
Battelle for Kids. (2019). Framework for 21st century learning definitions. Battelle for Kids.
Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185–216. https://doi.org/10.1177/135910457000100301
Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1), 43. https://doi.org/10.1186/s41239-023-00411-8
Chen, G., Gully, S. M., & Eden, D. (2001). Validation of a new general self-efficacy scale. Organizational Research Methods, 4(1), 62–83. https://doi.org/10.1177/109442810141004
Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. Plenum Press.
Dweck, C. S. (1999). Self-theories: Their role in motivation, personality, and development. Psychology Press.
Dweck, C. S., Chiu, C., & Hong, Y. (1995). Implicit theories and their role in judgments and reactions: A world from two perspectives. Psychological Inquiry, 6(4), 267–285. https://doi.org/10.1207/s15327965pli0604_1
Federici, R. A., & Skaalvik, E. M. (2014). Students’ perceptions of emotional and instrumental teacher support: Relations with motivational and emotional responses. International Education Studies, 7(1), 21–36. https://doi.org/10.5539/ies.v7n1p21
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), 6. https://doi.org/10.3390/soc15010006
Gong, W., & Xu, C. (2024). The influence of perceived teacher support on Chinese local college students’ engagement: The mediating roles of academic self-efficacy and learning motivation. SAGE Open, 14(4). https://doi.org/10.1177/21582440241293327
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). Sage.
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2–24. https://doi.org/10.1108/EBR-11-2018-0203
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
Jia, X. H., & Tu, J. C. (2024). Towards a new conceptual model of AI-enhanced learning for university students: The roles of artificial intelligence capability, general self-efficacy, learning motivation, and critical thinking awareness. Systems, 12(3), 74. https://doi.org/10.3390/systems12030074
Kock, N. (2015). Common method bias in PLS-SEM: A full collinearity assessment approach. International Journal of e-Collaboration, 11(4), 1–10. https://doi.org/10.4018/ijec.2015100101
Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30(3), 607–610. https://doi.org/10.1177/001316447003000308
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
Li, S., Kwok, S. W. H., Siu, S. C. N., Chung, J. Y. S., Lam, H. C. Y., Tsang, E. Y. M., Li, K. C., Yeung, J. W. Y., & Lam, S. C. (2023). Development of generic student engagement scale in higher education: An application on healthcare students. Nursing Open, 10(3), 1545–1555. https://doi.org/10.1002/nop2.1405
Lu, K., Zhu, J., Pang, F., & Shadiev, R. (2025). Understanding the relationship between college students’ artificial intelligence literacy and higher-order thinking skills using the 3P model: The mediating roles of behavioural engagement and peer interaction. Educational Technology Research and Development, 73(2), 693–716. https://doi.org/10.1007/s11423-024-10434-1
Ma, S. A., & Chen, Z. Z. (2024). The development and validation of the Artificial Intelligence Literacy Scale for Chinese College Students (AILS-CCS). IEEE Access, 12, 146419–146429. https://doi.org/10.1109/ACCESS.2024.3468378
Macnamara, B. N., & Burgoyne, A. P. (2023). Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices. Psychological Bulletin, 149(3–4), 133–173. https://doi.org/10.1037/bul0000352
Ministry of Education of the People’s Republic of China. (2018). Artificial intelligence innovation action plan for institutions of higher education. Ministry of Education of the People’s Republic of China.
Ministry of Education of the People’s Republic of China. (2024). Statistical bulletin on national education development 2024. Ministry of Education of the People’s Republic of China.
Nitzl, C., Roldán, J. L., & Cepeda, G. (2016). Mediation analysis in partial least squares path modeling: Helping researchers discuss more sophisticated models. Industrial Management & Data Systems, 116(9), 1849–1864. https://doi.org/10.1108/IMDS-07-2015-0302
Panthumas, S., Zaw, K., & Kittipichai, W. (2024). Validation of the 21st Century Skills Assessment Scale for public health students in Thailand: A methodological study. Journal of Educational Evaluation for Health Professions, 21, 37. https://doi.org/10.3352/jeehp.2024.21.37
Peng, C., Zhang, Z., Zhang, Z., Zhang, J., Zhang, Z., Liu, Y., Jia, R., & Xu, X. (2026). AI literacy and creativity among university students: The mediating role of learning engagement. Frontiers in Psychology, 16, 1567049. https://doi.org/10.3389/fpsyg.2025.1567049
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879
Romero, M. (2026). Evaluating the evolution of critical thinking, creativity, communication and collaboration through generative AI integration in higher education. Creative Education, 17(1), 1–18. https://doi.org/10.4236/ce.2026.171001
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68
Ryan, R. M., & Deci, E. L. (2020). Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 61, 101860. https://doi.org/10.1016/j.cedpsych.2020.101860
Shahzad, M. F., Xu, S., & Zahid, H. (2024). Exploring the impact of generative AI-based technologies on learning performance through self-efficacy, fairness and ethics, creativity, and trust in higher education. Education and Information Technologies, 30(3), 3691–3716. https://doi.org/10.1007/s10639-024-12949-9
Sisk, V. F., Burgoyne, A. P., Sun, J., Butler, J. L., & Macnamara, B. N. (2018). To what extent and under which circumstances are growth mind-sets important to academic achievement? Two meta-analyses. Psychological Science, 29(4), 549–571. https://doi.org/10.1177/0956797617739704
State Council of the People’s Republic of China. (2017). New generation artificial intelligence development plan (Guo Fa [2017] No. 35). State Council of the People’s Republic of China.
Tao, Y., Meng, Y., Gao, Z., & Yang, X. (2022). Perceived teacher support, student engagement, and academic achievement: A meta-analysis. Educational Psychology, 42(4), 401–420. https://doi.org/10.1080/01443410.2022.2033168
Thornhill-Miller, B., Camarda, A., Mercier, M., Burkhardt, J.-M., Morisseau, T., Bourgeois-Bougrine, S., Vinchon, F., El Hayek, S., Augereau-Landais, M., Mourey, F., Feybesse, C., Sundquist, D., & Lubart, T. (2023). Creativity, critical thinking, communication, and collaboration: Assessment, certification, and promotion of 21st century skills for the future of work and education. Journal of Intelligence, 11(3), 54. https://doi.org/10.3390/jintelligence11030054
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology. MIS Quarterly, 36(1), 157–178. https://doi.org/10.2307/41410412
Wang, B., Rau, P. L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour & Information Technology, 42(9), 1324–1337. https://doi.org/10.1080/0144929X.2022.2072768
Wang, S., Sun, Z., & Chen, Y. (2023). Effects of higher education institutes’ artificial intelligence capability on students’ self-efficacy, creativity and learning performance. Education and Information Technologies, 28(5), 4919–4939. https://doi.org/10.1007/s10639-022-11338-4
Wang, Y., & Zhang, W. (2024). The relationship between college students’ learning engagement and academic self-efficacy: A moderated mediation model. Frontiers in Psychology, 15, 1425172. https://doi.org/10.3389/fpsyg.2024.1425172
World Economic Forum. (2025). The future of jobs report 2025. World Economic Forum.
Yang, Y., & Peters, M. A. (2026). China’s 2025 White Paper on Smart Education: Governance logic, policy design, and international relevance. International Journal of Chinese Education, 15(1). https://doi.org/10.1177/2212585X251413788
Yeager, D. S., & Dweck, C. S. (2020). What can be learned from growth mindset controversies? American Psychologist, 75(9), 1269–1284. https://doi.org/10.1037/amp0000794
Zhao, X., Lynch, J. G., & Chen, Q. (2010). Reconsidering Baron and Kenny: Myths and truths about mediation analysis. Journal of Consumer Research, 37(2), 197–206. https://doi.org/10.1086/651257
Nanqiao, L., Alias, A., & Jamaludin, K. A. (2026). Determinants of Twenty-First-Century Competency Development in the Age of Artificial Intelligence: The Mediating Role of Student Engagement among Chinese University Students. International Journal of Academic Research in Progressive Education and Development, 15(3), 849-865.