International Journal of Academic Research in Business and Social Sciences

search-icon

Artificial Intelligence Hallucination Risk Assessment Using the SOAR Model: How Possible is it?

Open access
The integration of artificial intelligence (AI) into educational practices has become increasingly prevalent, particularly among secondary school students who utilize this technology to access information and complete academic tasks. While artificial intelligence offers considerable advantages in educational contexts, it also introduces potential risks, notably the phenomenon of 'AI hallucinations,' wherein the system generates outputs that appear credible but are, in fact, inaccurate, irrelevant, or entirely fabricated. This phenomenon can undermine students’ digital literacy and critical thinking. This study aims to develop a valid and reliable risk assessment scale for AI hallucinations, based on four key constructs which is factual, contextual, multimodal, and logical hallucinations. The development of this scale is guided by the SOAR Model (Strengths, Opportunities, Aspirations, Results), which emphasizes a strategic, strengths-based, and future-oriented approach. The key findings indicate that the SOAR model effectively demonstrates its potential by identifying individual strengths, challenges, available options, responses, and overall effectiveness within an educational context. The scope was deliberately confined to the SOAR model to encourage constructive engagement with the development of AI hallucination mitigation strategies. It also contributes to the development of a more comprehensive and ethical AI literacy curriculum for stakeholder’s purposes. The implications can benefit educational policy, teacher professional development, and improvements in AI systems. Future research could expand upon this analysis by employing alternative futuristic frameworks to gain broader perspectives and greater analytical depth. The scale is designed not only as a diagnostic tool but also as a foundation for targeted pedagogical interventions. It can be used by teachers and counsellors to identify students at high risk and to plan appropriate intervention programs. Overall, the initiative supports efforts to build a generation of students who are technologically literate, critical thinkers, and capable of using AI responsibly.
Allbee, D., & Marburger, J. (2024). A Case Study of the Impact of Lateral Reading Instruction On A Case Study of the Impact of Lateral Reading Instruction On Students’ Evaluation of Digital Information Students’ Evaluation of Digital Information (pp. 1–44). UNI ScholarWorks Graduate. https://scholarworks.uni.edu/grp/4198
Aziz, R. C., Hamzah, S., Hashim, N. A. A. N., Rahim, M. A., Zulkifli, W. F. W., & Ahmad, G. (2019). S.O.A.R Model?: An Alternative Approach for 21 th Century Education to Shift from “Classroom Management” to “Classroom Leadership.” International Journal of Academic Research in Progressive Education and Development, 8(2), 485–493. https://doi.org/10.6007/IJARPED/v8-i2/6142
Ciubotaru, B. I. (2025). The hallucination problem in Generative Artificial Intelligence: accuracy and trust in digital learning. Proceedings of the International Conference on Virtual Learning, 20, 35–45. https://doi.org/10.58503/icvl-v20y202503
Cole, M. L., Stavros, J. M., Cox, J., & Stavros, A. (2022). Measuring Strengths, Opportunities, Aspirations, and Results: Psychometric Properties of the 12-Item SOAR Scale. Frontiers in Psychology, 13, 1–17. https://doi.org/10.3389/fpsyg.2022.854406
Elsayed, H. (2024). The Impact of Hallucinated Information in Large Language Models on Student Learning Outcomes: A Critical Examination of Misinformation Risks in AI-Assisted Education. Northern Reviews on Algorithmic Research, Theoretical Computation, and Complexity, 9(8), 1–13. https://northernreviews.com/index.php/NRATCC/article/view/2024-08-07
Erümit, A. K., & Sar?alio?lu, R. Ö. (2025). Artificial intelligence in science and chemistry education: a systematic review. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00622-3
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61(3), 460–474. https://doi.org/10.1080/14703297.2023.2195846
Fulsher, A., Pagkratidou, M., & Kendeou, P. (2025). GenAI and misinformation in education: a systematic scoping review of opportunities and challenges. In AI and Society. Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/s00146-025-02536-y
J.W.Creswell, & J.D.Creswell. (2017). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publication.
Kamran, M., Bano, A., & Sohni, K. (2025). Optimising the teaching and learning process for children with special educational needs in an inclusive school?: A SOAR analysis in Karachi , Pakistan. British Journal of Special Education, 52(1), 37–48. https://doi.org/10.1111/1467-8578.12569
Kaur Sidhu, B. (2025). Hallucinations in Artificial Intelligence: Origins, Detection, and Mitigation. International Journal of Science and Research (IJSR), 14(1), 8–15. https://doi.org/10.21275/sr241229170309
Li, L., Fengchao, Y., & Zhang, E. (2024). A systematic review of learning task design for K-12 AI education: Trends, challenges, and opportunities. Computers and Education: Artificial Intelligence, 6. https://doi.org/10.1016/j.caeai.2024.100217
Ministry of Education, M. (MoE). (2023). Dasar Pendidikan Digital (pp. 1–82). Ministry of Education, Malaysia (MoE). https://www.moe.gov.my/dasarmenu/dasar-pendidikan-digital
Ministry of Education, M. (MoE). (2025). Kurikulum Persekolahan 2027 Terkini (pp. 1–14). Ministry of Education, Malaysia (MoE). https://www.moe.gov.my/storage/files/shares/images/KPM/UKK/2023/12_Dis/Kurikulum Persekolahan 2027 Terkini.pdf
Møgelvang, A., & Grassini, S. (2025). Validating the AI attitude scale (AIAS-4) and exploring attitudinal differences in a large sample of Norwegian university students. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00657-6
Muhammad, H., & Hromada, M. (2023). Evaluating an E-Government Stage Model by Using SOAR-AHP Process. Transportation Research Procedia, 74, 1538–1545. https://doi.org/10.1016/j.trpro.2023.11.131
Nica, I., Chiri??, N., & Georgescu, I. (2025). Triple Bottom Line in Sustainable Development: A Comprehensive Bibliometric Analysis. Sustainability (Switzerland), 17(5). https://doi.org/10.3390/su17051932
Omran, F., Ahmed, K., & Al-magarbi, A. O. (2023). Strengthening Libyan Hospitality?: A SOAR Analysis of Digital Marketing Strategies and Practices in the Tourism and Hospitality Sector. Journal of Economics, Management and Trade Volume, 29(12), 144–159. https://doi.org/10.9734/JEMT/2023/v29i121181
Perkins, M., Furze, L., Roe, J., & Macvaugh, J. (2024). The Artificial Intelligence Assessment Scale (AIAS): A Framework for Ethical Integration of Generative AI in Educational Assessment. Journal of University Teaching and Learning Practice, 21(6). https://doi.org/10.53761/q3azde36
Prabu, A., Id, K., Omprakash, A., Kumar, P., Mani, C., Id, M. K., Wael, D., & Sathiyasekaran, B. W. C. (2023). E-learning and E-modules in medical education — A SOAR analysis using perception of undergraduate students. PLoS ONE, 18(5), 1–14. https://doi.org/10.1371/journal.pone.0284882
Putri, A. I., & Pertiwi, V. I. (2025). Analisis SOAR Terhadap Strategi Keterbukaan Informasi Publik Melalui Pejabat Pengelola Informasi Dan Dokumentasi Provinsi Jawa Timur. Jurnal Tata SejutaSTIA MATARAM, 11(1), 87–102.
Sugiarti, W. S., Pujangkoro, S. A., & Sembiring, M. T. (2023). Analisis SOAR (Strength, Opportunity, Aspiration & Result) Sebagai Upaya Peningkatan Penjualan Melalui Digital Market. Jurnal Ilmiah Manajemen Dan Kewirausahaan, 2(2), 25–34.
UNESCO. (2023). Guidance for generative AI in education and research. In Guidance for generative AI in education and research. UNESCO. https://doi.org/10.54675/ewzm9535
UNICEF. (2023). Education 2030 in Malaysia 5-Year National Progress Report on SDG 4. www.unicef.org/malaysia
Yingzhe LI. (2025). Addressing “Hallucinations” in AI-Generated Content: Strategies for Developing Student Fact-Checking and Information Evaluation Skills. Artificial Intelligence Education Studies, 1(2), 48–62. https://doi.org/10.6914/aiese.010204
Zhang, H., Perry, A., & Lee, I. (2025). Developing and Validating the Artificial Intelligence Literacy Concept Inventory: an Instrument to Assess Artificial Intelligence Literacy among Middle School Students. International Journal of Artificial Intelligence in Education, 35(1), 398–438. https://doi.org/10.1007/s40593-024-00398-x
Zhou, J., Zhang, J., Wan, R., Cui, X., Liu, Q., Guo, H., Shi, X., Fu, B., Meng, J., Yue, B., Zhang, Y., & Zhang, Z. (2025). Integrating AI into clinical education: evaluating general practice trainees’ proficiency in distinguishing AI-generated hallucinations and impacting factors. BMC Medical Education, 25(1). https://doi.org/10.1186/s12909-025-06916-2
Manaf, N. A. A., & Matore, M. E. @ E. M. (2025). Artificial Intelligence Hallucination Risk Assessment Using the SOAR Model: How Possible is it? International Journal of Academic Research in Business and Social Sciences, 15(11), 931–942.