International Journal of Academic Research in Business and Social Sciences

search-icon

Evaluating the Impact of Chatgpt on Academic Performance and Technology Acceptance: A Quasi-Experimental Study in Malaysian Chinese Independent School History Education

Open access
This study investigates the technology acceptance of ChatGPT and its impact on academic performance in history studies among Malaysian Chinese Independent School students. Using the Technology Acceptance Model (TAM) as the theoretical framework, the research examines three objectives: (i) analyzing students' technology acceptance of ChatGPT, (ii) identifying the academic performance of students using ChatGPT compared to who do not use, and (iii) exploring the relationship between students’ acceptance of ChatGPT and their academic performance. A quasi-experimental design was used in the mixed quantitative methodology, descriptive statistics, t-tests, and correlation analysis were used to analyze the findings. With a mean acceptance score much higher than 3, the results show that students showed a great degree of acceptability towards ChatGPT. Furthermore, students who utilized ChatGPT outperformed those who did not in subjective history questions, demonstrating the value of incorporating AI into the classroom. However, there was no statistically significant association found between students' academic achievement and their acceptance of ChatGPT, suggesting that desire, study habits, and prior knowledge may operate as mediating elements in this relationship. It emphasizes the necessity of more research to tackle these issues, investigate ChatGPT's long-term effects on education, and maximize its use to improve academic achievement.
Alharbi, S., & Drew, S. (2014). Using the TAM in Understanding Academics’ Behavioral Intention to Use Learning Management Systems.pdf. International Journal of Advanced Computer Science and Applications, 5(1), 143–155.
Alismaiel, O. A., Cifuentes-Faura, J., & Al-Rahmi, W. M. (2022, April). Social Media Technologies Used for Education: An Empirical Study on TAM Model during the COVID-19 Pandemic. In Frontiers in Education (Vol. 7). Frontiers Media SA
Al-Kfairy, M. (2024). Factors Impacting the adoption and acceptance of CHATGPT in educational settings: A narrative review of empirical studies. Applied System Innovation, 7(6), 110. https://doi.org/10.3390/asi7060110
Alqahtani, T., Badreldin, H.I. et al. Albekairy, A. M. (2023). The emergent role of artificial intelligence, natural learning processing, and large language models in higher education and research, Research in Social and Administrative Pharmacy 19 (2023), pp.1236–1242, https://doi.org/10.1016/j.sapharm.2023.05.016
Anggraini, M. P., Cahyono, B. Y., Anugerahwati, M., & Ivone, F. M. (2022, February). Correlation patterns among online reading, offline reading, metacognitive reading strategy awareness, and General English proficiency. 67th TEFLIN International Virtual Conference & the 9th ICOELT 2021 (TEFLIN ICOELT 2021) (pp. 170–175). Atlantis Press. https://doi.org/10.2991/assehr.k.220201.030
Awang, M. M., Ahmad, A. R., Yakub, N. M., & Seman, A. A. (2016). Historical Thinking Skills among Pre-Service Teachers in Indonesia and Malaysia. Creative Education, 07(01), 62–76. https://doi.org/10.4236/ce.2016.71007
Azwan, A., Abdul Ghani, A., Mohammad, Z., & Abd. Rahman Abd. Aziz. (2005). Kesan Efikasi Kendiri Guru Sejarah Terhadap Amalan Pengajaran Berbantukan Teknologi Maklumat dan Komunikasi (ICT). Jurnal Penyelidikan Pendidikan, 7, 15–24.
Benjamin, R. et al. (2013). The Case for Critical-Thinking Skills and Performance Assessment. USA: Council for Aid to Education
Binti, S., Awang, M. M., & Ahmad, A. (2019). Implementation of Historical Thinking Skill Among Malaysian Students using History Textbook: Concept, Issues and Challenges. https://doi.org/10.32698/gcs.0197
Black, E. R. (2017, December 1). Learning then and there: An exploration of virtual reality in K-12 history education. http://hdl.handle.net/2152/63616
Brooks, S. (2013). Teaching for Historical Understanding in the Advanced Placement Program: A Case Study. The History Teacher, 47, 61-77.
Buhl, H. U., & Winter, R. (2008). Full Virtualization – BISE’s Contribution to a Vision. Business & Information Systems Engineering, 1(2), 133–136. https://doi.org/10.1007/s12599-008-0023-2
Fayrah. (2023, November 14). To Educate Students about AI, Make Them Use It. Cientificamerican. Retrieved January 16, 2024, from https://www.scientificamerican.com/article/to-educate-students-about-ai-make-them-use-it/
Carretero, M., Cantabrana, M., & Parellada, C. (2022). History Education in the Digital Age. In Springer eBooks. https://doi.org/10.1007/978-3-031-10743-6
Cengiz, O. (2015). Social studies teacher candidates views on historical thinking skills. Educational Research and Reviews, 10(14), 2031–2042. https://doi.org/10.5897/err2015.2294
Challenor, J., & Ma, M. (2019). A Review of Augmented Reality Applications for History Education and Heritage Visualisation. Multimodal Technologies and Interaction, 3(2), 39. https://doi.org/10.3390/mti3020039
Chee-Huay, C., & Kee-Jiar, Y. (2015). Why Students Fail in History: A Minor Case Study in Malaysia and Solutions from Cognitive Psychology Perspective. Mediterranean Journal of Social Sciences. https://doi.org/10.5901/mjss.2016.v7n1p517
Claus, P., & Marriott, J. (2017). History: An Introduction to Theory, Method and Practice. http://ci.nii.ac.jp/ncid/BB19317477
Darwin, Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki. (2023). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2023.2290342
Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Management Science, 35(8), 982–1003. https://doi.org/10.1287/mnsc.35.8.982
Deng, J., & Lin, Y. (2023). The Benefits and Challenges of ChatGPT: An Overview. Frontiers in Computing and Intelligent Systems, 2(2), 81–83. https://doi.org/10.54097/fcis.v2i2.4465
Dk. (2023). Simply artificial intelligence. Dorling Kindersley Ltd.
Duman, M. Ç., & Akdemir, B. (2021). A study to determine the effects of industry 4.0 technology components on organizational performance. Technological Forecasting and Social Change, 167(6), 1–14. https://doi.org/10.1016/j.techfore.2021.120615
Emmert-Streib, F., Yli-Harja, O., & Dehmer, M. (2020). Artificial Intelligence: A Clarification of Misconceptions, Myths and Desired Status. Frontiers in Artificial Intelligence, 3. https://doi.org/10.3389/frai.2020.524339
Fischer, I., Sweeney, S., Lucas, M., & Gupta, N. (2024). Making sense of generative AI for assessments: Contrasting student claims and assessor evaluations. The International Journal of Management Education, 22(3), 101081. https://doi.org/10.1016/j.ijme.2024.101081
Garcia, A., Seglem, R., & Share, J. (2013). Transforming Teaching and Learning Through Critical Media Literacy Pedagogy. LEARNing Landscapes, 6(2), 109–124. https://doi.org/10.36510/learnland.v6i2.608
Gbadegeshin, S. A., Natsheh, A. A., Ghafel, K., Tikkanen, J., Gray, A., Rimpiläinen, A., Kuoppala, A., Kalermo-Poranen, J., & Hirvonen, N. (2021). WHAT IS AN ARTIFICIAL INTELLIGENCE (AI): A SIMPLE BUZZWORD OR A WORTHWHILE INEVITABILITY? ICERI Proceedings, 1, 468–479. https://doi.org/10.21125/iceri.2021.0171
Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275–285. https://doi.org/10.1016/j.susoc.2022.05.004
Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2020). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. Journal of Computers in Education, 8(1), 1–32. https://doi.org/10.1007/s40692-020-00169-2
House, W. (2024, October 24). Memorandum on advancing the United States’ leadership in Artificial intelligence; harnessing artificial intelligence to fulfill national security objectives; and fostering the safety, security, and trustworthiness of artificial intelligence. The White House. https://www.whitehouse.gov/briefing-room/presidential-actions/2024/10/24/memorandum-on-advancing-the-united-states-leadership-in-artificial-intelligence-harnessing-artificial-intelligence-to-fulfill-national-security-objectives-and-fostering-the-safety-security/
Kementerian Pendidikan Malaysia. (2022). Laporan Analisis Keputusan Peperiksaan SPM Tahun 2022.
Kindenberg, B. (2024). ChatGPT-Generated and Student-Written Historical Narratives: A Comparative Analysis. Education Sciences, 14(5), 530. https://doi.org/10.3390/educsci14050530
King, W. L., Awang, M. M., Ahmad, A. R., & Dahalan, S. C. (2019b). The Potentials of Using Digital Primary Sources in History Classroom. Sustainable Development and Societal Wellbeing in the Current Technological Era, 47–52. https://doi.org/10.32698/gcs.0169
Korteling, J. E., Van De Boer-Visschedijk, G. C., Blankendaal, R. a. M., Boonekamp, R. C., & Eikelboom, A. R. (2021). Human- versus Artificial Intelligence. Frontiers in Artificial Intelligence, 4. https://doi.org/10.3389/frai.2021.622364
Kreps, S., McCain, R., & Brundage, M. (2020). All the news that’s fit to fabricate: AI-Generated text as a tool of media misinformation. Journal of Experimental Political Science, 9(1), 104–117. https://doi.org/10.1017/XPS.2020.37
Laskowski, N., & Tucci, L. (2023, November 13). artificial intelligence (AI). Enterprise AI. https://www.techtarget.com/searchenterpriseai/definition/AI-Artificial-Intelligence
Lercari, N. (2015). Simulating History in Virtual Worlds. In Progress in IS (pp. 337–352). https://doi.org/10.1007/978-3-319-22041-3_13
Limna, P., Kraiwanit, T., & Jangjarat, K. (2023). Adopting the Technology Acceptance Model (TAM) to Explore Online Purchase Intention via Facebook Live Streaming: Empirical Evidence from Bangkok, Thailand. ASEAN Journal of Management & Innovation, 10(1), 1-13. https://ajmi.stamford.edu/index.php/ajmi/article/view/385.
Ling Weay, A., Masood, M. & Abdullah, S. (2016). Analysing the relationship of sequential and global learning styles on students’ historical thinking and understanding: A case study on Form Four secondary schools students in Malaysia. International Journal of Assessment and Evaluation in Education, 6. 65-73.
Ma, G. (2023). Chance or Challenge: The Role of ChatGPT in History Teaching and Historical Research in Higher Education. In Atlantis Highlights in Computer Sciences/Atlantis highlights in computer sciences (pp. 869–874). https://doi.org/10.2991/978-94-6463-264-4_101
Malaysia Education Blueprint 2013-2025 (Preschool to Post-Secondary Education). Kementerian Pendidikan Malaysia. Retrieved from http://jpwpkl.moe.gov.my/download/phocadownload/sektor/spm/upm/malaysiaeducat ionblueprint.pdf
Meyer, A. (2019). Artificial intelligence technology enhances educational experience. The Campanile. https://thecampanile.org/19297/science-tech/artificial-intelligence-technology-enhances-educational-experience/
Ministry of Education. (2013). Malaysia Education Blueprint 2013 - 2025. In Executive Summary.
Nguyen, X. H., Nguyen, H. A., Cao, L., & hana, T. (2023, August 3). ChatGPT’s Understanding of History A Comparison to Vietnamese Students and its Potential in History Education. https://doi.org/10.35542/osf.io/8z9tj
Nicola, C. B., & Dalessio, D.(2019).Artificial Intelligence and the Impact on Business Curricula. Academy of Business Research Journal; Gulfport Vol.3,(2019):30-53.
Obeidat, H. H., Abdelrahman, M. S. B., Ateyat, K., & Al-Arood, M. (2011). The effect of students’ reluctance of studying history on their level of historical culture. Asian Social Science, 7(2). https://doi.org/10.5539/ass.v7n2p119
Ofianto, Aman, Ningsih, T. Z., & Abidin, N. F. (2022). The development of historical thinking assessment to examine students’ skills in analyzing the causality of historical events. European Journal of Educational Research, 11(2), 609-619. https://doi.org/10.12973/eu-jer.11.2.609
Ofianto, T. Z. N. (2021). Development of Students’ Historical Thinking Skills Through the Project-Based Learning Model. International Journal of Academic Research in Progressive Education and Development, 10(2), 615–624.
PISA 2022 Results (Malaysia). (2023, December 5). In OECD. OECD. Retrieved January 16, 2024, from https://www.oecd.org/publication/pisa-2022-results/webbooks/dynamic/pisa-country-notes/1dbe2061/pdf/malaysia.pdf
Prastiawan, D. I., Aisjah, S., & Rofiaty, R. (2021). The Effect of Perceived Usefulness, Perceived Ease of Use, and Social Influence on the Use of Mobile Banking Through the Mediation of Attitude Toward Use. Asia Pacific Management and Business Application,9(3), 243-260. https://apmba.ub.ac.id/index.php/apmba/article/view/420.
Pratama, R. A., Pratiwi, I. M., Saputra, M. A., & Sumargono, S. (2022, March 1). Integration of STEM education in history learning. International Journal of Evaluation and Research in Education (IJERE), 11(1), 313. https://doi.org/10.11591/ijere.v11i1.22064
Raghaw, M., Paulose, J., & Goswami, B. (2018b). Augmented reality for history education. International Journal of Engineering & Technology, 7(2.6), 121. https://doi.org/10.14419/ijet.v7i2.6.10136
Raharjana, I. K., Siahaan, D., & Fatichah, C. (2021). User stories and natural language processing: A systematic literature review. Institute of Electrical and Electronics Engineers Access, 9(1), 53811–53826. https://doi.org/10.1109/access.2021.3070606
Rashidi, Q. N. M. (2024, April 04). “AI education in schools needs a cautious approach.” thesun.my. https://thesun.my/malaysia-news/ai-education-in-schools-needs-cautious-approach-LI12297639
Research Guides: Using the Library of Congress Online: A Guide for Middle and High School Students: Types of Sources. (n.d.). https://guides.loc.gov/student-resources/types
Rohlf, G. (2015). How to Make Field Trips Fun, Educational, and Memorable: Balancing Self-Directed Inquiry with Structured Learning. The History Teacher, 48, 517-528.
Rouse, M. (2019). What is AI (artificial intelligence)? - Definition from WhatIs.com. [online] Search Enterprise AI. Available at: https:// searc hente rpris eai. techt arget. com/ defin ition/ AI- Artificial- Intelligence.
Shaengchart, Y. (2023) A Conceptual Review of TAM and ChatGPT Usage Intentions Among Higher Education Students (September 2023). Advance Knowledge for Executives, 2(3), https://ssrn.com/abstract=4581231
Shao, C. (2020). An Empirical Study on the Identification of Driving Factors of Satisfaction with Online Learning based on TAM. In 5th International Conference on Economics, Management, Law and Education (EMLE 2019) (pp. 1067-1073). Atlantis Press.
Sitthipon, T., Siripipatthanakul, S., Phayaphrom, B., Siripipattanakul, S., & Limna, P. (2022).Determinants of Customers’ Intention to Use Healthcare Chatbots and Apps in Bangkok, Thailand. International Journal of Behavioral Analytics,2(2), 1-15.
Slamet, J. (2024). Potential of ChatGPT as a digital language learning assistant: EFL teachers’ and students’ perceptions. Discover Artificial Intelligence, 4(1). https://doi.org/10.1007/s44163-024-00143-2
Sok, S., & Heng, K. (2023). ChatGPT for Education and Research: A Review of Benefits and Risks. SSRN Electronic Journal. DOI:10.2139/ssrn.4378735.
Talin, R. (2016). Why Historical Thinking Skills was not there. International Journal of Learning Teaching and Educational Research, 15(3). http://eprints.ums.edu.my/15178/
Tanvir, K., Islam, M. S., Sezan, S. B. K., Sanad, Z. A., & Ataur, A. I. (2023). Impact of ChatGPT on Academic Performance among Bangladeshi Undergraduate Students. Deleted Journal, 35, 18–28. https://doi.org/10.55529/ijrise.35.18.28
Tirado-Olivares, S., López-Fernández, C., González-Calero, J. A., & Cózar-Gutiérrez, R. (2024). Enhancing historical thinking through learning analytics in Primary Education: A bridge to formative assessment. Education and Information Technologies. https://doi.org/10.1007/s10639-023-12425-w
TUCKER, L. G. (2024). APPLICATIONS OF AI IN PRIMARY AND SECONDARY EDUCATION (By C. ANGULO BAHON, A. HERNANDEZ FERNANDEZ, & Sarah Bettis) [Thesis]. https://upcommons.upc.edu/bitstream/handle/2117/413223/183431.pdf?sequence=2
Department of Education. (2023). Office of Educational Technology, Artificial Intelligence and Future of Teaching and Learning: Insights and Recommendations, Washington, DC.
Wardana, A. A., Saputro, E. P., Wahyuddin, M., & Abas, N. I. (2022). The Effect of Convenience, Perceived Ease of Use, and Perceived Usefulness on Intention to Use E-Wallet. In International Conference on Economics and Business Studies (ICOEBS2022) (pp. 386-395). Atlantis Press. https://doi.org/10.2991/aebmr.k.220602.051.
Waring, S. M. (2011). Preserving History: The Construction of History in the K-16 Classroom. https://eric.ed.gov/?id=ED529591\
Waring, S. M., & Torrez, C. a. F. (2010). Using Digital Primary Sources to Teach Historical Perspective to Preservice Teachers. Contemporary Issues in Technology and Teacher Education, 10(3), 294–308. https://www.learntechlib.org/p/29480/article_29480.pdf
What is AI (artificial intelligence)? (2024, April 3). McKinsey & Company. https://www.mckinsey.com/featured-insights/mckinsey-explainers/what-is-ai
Xu, J. J., & Babaian, T. (2021). Artificial intelligence in business curriculum: The pedagogy and learning outcomes. The International Journal of Management Education, 19(3), 100550. https://doi.org/10.1016/j.ijme.2021.100550
Youssef, E., Medhat, M., Abdellatif, S., & Malek, M. A. (2024). Examining the effect of ChatGPT usage on students’ academic learning and achievement: a survey-based study in Ajman, UAE. Computers and Education Artificial Intelligence, 7, 100316. https://doi.org/10.1016/j.caeai.2024.100316
Zogheib, S., & Zogheib, B. (2024). Understanding University Students’ Adoption of ChatGPT: Insights from TAM, SDT, and Beyond. Journal of Information Technology Education Research, 23, 025. https://doi.org/10.28945/5377
De, C. Y., & Yee, C. P. (2025). Evaluating the Impact of Chatgpt on Academic Performance and Technology Acceptance: A Quasi-Experimental Study in Malaysian Chinese Independent School History Education. International Journal of Academic Research in Business and Social Sciences, 15(8), 1060-1081.