Measuring sustainable use of artificial intelligence in higher education: A novel explainable AI model
Abstract
The rapid use of artificial intelligence (AI) in higher education offers opportunities for improved learning and operational efficiency, but raise questions about how its use can be sustained and its impacts assessed. Unchecked AI deployment can create ethical, equity and quality challenges. It is posited a new explainable AI (XAI) derived measurement model to examine sustainable use of AI in higher education. We developed a multifaceted measure to evaluate AI use, in terms of institutional support, user attitudes, ethical practices, educational outcomes and environmental issues. A combined sustainability artificial intelligence (SAUI) utilization index was developed through Analytic Hierarchy Process (AHP) weighting and statistical validation. Then, we constructed a machine learning model (XGBoost model) to infer the SAUI with SHapley Additive exPlanations (SHAP) for interpretable predictions. Factor analysis, structural equation modelling, clustering and predictive modelling were implemented. The study results show that faculty training and positive attitude toward AI have a more powerful contribution in influencing sustainable use of AI, compared to institutional facilitating conditions. Ethical and risk considerations were of moderate importance, whereas demographics had no predictive power. The explainability factor is especially important to stakeholders wanting actionable insights in education. Future research should include broader applications for this framework in other areas, and incorporate longitudinal data for analysis, in support of sustainability over time, supported in the knowledge that the presence of AI in academia promotes positively to sustainability goals.
Full text article
References
[1] Chen L, Chen P, Lin Z. Artificial intelligence in education: A review. IEEE access. 2020 Apr 17;8:75264-78. https://doi.org/10.1109/ACCESS.2020.2988510
[2] Yang W. Artificial Intelligence education for young children: Why, what, and how in curriculum design and implementation. Comput. Educ. Artif. Intell.. 2022 Jan 1;3:100061. https://doi.org/10.1016/j.caeai.2022.100061
[3] Charow R, Jeyakumar T, Younus S, Dolatabadi E, Salhia M, Al-Mouaswas D, Anderson M, Balakumar S, Clare M, Dhalla A, Gillan C. Artificial intelligence education programs for health care professionals: scoping review. JMIR Medical Education. 2021 Dec 13;7(4):e31043. https://doi.org/10.2196/31043
[4] Sijing L, Lan W. Artificial intelligence education ethical problems and solutions. In2018 13th International Conference on Computer Science & Education (ICCSE) 2018 Aug 8 (pp. 1-5). IEEE. https://doi.org/10.1109/ICCSE.2018.8468773
[5] Wong GK, Ma X, Dillenbourg P, Huan J. Broadening artificial intelligence education in K-12: Where to start?. ACM inroads. 2020 Feb 13;11(1):20-9. https://doi.org/10.1145/3381884
[6] Polak S, Schiavo G, Zancanaro M. Teachers' perspective on artificial intelligence education: An initial investigation. InCHI conference on human factors in computing systems extended abstracts 2022 Apr 27 (pp. 1-7). https://doi.org/10.1145/3491101.3519866
[7] Sanusi IT, Olaleye SA, Agbo FJ, Chiu TK. The role of learners' competencies in artificial intelligence education. Computers and Education: Artificial Intelligence. 2022 Jan 1;3:100098. https://doi.org/10.1016/j.caeai.2022.100098
[8] Sapci AH, Sapci HA. Artificial intelligence education and tools for medical and health informatics students: systematic review. JMIR Medical Education. 2020 Jun 30;6(1):e19285. https://doi.org/10.2196/19285
[9] Park W, Kwon H. Implementing artificial intelligence education for middle school technology education in Republic of Korea. International journal of technology and design education. 2024 Mar;34(1):109-35. https://doi.org/10.1007/s10798-023-09812-2
[10] Sanusi IT, Olaleye SA, Oyelere SS, Dixon RA. Investigating learners' competencies for artificial intelligence education in an African K-12 setting. Computers and Education Open. 2022 Dec 1;3:100083. https://doi.org/10.1016/j.caeo.2022.100083
[11] Huang X. Aims for cultivating students' key competencies based on artificial intelligence education in China. Education and Information Technologies. 2021 Sep;26(5):5127-47. https://doi.org/10.1007/s10639-021-10530-2
[12] Yue M, Jong MS, Dai Y. Pedagogical design of K-12 artificial intelligence education: A systematic review. Sustainability. 2022 Nov 24;14(23):15620. https://doi.org/10.3390/su142315620
[13] Chiu TK, Chai CS. Sustainable curriculum planning for artificial intelligence education: A self-determination theory perspective. Sustainability. 2020 Jul 10;12(14):5568. https://doi.org/10.3390/su12145568
[14] Gofman M, Jin Z. Artificial intelligence, education, and entrepreneurship. The Journal of Finance. 2024 Feb;79(1):631-67. https://doi.org/10.1111/jofi.13302
[15] Roll I, Wylie R. Evolution and revolution in artificial intelligence in education. International journal of artificial intelligence in education. 2016 Jun;26(2):582-99. https://doi.org/10.1007/s40593-016-0110-3
[16] Tedre M, Toivonen T, Kahila J, Vartiainen H, Valtonen T, Jormanainen I, Pears A. Teaching machine learning in K-12 classroom: Pedagogical and technological trajectories for artificial intelligence education. IEEE access. 2021 Jul 19;9:110558-72. https://doi.org/10.1109/ACCESS.2021.3097962
[17] Li H, Wang H. Research on the application of artificial intelligence in education. In2020 15th international conference on Computer Science & Education (ICCSE) 2020 Aug 18 (pp. 589-591). IEEE. https://doi.org/10.1109/ICCSE49874.2020.9201743
[18] Zhan Z, Tong Y, Lan X, Zhong B. A systematic literature review of game-based learning in Artificial Intelligence education. Interactive learning environments. 2024 Mar 15;32(3):1137-58. https://doi.org/10.1080/10494820.2022.2115077
[19] Ouyang F, Jiao P. Artificial intelligence in education: The three paradigms. Computers and Education: Artificial Intelligence. 2021 Jan 1;2:100020. https://doi.org/10.1016/j.caeai.2021.100020
[20] Huang X, Qiao C. Enhancing computational thinking skills through artificial intelligence education at a STEAM high school. Science & Education. 2024 Apr;33(2):383-403. https://doi.org/10.1007/s11191-022-00392-6
[21] Qu J, Zhao Y, Xie Y. Artificial intelligence leads the reform of education models. Systems Research and Behavioral Science. 2022 May;39(3):581-8. https://doi.org/10.1002/sres.2864
[22] Chen X, Zou D, Xie H, Cheng G, Liu C. Two decades of artificial intelligence in education. Educational Technology & Society. 2022 Jan 1;25(1):28-47.
[23] Gocen A, Aydemir F. Artificial intelligence in education and schools. Research on Education and Media. 2020;12(1):13-21. https://doi.org/10.2478/rem-2020-0003
[24] Yufeia L, Salehb S, Jiahuic H, Syed SM. Review of the application of artificial intelligence in education. Integration (Amsterdam). 2020;12(8):1-5. https://doi.org/10.53333/IJICC2013/12850
[25] Eaton E, Koenig S, Schulz C, Maurelli F, Lee J, Eckroth J, Crowley M, Freedman RG, Cardona-Rivera RE, Machado T, Williams T. Blue sky ideas in artificial intelligence education from the EAAI 2017 new and future AI educator program. AI Matters. 2018 Feb 16;3(4):23-31. https://doi.org/10.1145/3175502.3175509
[26] Lampou R. The integration of artificial intelligence in education: Opportunities and challenges. Review of Artificial Intelligence in Education. 2023 Aug 18;4:e15-. https://doi.org/10.37497/rev.artif.intell.educ.v4i00.15
[27] Devedžić V. Web intelligence and artificial intelligence in education. Journal of Educational Technology & Society. 2004 Oct 1;7(4):29-39.
[28] Chassignol M, Khoroshavin A, Klimova A, Bilyatdinova A. Artificial Intelligence trends in education: a narrative overview. Procedia computer science. 2018 Jan 1;136:16-24. https://doi.org/10.1016/j.procs.2018.08.233
[29] Pham ST, Sampson PM. The development of artificial intelligence in education: A review in context. Journal of Computer Assisted Learning. 2022 Oct;38(5):1408-21. https://doi.org/10.1111/jcal.12687
[30] Yoon DM, Kim KJ. Challenges and opportunities in game artificial intelligence education using angry birds. Ieee Access. 2015 Jun 22;3:793-804. https://doi.org/10.1109/ACCESS.2015.2442680
[31] Yue M, Jong MS, Ng DT. Understanding K-12 teachers' technological pedagogical content knowledge readiness and attitudes toward artificial intelligence education. Education and information technologies. 2024 Oct;29(15):19505-36. https://doi.org/10.1007/s10639-024-12621-2
[32] Huang J, Saleh S, Liu Y. A review on artificial intelligence in education. Academic Journal of Interdisciplinary Studies. 2021 May;10(3). https://doi.org/10.36941/ajis-2021-0077
[33] Zhai X, Chu X, Chai CS, Jong MS, Istenic A, Spector M, Liu JB, Yuan J, Li Y. A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity. 2021;2021(1):8812542. https://doi.org/10.1155/2021/8812542
[34] Hwang GJ, Xie H, Wah BW, Gašević D. Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence. 2020 Jan 1;1:100001. https://doi.org/10.1016/j.caeai.2020.100001
[35] van de Venter R, Skelton E, Matthew J, Woznitza N, Tarroni G, Hirani SP, Kumar A, Malik R, Malamateniou C. Artificial intelligence education for radiographers, an evaluation of a UK postgraduate educational intervention using participatory action research: a pilot study. Insights into imaging. 2023 Feb 3;14(1):25. https://doi.org/10.1186/s13244-023-01372-2
[36] Baker MJ. The roles of models in Artificial Intelligence and Education research: a prospective view. Journal of Artificial Intelligence and Education. 2000;11:122-43.
[37] Lameras P, Arnab S. Power to the teachers: an exploratory review on artificial intelligence in education. Information. 2021 Dec 29;13(1):14. https://doi.org/10.3390/info13010014
[38] Goksel N, Bozkurt A. Artificial intelligence in education: Current insights and future perspectives. InHandbook of Research on Learning in the Age of Transhumanism 2019 (pp. 224-236). IGI Global. https://doi.org/10.4018/978-1-5225-8431-5.ch014
[39] Cantú-Ortiz FJ, Galeano Sánchez N, Garrido L, Terashima-Marin H, Brena RF. An artificial intelligence educational strategy for the digital transformation. International Journal on Interactive Design and Manufacturing (IJIDeM). 2020 Dec;14(4):1195-209. https://doi.org/10.1007/s12008-020-00702-8
[40] Giannakos M, Voulgari I, Papavlasopoulou S, Papamitsiou Z, Yannakakis G. Games for artificial intelligence and machine learning education: Review and perspectives. Non-formal and informal science learning in the ICT era. 2020:117-33. https://doi.org/10.1007/978-981-15-6747-6_7
[41] Zawacki-Richter O, Marín VI, Bond M, Gouverneur F. Systematic review of research on artificial intelligence applications in higher education-where are the educators?. International journal of educational technology in higher education. 2019 Dec;16(1):1-27. https://doi.org/10.1186/s41239-019-0171-0
[42] Alam A. Possibilities and apprehensions in the landscape of artificial intelligence in education. In2021 International conference on computational intelligence and computing applications (ICCICA) 2021 Nov 26 (pp. 1-8). IEEE. https://doi.org/10.1109/ICCICA52458.2021.9697272
[43] Yang D, Oh ES, Wang Y. Hybrid physical education teaching and curriculum design based on a voice interactive artificial intelligence educational robot. Sustainability. 2020 Sep 27;12(19):8000. https://doi.org/10.3390/su12198000
[44] Kamalov F, Santandreu Calonge D, Gurrib I. New era of artificial intelligence in education: Towards a sustainable multifaceted revolution. Sustainability. 2023 Aug 16;15(16):12451. https://doi.org/10.3390/su151612451
[45] Al Braiki B, Harous S, Zaki N, Alnajjar F. Artificial intelligence in education and assessment methods. Bulletin of Electrical Engineering and Informatics. 2020 Oct 1;9(5):1998-2007. https://doi.org/10.11591/eei.v9i5.1984
[46] Khosravi H, Shum SB, Chen G, Conati C, Tsai YS, Kay J, Knight S, Martinez-Maldonado R, Sadiq S, Gašević D. Explainable artificial intelligence in education. Computers and education: artificial intelligence. 2022 Jan 1;3:100074. https://doi.org/10.1016/j.caeai.2022.100074
[47] Hamal O, El Faddouli NE, Harouni MH, Lu J. Artificial intelligent in education. Sustainability. 2022 Mar 1;14(5):2862. https://doi.org/10.3390/su14052862
[48] Nguyen A, Ngo HN, Hong Y, Dang B, Nguyen BP. Ethical principles for artificial intelligence in education. Education and information technologies. 2023 Apr;28(4):4221-41. https://doi.org/10.1007/s10639-022-11316-w
[49] Sadiku MN, Musa SM, Chukwu UC. Artificial intelligence in education. Iuniverse; 2022 Jan 27.
[50] Ahmad SF, Rahmat MK, Mubarik MS, Alam MM, Hyder SI. Artificial intelligence and its role in education. Sustainability. 2021 Nov 22;13(22):12902. https://doi.org/10.3390/su132212902
[51] Saputra I, Astuti M, Sayuti M, Kusumastuti D. Integration of Artificial Intelligence in Education: Opportunities, Challenges, Threats and Obstacles. A Literature Review. The Indonesian journal of computer science. 2023 Aug 30;12(4). https://doi.org/10.33022/ijcs.v12i4.3266
[52] Akgun S, Greenhow C. Artificial intelligence in education: Addressing ethical challenges in K-12 settings. AI and Ethics. 2022 Aug;2(3):431-40. https://doi.org/10.1007/s43681-021-00096-7
[53] Chen X, Xie H, Zou D, Hwang GJ. Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence. 2020 Jan 1;1:100002. https://doi.org/10.1016/j.caeai.2020.100002
[54] Namatherdhala B, Mazher N, Sriram GK. A comprehensive overview of artificial intelligence tends in education. International Research Journal of Modernization in Engineering Technology and Science. 2022;4(7):61-7.
[55] Wang S, Wang F, Zhu Z, Wang J, Tran T, Du Z. Artificial intelligence in education: A systematic literature review. Expert Systems with Applications. 2024 Oct 15;252:124167. https://doi.org/10.1016/j.eswa.2024.124167
[56] Holmes W, Bialik M, Fadel C. Artificial intelligence in education promises and implications for teaching and learning. Center for Curriculum Redesign; 2019 Feb 28.
[57] Yang QF, Lian LW, Zhao JH. Developing a gamified artificial intelligence educational robot to promote learning effectiveness and behavior in laboratory safety courses for undergraduate students. International journal of educational technology in higher education. 2023 Apr 14;20(1):18. https://doi.org/10.1186/s41239-023-00391-9
[58] Ahmad SF, Alam MM, Rahmat MK, Mubarik MS, Hyder SI. Academic and administrative role of artificial intelligence in education. Sustainability. 2022 Jan 19;14(3):1101. https://doi.org/10.3390/su14031101
[59] Doroudi S. The intertwined histories of artificial intelligence and education. International Journal of Artificial Intelligence in Education. 2023 Dec;33(4):885-928. https://doi.org/10.1007/s40593-022-00313-2
[60] Ozodakhon K. The benefits and drawbacks of using artificial intelligence (ChatGPT) in education. University Research Base. 2024 Apr 18:805-8.
[61] Joshi S, Rambola RK, Churi P. Evaluating artificial intelligence in education for next generation. InJournal of Physics: Conference Series 2021 (Vol. 1714, No. 1, p. 012039). IOP Publishing. https://doi.org/10.1088/1742-6596/1714/1/012039
[62] Idroes GM, Noviandy TR, Maulana A, Irvanizam I, Jalil Z, Lensoni L, Lala A, Abas AH, Tallei TE, Idroes R. Student perspectives on the role of artificial intelligence in education: A survey-based analysis. Journal of Educational Management and Learning. 2023 Jul 24;1(1):8-15. https://doi.org/10.60084/jeml.v1i1.58
[63] Filgueiras F. Artificial intelligence and education governance. Education, Citizenship and Social Justice. 2024 Nov;19(3):349-61. https://doi.org/10.1177/17461979231160674
[64] Paek S, Kim N. Analysis of worldwide research trends on the impact of artificial intelligence in education. Sustainability. 2021 Jul 16;13(14):7941. https://doi.org/10.3390/su13147941
[65] Foltynek T, Bjelobaba S, Glendinning I, Khan ZR, Santos R, Pavletic P, Kravjar J. ENAI Recommendations on the ethical use of Artificial Intelligence in Education. International Journal for Educational Integrity. 2023 Dec;19(1):1-4. https://doi.org/10.1007/s40979-023-00133-4
[66] Chiu TK, Xia Q, Zhou X, Chai CS, Cheng M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence. 2023 Jan 1;4:100118. https://doi.org/10.1016/j.caeai.2022.100118