Responsible agentic artificial intelligence governance: Risk, safety, and ethical challenges in autonomous systems
Abstract
With the development of the systems of artificial intelligence as non-communicative and non-cognitive assistive tools, to autonomous agents independent of human intention rendering decisions and carrying out tasks, society experiences the challenges that it never experienced before in the issues of responsibility of their creation and implementation. The swift decentralization of agentic AI systems into essential sectors such as healthcare, financial systems, transportation, and defense has lagged behind the formulation of sufficient governance strategies, among other aspects of excessively high risks and safety controls and ethical accountability. These systems are autonomous and have the ability to exhibit new emergent behavior and multi-step thinking, which have prompted new safety issues not properly handled by the traditional AI governance frameworks. This literature review is designed in accordance with the PRISMA approach to analyze the existing literature, theories, and new tendencies in the responsible agentic AI regulation in a systematic manner. The discussion has identified that there are severe issues to define effective oversight systems of autonomous AI agents such as checking goal congruency, tracking on emergent capabilities, engineering against negative instrumental actions, and accountability in multi-agent systems. The prevailing systems of governance are characterized by disintegration in the various regulatory systems and there is little coordination between the technical safety actions and the policy actions. The findings indicate that there is a drastic response to adaptive governance constructs able to adjust to the quickly changing AI functions, combination of technical safety protocols with ethics, and formation of international coordination systems.
Full text article
References
[1] Xiao Y, Shi G, Zhang P. Toward agentic ai networking in 6g: A generative foundation model-as-agent approach. IEEE Communications Magazine. 2025 Sep 8;63(9):68-74. https://doi.org/10.1109/MCOM.001.2500005
[2] Qu Y, Huang K, Yin M, Zhan K, Liu D, Yin D, Cousins HC, Johnson WA, Wang X, Shah M, Altman RB. CRISPR-GPT for agentic automation of gene-editing experiments. Nature Biomedical Engineering. 2025 Jul 30:1-4. https://doi.org/10.1038/s41551-025-01463-z
[3] Gabriel I. Artificial intelligence, values, and alignment. Minds and machines. 2020 Sep;30(3):411-37. https://doi.org/10.1007/s11023-020-09539-2
[4] Javaid M, Haleem A, Khan IH, Suman R. Understanding the potential applications of Artificial Intelligence in Agriculture Sector. Advanced Agrochem. 2023 Mar 1;2(1):15-30. https://doi.org/10.1016/j.aac.2022.10.001
[5] Peres RS, Jia X, Lee J, Sun K, Colombo AW, Barata J. Industrial artificial intelligence in industry 4.0-systematic review, challenges and outlook. IEEE access. 2020 Dec 7;8:220121-39. https://doi.org/10.1109/ACCESS.2020.3042874
[6] Mohsen SE, Hamdan A, Shoaib HM. Digital transformation and integration of artificial intelligence in financial institutions. Journal of Financial Reporting and Accounting. 2025 Mar 20;23(2):680-99. https://doi.org/10.1108/JFRA-09-2023-0544
[7] Tuo Y, Wu J, Zhao J, Si X. Artificial intelligence in tourism: insights and future research agenda. Tourism Review. 2025 Mar 25;80(4):793-812. https://doi.org/10.1108/TR-03-2024-0180
[8] Chen Y, Prentice C. Integrating artificial intelligence and customer experience. Australasian Marketing Journal. 2025 May;33(2):141-53. https://doi.org/10.1177/14413582241252904
[9] Borghoff UM, Bottoni P, Pareschi R. Human-artificial interaction in the age of agentic AI: a system-theoretical approach. Frontiers in Human Dynamics. 2025 May 9;7:1579166. https://doi.org/10.3389/fhumd.2025.1579166
[10] Plaat A, van Duijn M, Van Stein N, Preuss M, van der Putten P, Batenburg KJ. Agentic large language models, a survey. Journal of Artificial Intelligence Research. 2025 Dec 30;84. https://doi.org/10.1613/jair.1.18675
[11] Gridach M, Nanavati J, Abidine KZ, Mendes L, Mack C. Agentic ai for scientific discovery: A survey of progress, challenges, and future directions. arXiv preprint arXiv:2503.08979. 2025 Mar 12.
[12] Chan A, Salganik R, Markelius A, Pang C, Rajkumar N, Krasheninnikov D, Langosco L, He Z, Duan Y, Carroll M, Lin M. Harms from increasingly agentic algorithmic systems. InProceedings of the 2023 ACM conference on fairness, accountability, and transparency 2023 Jun 12 (pp. 651-666). https://doi.org/10.1145/3593013.3594033
[13] Wei J, Yang Y, Zhang X, Chen Y, Zhuang X, Gao Z, Zhou D, Wang G, Gao Z, Cao J, Qiu Z. From ai for science to agentic science: A survey on autonomous scientific discovery. arXiv preprint arXiv:2508.14111. 2025 Aug 18.
[14] Jiang F, Pan C, Wang K, Michiardi P, Dobre OA, Debbah M. From large ai models to agentic ai: A tutorial on future intelligent communications. IEEE Journal on Selected Areas in Communications. 2026 Feb 2. https://doi.org/10.1109/JSAC.2026.3660010
[15] Mohammed A. Agentic AI as a Proactive Cybercrime Sentinel: Detecting and Deterring Social Engineering Attacks. Journal of Data and Digital Innovation (JDDI). 2025 Jun 16;2(2):109-17.
[16] Belcak P, Heinrich G, Diao S, Fu Y, Dong X, Muralidharan S, Lin YC, Molchanov P. Small language models are the future of agentic ai. arXiv preprint arXiv:2506.02153. 2025 Jun 2.
[17] Bousetouane F. Agentic systems: A guide to transforming industries with vertical ai agents. arXiv preprint arXiv:2501.00881. 2025 Jan 1. https://doi.org/10.32388/2DKDCK
[18] Sapkota R, Roumeliotis KI, Karkee M. Vibe coding vs. agentic coding: Fundamentals and practical implications of agentic ai. arXiv preprint arXiv:2505.19443. 2025 May 26.
[19] Floridi L. AI as Agency without Intelligence: On Artificial Intelligence as a New Form of Artificial Agency and the Multiple Realisability of Agency Thesis: L. Floridi. Philosophy & Technology. 2025 Mar;38(1):30. https://doi.org/10.1007/s13347-025-00858-9
[20] Meng L. From Reactive to Proactive: Integrating Agentic AI and Automated Workflows for Intelligent Project Management (AI-PMP). Frontiers in Engineering. 2025 Nov 26;1(1):82-93. https://doi.org/10.63313/FE.9003
[21] Shavit Y, Agarwal S, Brundage M, Adler S, O'Keefe C, Campbell R, Lee T, Mishkin P, Eloundou T, Hickey A, Slama K. Practices for governing agentic AI systems. Research Paper, OpenAI. 2023 Dec 14.
[22] Singh A, Ehtesham A, Kumar S, Khoei TT. Enhancing AI systems with agentic workflows patterns in large language model. In2024 IEEE World AI IoT Congress (AIIoT) 2024 May 29 (pp. 527-532). IEEE. https://doi.org/10.1109/AIIoT61789.2024.10578990
[23] Townsend DM, Hunt RA, Rady J, Manocha P, Jin JH. Are the futures computable? Knightian uncertainty and artificial intelligence. Academy of Management Review. 2025 Apr;50(2):415-40. https://doi.org/10.5465/amr.2022.0237
[24] Qiu J, Lam K, Li G, Acharya A, Wong TY, Darzi A, Yuan W, Topol EJ. LLM-based agentic systems in medicine and healthcare. Nature Machine Intelligence. 2024 Dec;6(12):1418-20. https://doi.org/10.1038/s42256-024-00944-1
[25] Li Y, Zhou X, Yin HB, Chiu TK. Design language learning with artificial intelligence (AI) chatbots based on activity theory from a systematic review. Smart Learning Environments. 2025 Mar 10;12(1):24. https://doi.org/10.1186/s40561-025-00379-0
[26] Markauskaite L, Marrone R, Poquet O, Knight S, Martinez-Maldonado R, Howard S, Tondeur J, De Laat M, Shum SB, Gašević D, Siemens G. Rethinking the entwinement between artificial intelligence and human learning: What capabilities do learners need for a world with AI?. Computers and Education: Artificial Intelligence. 2022 Jan 1;3:100056. https://doi.org/10.1016/j.caeai.2022.100056
[27] Sudarshan M, Shih S, Yee E, Yang A, Zou J, Chen C, Zhou Q, Chen L, Singhal C, Shih G. Agentic llm workflows for generating patient-friendly medical reports. arXiv preprint arXiv:2408.01112. 2024 Aug 2.
[28] McIntosh TR, Susnjak T, Liu T, Watters P, Xu D, Liu D, Halgamuge MN. From Google Gemini to OpenAI Q*(Q-Star): a survey on reshaping the generative artificial intelligence (AI) research landscape. Technologies. 2025 Jan 30;13(2):51. https://doi.org/10.3390/technologies13020051
[29] Ladak A, Loughnan S, Wilks M. The moral psychology of artificial intelligence. Current Directions in Psychological Science. 2024 Feb;33(1):27-34. https://doi.org/10.1177/09637214231205866
[30] Teo ZL, Thirunavukarasu AJ, Elangovan K, Cheng H, Moova P, Soetikno B, Nielsen C, Pollreisz A, Ting DS, Morris RJ, Shah NH. Generative artificial intelligence in medicine. Nature medicine. 2025 Oct;31(10):3270-82. https://doi.org/10.1038/s41591-025-03983-2
[31] Hanna MG, Pantanowitz L, Dash R, Harrison JH, Deebajah M, Pantanowitz J, Rashidi HH. Future of artificial intelligence-machine learning trends in pathology and medicine. Modern Pathology. 2025 Apr 1;38(4):100705. https://doi.org/10.1016/j.modpat.2025.100705
[32] Habler I, Huang K, Narajala VS, Kulkarni P. Building a secure agentic AI application leveraging A2A protocol. arXiv preprint arXiv:2504.16902. 2025 Apr 23.
[33] Moradbakhti L, Schreibelmayr S, Mara M. Do men have no need for "feminist" artificial intelligence? Agentic and gendered voice assistants in the light of basic psychological needs. Frontiers in psychology. 2022 Jun 14;13:855091. https://doi.org/10.3389/fpsyg.2022.855091
[34] Kolagani SH. Agentic Automation and Work Flow Orchestration in Enterprise SaaS: Effects on Ticket Resolution Time and Employee Productivity in IT Service Management. IJSAT-International Journal on Science and Technology. 2024 Nov 8;15(4). https://doi.org/10.71097/IJSAT.v15.i4.9876
[35] Todupunuri A. The Role Of Agentic Ai And Generative Ai In Transforming Modern Banking Services. American Journal of AI Cyber Computing Management. 2025 Sep 26;5(3):85-93. https://doi.org/10.64751/ajaccm.2025.v5.n3.pp85-93
[36] Gosmar D, Dahl DA. Hallucination mitigation using agentic ai natural language-based frameworks. arXiv preprint arXiv:2501.13946. 2025 Jan 19.
[37] Yamada Y, Lange RT, Lu C, Hu S, Lu C, Foerster J, Clune J, Ha D. The ai scientist-v2: Workshop-level automated scientific discovery via agentic tree search. arXiv preprint arXiv:2504.08066. 2025 Apr 10.
[38] Kshetri N. Transforming cybersecurity with agentic AI to combat emerging cyber threats. Telecommunications Policy. 2025 Jul 1;49(6):102976. https://doi.org/10.1016/j.telpol.2025.102976
[39] Transparency in the reporting of artificial intelligence-the TITAN guideline. Premier Journal of Science. 2025;10:100082.
[40] Hanna MG, Pantanowitz L, Dash R, Harrison JH, Deebajah M, Pantanowitz J, Rashidi HH. Future of artificial intelligence (AI)-machine learning (ML) trends in pathology and medicine. Modern Pathology. 2025 Jan 4:100705. https://doi.org/10.1016/j.modpat.2025.100705
[41] Chen E, Prakash S, Janapa Reddi V, Kim D, Rajpurkar P. A framework for integrating artificial intelligence for clinical care with continuous therapeutic monitoring. Nature Biomedical Engineering. 2025 Apr;9(4):445-54. https://doi.org/10.1038/s41551-023-01115-0
[42] Liu SY. Artificial intelligence (AI) in agriculture. IT professional. 2020 May 21;22(3):14-5. https://doi.org/10.1109/MITP.2020.2986121
[43] Shimizu H, Nakayama KI. Artificial intelligence in oncology. Cancer science. 2020 May;111(5):1452-60. https://doi.org/10.1111/cas.14377
[44] Schwendicke FA, Samek W, Krois J. Artificial intelligence in dentistry: chances and challenges. Journal of dental research. 2020 Jul;99(7):769-74. https://doi.org/10.1177/0022034520915714
[45] Verganti R, Vendraminelli L, Iansiti M. Innovation and design in the age of artificial intelligence. Journal of product innovation management. 2020 May;37(3):212-27. https://doi.org/10.1111/jpim.12523
[46] Novelli C, Taddeo M, Floridi L. Accountability in artificial intelligence: What it is and how it works. Ai & Society. 2024 Aug;39(4):1871-82. https://doi.org/10.1007/s00146-023-01635-y
[47] Rashidi HH, Pantanowitz J, Hanna MG, Tafti AP, Sanghani P, Buchinsky A, Fennell B, Deebajah M, Wheeler S, Pearce T, Abukhiran I. Introduction to artificial intelligence and machine learning in pathology and medicine: generative and nongenerative artificial intelligence basics. Modern Pathology. 2025 Apr 1;38(4):100688. https://doi.org/10.1016/j.modpat.2024.100688
[48] Waisberg E, Ong J, Kamran SA, Masalkhi M, Paladugu P, Zaman N, Lee AG, Tavakkoli A. Generative artificial intelligence in ophthalmology. Survey of ophthalmology. 2025 Jan 1;70(1):1-1. https://doi.org/10.1016/j.survophthal.2024.04.009
[49] Wang H, Fu T, Du Y, Gao W, Huang K, Liu Z, Chandak P, Liu S, Van Katwyk P, Deac A, Anandkumar A. Scientific discovery in the age of artificial intelligence. Nature. 2023 Aug 3;620(7972):47-60. https://doi.org/10.1038/s41586-023-06221-2
[50] Banh L, Strobel G. Generative artificial intelligence. Electronic Markets. 2023 Dec;33(1):63. https://doi.org/10.1007/s12525-023-00680-1
[51] Ahmed I, Jeon G, Piccialli F. From artificial intelligence to explainable artificial intelligence in industry 4.0: a survey on what, how, and where. IEEE transactions on industrial informatics. 2022 Jan 27;18(8):5031-42. https://doi.org/10.1109/TII.2022.3146552
[52] Alqahtani T, Badreldin HA, Alrashed M, Alshaya AI, Alghamdi SS, Bin Saleh K, Alowais SA, Alshaya OA, Rahman I, Al Yami MS, Albekairy AM. The emergent role of artificial intelligence, natural learning processing, and large language models in higher education and research. Research in social and administrative pharmacy. 2023 Aug 1;19(8):1236-42. https://doi.org/10.1016/j.sapharm.2023.05.016
[53] Bankins S, Formosa P. The ethical implications of artificial intelligence (AI) for meaningful work. Journal of Business Ethics. 2023 Jul;185(4):725-40. https://doi.org/10.1007/s10551-023-05339-7
[54] Abulibdeh A, Zaidan E, Abulibdeh R. Navigating the confluence of artificial intelligence and education for sustainable development in the era of industry 4.0: Challenges, opportunities, and ethical dimensions. Journal of Cleaner Production. 2024 Jan 15;437:140527. https://doi.org/10.1016/j.jclepro.2023.140527
[55] King MR, ChatGPT. A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and molecular bioengineering. 2023 Feb;16(1):1-2. https://doi.org/10.1007/s12195-022-00754-8
[56] Ikhsan RB, Fernando Y, Prabowo H, Gui A, Kuncoro EA. An empirical study on the use of artificial intelligence in the banking sector of Indonesia by extending the TAM model and the moderating effect of perceived trust. Digital Business. 2025 Jun 1;5(1):100103. https://doi.org/10.1016/j.digbus.2024.100103
[57] Gangwal A, Lavecchia A. Artificial intelligence in natural product drug discovery: current applications and future perspectives. Journal of medicinal chemistry. 2025 Feb 7;68(4):3948-69. https://doi.org/10.1021/acs.jmedchem.4c01257
[58] Crompton H, Burke D. Artificial intelligence in higher education: the state of the field. International journal of educational technology in higher education. 2023 Apr 24;20(1):22. https://doi.org/10.1186/s41239-023-00392-8
[59] Puntoni S, Reczek RW, Giesler M, Botti S. Consumers and artificial intelligence: An experiential perspective. Journal of marketing. 2021 Jan;85(1):131-51. https://doi.org/10.1177/0022242920953847
[60] Kumar I, Rawat J, Mohd N, Husain S. Opportunities of artificial intelligence and machine learning in the food industry. Journal of Food Quality. 2021;2021(1):4535567. https://doi.org/10.1155/2021/4535567
[61] Moor M, Banerjee O, Abad ZS, Krumholz HM, Leskovec J, Topol EJ, Rajpurkar P. Foundation models for generalist medical artificial intelligence. Nature. 2023 Apr 13;616(7956):259-65. https://doi.org/10.1038/s41586-023-05881-4
[62] Jaiswal A, Arun CJ, Varma A. Rebooting employees: Upskilling for artificial intelligence in multinational corporations. InArtificial intelligence and international HRM 2023 May 22 (pp. 114-143). Routledge. https://doi.org/10.4324/9781003377085-5
[63] Hosseini S, Seilani H. The role of agentic ai in shaping a smart future: A systematic review. Array. 2025 Jul 1;26:100399. https://doi.org/10.1016/j.array.2025.100399
[64] Murugesan S. The rise of agentic AI: implications, concerns, and the path forward. IEEE Intelligent Systems. 2025 Apr 10;40(2):8-14. https://doi.org/10.1109/MIS.2025.3544940
[65] Acharya DB, Kuppan K, Divya B. Agentic AI: Autonomous intelligence for complex goals-A comprehensive survey. IEEe Access. 2025 Jan 22;13:18912-36. https://doi.org/10.1109/ACCESS.2025.3532853
[66] Hughes L, Dwivedi YK, Malik T, Shawosh M, Albashrawi MA, Jeon I, Dutot V, Appanderanda M, Crick T, De' R, Fenwick M. AI agents and agentic systems: A multi-expert analysis. Journal of Computer Information Systems. 2025 Jul 4;65(4):489-517. https://doi.org/10.1080/08874417.2025.2483832
[67] Vanneste BS, Puranam P. Artificial intelligence, trust, and perceptions of agency. Academy of Management Review. 2024 Mar 22(ja):amr-2022. https://doi.org/10.2139/ssrn.3897704
[68] Schneider J. Generative to agentic ai: Survey, conceptualization, and challenges. arXiv preprint arXiv:2504.18875. 2025 Apr 26.
[69] Karunanayake N. Next-generation agentic AI for transforming healthcare. Informatics and Health. 2025 Sep 1;2(2):73-83. https://doi.org/10.1016/j.infoh.2025.03.001
Authors
Copyright (c) 2026 Birupaksha Biswas, Suhena Sarkar (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2025 International Journal of Applied Resilience and Sustainability (IJARS) 
This work is licensed under a Creative Commons Attribution 4.0 International License.