Reinforcement learning driven self-evolving trust framework for secure and scalable internet of vehicles using blockchain

Poushali Das (1) , Suity Roy (2) , Ipsita Pathak (3) , Sudipta Bhanja (2) , Siddhartha Chatterjee (2)
(1) Independent Researcher, Kolkata 700089, West Bengal, India, India,
(2) Department of Computer Science and Engineering, College of Engineering and Management, Kolaghat, KTPP Township, Purba Medinipur - 721171, West Bengal, India, India,
(3) Department of Basic Science and Engineering, Humanities, Government College of Engineering and Ceramic Technology, Kolkata 700010, West Bengal, India, India

Abstract

The current high-speed pace of the Internet of Vehicles (IoV) has successfully allowed the construction of intelligent transportation frames; nevertheless, there are several grave issues, such as malicious data injection, dynamic trust variations, scale risks, and strict low-latency, which have been mentioned. Current methods of managing trust use mainly fixed or semi-dynamic reputation models, likely to fail in dynamically changing and adversarial settings of the IoV. In dealing with these issues, this article suggests a self-evolving framework of trust, combining blockchain technology, reinforcement learning (RL), and edge/fog computing to allow real-time, adaptive, and secure assessment of trust. The suggested system will utilise a multi-layered structure in which vehicular information is subject to pre-processing and behavioural evaluation to determine reliability in terms of data accuracy, abnormality detection, and falsity detection. A blockchain ledger keeps historical trust records with constant levels of transparency, impartiality, and withstands modification. The reinforcement learning-based trust decision engine is a dynamic assessment of incoming data, which is formed based on real-time behavioral features and historical trust data, and independent of the acceptance, verification, or rejection of the messages. A mechanism of continuous updating of the trust scores is based on a reward and a penalty system so that the system can adjust to changing network conditions and new patterns of attacks. The framework adopts a low-latency performance using edge and fog computing to compute locally, and privacy-preserving approaches, including anonymization and federated learning, to keep sensitive vehicular information safe. It is shown through a large body of simulations run on SUMO and NS-3 that the proposed framework is much more suited in terms of trust accuracy, attack detection rate, and communication latency to scale over a large area and set up the next generation IoV systems.

Full text article

Generated from XML file

References

[1] Sharma PK, Moon SY, Park JH. Block-VN: A distributed Blockchain based vehicular network architecture in smart city. Journal of information processing systems. 2017 Feb 1;13(1).

[2] Liang X, Shetty S, Tosh D, Kamhoua C, Kwiat K, Njilla L. Provchain: A blockchain-based data provenance architecture in cloud environment with enhanced privacy and availability. In2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID) 2017 May 14 (pp. 468-477). IEEE. https://doi.org/10.1109/CCGRID.2017.8

[3] Lu Z, Liu W, Wang Q, Qu G, Liu Z. A privacy-preserving trust model based on blockchain for VANETs. Ieee Access. 2018 Aug 7;6:45655-64. https://doi.org/10.1109/ACCESS.2018.2864189

[4] Yang Z, Yang K, Lei L, Zheng K, Leung VC. Blockchain-based decentralized trust management in vehicular networks. IEEE internet of things journal. 2018 May 14;6(2):1495-505. https://doi.org/10.1109/JIOT.2018.2836144

[5] Li Z, Kang J, Yu R, Ye D, Deng Q, Zhang Y. Consortium blockchain for secure energy trading in industrial internet of things. IEEE transactions on industrial informatics. 2017 Dec 22;14(8):3690-700.

[6] Zhang H, Liu J, Zhao H, Wang P, Kato N. Blockchain-based trust management for internet of vehicles. IEEE Transactions on Emerging Topics in Computing. 2020 Nov 2;9(3):1397-409. https://doi.org/10.1109/TETC.2020.3033532

[7] Chen W, Chen Y, Chen X, Zheng Z. Toward secure data sharing for the IoV: A quality-driven incentive mechanism with on-chain and off-chain guarantees. IEEE Internet of Things Journal. 2019 Oct 10;7(3):1625-40. https://doi.org/10.1109/JIOT.2019.2946611

[8] Xu Q, Zhang L, Liu Y, Li Z. Enhancing Trust Management System for Connected Autonomous Vehicles Using Machine Learning Methods: A Survey. IEEE Transactions on Intelligent Transportation Systems. 2026 Jan 5. https://doi.org/10.1109/TITS.2025.3647284

[9] Hewa T, Gür G, Kalla A, Ylianttila M, Bracken A, Liyanage M. The role of blockchain in 6G: Challenges, opportunities and research directions. 2020 2nd 6G Wireless Summit (6G SUMMIT). 2020 Mar 17:1-5. https://doi.org/10.1109/6GSUMMIT49458.2020.9083784

[10] Negka L, Spathoulas G. Towards Secure, Decentralised, and Privacy Friendly Forensic Analysis of Vehicular Data. Sensors. 2021 Oct 21;21(21):6981. https://doi.org/10.3390/s21216981

[11] Dai HN, Zheng Z, Zhang Y. Blockchain for Internet of Things: A survey. IEEE internet of things journal. 2019 Jun 5;6(5):8076-94. https://doi.org/10.1109/JIOT.2019.2920987

[12] Sun J, Yan J, Zhang KZ. Blockchain-based sharing services: What blockchain technology can contribute to smart cities. Financial Innovation. 2016 Dec 13;2(1):26. https://doi.org/10.1186/s40854-016-0040-y

[13] Lin IC, Liao TC. A survey of blockchain security issues and challenges. Int. J. Netw. Secur.. 2017 Sep 1;19(5):653-9.

[14] Reyna A, Martín C, Chen J, Soler E, Díaz M. Blockchain and IoT integration. FGCS. 2018

[15] Mollah MB, Zhao J, Niyato D, Lam KY, Zhang X, Ghias AM, Koh LH, Yang L. Blockchain for future smart grid: A comprehensive survey. IEEE Internet of Things journal. 2020 May 11;8(1):18-43. https://doi.org/10.1109/JIOT.2020.2993601

[16] Zhang D, Yu FR, Yang R, Zhu L. Software-defined vehicular networks with trust management: A deep reinforcement learning approach. IEEE Transactions on Intelligent Transportation Systems. 2020 Oct 1;23(2):1400-14. https://doi.org/10.1109/TITS.2020.3025684

[17] Guo J, Li X, Liu Z, Ma J, Yang C, Zhang J, Wu D. TROVE: A context-awareness trust model for VANETs using reinforcement learning. IEEE Internet of Things Journal. 2020 Feb 19;7(7):6647-62. https://doi.org/10.1109/JIOT.2020.2975084

[18] Gyawali S, Qian Y, Hu RQ. Deep reinforcement learning based dynamic reputation policy in 5G based vehicular communication networks. IEEE Transactions on Vehicular Technology. 2021 May 11;70(6):6136-46. https://doi.org/10.1109/TVT.2021.3079379

[19] Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G, Petersen S. Human-level control through deep reinforcement learning. nature. 2015 Feb;518(7540):529-33. https://doi.org/10.1038/nature14236

[20] Sutton RS, Barto AG. Reinforcement learning: An introduction. Cambridge: MIT press; 1998 Mar 1.

[21] Tang F, Kawamoto Y, Kato N, Liu J. Future intelligent and secure vehicular network toward 6G: Machine-learning approaches. Proceedings of the IEEE. 2019 Dec 6;108(2):292-307. https://doi.org/10.1109/JPROC.2019.2954595

[22] Zhang C, Patras P, Haddadi H. Deep learning in mobile and wireless networking: A survey. IEEE Communications surveys & tutorials. 2019 Mar 13;21(3):2224-87. https://doi.org/10.1109/COMST.2019.2904897

[23] Abbas N, Zhang Y, Taherkordi A, Skeie T. Mobile edge computing: A survey. IEEE Internet of Things Journal. 2017 Sep 8;5(1):450-65. https://doi.org/10.1109/JIOT.2017.2750180

[24] Mao Y, You C, Zhang J, Huang K, Letaief KB. Mobile edge computing: Survey and research outlook. arXiv preprint arXiv:1701.01090. 2017 Jan:1-37.

[25] Zhou Z, Chen X, Li E, Zeng L, Luo K, Zhang J. Edge intelligence: Paving the last mile of artificial intelligence with edge computing. Proceedings of the IEEE. 2019 Jun 12;107(8):1738-62. https://doi.org/10.1109/JPROC.2019.2918951

[26] Roman, R., Lopez, J., & Mambo, M. (2018). Mobile edge computing, fog computing, and cloud computing: A survey. Computer Networks, 135, 1-15.

[27] Dorri A, Kanhere SS, Jurdak R. Towards an optimized blockchain for IoT. InProceedings of the second international conference on Internet-of-Things design and implementation 2017 Apr 18 (pp. 173-178). https://doi.org/10.1145/3054977.3055003

[28] Huang X, Yu R, Kang J, He Y, Zhang Y. Exploring mobile edge computing for 5G-enabled software defined vehicular networks. IEEE Wireless Communications. 2018 Jan 4;24(6):55-63. https://doi.org/10.1109/MWC.2017.1600387

[29] Liu J, Wan J, Zeng B, Wang Q, Song H, Qiu M. A scalable and quick-response software defined vehicular network assisted by mobile edge computing. IEEE Communications Magazine. 2017 Jul 14;55(7):94-100. https://doi.org/10.1109/MCOM.2017.1601150

[30] Zhang K, Mao Y, Leng S, He Y, Zhang Y. Mobile-edge computing for vehicular networks: A promising network paradigm with predictive off-loading. IEEE vehicular technology magazine. 2017 Apr 24;12(2):36-44. https://doi.org/10.1109/MVT.2017.2668838

[31] Satyanarayanan M. The emergence of edge computing. computer. 2017 Jan 5;50(1):30-9. https://doi.org/10.1109/MC.2017.9

[32] Liu J, Wan J, Zeng B, Wang Q, Song H, Qiu M. A scalable and quick-response software defined vehicular network assisted by mobile edge computing. IEEE Communications Magazine. 2017 Jul 14;55(7):94-100. https://doi.org/10.1109/MCOM.2017.1601150

[33] Conti M, Kumar ES, Lal C, Ruj S. A survey on security and privacy issues of bitcoin. IEEE communications surveys & tutorials. 2018 May 31;20(4):3416-52. https://doi.org/10.1109/COMST.2018.2842460

[34] Zhang Y, Kasahara S, Shen Y, Jiang X, Wan J. Smart contract-based access control for the internet of things. IEEE internet of things journal. 2018 Jun 15;6(2):1594-605. https://doi.org/10.1109/JIOT.2018.2847705

[35] Gupta S, Vanteru K, Reddy S, Madupati B. AI-Enhanced Blockchain Networks for Climate Change Monitoring and Carbon Credit Verification. InProceedings of the 2025 4th International Conference on Frontiers of Artificial Intelligence and Machine Learning 2025 Apr 25 (pp. 31-37). https://doi.org/10.1145/3748382.3748389

[36] Nguyen DC, Pathirana PN, Ding M, Seneviratne A. Integration of blockchain and cloud of things: Architecture, applications and challenges. IEEE Communications surveys & tutorials. 2020 Aug 28;22(4):2521-49.

[37] Dorri A, Kanhere SS, Jurdak R. Blockchain in internet of things: challenges and solutions. arXiv preprint arXiv:1608.05187. 2016 Aug 18.

[38] Chatterjee S, Nandan M, Ghosh A, Banik S. Dtnma: identifying routing attacks in delay-tolerant network. InCyber Intelligence and Information Retrieval: Proceedings of CIIR 2021 2021 Sep 29 (pp. 3-15). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-16-4284-5_1

[39] Zhou Z, Chen X, Li E, Zeng L, Luo K, Zhang J. Edge intelligence: Paving the last mile of artificial intelligence with edge computing. Proceedings of the IEEE. 2019 Jun 12;107(8):1738-62. https://doi.org/10.1109/JPROC.2019.2918951

[40] Xu X, Pautasso C, Zhu L, Gramoli V, Ponomarev A, Tran AB, Chen S. The blockchain as a software connector. In2016 13th Working IEEE/IFIP Conference on Software Architecture (WICSA) 2016 Apr 5 (pp. 182-191). Ieee. https://doi.org/10.1109/WICSA.2016.21

[41] Atzori L, Iera A, Morabito G. The internet of things: A survey. Computer networks. 2010 Oct 28;54(15):2787-805. https://doi.org/10.1016/j.comnet.2010.05.010

[42] Kouicem DE, Bouabdallah A, Lakhlef H. An efficient architecture for trust management in IoE based systems of systems. In2018 13th Annual Conference on System of Systems Engineering (SoSE) 2018 Jun 19 (pp. 138-143). IEEE. https://doi.org/10.1109/SYSOSE.2018.8428732

[43] Yan Z, Zhang P, Vasilakos AV. A survey on trust management for Internet of Things. Journal of network and computer applications. 2014 Jun 1;42:120-34. https://doi.org/10.1016/j.jnca.2014.01.014

[44] Zhang J, Cui J, Zhong H, Chen Z, Liu L. PA-CRT: Chinese remainder theorem based conditional privacy-preserving authentication scheme in vehicular ad-hoc networks. IEEE Transactions on Dependable and Secure Computing. 2019 Mar 10;18(2):722-35. https://doi.org/10.1109/TDSC.2019.2904274

[45] Raya M, Hubaux JP. The security of vehicular ad hoc networks. InProceedings of the 3rd ACM workshop on Security of ad hoc and sensor networks 2005 Nov 7 (pp. 11-21). https://doi.org/10.1145/1102219.1102223

[46] Nguyen DC, Ding M, Pathirana PN, Seneviratne A. Blockchain and AI-based solutions to combat coronavirus (COVID-19)-like epidemics: A survey. Ieee Access. 2021 Jun 30;9:95730-53. https://doi.org/10.1109/ACCESS.2021.3093633

[47] Wang S, Zhang X, Zhang Y, Wang L, Yang J, Wang W. A survey on mobile edge networks: Convergence of computing, caching and communications. Ieee Access. 2017 Mar 21;5:6757-79. https://doi.org/10.1109/ACCESS.2017.2685434

[48] Abdel‐Basset M, Manogaran G, Mohamed M, Rushdy E. Internet of things in smart education environment: Supportive framework in the decision‐making process. Concurrency and Computation: Practice and Experience. 2019 May 25;31(10):e4515. https://doi.org/10.1002/cpe.4515

[49] Zhang Y, Wen J. The IoT electric business model: Using blockchain technology for the internet of things. Peer-to-Peer Networking and Applications. 2017 Jul;10(4):983-94. https://doi.org/10.1007/s12083-016-0456-1

[50] Christidis K, Devetsikiotis M. Blockchains and smart contracts for the internet of things. IEEE access. 2016 May 10;4:2292-303. https://doi.org/10.1109/ACCESS.2016.2566339

[51] Kshetri N. Can blockchain strengthen the internet of things?. IT professional. 2017 Aug 17;19(4):68-72. https://doi.org/10.1109/MITP.2017.3051335

[52] Hussain R, Zeadally S. Autonomous cars: Research results, issues, and future challenges. IEEE Communications Surveys & Tutorials. 2018 Sep 10;21(2):1275-313. https://doi.org/10.1109/COMST.2018.2869360

[53] Zhang L, Luo M, Li J, Au MH, Choo KK, Chen T, Tian S. Blockchain based secure data sharing system for Internet of vehicles: A position paper. Vehicular Communications. 2019 Apr 1;16:85-93 https://doi.org/10.1016/j.vehcom.2019.03.003

[54] El Hadraoui H, Ouahabi N, El Bazi N, Laayati O, Zegrari M, Chebak A. Toward an intelligent diagnosis and prognostic health management system for autonomous electric vehicle powertrains: A novel distributed intelligent digital twin-based architecture. IEEE Access. 2024 Aug 9;12:110729-61. https://doi.org/10.1109/ACCESS.2024.3441517

[55] Chatterjee S, Nandan M, Ghosh A, Banik S. Dtnma: identifying routing attacks in delay-tolerant network. InCyber Intelligence and Information Retrieval: Proceedings of CIIR 2021 2021 Sep 29 (pp. 3-15). Singapore: Springer Singapore. https://doi.org/10.1007/978-981-16-4284-5_1

Authors

Poushali Das
Suity Roy
Ipsita Pathak
Sudipta Bhanja
Siddhartha Chatterjee
Das, P. ., Roy, S. ., Pathak, I. ., Bhanja, S. ., & Chatterjee, S. . (2026). Reinforcement learning driven self-evolving trust framework for secure and scalable internet of vehicles using blockchain. International Journal of Applied Resilience and Sustainability, 2(3), 1-15. https://doi.org/10.70593/deepsci.0203001

Article Details

How to Cite

Das, P. ., Roy, S. ., Pathak, I. ., Bhanja, S. ., & Chatterjee, S. . (2026). Reinforcement learning driven self-evolving trust framework for secure and scalable internet of vehicles using blockchain. International Journal of Applied Resilience and Sustainability, 2(3), 1-15. https://doi.org/10.70593/deepsci.0203001

Multi-agent cooperative control of a three-tank liquid system using reinforcement learning algorithms

Lincoln Nobert Munhenzwa, Adlen Kerboua, Godfrey Murairidzi Gotora (Author)
Abstract View : 79
Download :70