A multimodal predictive framework for early detection of anxiety instability and panic attacks
Abstract
Although anxiety disorders and panic attacks belong to the types of the most widespread and, accordingly, the most debilitating mental disorders of the world, the current clinical practice is largely based on retrospective self-report and episodic assessment, which does not always include early warning signs of behaviour and physiological indicators. More recent evidence suggests that slight changes in autonomic regulation, namely decreases in heart-rate variability (HRV) is antecedent to the increment of anxiety and the beginning of the panic attacks. A combination of wearable sensing, digital phenotyping and machine-learning can be used to continuously track psychological vulnerability in the real world. The current research suggests using an algorithmic approach to digital predictive analysis of the changes in the intensity of anxiety and the onset of a panic attack based on continuous multimodal state measurements. This model combines physiological measures, such as heart rate, HRV, respiration, electrodermal activity and behavioural dynamics, linguistic cues and exposure to environmental stressors to produce a personalised Anxiety Stability Index (ASI). The hybrid Random Forest-Long Short -Memories model also reveals the nonlinear correlations and the time-specific trends, which in turn predicts the instability at hand and the pace of the anxiety development. The principles of multimodal fusion and interpretable modelling will be used to improve transparency and clinical usefulness. The given framework would aim at determining the typical patterns of instability prior to the onset of acute panic, transforming the unchanging questionnaire-based measurements into the actual predictions. It can promote digital psychiatry because it encourages proactive treatment, elimination of panic cases in case of an emergency, and enhancement of the provision of individualised mental-health services in ordinary environments.
Full text article
References
[1] Diagnostic A. statistical manual of mental disorders, (DSM-5) Washington. DC: American Psychiatric Association. 2013.
[2] Stein MB, Craske MG. Treating anxiety in 2017: optimizing care to improve outcomes. Jama. 2017 Jul 18;318(3):235-6. https://doi.org/10.1001/jama.2017.6996
[3] Barlow DH. Anxiety and its disorders: The nature and treatment of anxiety and panic. Guilford press; 2004 Jan 28.
[4] Craske MG, Kircanski K, Epstein A, Wittchen HU, Pine DS, Lewis‐Fernández R, Hinton D. Panic disorder: a review of DSM‐IV panic disorder and proposals for DSM‐V. Depression and anxiety. 2010 Feb;27(2):93-112. https://doi.org/10.1002/da.20654
[5] Meuret AE, Rosenfield D, Hofmann SG, Suvak MK, Roth WT. Changes in respiration mediate changes in fear of bodily sensations in panic disorder. Journal of Psychiatric Research. 2009 Mar 1;43(6):634-41. https://doi.org/10.1016/j.jpsychires.2008.08.003
[6] Thayer JF, Åhs F, Fredrikson M, Sollers III JJ, Wager TD. A meta-analysis of heart rate variability and neuroimaging studies: implications for heart rate variability as a marker of stress and health. Neuroscience & Biobehavioral Reviews. 2012 Feb 1;36(2):747-56. https://doi.org/10.1016/j.neubiorev.2011.11.009
[7] Kreibig SD. Autonomic nervous system activity in emotion: A review. Biological psychology. 2010 Jul 1;84(3):394-421. https://doi.org/10.1016/j.biopsycho.2010.03.010
[8] Thayer JF, Lane RD. A model of neurovisceral integration in emotion regulation and dysregulation. Journal of affective disorders. 2000 Dec 2;61(3):201-16. https://doi.org/10.1016/S0165-0327(00)00338-4
[9] Chalmers JA, Quintana DS, Abbott MJ, Kemp AH. Anxiety disorders are associated with reduced heart rate variability: a meta-analysis. Frontiers in psychiatry. 2014 Jul 11;5:80. https://doi.org/10.3389/fpsyt.2014.00080
[10] Friedman BH. An autonomic flexibility-neurovisceral integration model of anxiety and cardiac vagal tone. Biological psychology. 2007 Feb 1;74(2):185-99. https://doi.org/10.1016/j.biopsycho.2005.08.009
[11] Kim HG, Cheon EJ, Bai DS, Lee YH, Koo BH. Stress and heart rate variability: a meta-analysis and review of the literature. Psychiatry investigation. 2018 Feb 28;15(3):235. https://doi.org/10.30773/pi.2017.08.17
[12] Insel TR. Digital phenotyping: technology for a new science of behavior. Jama. 2017 Oct 3;318(13):1215-6. https://doi.org/10.1001/jama.2017.11295
[13] Onnela JP, Rauch SL. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology. 2016 Jun;41(7):1691-6. https://doi.org/10.1038/npp.2016.7
[14] Torous J, Onnela JP, Keshavan M. New dimensions and new tools to realize the potential of RDoC: digital phenotyping via smartphones and connected devices. Translational psychiatry. 2017 Mar;7(3):e1053-. https://doi.org/10.1038/tp.2017.25
[15] Insel TR. Digital phenotyping: technology for a new science of behavior. Jama. 2017 Oct 3;318(13):1215-6. https://doi.org/10.1001/jama.2017.11295
[16] Onnela JP, Rauch SL. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology. 2016 Jun;41(7):1691-6. https://doi.org/10.1038/npp.2016.7
[17] Sano A, Picard RW. Stress recognition using wearable sensors and mobile phones. In2013 Humaine association conference on affective computing and intelligent interaction 2013 Sep 2 (pp. 671-676). IEEE. https://doi.org/10.1109/ACII.2013.117
[18] Gjoreski M, Gjoreski H, Luštrek M, Gams M. Continuous stress detection using a wrist device: in laboratory and real life. Inproceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing: Adjunct 2016 Sep 12 (pp. 1185-1193). https://doi.org/10.1145/2968219.2968306
[19] Garcia-Ceja E, Riegler M, Nordgreen T, Jakobsen P, Oedegaard KJ, Tørresen J. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive and Mobile Computing. 2018 Dec 1;51:1-26. https://doi.org/10.1016/j.pmcj.2018.09.003
[20] Jacobson NC, Chung YJ. Passive sensing of prediction of moment-to-moment depressed mood among undergraduates with clinical levels of depression sample using smartphones. Sensors. 2020 Jun 24;20(12):3572. https://doi.org/10.3390/s20123572
[21] Hochreiter S, Schmidhuber J. Long short-term memory. Neural computation. 1997 Nov 15;9(8):1735-80. https://doi.org/10.1162/neco.1997.9.8.1735
[22] Breiman L, Forests R. Machine Learning. Vol. 45. The Netherlands: Kluwer Academic Publishers. 2001:5-32. https://doi.org/10.1023/A:1010933404324
[23] Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: A survey and taxonomy. IEEE transactions on pattern analysis and machine intelligence. 2018 Jan 25;41(2):423-43. https://doi.org/10.1109/TPAMI.2018.2798607
[24] Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Advances in neural information processing systems. 2017;30.
[25] Doshi-Velez F, Kim B. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608. 2017 Feb 28.
[26] Lederbogen F, Kirsch P, Haddad L, Streit F, Tost H, Schuch P, Wüst S, Pruessner JC, Rietschel M, Deuschle M, Meyer-Lindenberg A. City living and urban upbringing affect neural social stress processing in humans. Nature. 2011 Jun 23;474(7352):498-501. https://doi.org/10.1038/nature10190
[27] Pun VC, Kazemiparkouhi F, Manjourides J, Suh HH. Long-term PM2. 5 exposure and respiratory, cancer, and cardiovascular mortality in older US adults. American journal of epidemiology. 2017 Oct 15;186(8):961-9. https://doi.org/10.1093/aje/kwx166
[28] Evans GW. The built environment and mental health. Journal of urban health. 2003 Dec;80(4):536-55. https://doi.org/10.1093/jurban/jtg063
[29] Smuck M, Odonkor CA, Wilt JK, Schmidt N, Swiernik MA. The emerging clinical role of wearables: factors for successful implementation in healthcare. NPJ digital medicine. 2021 Mar 10;4(1):45. https://doi.org/10.1038/s41746-021-00418-3
[30] Healey JA, Picard RW. Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on intelligent transportation systems. 2005 Jun 30;6(2):156-66. https://doi.org/10.1109/TITS.2005.848368
[31] Das S, Chatterjee S, Karani AI, Ghosh AK. Stress detection while doing exam using eeg with machine learning techniques. InInternational Conference on Innovations in Data Analytics 2023 Nov 29 (pp. 177-187). Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-97-4928-7_14
[32] Calvo RA, Milne DN, Hussain MS, Christensen H. Natural language processing in mental health applications using non-clinical texts. Natural Language Engineering. 2017 Sep;23(5):649-85. https://doi.org/10.1017/S1351324916000383
[33] Tausczik YR, Pennebaker JW. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of language and social psychology. 2010 Mar;29(1):24-54. https://doi.org/10.1177/0261927X09351676
[34] Sabry F, Eltaras T, Labda W, Alzoubi K, Malluhi Q. Machine learning for healthcare wearable devices: the big picture. Journal of Healthcare Engineering. 2022;2022(1):4653923. https://doi.org/10.1155/2022/4653923
[35] Acheampong FA, Wenyu C, Nunoo‐Mensah H. Text‐based emotion detection: Advances, challenges, and opportunities. Engineering Reports. 2020 Jul;2(7):e12189. https://doi.org/10.1002/eng2.12189
[36] Tarassenko L, Clifton DA, Pinsky MR, Hravnak MT, Woods JR, Watkinson PJ. Centile-based early warning scores derived from statistical distributions of vital signs. Resuscitation. 2011 Aug 1;82(8):1013-8. https://doi.org/10.1016/j.resuscitation.2011.03.006
[37] Lin X, Luo J, Liao M, Su Y, Lv M, Li Q, Xiao S, Xiang J. Wearable sensor-based monitoring of environmental exposures and the associated health effects: A review. Biosensors. 2022 Dec 6;12(12):1131. https://doi.org/10.3390/bios12121131
[38] Riley RD, van der Windt D, Croft P, Moons KG, editors. Prognosis research in healthcare: concepts, methods, and impact. Oxford University Press; 2019 Jan 17. https://doi.org/10.1093/med/9780198796619.001.0001
[39] Steyerberg EW, Harrell Jr FE. Prediction models need appropriate internal, internal-external, and external validation. Journal of clinical epidemiology. 2015 Apr 18;69:245. https://doi.org/10.1016/j.jclinepi.2015.04.005
[40] Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, Cui C, Corrado G, Thrun S, Dean J. A guide to deep learning in healthcare. Nature medicine. 2019 Jan;25(1):24-9. https://doi.org/10.1038/s41591-018-0316-z
[41] Ghosh A, Diyasi S, Chatterjee S. Enhancing SQL Injection Prevention: Advanced Machine Learning and LSTM-Based Techniques. International Journal on Computational Modelling Applications. 2024 Jul 31;1(1):20-31. https://doi.org/10.63503/j.ijcma.2024.16
[42] World Health Organization. WHO consultation towards the development of guidance on ethics and governance of artificial intelligence for health: meeting report, Geneva, Switzerland, 2-4 October 2019. World Health Organization; 2021.
[43] Jobin A, Ienca M, Vayena E. The global landscape of AI ethics guidelines. Nature machine intelligence. 2019 Sep;1(9):389-99. https://doi.org/10.1038/s42256-019-0088-2
[44] Hoofnagle CJ, Van Der Sloot B, Borgesius FZ. The European Union general data protection regulation: what it is and what it means. Information & communications technology law. 2019 Jan 2;28(1):65-98. https://doi.org/10.1080/13600834.2019.1573501
[45] Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, Cui C, Corrado G, Thrun S, Dean J. A guide to deep learning in healthcare. Nature medicine. 2019 Jan;25(1):24-9. https://doi.org/10.1038/s41591-018-0316-z
[46] Pun VC, Manjourides J, Suh H. Association of ambient air pollution with depressive and anxiety symptoms in older adults: results from the NSHAP study. Environmental health perspectives. 2016 Aug 12;125(3):342. https://doi.org/10.1289/EHP494
[47] Huckvale K, Torous J, Larsen ME. Assessment of the data sharing and privacy practices of smartphone apps for depression and smoking cessation. JAMA network open. 2019 Apr 5;2(4):e192542. https://doi.org/10.1001/jamanetworkopen.2019.2542
Authors
Copyright (c) 2026 Poushali Das, Rituparna Mondal, Soumitra De, Siddhartha Chatterjee, Shibani Mukherjee (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2025 International Journal of Applied Resilience and Sustainability (IJARS) 
This work is licensed under a Creative Commons Attribution 4.0 International License.