Big Data Machine Learning for Clinical Risk Prediction
Keywords:
Combining PC-1; PC-2 with ML Ridge regression; SVM Linear; lasso; AUC-ROC curve; area under the precision-recall; maximal accuracy Ya.Yu. et al.; the goodness of fit was evaluated and an internal; external validation of the risk score Risk factors; sensitive; specific; especially; AUC-ROC 3829 clinical/biobanked; 110706 clinically well-characterized; 7400 clinical; 165237 individuals.Abstract
Healthcare is a path-breaking field for big data. By combining electronic medical record data with omics data (genomics, proteomics, metabolomics, etc.), lifestyle information (e.g., smoking, drinking, diet, and exercise), social determinants of health, and relevant data from wearable devices, a diverse array of clinical and biological predictive models can be constructed. In particular, the application of machine-learning (ML) methods for clinical risk-prediction modeling has gained impressive momentum in recent years, amassing a wealth of reference literature. Unlike traditional statistical approaches commonly utilized in clinical applications, ML techniques have the potential to simultaneously leverage high-dimensional, heterogeneous data.
This contribution reviews multiple important aspects of risk prediction using big data and ML methods, including data-sources, framework, performance metrics, and regulation. Relevant clinical applications span almost every area, including cardiovascular medicine, oncology, infectious diseases, nephrology, rheumatology, and psychiatry. Although numerous ML-based risk-scoring systems with impressive performance are found in the literature, external validation and transportability remain critical challenges that merit further exploration.
References
1. Atkins, D., Makridis, C. A., Alterovitz, G., Ramoni, R., & Clancy, C. (2022). Developing and implementing predictive models in a learning healthcare system: Traditional and artificial intelligence approaches in the Veterans Health Administration. Annual Review of Biomedical Data Science, 5, 393–413.
2. Bhaskhar, N., Ip, W., Chen, J. H., & Rubin, D. L. (2023). Clinical outcome prediction using observational supervision with electronic health records and audit logs. Journal of Biomedical Informatics, 147, 104522.
3. Pandugula, C., Ganti, V. K. A. T., & Mallesham, G. (2024). Predictive Modeling in Assessing the Efficacy of Precision Medicine Protocols. EDUCATIONAL ADMINISTRATION: THEORY AND PRACTICE Учредители: Green Publication БИБЛИОМЕТРИЧЕСКИЕ ПОКАЗАТЕЛИ: Входит в РИНЦ: на рассмотрении Цитирований в РИНЦ: 0 Входит в ядро РИНЦ: нет Цитирований из ядра РИНЦ: 0 Рецензии: нет данных Процентиль журнала в рейтинге SI: ТЕМАТИЧЕСКИЕ НАПРАВЛЕНИЯ:.
4. Boll, H. O., Amirahmadi, A., Ghazani, M. M., de Morais, W. O., de Freitas, E. P., Soliman, A., Etminani, F., Byttner, S., & Recamonde-Mendoza, M. (2024). Graph neural networks for clinical risk prediction based on electronic health records: A survey. Journal of Biomedical Informatics, 151, 104616.
5. Fine, N. M., Kalmady, S. V., Sun, W., Greiner, R., Howlett, J. G., White, J. A., McAlister, F. A., Ezekowitz, J. A., & Kaul, P. (2024). Machine learning for risk prediction after heart failure emergency department visit or hospital admission using administrative health data. PLOS Digital Health, 3(10), e0000636.
6. Singireddy, S., Adusupalli, B., Pamisetty, A., Mashetty, S., & Kaulwar, P. K. (2024). Redefining financial risk strategies: The integration of smart automation, secure access systems, and predictive intelligence in insurance, lending, and asset management. Journal of Artificial Intelligence and Big Data Disciplines, 1(1), 109-124.
7. Guo, A., Mazumder, N. R., Ladner, D. P., & Foraker, R. E. (2021). Predicting mortality among patients with liver cirrhosis in electronic health records with machine learning. PLOS ONE, 16(8), e0256428.
8. Iwagami, M., Inokuchi, R., Kawakami, E., Yamada, T., Goto, A., Kuno, T., Hashimoto, Y., Michihata, N., Goto, T., & Shinozaki, T. (2024). Comparison of machine-learning and logistic regression models for prediction of 30-day unplanned readmission in electronic health records: A development and validation study. PLOS Digital Health, 3(8), e0000578.
9. Polineni, T. N. S., Kumar, A. S., Maguluri, K. K., Koli, V., Valiki, D., & Ravikanth, S. (2024, November). A Scalable and Robust Framework for Advanced Semi Supervised Learning Supporting Universal Applications. In Proceedings of the 3rd International Conference on Optimization Techniques in the Field of Engineering (ICOFE-2024).
10. Islam, K. R., Prithula, J., Kumar, J., Tan, T. L., Reaz, M. B. I., Sumon, M. S. I., & Chowdhury, M. E. H. (2023). Machine learning-based early prediction of sepsis using electronic health records: A systematic review. Journal of Clinical Medicine, 12(17), 5658.
11. Jing, B., Boscardin, W. J., Deardorff, W. J., Jeon, S. Y., Lee, A. K., Donovan, A. L., & Lee, S. J. (2022). Comparing machine learning to regression methods for mortality prediction using Veterans Affairs electronic health record clinical data. Medical Care, 60(6), 470–479.
12. Recharla, M. (2024). Antioxidants, Biological Markers, Catalase, Glutathione Peroxidase, Chronic Periodontitis, Saliva, Smokeless tobacco, Smoker. Frontiers in Health Informatics, 13(8), 4999.
13. Kijpaisalratana, N., et al. (2022). Machine learning algorithms for early sepsis detection in the emergency department: A retrospective study. International Journal of Medical Informatics, 160, 104689.
14. Shyamala Anto Mary, P., Kalisetty, S., & Mandala, V. M. (2024, November). Advancing IoT Data Forecasting with Deep Learning Framework for Resilience Scalability and Real-World Applications. In Proceedings of the 3rd International Conference on Optimization Techniques in the Field of Engineering (ICOFE-2024).
15. Kolla, S. K. (2023). Big data–driven machine learning frameworks for clinical risk prediction. International Journal of Medical Toxicology and Legal Medicine.
16. Li, Y. (2022). Deep learning for electronic health records: Risk prediction, explainability, and uncertainty [Doctoral dissertation, University of Oxford].
17. McGilvray, M. M. O., Heaton, J., Guo, A., Masood, M. F., Cupps, B. P., Damiano, M., Pasque, M. K., & Foraker, R. (2022). Electronic health record-based deep learning prediction of death or severe decompensation in heart failure patients. JACC: Heart Failure, 10(9).
18. Nasarudin, N. A., Al Jasmi, F., Sinnott, R. O., Zaki, N., Al Ashwal, H., Mohamed, E. A., et al. (2024). A review of deep learning models and online healthcare databases for electronic health records and their use for health prediction. Artificial Intelligence Review, 57, 249.
19. Nguyen, K., Wilson, D. L., Diiulio, J., Hall, B., Militello, L., Gellad, W. F., Harle, C. A., Lewis, M., Schmidt, S., Rosenberg, E. I., Nelson, D., He, X., Wu, Y., Bian, J., Staras, S. A. S., Gordon, A. J., Cochran, J., Kuza, C., Yang, S., & Lo-Ciganic, W. (2024). Design and development of a machine-learning-driven opioid overdose risk prediction tool integrated in electronic health records in primary care settings. Bioelectronic Medicine, 10, 24.
20. Pan, W., Xu, Z., Rajendran, S., et al. (2024). An adaptive federated learning framework for clinical risk prediction with electronic health records from multiple hospitals. Patterns, 5(1), 100898.
21. Nandan, B. P. (2024). Semiconductor Process Innovation: Leveraging Big Data for Real-Time Decision-Making. Journal of Computational Analysis and Applications (JoCAAA), 33(08), 4038-4053.
22. Pettit, R. W., Fullem, R., & Cheng, C. (2021). Artificial intelligence, machine learning, and deep learning for clinical outcome prediction. Emerging Topics in Life Sciences, 5(6), 729–745.
23. Shamout, F. E., Zhu, T., & Clifton, D. A. (2021). Machine learning for clinical outcome prediction. IEEE Reviews in Biomedical Engineering, 14, 116–126.
24. Silva, C. A. O., Gonzalez-Otero, R., Bessani, M., Mendoza, L. O., & de Castro, C. L. (2022). Interpretable risk models for sleep apnea and coronary diseases from structured and non-structured data. Expert Systems with Applications, 200, 116955.
25. Pamisetty, V. (2024). Transforming taxation systems through predictive analytics and AI-driven compliance monitoring tools. Am Data Sci J Adv Comput, 3, 55-68.
26. Sun, H., Depraetere, K., Meesseman, L., De Roo, J., Vanbiervliet, M., De Baerdemaeker, J., Muys, H., von Dossow, V., Hulde, N., & Szymanowsky, R. (2021). A scalable approach for developing clinical risk prediction applications in different hospitals. Journal of Biomedical Informatics, 118, 103783.
27. Xie, F., Zhou, J., Lee, J. W., Tan, M., Li, S., Rajnthern, L. S. O., Chee, M. L., Chakraborty, B., Wong, A.-K. I., Dagan, A., Ong, M. E. H., Gao, F., & Liu, N. (2022). Benchmarking emergency department prediction models with machine learning and public electronic health records. Scientific Data, 9, 658.
28. Yang, D., Kim, J., Yoo, J., Cha, W. C., & Paik, H. (2022). Identifying the risk of sepsis in patients with cancer using digital health care records: Machine learning-based approach. JMIR Medical Informatics, 10(6), e37689.
29. Zang, C., & Wang, F. (2021). SCEHR: Supervised contrastive learning for clinical risk prediction using electronic health records. Proceedings of the IEEE International Conference on Data Mining, 857–866.
30. Mashetty, S. (2024). The role of US patents and trademarks in advancing mortgage financing technologies. European Advanced Journal for Science & Engineering (EAJSE)-p-ISSN, 3050-9696.
31. Ren, Y., et al. (2021). Machine learning based early mortality prediction in the emergency department. International Journal of Medical Informatics, 149, 104570.
32. Chen, I. Y., Joshi, M., Ghassemi, M., & Szolovits, P. (2021). Probabilistic machine learning for healthcare. Annual Review of Biomedical Data Science, 4, 23–43.
33. Goldstein, B. A., Navar, A. M., Pencina, M. J., & Ioannidis, J. P. A. (2021). Opportunities and challenges in developing risk prediction models with electronic health record data. Journal of the American Medical Informatics Association, 28.
34. Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2022). Ensuring fairness in machine learning to advance health equity. Annals of Internal Medicine, 175.
35. Wiens, J., Saria, S., Sendak, M., Ghassemi, M., Liu, V. X., Doshi-Velez, F., Jung, K., Heller, K., Kale, D., Saeed, M., Ossorio, P. N., Thadaney-Israni, S., & Goldenberg, A. (2021). Do no harm: A roadmap for responsible machine learning for health care. Nature Medicine, 27.
36. Sendak, M. P., D'Arcy, J., Kashyap, S., Gao, M., Nichols, M., Corey, K., Ratliff, W., & Balu, S. (2021). A path for translation of machine learning products into healthcare delivery. EMJ Innovations, 5.
37. Mashetty, S. (2024). Research insights into the intersection of mortgage analytics, community investment, and affordable housing policy. Available at SSRN 5249213.
38. Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2021). Key challenges for delivering clinical impact with artificial intelligence. BMC Medicine, 19.
39. Rajpurkar, P., Chen, E., Banerjee, O., & Topol, E. J. (2022). AI in health and medicine. Nature Medicine, 28.
40. Yu, K. H., Beam, A. L., & Kohane, I. S. (2021). Artificial intelligence in healthcare. Nature Biomedical Engineering, 5.
41. Paleti, S. Agentic AI in Financial Decision-Making: Enhancing Customer Risk Profiling. Predictive Loan Approvals, and Automated Treasury Management in Modern Banking.
42. Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., Lehman, L.-W. H., Celi, L. A., & Mark, R. G. (2023). MIMIC-IV, a freely accessible electronic health record dataset. Scientific Data, 10.
43. Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., Sundberg, P., Yee, H., Zhang, K., Zhang, Y., Flores, G., Duggan, G. E., Irvine, J., Le, Q., Litsch, K., … Dean, J. (2021). Scalable and accurate deep learning with electronic health records. NPJ Digital Medicine, 4.
44. Weng, W.-H., Wagholikar, K. B., McCradden, M. D., Tang, X., & Szolovits, P. (2022). Representation learning for clinical risk prediction from electronic health records. Journal of Biomedical Informatics, 128.
45. Pamisetty, A. (2024). Leveraging Big Data Engineering for Predictive Analytics in Wholesale Product Logistics. Available at SSRN 5231473.
46. Das, S., & colleagues. (2024). Clinical risk prediction using language models: Benefits and considerations. Journal of the American Medical Informatics Association, 31(9), 1856–1864.
Additional Files
Published
Issue
Section
License
Copyright (c) 2025 European Advanced Journal for Science & Engineering (EAJSE)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Articles published in the European Advanced Journal for Science & Engineering (EAJSE) are made freely available online immediately upon publication under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license permits unrestricted use, distribution, and reproduction in any medium or format, provided the original work is properly cited. Authors retain copyright of their work. By submitting to EAJSE, authors grant the journal the right of first publication. For details, visit: https://creativecommons.org/licenses/by/4.0/
