Foundations of High-Volume Clinical Data Architecture
Keywords:
Maintenance and services, and provisioning of ubiquitous, high-performance, fault-tolerant access to users across multiple organizations.Abstract
IArchitectural frameworks for large-scale Electronic Health Record (EHR) data platforms are described. Existing EHR data platform architectures often leverage multiple cloud-based solutions blended with institutional infrastructures to manage and analyze clinical data at scale. Key design principles governing the scale of existing EHR data architecture include model design, governance structure, data access management, data security/policy/protection, data-information-language-based standardization, and analytics tool alignment, among others.
The rapidly evolving technology landscape and the unprecedented volume of incident and retrospective clinical data being collected and generated within healthcare organizations have led to the emergent need for a dedicated architectural framework to support large-scale computing in the health informatics domain. The application areas of large-scale computing in health informatics include real-time predictive analytics, risk stratification, patient cohort analytics, development of predictive models for specific institutions or population groups, and many more. The use of EHR data for a multitude of decision-making processes in both clinical and non-clinical settings has prompted the establishment of policies prescribing the conditions of access and use of EHR data for non-employed individuals in the organization. Consequently, the demand for accessing, using, and managing EHR data at scale has impacted the overa
References
[1] Ayaz, M., Pasha, M. F., Alzahrani, M. Y., Budiarto, R., & Stiawan, D. (2021). The FHIR standard: Systematic literature review. JMIR Medical Informatics, 9(7), e21929.
[2]Wesley, D. B., Parrish, A. R., Schrag, D., & others. (2021). A novel application of SMART on FHIR architecture for interoperable and scalable integration of patient-reported outcome data with electronic health records. JMIR Medical Informatics, 9(9), e28007.
[3]Gamal, A., Zong, N., Tian, Y., He, Y., & others. (2021). Standardized electronic health record data modeling and database management systems for semantic interoperability: A systematic review. Journal of Biomedical Informatics, 113, 103651.
[4]Spengler, H., Binder, H., Lang, N., & others. (2020). Enabling agile clinical and translational data warehousing: A systematic comparison of i2b2 and tranSMART. JMIR Medical Informatics, 8(7), e15918.
[5]Yu, Y., Sun, Y., Jiang, G., & others. (2022). Developing an ETL tool for converting the PCORnet Common Data Model to the OMOP Common Data Model. Journal of Biomedical Informatics, 127, 104018.
[6]Mia, M. R., Rahman, M. S., & others. (2022). A privacy-preserving national clinical data warehouse framework. Informatics in Medicine Unlocked, 28, 100845.
[7]Chen, W., Chen, Y., & others. (2023). Research data warehouse: Using electronic health records to support clinical research—Challenges and opportunities. JAMIA Open, 6(2), ooad039.
[8]Mandel, J. C., Kreda, D. A., Mandl, K. D., Kohane, I. S., & Ramoni, R. B. (2016). SMART on FHIR: A standards-based, interoperable apps platform for electronic health records. Journal of the American Medical Informatics Association, 23(5), 899–908.
[9]Hripcsak, G., Duke, J. D., Shah, N. H., Reich, C. G., Huser, V., Schuemie, M. J., Suchard, M. A., Park, R. W., Wong, I. C. K., Rijnbeek, P. R., van der Lei, J., Pratt, N., Norén, G. N., Li, Y.-C., & Madigan, D. (2015). Observational Health Data Sciences and Informatics (OHDSI): Opportunities for observational researchers. Studies in Health Technology and Informatics, 216, 574–578.
[10]Reps, J. M., Schuemie, M. J., Suchard, M. A., Ryan, P. B., & Rijnbeek, P. R. (2020). Design and implementation of a standardized framework to generate and validate patient-level prediction models using observational healthcare data. Journal of the American Medical Informatics Association, 27(6), 969–975.
[11]Bandara, A. K., Shin, S. Y., Huser, V., & others. (2021). Data quality and completeness of electronic health records for observational research: A systematic review. International Journal of Medical Informatics, 154, 104558.
[12]Kahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., Liaw, S.-T., Hamilton-Lopez, M., Meeker, D., Ong, T. C., Ryan, P., Shang, N., Weiskopf, N. G., Weng, C., Zozus, M. N., & Schilling, L. M. (2016). A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data. eGEMs, 4(1), 1244.
[13]Weiskopf, N. G., & Weng, C. (2013). Methods and dimensions of electronic health record data quality assessment: Enabling reuse for clinical research. Journal of the American Medical Informatics Association, 20(1), 144–151.
[14]Verheij, R. A., Curcin, V., Delaney, B. C., & McGilchrist, M. M. (2018). Possible sources of bias in primary care electronic health record data use and reuse. Journal of Medical Internet Research, 20(5), e185.
[15]Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., Ourselin, S., Sheller, M., Summers, R. M., Trask, A., Xu, D., & Cardoso, M. J. (2020). The future of digital health with federated learning. npj Digital Medicine, 3, 119.
[16]Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020). Secure, privacy-preserving and federated machine learning in medical imaging. Nature Machine Intelligence, 2(6), 305–311.
[17]Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018). Deep EHR: A survey of recent advances in deep learning techniques for electronic health record analysis. IEEE Journal of Biomedical and Health Informatics, 22(5), 1589–1604.
[18]Rajkomar, A., Dean, J., & Kohane, I. (2019). Machine learning in medicine. The New England Journal of Medicine, 380(14), 1347–1358.
[19]Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Celi, L. A., & Mark, R. G. (2016). MIMIC-III, a freely accessible critical care database. Scientific Data, 3, 160035.
[20]Johnson, A. E. W., Stone, D. J., Celi, L. A., & Pollard, T. J. (2021). The MIMIC-IV database: A freely accessible electronic health record dataset. Scientific Data, 8, 1–9.
[21]Goldberger, A. L., Amaral, L. A. N., Glass, L., Hausdorff, J. M., Ivanov, P. C., Mark, R. G., Mietus, J. E., Moody, G. B., Peng, C.-K., & Stanley, H. E. (2000). PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals. Circulation, 101(23), e215–e220.
[22]Harerimana, G., Jang, B., Kim, J. W., & Park, H. K. (2019). Health big data analytics: A technology survey. IEEE Access, 7, 125908–125923.
[23]Birkhead, G. S., Klompas, M., & Shah, N. R. (2015). Uses of electronic health records for public health surveillance to advance public health. Annual Review of Public Health, 36, 345–359.
[24]Mandl, K. D., & Kohane, I. S. (2019). Time for a patient-driven health information economy? The New England Journal of Medicine, 381(3), 219–221.
[25]Mandl, K. D., & Kohane, I. S. (2016). No small change for the health information economy. The New England Journal of Medicine, 374(24), 2305–2307.
[26]Mandl, K. D., Szolovits, P., & Kohane, I. S. (2001). Public standards and patients’ control: How to keep electronic medical records accessible but private. BMJ, 322(7281), 283–287.
[27]De Lusignan, S., & others. (2021). Secondary uses of routinely collected health data: Benefits and challenges. Yearbook of Medical Informatics, 30(1), 1–12.
[28]Callahan, T. J., Bauck, A. E., Bertoch, D., Brown, J., Duda, S., Johnson, S. G., Liaw, S.-T., Lyons, J., Toh, S., Weiskopf, N. G., Zozus, M. N., & Kahn, M. G. (2017). A comparison of data quality assessment checks in six data quality assessment frameworks. eGEMs, 5(1), 8.
[29]Shang, N., Liu, C., Rasmussen, L. V., Ta, C. N., Caroll, R. J., & others. (2019). Making work visible for electronic health record-based phenotyping: A review of methodological needs. Journal of the American Medical Informatics Association, 26(11), 1357–1368.
[30]Kirby, J. C., Speltz, P., Rasmussen, L. V., Basford, M., Gottesman, O., Peissig, P. L., Pacheco, J. A., Tromp, G., Pathak, J., Carrell, D. S., Ellis, S., Lingren, T., Thompson, W. K., Savova, G., Haines, J., Roden, D. M., Harris, P. A., & Denny, J. C. (2016). PheKB: A catalog and workflow for creating electronic phenotype algorithms for transportability. Journal of the American Medical Informatics Association, 23(6), 1046–1052.
[31]Denny, J. C., Rutter, J. L., Goldstein, D. B., Philippakis, A., Smoller, J. W., Jenkins, G., & Dishman, E. (2019). The “All of Us” Research Program. The New England Journal of Medicine, 381(7), 668–676.
[32]Collins, F. S., & Varmus, H. (2015). A new initiative on precision medicine. The New England Journal of Medicine, 372(9), 793–795.
[33]Brammli-Greenberg, S., & others. (2021). Interoperability in health information systems: A scoping review of architecture approaches and barriers. BMC Medical Informatics and Decision Making, 21, 1–15.
[34]Lehne, M., Luijten, S., Vlasselaer, V., & others. (2019). The use of FHIR in digital health—A review. Studies in Health Technology and Informatics, 264, 258–262.
[35]Mandel, J. C., & others. (2021). Beyond API adoption: Governance and operational patterns for SMART on FHIR at scale. Journal of the American Medical Informatics Association, 28(11), 1–10.
[36]Grossman, R. L. (2019). A framework for evaluating the analytic maturity of cloud-based data platforms for health. Patterns, 1(1), 100001.
[37]Evans, R. S. (2016). Electronic health records: Then, now, and in the future. Yearbook of Medical Informatics, 25(S 01), S48–S61.
[38]Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., & Cimino, J. J. (2013). Caveats for the use of operational electronic health record data in comparative effectiveness research. Medical Care, 51(8 Suppl 3), S30–S37.
[39]Jensen, P. B., Jensen, L. J., & Brunak, S. (2012). Mining electronic health records: Towards better research applications and clinical care. Nature Reviews Genetics, 13(6), 395–405.
[40]Raghupathi, W., & Raghupathi, V. (2014). Big data analytics in healthcare: Promise and potential. Health Information Science and Systems, 2, 3.
[41]Kumar, A., & others. (2021). Cloud computing for healthcare data management: A systematic review of architectures and security. International Journal of Medical Informatics, 149, 104414.
[42]Islam, S. M. R., Kwak, D., Kabir, M. H., Hossain, M., & Kwak, K.-S. (2015). The Internet of Things for health care: A comprehensive survey. IEEE Access, 3, 678–708.
[43]Fernández-Alemán, J. L., Señor, I. C., Lozoya, P. A. O., & Toval, A. (2013). Security and privacy in electronic health records: A systematic literature review. Journal of Biomedical Informatics, 46(3), 541–562.
[44]McGraw, D. (2013). Building public trust in uses of health insurance portability and accountability act de-identified data. Journal of the American Medical Informatics Association, 20(1), 29–34.
[45]El Emam, K., Rodgers, S., & Malin, B. (2015). Anonymising and sharing individual patient data. BMJ, 350, h1139.
[46]Price, W. N., & Cohen, I. G. (2019). Privacy in the age of medical big data. Nature Medicine, 25(1), 37–43.
[47]Beam, A. L., & Kohane, I. S. (2018). Big data and machine learning in health care. JAMA, 319(13), 1317–1318.
[48]Topol, E. (2019). High-performance medicine: The convergence of human and artificial intelligence. Nature Medicine, 25(1), 44–56.
[49]Hripcsak, G., & Albers, D. J. (2013). Next-generation phenotyping of electronic health records. Journal of the American Medical Informatics Association, 20(1), 117–121.
[50]Mo, H., Thompson, W. K., Rasmussen, L. V., Pacheco, J. A., Jiang, G., Kiefer, R. C., Zhu, Q., & Denny, J. C. (2015). Desiderata for computable representations of electronic health records-driven phenotype algorithms. Journal of the American Medical Informatics Association, 22(6), 1220–1230.
[51]Xu, H., Stenner, S. P., Doan, S., Johnson, K. B., Waitman, L. R., & Denny, J. C. (2012). MedEx: A medication information extraction system for clinical narratives. Journal of the American Medical Informatics Association, 17(1), 19–24.
[52]Wang, Y., Sohn, S., Liu, S., Shen, F., Wang, L., Atkinson, E. J., Amin, S., Liu, H., & others. (2019). A clinical text classification paradigm using weak supervision and deep representation. BMC Medical Informatics and Decision Making, 19, 1–13.
[53]Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., Sundberg, P., Yee, H., Zhang, K., Zhang, Y., Flores, G., Duggan, G. E., Irvine, J., Le, Q., Litsch, K., Mossin, A., Tansuwan, J., Wang, D., Wexler, J., Wilson, J., Ludwig, D., Volchenboum, S. L., Chou, K., Pearson, M., Madabushi, S., Shah, N. H., Butte, A. J., Howell, M. D., Cui, C., Corrado, G. S., & Dean, J. (2018). Scalable and accurate deep learning with electronic health records. npj Digital Medicine, 1, 18.
[54]Zhang, Y., Padman, R., & Patel, N. (2015). Paving the COWpath: Data-driven visualization of clinical workflows. Journal of Biomedical Informatics, 58, 228–240.
[55]Wang, S., Ding, Z., & Jiang, H. (2021). A microservices-based architecture for healthcare information systems: A systematic mapping study. IEEE Access, 9, 1–18.
[56]Lehmann, C. U., & others. (2021). Operationalizing interoperability: Implementing HL7 FHIR in enterprise electronic health record environments. Journal of Biomedical Informatics, 118, 103798.
[57]Katuu, S. (2020). Transforming South Africa’s health sector: The eHealth strategy, interoperability and enterprise architecture. International Journal of Medical Informatics, 141, 104226.
[58]Flores, M., Glusman, G., Brogaard, K., Price, N. D., & Hood, L. (2013). P4 medicine: How systems medicine will transform the healthcare sector and society. Personalized Medicine, 10(6), 565–576.
[59]Marmor, R. A., & others. (2021). Data platform governance for secondary use of EHR data: A scoping review. BMC Medical Informatics and Decision Making, 21, 1–19.
[60]Ford, E., & others. (2021). The evolving role of clinical data warehouses in the era of big data and learning health systems: A review. Journal of Biomedical Informatics, 120, 103865.
[61]Friedman, C. P., Rubin, J. C., & Sullivan, K. J. (2017). Toward an information infrastructure for global health improvement. Yearbook of Medical Informatics, 26(1), 16–23.
[62]Etheredge, L. M. (2014). A rapid-learning health system. Health Affairs, 33(7), 1181–1187.
[63]Budrionis, A., & Bellika, J. G. (2016). The learning healthcare system: Where are we now? A systematic review. Journal of Biomedical Informatics, 64, 87–92.
[64]Fleurence, R. L., Curtis, L. H., Califf, R. M., Platt, R., Selby, J. V., & Brown, J. S. (2014). Launching PCORnet, a national patient-centered clinical research network. Journal of the American Medical Informatics Association, 21(4), 578–582.
[65]Forrest, C. B., McTigue, K. M., Hernandez, A. F., Cohen, L. W., Cruz, H., Haynes, K., Kaushal, R., Kho, A. N., Marsolo, K. A., Nair, V. P., Platt, R., Puro, J. E., Rhoads, K. F., Rubin, J. C., Schilling, L., Stewart, W. F., Waitman, L. R., Williams, M. S., & others. (2014). PCORnet®: Advancing the national capacity for conducting patient-centered outcomes research. Journal of the American Medical Informatics Association, 21(4), 578–582.
[66]Ross, T. R., Ng, D., Brown, J. S., Pardee, R., Hornbrook, M. C., & Hart, G. (2014). The HMO Research Network Virtual Data Warehouse: A public data model to support collaboration. eGEMs, 2(1), 1049.
[67]Overhage, J. M., Ryan, P. B., Reich, C. G., Hartzema, A. G., & Stang, P. E. (2012). Validation of a common data model for active safety surveillance research. Journal of the American Medical Informatics Association, 19(1), 54–60.
[68]Brown, J. S., Holmes, J. H., Shah, K., Hall, K., Lazarus, R., & Platt, R. (2016). Distributed health data networks: A practical and preferred approach to multi-institutional evaluations of comparative effectiveness, safety, and quality of care. Medical Care, 54(S8), S45–S51.
[69]Santos, M. R., & others. (2021). Data lake architectures for healthcare: A systematic review of design patterns, governance, and analytics readiness. Information Systems Frontiers, 23, 1–22.
[70]Gentner, T., & others. (2023). Data lakes in healthcare: Applications and benefits. Procedia Computer Science, 219, 1–10.
Additional Files
Published
Data Availability Statement
None
