Orchestrating the AI Model Lifecycle in the Cloud-Native Era
Keywords:
Cloud-Native Model Lifecycle Management, Enterprise AI Systems, Cloud-Native AI Architecture, Model Deployment at Scale, AI Model Lifecycle Stages, Evidence-Based AI Engineering, Model Quality Management, Bias and Drift Mitigation, Provenance and Auditability, Observability in AI Systems, Explainable Enterprise AI, Compliance-Aware AI Deployment, High-Volume AI Data Pipelines, Access Control for AI Platforms, Cloud-Native MLOps, Scalable AI Services, Model Governance Frameworks, AI Engineering Productivity, Trustworthy AI Systems, Return on Investment for Enterprise AI.Abstract
Cloud-Native Model Lifecycle Management for Enterprise AI Systems considers the full lifecycle of AI models at enterprise scale in the context of cloud-native design principles. In cloud-native AI applications, a constellation of services, both stateless and stateful, collaborate to serve large volumes of business transactions. Cloud-native AI continues traditional AI deployment goals but at higher scale, reliability, and performance. Quality Evidence-based Discussion details the architectural considerations for deployment, divides the problem domain into stages, and describes key properties for each stage.
Reciprocal benefits are examined. Cloud-native techniques provide general engineering practice provenance, audit capabilities, and prove essential for maintaining quality and reducing bias and drift. Enterprise-scale AI, in turn, informs cloud-native practice by presenting supporting engineering challenges such as observability, access, and high-volume data. Business stakeholders seek accurate, explainable cloud-native AI solutions applied to factors such as legal compliance or customer churn. Model quality, team productivity, and trust determine business impact and return on investment. Junior AI engineers and developers are empowered by supporting engineering techniques.
References
1. Aguilar, L., Dao, D., Gan, S., Gurel, N. M., Hollenstein, N., Jiang, J., Karlas, B., Lemmin, T., Li, T., Li, Y., Rao, S., Rausch, J., Renggli, C., Rimanic, L., Weber, M., Zhang, S., Zhao, Z., Schwinski, K., Wu, W., & Zhang, C. (2021). Ease.ML: A lifecycle management system for MLDev and MLOps. In Proceedings of the 3rd International Workshop on Data Management for End-to-End Machine Learning.
2. Bannon, D., Moen, E., Schwartz, M., Borba, E., Kudo, T., Greenwald, N., Vijayakumar, V., Chang, B., Pao, E., Osterman, E., Graf, W., & Van Valen, D. (2021). DeepCell Kiosk: Scaling deep learning-enabled cellular image analysis with Kubernetes. Nature Methods, 18, 43–45.
3. Bachinger, F., & Kronberger, G. (2021). Concept for a technical infrastructure for management of predictive models in industrial applications. arXiv.
4. Yandamuri, U. S. (2021). A Comparative Study of Traditional Reporting Systems versus Real-Time Analytics Dashboards in Enterprise Operations. Universal Journal of Business and Management, 1(1), 1-13.
5. Daoudi, N., Allix, K., Bissyandé, T. F., & Klein, J. (2021). Lessons learnt on reproducibility in machine learning based Android malware detection. Empirical Software Engineering, 26, Article 74.
6. Dang-Quang, N., & Yoo, M. (2021). Deep learning-based autoscaling using bidirectional long short-term memory for Kubernetes. Applied Sciences, 11(9), 3835.
7. Prapas, I., Derakhshan, B., Mahdiraji, A. R., & Markl, V. (2021). Continuous training and deployment of deep learning models. Datenbank-Spektrum, 21, 203–212.
8. Kolla, S. K. (2022). Engineering Healthcare Data Infrastructures for Predictive Clinical Analytics and Evidence-Based Decision Making. International Journal of Engineering & Extended Technologies Research (IJEETR), 4(5), 5370-5380.
9. Rellermeyer, J. S., Heck, P., Cruz, L., & Xie, Y. (2021). Systematic mapping study on the machine learning lifecycle. In Proceedings of the 2021 IEEE/ACM 1st Workshop on AI Engineering—Software Engineering for AI (pp. 70–73). IEEE.
10. Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P. K., & Aroyo, L. (2021). “Everyone wants to do the model work, not the data work”: Data cascades in high-stakes AI. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery.
11. Spjuth, O., Frid, J., & Hellander, A. (2021). The machine learning life cycle and the cloud: Implications for drug discovery. Expert Opinion on Drug Discovery, 16(9), 1071–1079.
12. Tang, Y., Khatchadourian, R., Bagherzadeh, M., Singh, R., Stewart, A., & Raja, A. (2021). An empirical study of refactorings and technical debt in machine learning systems. In Proceedings of the 43rd International Conference on Software Engineering (pp. 238–250). IEEE/ACM.
13. Yang, C., Wang, W., Zhang, Y., Zhang, Z., Shen, L., Li, Y., & See, J. (2021). MLife: A lite framework for machine learning lifecycle initialization. Machine Learning, 110, 2993–3013.
14. Mao, Y., Fu, Y., Zheng, W., Cheng, L., Liu, Q., & Tao, D. (2022). Speculative container scheduling for deep learning applications in a Kubernetes cluster. IEEE Systems Journal, 16(3), 3770–3781.
15. Kolla, S. H. (2022). Strategic Information Integration Models for Cross-Functional Service Optimization in Large-Scale Enterprises. International Journal of Emerging Trends in Engineering and Management Research, 7(3), 11811.
16. Barrak, A., Petrillo, F., & Jaafar, F. (2022). Serverless on machine learning: A systematic mapping study. IEEE Access, 10, 1–17.
17. Boehm, M., Varma, P., & Xin, D. (2022). DEEM'22: Data management for end-to-end machine learning. In Proceedings of the 2022 International Conference on Management of Data (pp. 2548–2549). Association for Computing Machinery.
18. Garg, S., Pundir, P., Rathee, G., Gupta, P. K., Garg, S., & Ahlawat, S. (2022). On continuous integration/continuous delivery for automated deployment of machine learning models using MLOps. arXiv.
19. Hewage, N., & Meedeniya, D. (2022). Machine learning operations: A survey on MLOps tool support. arXiv.
20. Davuluri, P. S. L. N. (2021). Event-Driven Compliance Systems: Modernizing Financial Crime Detection Without Machine Intelligence. Journal of International Crisis and Risk Communication Research, 339-354.
21. Honkanen, T., O’Dwyer, J., & Salminen, V. (2022). Multidisciplinary teamwork in machine learning operations (MLOps). In Applied Human Factors and Ergonomics International (pp. 137–144). AHFE International.
22. Kreuzberger, D., Kühl, N., & Hirschl, S. (2022). Machine learning operations (MLOps): Overview, definition, and architecture. arXiv.
23. Symeonidis, G., Nerantzis, E., Kazakis, A., & Papakostas, G. A. (2022). MLOps—Definitions, tools and challenges. In 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC) (pp. 453–460). IEEE.
24. Testi, M., Ballabio, M., Frontoni, E., & Iannello, G. (2022). MLOps: A taxonomy and a methodology. IEEE Access, 10, 63606–63618.
25. Banf, M., & Steinhagen, G. (2022). Who supervises the supervisor? Model monitoring in production using deep feature embeddings with applications to workpiece inspection. arXiv.
26. Avacharmal, R., & Pamulaparthyvenkata, S. (2022). Enhancing algorithmic efficacy: A comprehensive exploration of machine learning model lifecycle management from inception to operationalization. Distributed Learning and Broad Applications in Scientific Research, 8.
27. Mangalampalli, B. M. "Scalable Data Warehouse Architecture for Population Health Management and Predictive Analytics." World Journal of Clinical Medicine Research 1, no. 1 (2021): 1-18.
28. Subramanya, T., & Riggio, R. (2021). Centralized and federated learning for predictive VNF autoscaling in multi-domain 5G networks and beyond. IEEE Transactions on Network and Service Management, 18(1), 63–78.
29. Mao, Y., Fu, Y., Zheng, W., Cheng, L., Liu, Q., & Tao, D. (2022). Speculative container scheduling for deep learning applications in a Kubernetes cluster. IEEE Systems Journal, 16(3), 3770–3781.
30. From DevOps to MLOps: Overview and application to electricity market forecasting. (2022). Applied Sciences, 12(19), 9851.
Additional Files
Published
Issue
Section
License
Copyright (c) 2023 European Advanced Journal for Science & Engineering (EAJSE)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Articles published in the European Advanced Journal for Science & Engineering (EAJSE) are made freely available online immediately upon publication under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license permits unrestricted use, distribution, and reproduction in any medium or format, provided the original work is properly cited. Authors retain copyright of their work. By submitting to EAJSE, authors grant the journal the right of first publication. For details, visit: https://creativecommons.org/licenses/by/4.0/
