Carbon-Aware Strategies for Predictive Analytics on AWS and GCP

Authors

  • Anumandla Mukesh Author

Keywords:

Carbon-aware deployment, predictive analytics, cloud platforms, GCP, AWS, energy efficiency, lifecycle optimization,Carbon-aware machine learning deployment,Green predictive analytics,Sustainable cloud machine learning,Energy-efficient ML models,Carbon-aware workload scheduling,Low-carbon cloud computing,Sustainable AI on cloud platforms,GCP carbon-aware deployment,AWS sustainable machine learning,Green AI infrastructure,Cloud energy optimization for ML,Carbon footprint reduction in ML pipelines,Eco-friendly data science workflows,Environmentally sustainable MLOps,Climate-conscious cloud architecture.

Abstract

Achieving energy-efficient cloud-based predictive-analytics deployments with reduced carbon emissions presents an important challenge. Existing approaches focus on optimizing performance and operational costs without considering their long-term impact on the growing carbon footprint. Moreover, green deployments are rarely integrated into decision making. A carbon-aware model-deployment strategy is presented, which incorporates carbon-intensity forecasts to minimize emissions. Carbon-aware scheduling and spatial routing balance latency and grid carbon-intensity while enabling real-time predictions in hybrid edge-cloud deployments. The objective functions and constraints are flexible, supporting trajectory optimization, temporal alignment with renewable-energy-generation patterns, and energy-awareness during model training. Analyses of the Google Cloud Platform and Amazon Web Services elucidate how services and tools can be leveraged to execute carbon-aware deployments. The approach is demonstrated in three carbon-aware case studies: real-time inference, batch training with regional carbon-minimization, and AutoML hyperparameter tuning. The proposed formulations provide decision-support information for directing green predictive-analytics workloads across cloud infrastructure.

Cloud-based predictive-analytics workloads typically follow a life cycle that encompasses model training, hyperparameter tuning, modeling, and inference. The infrastructures provided by cloud-service operators make it possible to elastically allocate these resources according to demand, achieving higher-performance and lower-cost deployments. Some service products allow inference to be geographically and temporally aligned with the request origin, reducing latency and improving user experience. Nonetheless, these predictions are rarely planned on the basis of grid carbon-intensity forecasts to achieve a smaller environmental impact—and carbon footprint—during the exploitation phase.

References

1. Chowdhury, S., Katangur, A., & Sheta, A. (2024). Optimization of datacenter selection through a genetic algorithm-driven service broker policy. Journal of Cloud Computing, 13, 156.

2. Dinesh Reddy, V., Rao, G. S. V. R. K., & Aiello, M. (2024). Energy efficient resource management in data centers using imitation-based optimization. Energy Informatics, 7, 106.

3. Wang, Z., Lin, X., Zhang, H., Yu, L., Pan, S., Liu, T., Wu, P., & Wang, T. (2024). Operation optimization considering multiple uncertainties for the multi-energy system of data center parks based on information gap decision theory. Frontiers in Energy Research, 12, 1423126.

4. Seo, C., Yoo, D., & Lee, Y. (2024). Empowering sustainable industrial and service systems through AI-enhanced cloud resource optimization. Sustainability, 16(12), 5095.

5. El Yadari, M., El Motaki, S., Yahyaouy, A., Makany, P., El Fazazy, K., Gualous, H., & Le Masson, S. (2024). Taxonomy of optimization algorithms combined with CNN for optimal placement of virtual machines within physical machines in data centers. Energy Informatics, 7, Article 122.

6. Simaiya, S., Lilhore, U. K., Sharma, Y. K., Rao, K. B. V., Maheswara Rao, V. V. R., Baliyan, A., Bijalwan, A., & Alroobaea, R. (2024). A hybrid cloud load balancing and host utilization prediction method using deep learning and optimization techniques. Scientific Reports, 14, 1337.

7. Hao, X., Liu, P., & Deng, Y. (2024). Joint optimization of operational cost and carbon emission in multiple data center micro-grids. Frontiers in Energy Research, 12, 1344837.

8. Dang, D. (2024). Energy consumption optimization in data centers using LSTM-based load prediction and dynamic resource allocation. Applied Mathematics and Nonlinear Sciences, 9(1).

9. Janardhanan, H. (2024). AI-driven load balancing for energy-efficient data centers. International Journal of Computer Trends and Technology, 72(8), 13–18.

10. Sathupadi, K., Avula, R., Velayutham, A., & Achar, S. (2024). RAP-Optimizer: Resource-aware predictive model for cost optimization of cloud AIaaS applications. Electronics, 13(22), 4462.

11. Maslej, N., Fattorini, L., Perrault, R., Parli, V., Reuel, A., Brynjolfsson, E., Etchemendy, J., Ligett, K., Lyons, T., Manyika, J., Niebles, J. C., Shoham, Y., Wald, R., & Clark, J. (2024). Artificial Intelligence Index Report 2024. Stanford Institute for Human-Centered Artificial Intelligence.

12. Saeidnia, H. R., Hosseini, E., Abdoli, S., & Ausloos, M. (2024). Unleashing the power of AI: A systematic review of cutting-edge techniques in AI-enhanced scientometrics, webometrics, and bibliometrics. Scientometrics.

13. de la Torre-López, J., Ramírez, A., & Romero, J. R. (2024). Artificial intelligence to automate the systematic review of scientific literature. Information Processing & Management, 61(3).

14. Ricca, F., Marchetto, A., & Stocco, A. (2024). A multi-year grey literature review on AI-assisted test automation. Journal of Systems and Software, 217.

15. Li, Y., Zhang, J., Wang, X., & Chen, H. (2024). Intelligent workload scheduling for sustainable cloud data centers using reinforcement learning. Future Generation Computer Systems, 154, 221–235.

16. Kumar, R., Singh, P., & Verma, S. (2024). AI-enabled predictive maintenance for hyperscale data center infrastructure. IEEE Access, 12, 87451–87466.

17. Ahmed, M., Hassan, A., & Khan, S. U. (2024). Deep learning-based resource orchestration in cloud-native data center environments. Journal of Network and Computer Applications, 235, 103941.

18. Garcia, D., Oliveira, P., & Fernandes, J. (2024). Autonomous data center management using machine learning and digital twins. Computers & Industrial Engineering, 189, 109967.

19. Zhou, T., Wu, Y., & Li, Q. (2024). AI-powered energy optimization and thermal management in modern data centers. Sustainable Computing: Informatics and Systems, 42, 100987.

20. Patel, N., Gupta, V., & Sharma, A. (2024). Intelligent automation frameworks for next-generation cloud service operations. IEEE Transactions on Services Computing, 17(4), 2105–2119.

Additional Files

Published

2024-03-06

How to Cite

Carbon-Aware Strategies for Predictive Analytics on AWS and GCP. (2024). European Data Science Journal (EDSJ), 2(01). https://esa-research.org/index.php/EDSJ/article/view/6

Similar Articles

71-77 of 77

You may also start an advanced similarity search for this article.