51. Machine Learning with Sensitivity Analysis to Determine Key Factors Contributing to Energy Consumption in Cloud Data Centers
- Author
-
Yun Li, Cindy Goh, and Yong Wee Foo
- Subjects
Artificial neural network ,business.industry ,Computer science ,Big data ,020206 networking & telecommunications ,Cloud computing ,02 engineering and technology ,Energy consumption ,computer.software_genre ,Machine learning ,Data modeling ,020204 information systems ,Server ,Genetic algorithm ,0202 electrical engineering, electronic engineering, information engineering ,Data center ,Data mining ,Artificial intelligence ,business ,computer ,Efficient energy use - Abstract
Machine learning (ML) approach to modeling\ud and predicting real-world dynamic system behaviours has\ud received widespread research interest. While ML capability in\ud approximating any nonlinear or complex system is promising,\ud it is often a black-box approach, which lacks the physical\ud meanings of the actual system structure and its parameters, as\ud well as their impacts on the system. This paper establishes a\ud model to provide explanation on how system parameters affect\ud its output(s), as such knowledge would lead to potential useful,\ud interesting and novel information. The paper builds on our\ud previous work in machine learning, and also combines an\ud evolutionary artificial neural networks with sensitivity analysis\ud to extract and validate key factors affecting the cloud data\ud center energy performance. This provides an opportunity for\ud software analyst to design and develop energy-aware\ud applications and for Hadoop administrator to optimize the\ud Hadoop infrastructure by having Big Data partitioned in\ud bigger chunks and shortening the time to complete MapReduce\ud jobs.
- Published
- 2016