Model-free resource management of cloud-based applications using reinforcement learning

The digital system of the future will face the growing challenge of controlling the system behavior in complex dynamically evolving environments. In this paper, we examine the applicability of a new management paradigm based on Reinforcement Learning approach, where no preliminary specification of the system model is required. In contrast, the learning agent identifies the most adequate control policies in live interaction with a partially observed system and provides it with autonomous management capabilities. We present the results of experimentation with Cloud- based applications and discuss the technical challenges that need to be addressed in this field.