Dynamic Computation Offloading with Imperfect State Information in Energy Harvesting Small Cell Networks: A Partially Observable Stochastic Game

The combination of energy harvesting small cell networks (EH-SCNs) and mobile edge computing (MEC) has been considered as an effective means to improve the performance of mobile networks and provide users with a higher quality of service (QoS). In this letter, we investigate the decentralized computation offloading problem in heterogeneous EH-SCNs with MEC, where heterogeneous small cell base stations (SBSs) are rational individuals with interests to maximize their own benefits while considering their QoS requirements. Different from existing works, we address the challenge that heterogeneous SBSs may unwilling to expose their own information about the system state and offloading decisions. We formulate the problem as a partially observable stochastic game (POSG), in which SBSs can make optimal offloading decisions with imperfect state information. We analyze the local equilibrium, and propose a stochastic offloading algorithm to obtain the approximate optimal solution. Numerical results validate the effectiveness of the proposed scheme.