Build the Structure of WFSless AO System Through Deep Reinforcement Learning

We report on an aberration correction algorithm for a wavefront sensorless adaptive optics (WFSless AO) system based on deep reinforcement learning. First, it is verified that the reinforcement learning theory can be applied in our system. In addition, the deep deterministic policy gradient algorithm is introduced to build the control structure. After that, deep learning is used to deal with the messy raw images of far-field intensity distribution. We emphatically present how to design a feature extraction with the convolutional neural network in the control structure. To demonstrate the performance of this structure, some comparisons are made with the stochastic parallel gradient descent algorithm and the WFSless AO based on general modes algorithm. The results indicate that the correction speed of our method improves about 9 times and 2.5 times, respectively, for the similar correction effect.