A Human-swarm Interaction Method Based on Augmented Reality

Aimed at the difficulty of interactive control for a swarm of robots by individual operator, a human-swarm interaction method based augmented reality is proposed. The augmented reality technology can display the swarm robots operating and environment in front of the operator, which reduces the operator’s cognitive complexity of remote robots. What’s more, the gesture recognition technology for natural interaction improves the naturalness of the proposed interaction method. The swarm robots coordination control rules are designed for that the difficulty in operating will not increase as the size of swarm robots increases. Simulations and experiments are performed to demonstrate the validity of the method. And the proposed method is verified with real robots.