Underwater Frogman Situational Awareness and AR Helmet Display and Control System

When frogmen perform underwater tasks, the visibility and permeability of the surrounding environment are poor due to the influence of slit, sewage and sediment, and the visual distance is only about 3-5 meters. However, integrating multi-beam imaging sonar on the top of frogman's helmet and displaying real-time sonar image information through AR glasses can expand frogman's "field of view" to 100 meters. This system satisfies the big view field of target monitoring and searching and the small view field of target recognition and tracking, thus greatly improving frogman's underwater situational awareness ability. Helmet display system, as a typical application of AR technology, has been widely used in F35 fighter plane and BMW motorcycle. However, due to the limited display area, low underwater visibility and difficult interaction, there is no helmet display system suitable for underwater Frogman. To this end, we design and implement a monocular silicon-based perspective VR visualization system for underwater frogman, which breaks through a series of key technologies that sonar, camera and underwater environment information multi-source data fusion, multi-window adaptive layout technology, sonar image real-time visualization technology and camera image real-time visualization technology, and realizes multi-source information integration and VR panoramic visualization for underwater frogman operation.