Operators Training Using Simulation And VR Technology

Abstract This paper introduces a method for training operators using digital technologies. More specifically the training is focused on the teleoperation and remote control of resources and sensors using a simulated environment with virtual elements, before entering the real one. The objective is to improve the training of the operators and bring them closer to Industry 4.0 technologies where robotic and other automation solutions are tackled to support production activities. In this training activity the benefits of using a simulated environment as well as VR technology are presented. More specifically, a simulation application has been created and can be executed on a PC showing a virtual environment where a mobile platform can navigate freely around, calculating its path, and use its camera for obstacle or part detection purposes. On the other side, the VR application can be executed on a smartphone device with Android OS and can be used to see the field of view of the camera attached on the robot. The aforementioned applications can be connected through TCP/IP connection and enable the operator in real time to see and navigate in the virtual world using either the VR or simulation application. Furthermore, a specific scenario has been created and elaborated in the paper, where the robot needs to navigate inside a virtual infrastructure and perform inspection activities using its camera. Lastly, the benefits of each application are further detailed in the paper, focusing mainly on the validation of the inspection automated solution and its remote control in an intuitive and immersive way.