Remote virtual whiteboard assistance for improving task performance during lunar surface operations

During extravehicular activities (EVAs), astronauts are heavily dependent on the Mission Center (MCC) and their Intra-Vehicular Astronaut (IVA) counterparts. Each procedure step in a mission is relayed to the astronaut through a real-time voice loop, and emergency procedures are written on cuff checklists that astronauts must read from their spherically shaped helmet. In all situations, crew members heavily rely on IVA or MCC support, especially when they do not understand a procedure or need help with a specific problem. However, it can be hard to communicate procedures effectively due to a lack of visual diagrams and situational awareness between the two parties. To improve EVA efficiency, we investigated the use of a virtual whiteboard on a heads-up display during a lunar surface EVA task with virtual reality (VR). The virtual whiteboard allows MCC to send additional visual guidance (e.g., drawings and annotations) overlayed on the astronaut’s visual field of view to better assist with mission tasks. We conducted a between-subjects experiment where 21 participants were asked to accomplish a rover repair procedure, with (n = 11) and without (n = 10) the virtual whiteboard, using a VR lunar environment with support of a research proctor acting as MCC. The whiteboard group completed the rover procedure 39.1% faster than the non-whiteboard group, and this difference was statistically significant (p = 0.017). The total number of words exchanged during the experimental sessions was not statistically different between groups (p = 0.99). However, participants in the whiteboard group showed a tendency to talk less than their counterparts, while the research proctor in the whiteboard group showed a tendency to speak more. Finally, analysis of the spatial locations during the experiment indicated that whiteboard participants stayed closer to the rover, showing a better focus on the task at hand and therefore short completion times. The results of this experiment inform future development of AR spacesuit technologies for future planetary exploration EVA operations.