Augmented Assembly Work Instruction Knowledge Graph for Adaptive Presentation

The application of Augmented Reality (AR) that present work instruction through visual elements for assembly operation can effectively reduce the cognitive load of operators. Among challenges that prevent AR systems from being widely used in complex assembly operations, the lack of augmented work instruction (AWI) adaptive presentation is an important aspect. This paper propose an augmented assembly work instruction knowledge graph (AWI-KG) for adaptive presentation to solve the problem. The characteristics of AWI are analyzed to abstract the concepts and relationships for domain ontology constructing. And using the domain ontology to extract the entities in assembly manual to establish the AWI-KG. Then, a collaborative filtering method based on AWI-KG is proposed. The multidimensional vectors are used to calculate the adaptive presentation mode for AWI according to the operator’s capabilities. The proposed method was applied in an AR system. The results show that the recommended visual elements can effectively adapt to the operator’s capabilities.