Augmented reality for assist apron operation safety supervisor in aircraft inspection processes

With the development of aviation, the issue of aviation safety is become more and more important. Especially for airplane maintenance and inspection task. As processes in the aircraft inspection after the plane take off are error prone and time consuming, efforts are made to implement these technologies to support apron operation safety supervisors during the inspection process. In this paper, we will show a concept to facilitate efficiency of assisting airport supervisor in aircraft inspection process. We propose a graphical user interface that contain the menu-guided instructions and digital inspection document, which will increase the efficiency of manual process. Furthermore, in order to help supervisor have an better understanding of inspecting processes, by attaching the 3D model of aircraft physical components, they can see corresponding hint information. Seeing instructional graphics overlaid directly on the actual task environment can significantly improve a user’s understanding compared to viewing instructions displayed on a nearby monitor or in a paper manual. In order to get the better view display effect, we used the one of the most advanced Augmented Reality (AR) glasses, the Microsoft Hololens2. In the inspector’s views, the part of airplane’s 3D model will immediately overlaid on the physical component. This Augment Reality Vision can be used for inspection purpose. And any inspection relate information can be directly attached to the aircraft component. For example, following the instruction, 3D model animation and inspection guide document information will appear on the aircraft component’s surface, which will improve the efficiency of inspection process. In addition, remote collaboration is discussed applying augmented reality devices in an inspection process, which will ensure inspector and expert has same vision in different site, that can improve the efficiency of dealing complicate problem.