Real-time tracking of surrounding objects in augmented and mixed reality applications

Today one of the most important problems in modern Augmented and Mixed reality applications is the analysis of surrounding objects in order to trace variability of the observed environment, the behavior of which is usually unpredictable. The solution to this problem can be widely applied in many mobile applications as a tool to interact with surrounding objects in the environment. Augmented and Mixed realities are both extremely promising directions for further research of interaction with the real environment. In this paper, we suggest a method of creation of geometric data based on a series of points in order to reconstruct the surface of real objects. This allows us to ensure the interaction with virtual objects. The proposed method comprises three steps: point detection, points clusterization into multiple groups of points, depending on their location, and the creation of geometric data such as lines and surfaces.