Search

The ExtendedHand interface projects a computer graphics (CG) hand that synchronizes with a user’s physical hand movements onto a real environment, visually extending the user’s reach. This paper focuses on enhancing the user’s tactile perception of an object through cross-modal phenomena by providing a sound texture (auditory information that matches the object) when the CG hand touches it. Here, ExtendedHand enables users to touch objects beyond their physical reach, an experience that cannot be achieved with their physical body. In such situations, the appropriateness of adjusting sound pressure based on physical laws according to distance for users is unclear. Additionally, we have empirical knowledge that the speed at which we touch objects with our hands results in different sounds. Within ExtendedHand, since the movement of the user’s physical hand is amplified and reflected in the CG hand’s movement, the physical hand’s speed does not match the CG hand’s speed. This raises the question of whether sound texture feedback should align with the visual information of the CG hand or the proprioceptive sensory information of the physical hand. In this paper, we conducted two user studies to explore appropriate sound texture feedback for the projected CG hand. The results indicate that when the CG hand touches objects at various distances, the sound pressure should follow the same sound pressure attenuation as observed in physical phenomena. Additionally, the results suggest that despite swift tracing actions with the CG hand, users perceive sounds produced at a slower pace to be more suitable.

With the rapid growth of technology in smart city networks, navigation inside complex buildings is difficult to navigate within such structures. Since the indoor Global Positioning System (GPS) works within an ultra-high radio frequency range, thick walls can negatively affect the quality of signals. The lack of GPS signals and line of sight with orbiting satellites makes navigation more challenging than in outdoor environments. Radiofrequency (RF) signals, Assisted GPS, and sensor-based solutions are used for tracking users in indoor environments, but they have some issues. This paper proposes the Smart Indoor Navigation System Using Augmented Reality (SINS_AR). It provides a solution for this challenge using available and accessible resources. It is used to get the best solution for indoor environments. When implementing the proposed system, a shop within a shopping mall, a specific room in a hotel, or a lecture room in a university can be easily located, providing the users with visual assistance that is reasonably accurate through their smartphones to reach the desired location. SINS_AR system is inspired by augmented reality and 2-D Visual markers. Several visual markers are placed in the complex building structure that when scanned using the application, arrows displayed on the screen lead the users to their destination. The application allows the users to choose their desired destination and also allows them to change their destination in between.

The Industrial Metaverse can benefit from the concepts fostered by Industry 5.0, since it implies making use of dynamic and up-to-date content, as well as fast human-to-machine interactions. To enable such enhancements, this article proposes the concept of Meta-Operator, which is essentially an industrial worker that follows the principles of Industry 5.0 and interacts with Industrial Metaverse applications and with his/her surroundings through advanced Extended Reality (XR) devices. In order to build the foundations of future Meta-Operators, this article provides a thorough description of the main technologies that support such a concept: the main components of the Industrial Metaverse, the latest XR technologies and accessories and the use of Opportunistic Edge Computing (OEC) communications (to detect and interact with the surrounding Internet of Things (IoT) and Industrial IoT (IIoT) devices). Moreover, this paper analyzes how to create the next generation of Industrial Metaverse applications based on the Industry 5.0 concepts, including the most relevant standardization initiatives, the integration of AR/MR devices with IoT/IIoT solutions, the development of advanced communications and software architectures and the creation of shared experiences and opportunistic collaborative protocols. Finally, this article provides an extensive list of potential Industry 5.0 applications for the Industrial Metaverse and analyzes thoroughly the main challenges and research lines. Thus, this article provides a holistic view and useful guidelines for the future developers and researchers that will create the next generation of applications for the Industrial Metaverse.

Currently, it is a norm to design a semiconductor fab using building information models (BIMs), which refer to a digital representation of a building’s physical and functional characteristics. The comprehensive data provided by BIMs include 3D geometric models. This paper presents a 3D model-based camera tracking method, which is targeted at navigating a fab’s wide indoor environment. The key observation made in designing the method is that there are a number of fixed objects in such an indoor environment. The columns are the representative among them. Our method extracts the columns from the input image and matches them to their BIMs to estimate the camera pose. The estimation accuracy is significantly increased by adopting an instance segmentation network. It is trained with a dataset, which is extracted from the target indoor environment and processed by our own data engine. The test results show that our tracking method is drift-free, accurate and robust. We envision that it can be used in many applications such as AR-based visual inspection.

This paper studies how the GeoGebra 3D Calculator with augmented reality (AR) serves as a tool for visualizing 3D graphs from functions of two variables in a mid-sized multivariable calculus class. We assessed this AR tool’s usability as a content delivery system. In our study, 39 students in the AR group received instructions on using the GeoGebra 3D Calculator with AR tool, while another 28 students in the control group worked exclusively with PowerPoint slides. Statistical testing reveals that the GeoGebra 3D Calculator with AR proves more effective than PowerPoint slides in terms of usability for teaching and learning multivariable calculus. However, the students’ attitudes and engagement do not show significant differences between the AR and control groups. This preliminary study highlights the crucial role of innovative educational technologies like the GeoGebra 3D Calculator with AR in enhancing the visualization of 3D graphs and other multivariable calculus topics. It suggests an advancement in the evolution of digital tools in education. The increased usability observed in the AR group indicates a promising direction for future educational strategies, especially in fields that require strong spatial visualization skills.

EXtended Reality (XR) alongside the Digital Twin (DT) in Industrial Internet of Things (IIoT) emerges as a promising next-generation technology. Its diverse applications hod the potential to revolutionize multiple facets of Industry 4.0 and serve as a cornerstone for the rise of Industry 5.0. However, current systems are still not effective in providing a high-quality experience for users due to various factors, one of which is their limited resources for processing and transmitting complex data and big data. To overcome these challenges, this paper presents an in-depth analysis of performance optimization techniques for resource-constrained Augmented Reality (AR) and/or Virtual Reality (VR) environments operating with DT, with a specific focus on Quality of Service (QoS), Quality of Experience (QoE), Edge-Cloud architectures and future research directions. Furthermore, this study delves into the intricate complex trade-off relationships involving optimization factors, including system quality, information quality, and QoE. In addition, it also explores potential solutions based on powerful emerging technological tools, including data compression, blockchain, cloud computing, quantum computing, Artificial Intelligence (AI) / Machine Learning (ML), and cybersecurity in the Cyber-Physical Systems (CPS). The insights provided in this comprehensive survey can inspire and guide researchers and industrial practitioners in optimizing performance for XR with DT applications in resource-constrained Smart Manufacturing System (SMS).

The development of conventional augmented reality (AR) works typically involves complex environment setup, programming development, high costs, and long development cycles, requiring developers to possess certain technical expertise and facing a high entry barrier. To address these challenges and reduce the difficulty of AR work development, this paper proposes a method for creating AR works based on graphical programming. A prototype system is developed to facilitate visual creation. The proposed method involves importing models and AR markers to construct the elements of the work. Subsequently, model parameter variables are designed to enable graphical programming and establish data associations between the work’s elements and the logic function algorithm. Additionally, the front-end page layout of the work can be conducted, and the binding of front-end buttons to back-end graphical programming trigger events can be realized. The prototype system is developed using the AR-Foundation and Unity3D engine. Several case studies are presented to demonstrate the feasibility and versatility of this AR creation method.