Search

Extended reality (XR) enables both new opportunities but also introduces new barriers for inclusion in society. Furthermore, XR is less researched than web, desktop and mobile applications. This position paper presents the concept of an XR platform for inclusion, with the purpose to make people on the autism spectrum and with other disabilities, more independent of help from others in everyday life situations. Based on previous research, our position is that, through current and future XR technologies combined with civic and artificial intelligence, it is possible to create individually personalised support for this purpose, grounded in practice to ensure validation. [ABSTRACT FROM AUTHOR]

This work developed a simple, easy-to-prepare, and inexpensive indicator (R-Paper) based on rub-coating of red cabbage on readily available paper substrates to detect the freshness of fish in out-of-lab settings. A single-step rub-coating method was used to incorporate anthocyanins on paper substrates, without the extraction of the compound from red cabbage. The preparation of the indicator and its usage is quick and does not require additional chemicals, personnel expertise, or laboratory facilities. The functional colorimetric interface created by directly rubbing red cabbage on paper was used for fish quality monitoring, which displayed a naked-eye detectable color change from purple (for fresh fish) to blue (for spoiling fish) and then to blue-green (for spoiled fish), corresponding to total volatile basic nitrogen (TVB-N) and pH changes. To provide a user-friendly quantitative analysis of this color change, we used the free Android software Color Grab to quantify the color using L* , a* , b* , and RGB indices. To the best of our knowledge, this work is the first report on an indicator prepared by rub-coating red cabbage onto paper-based substrates for fish spoilage monitoring through smartphone-based analysis. To verify that the R-Paper indicator performs on a par with the indicators using extracted anthocyanins, its performance was compared with indicators prepared using anthocyanins extracted from red cabbage (AR-Paper). Naked-eye analysis, simple preparation, ease of use, low cost, and free smartphone-based analysis make the R-Paper indicator an appropriate food quality indicator in resource-limited areas. [Display omitted] • A colorimetric indicator prepared by rub-coating red cabbage on paper is developed to assess the freshness of fish. • A cost-free smartphone application was employed for measuring the colorimetric response of the indicator. • The indicator displayed quantifiable colors of purple for fresh fish, blue for spoiling, and blue-green for spoiled fish. • The preparation and usage of the indicator is simple and does not require specialized laboratory equipment or expert users. [ABSTRACT FROM AUTHOR]

Abstract: The popularity of augmented reality (AR) applications on mobile devices is increasing, but there is as yet little research on their use in real-settings. We review data from two pioneering field trials where MapLens, a magic lens that augments paper-based city maps, was used in small-group collaborative tasks. The first study compared MapLens to a digital version akin to Google Maps, the second looked at using one shared mobile device vs. using multiple devices. The studies find place-making and use of artefacts to communicate and establish common ground as predominant modes of interaction in AR-mediated collaboration with users working on tasks together despite not needing to. [Copyright &y& Elsevier]

Landscape design has a long history, from ancient royal gardens to modern urban parks, and its design concepts and techniques are constantly evolving. Nowadays, with the improvement of people's environmental requirements, landscape design is also constantly innovating. Although the landscape has made great progress, in actual operation, there are problems such as communication barriers with customers, difficulty in design implementation, and inability to preview the design effect in real time. Computer augmented reality technology has begun to play an important role in landscape design. Augmented Reality (AR) overlays the virtual 3D model into the real scene, previews the effect of design implementation in real time, carries out data analysis and optimization, and improves the design better to meet the needs of the public. In order to scientifically evaluate the effect of computer augmented reality technology in landscape design, this paper sets two main indicators: efficiency and quality. Efficiency is primarily concerned with the speed difference compared to traditional design methods. By means of comparative experiments, the time required to use augmented reality technology is calculated. Quality is mainly based on user feedback and expert review. Through users' actual experience of landscape design under augmented reality technology, their feedback is collected, and combined with professional review, the performance of augmented reality technology in design quality is comprehensively evaluated. This paper investigates the evaluation results of people in four landscapes (green plants, pavilions, ancient buildings, fountains). The survey results show that the fountain design quality is 80 points, the efficiency score is consistent with the pavilion, the feasibility score exceeds 80 points (82), and the user satisfaction is 5 points higher than the pavilion design. [ABSTRACT FROM AUTHOR]

Virtual reality (VR) and augmented reality (AR) are rapidly developing technologies that may have important healthcare-related applications, including the possible evaluation of the health and performance of astronauts. Advances in the fields of VR/AR and space exploration have independently progressed; however, over the last decade synergies and overlapping applications have emerged between spaceflight and extended reality. This paper is intended to be a resource to update the medical community on the current and future integration of VR and AR into space exploration, particularly as this integration relates to astronaut health. We highlight how these technologies are used in terrestrial healthcare with specific attention to visual function. Furthermore, we elaborate on emerging VR applications being developed for future spaceflight. The paper discusses the current state of the art, such as the Apple Vision Pro headset, and outlines key challenges like mass and volume constraints, power limitations, and the heightened cognitive and physical demands of space travel. It also addresses the potential of VR/AR technologies to mitigate these issues through efficiency, stress reduction, and exercise motivation. Finally, we emphasize the benefits that these technologies provide to overcome possible barriers to long duration spaceflight and manned exploration missions, including spaceflight associated neuro-ocular syndrome (SANS). • Virtual reality (VR) and augmented reality (AR) are rapidly developing technologies that may have important healthcare-related applications, including the possible evaluation of the health and performance of astronauts. • This paper is intended to be a resource to update the medical community on the current and future integration of VR and AR into space exploration, particularly as this integration relates to astronaut health. • We highlight how these technologies are used in terrestrial healthcare with specific attention to visual function. Furthermore, we elaborate on emerging VR applications being developed for future spaceflight. [ABSTRACT FROM AUTHOR]

This paper presents a support tool designed for instructors in technical education within engineering programs, focusing specifically on power electronics and laboratory procedures related to the three-phase half-wave rectifier. The Augmented Reality (AR) application was developed for Android devices using Unity+Vuforia, employing a gamification-based approach. The application allows students to evaluate their knowledge and skills in real-time and offers an interactive learning environment. It provides learning diagnostics and sends each student's evaluation to a database stored on Google-Forms that is accessible by the instructor or assessor in question. It's important to note that this APP is freely accessible through the Android APP store. The learning strategy is around a game that tests players on their knowledge of measuring devices and theoretical concepts. Additionally, there is a puzzle task that encourages learners to correctly arrange the waveforms in a rectifier. Students can also connect the half-wave rectifier's essential connections and the transformer's delta-star connections through touch interaction. A comparison study between traditional teaching methods and the innovative AR-based approach has been conducted. This educational proposal itself is an innovative solution that will be especially helpful for laboratories lacking useful equipment in Mexican colleges. To test the effect of AR application on student success, an experimental study was conducted on two groups of students (a control group [non-using AR] and a test group [using AR]). To determine significant difference in acquired learning, an ANOVA statistical analysis was conducted using independent sample tests. According to tests result, there is a significant difference in the acquired knowledge for those who used the designed tool. The probability value (p = 1e-5 <0.05) for the use of AR is found. They increase their initial average grade from 27.08% to 72.3%, in contrast to the control group with no significant increasing learning, reporting an initial average grade of 28.75–43.33%. These results show that the use of AR in electronic practice makes a significant difference in student success. [ABSTRACT FROM AUTHOR]

Augmented Reality has become a bridge from the virtual to the real world. This technology has been an implementable choice for fashion companies to provide more information and customization for their user's shopping experience. From the COVID-19 pandemic alongside technological globalization, fashion industries have to find a new way for customers to purchase products. All things considered, AR helped fashion industries keep customers attracted and satisfied. This paper is conducted in a Systematic Literature Review manner to review and compare the AR technologies used by fashion industries. Furthermore, the result would be a proposition of which Augmented Reality technology or platform option is feasible and implementable for the fashion industry. After comparing the technologies used in past papers and their technical and economic feasibility, we propose a 3-term plan. The short-term plan with zero cost and mobile platform-focused application, the medium-term plan with an upgraded version of the garment object from 2D images to 3D objects, and the long-term plan changing the platform used from mobile to a new device. We also conclude that artificial intelligence can also support and improve the augmented reality experience for customers in the fashion retail industry by implementing an AI-powered virtual assistant. [ABSTRACT FROM AUTHOR]

This paper reviews the recent development of augmented reality (AR) head-tracking techniques. AR is an emerging technology that provides users with digital augmentation layered on the real-life environment. AR systems use tracking to maintain the point of reference and enable the device to follow the user's movements and position within the physical world. Head-tracking is a crucial component of AR that inputs and interprets the movement of the device and the user's physical location in real-time. The main challenge in head-tracking is the appearance change that results from head rotation, which necessitates high accuracy and long-range tracking in a noisy environment. Latency and errors in head-tracking can reduce the system's overall effectiveness and cause jarring or unsettling effects for the user. This paper's contribution is to shed light on the best methods for tracking and registering in augmented reality, which will guide future advancements in the field. The review covers recent work proposed to improve head-tracking performance and reduce latency, highlighting the challenges and future directions of head-tracking techniques in AR. [ABSTRACT FROM AUTHOR]

Wooden-house assembly is an area where still a big part of the work is done manually. In this case study, pairs of operators compose large wooden pieces together based on paper-print instructions complemented by visual guidance in the shape of laser marks projected from lasers mounted in the ceiling, based on Computer-aided design (CAD) data. Augmented Reality (AR) head-mounted displays (HMD) offer a unique platform for providing instructions and additional information superimposed in the work environment and thus can provide guidance in a cognitively ergonomic way. A particular advantage compared to other computing platforms is that the operators have free hands and can perform the manual work and follow guidance simultaneously. We present an evaluation of a prototype that dynamically transforms a CAD data file with design and measurements of wooden trusses to be manufactured, into an AR-based guidance system developed in Unity for Microsoft HoloLens 2 devices. We used an iterative participatory design process for prototyping and think-aloud protocol combined with observations for evaluation, involving professional assemblers in different stages of the process. Participants found the solution to potentially save time in their everyday work and simplify the task by offering increased visibility of the marks compared to the existing laser projection. Large-scale deployment of the system is still facing design challenges of which some are also discussed in the paper. [ABSTRACT FROM AUTHOR]

Augmented Reality (AR) and Virtual Reality (VR) technologies have significantly progressed in recent years, revolutionizing a diverse set of industries, mainly the industrial metaverse in cultural heritage and the cultural and creative sectors. In the context of social manufacturing, there's a pronounced need for platforms that foster collaboration. This paper introduces a collaborative AR/VR platform for social manufacturing, emphasizing the need for a co-creation environment. This platform supports real-time customized fabrication of 3D objects through rapid manufacturing within an AR/VR-based collaborative framework, further enhancing shared awareness in social manufacturing endeavors. The platform provides a robust toolkit for AR/VR applications that enables real-time interaction with virtual entities and seamless integration with the backend databases of online marketplaces. Designed to be universally adaptable, the toolkit is indifferent to the type of database it interacts with, and can function on a wide range of platforms including Web VR, Mobile AR, and HoloLens AR. A use case involving a reference chair model demonstrates the toolkit's capabilities, highlighting its potential to transform experiences within AR/VR landscapes. By offering a seamless fusion of digital content within physical environments, this AR/VR toolkit signifies a considerable advancement towards the intersection of digital and physical realities, paving the way of immersive experiences. [ABSTRACT FROM AUTHOR]

The growing complexity of the logistics chain, the need to take on an ever longer and distributed logistic chain, which in some cases even reaches the final stages of the production of the same goods, highlights the problem of managing the post-production phases of products and goods, but also of the personnel who work on these activities, charged to the companies that deal with logistics. We present in this paper the Integrated Logistic Platform (ILP 4.0), a software architectural model, whose purpose is to lead warehouse logistics to new levels of efficiency, not reachable as the sum of the operational functions within a single logistic company, but reachable only through a unique and cross-functional system, which surpasses the usual fragmented vision and consequent approaches, in favor a strategic coordination of all activities. In this paper it is described the general architecture of the realized platform, with its research contributions and innovations, in particular related to some typical problems of warehouse environments, solved with the help of machine learning and computer vision approaches, but also with the integration of augmented reality (AR) and virtual reality (VR) devices. The aim of the integration of these technologies in the project is the definition of a "smart" warehouse model environment, capable of mitigate problems of warehouse logistics such as: automation of the inventory process (through an UAV), control of warehouse movements, and management of logical / physical security of the premises. Based on the experiences made on the project, and focusing the attention on the safety and security aspects in logistics, that the platform covers, we discuss further a possible federated learning approach in order to mitigate the lack of data in order to solve some security and safety problems in the logistic area. [ABSTRACT FROM AUTHOR]

It is challenging to evacuate people quickly and safely in large complex buildings in emergencies. With the rapid development of smart mobile devices, the research of augmented reality (AR) technology in emergency evacuation is gradually becoming a hot topic. Meanwhile, virtual agents have been widely used in numerous fields and have been proved to be helpful for guidance. Therefore, this study proposes an indoor evacuation guidance system with an AR virtual agent. The system uses smartphones as mobile terminals to deliver optimal exit path directions for users in real-time. An AR virtual agent is used to guide users to evacuate quickly and safely in complex building environments. In this paper, we take a museum as an example and use the permanent features in the museum as markers for the AR application to activate the virtual agent, which plays the role of a guide to help users evacuate the building. This paper describes the design and implementation of the system, and conducts a user study at a local museum to evaluate the system's usability. The results show that the system can effectively provide guidance and help users to evacuate indoors in the emergency. [ABSTRACT FROM AUTHOR]

For many applications, remote guidance and telerobotics provide great advantages. For example, tele-ultrasound can bring much-needed expert healthcare to isolated communities. However, existing tele-guidance methods have serious limitations including either low precision for video conference-based systems, or high complexity and cost for telerobotics. A new concept called human teleoperation leverages mixed reality, haptics, and high-speed communication to provide tele-guidance that gives an expert nearly-direct remote control without requiring a robot. This paper provides an overview of the human teleoperation concept and its application to tele-ultrasound. The concept and its impact are discussed. A new approach to remote streaming and control of point-of-care ultrasound systems independent of their manufacturer is described, as is a high-speed communication system for the HoloLens 2 that is compatible with ResearchMode API sensor stream access. Details of these systems are shown in supplementary video demonstrations. Novel interaction methods enabled by HoloLens 2-based pose tracking are also introduced and tests of the communication and user interaction are presented. The results show continued improvement of the system compared to previous work in instrumentation, HCI, and communication. The system thus has good potential for tele-ultrasound, as well as possible other applications of human teleoperation including remote maintenance, inspection, and training. The remote ultrasound streaming and control application is made available open source. [Display omitted] • System improvements to human teleoperation demonstrate its feasibility. • Other devices such as the Nreal Light can be used for implementation. • New device-agnostic remote ultrasound streaming and control demonstrated. • HoloLens pose tracking enables human teleoperation with limited compute resources. • HoloLens-based communication system provides effective sensor data streaming. [ABSTRACT FROM AUTHOR]

The rapid advancement of technology in Industry 4.0 (I4.0) led to the widespread use of cutting-edge technologies like Virtual Reality (VR) and Augmented Reality (AR). However, with Industry 5.0 (I5.0), comes a paradigm shift that emphasizes the importance of human well-being to establish a stronger sense of connection and purpose for employees. In this endeavour, gamification has emerged as a powerful tool, showing great potential in engaging, motivating, and empowering employees. This research paper aims to investigate the potential of gamification within the workplace and addresses three main research questions. Firstly, the study explores the prevalent equipment or devices used by organizations that implement gamification, and the relationship with the success of gamification strategies. Secondly, it examines how employees' age influences their perceptions of gamification's potential and their willingness to embrace its implementation. Lastly, this research investigates the relationship between employee satisfaction - with the implemented gamification strategy - and their participation in the design process. The study adopts a survey-based methodology, gathering data from 23 participants through a convenient sampling approach. Quantitative data analysis is conducted using Microsoft Excel , while qualitative data analysis is performed using NVivo. The findings explore the interrelationships between gamification, technology usage, age, employee satisfaction, and participation in the design process, highlighting the prevalence of computers, tablets, and mobile devices as the primary tools in gamification experiences. Moreover, the study emphasizes how employees' age influences their perceptions of gamification and reveals a positive relationship between employee satisfaction and participation in the design process. These findings underscore the potential of gamification in enhancing collaboration, learning, and employee well-being, and ultimately driving organizational success in the I5.0 era. [ABSTRACT FROM AUTHOR]

In recent years, the manufacturing industry has witnessed the utilization of Augmented Reality (AR) technologies in their daily operations. This paper takes a deep dive into the applications of AR in the manufacturing industry, specifically focusing on quality inspection, assembly, and remote assistance. This research offers valuable insights into the technical architectures using custom and commercial software, as well as the Proof of Concept (PoC) applications for Hand-Held Device (HHD) and Head-Mounted Device (HMD). The custom application for an HHD combines the state-of-the-art You Only Look Once (YOLO) object detection algorithm to enable AR for quality inspection. We used commercial software from Pocket virtuality® to develop assembly and remote assistance applications for an HMD. An applied research approach was adopted, incorporating the collection of both quantitative and qualitative data to assess the various application scenarios. Among the key findings, it is evident that the functionality of the custom-developed app for quality inspection is contingent upon the operating system, software libraries available on the HHD, and the chosen version of the YOLO detection model. Furthermore, through quantitative and qualitative analysis, it becomes apparent that the software and hardware components of the HMD require significant improvements. These findings offer a high potential for improvement and emphasize the need for further research in the field. Moreover, this research emphasizes the fact that AR has the potential to make a huge impact on the manufacturing industry. [ABSTRACT FROM AUTHOR]

Augmented and virtual reality technologies are actively making their way into the field of healthcare, revolutionizing traditional approaches to diagnosis, prevention, and treatment. This article discusses how these concepts are combined and their profound impact on the emergence of the Metahospital. The authors provide an overview of this concept, highlighting its dual role in aiding healthcare professionals and empowering patients. Central to this paradigm shift is technology's potential to enhance specialized training and elevate the precision and efficiency of diagnostics, all while prioritizing patient safety. This model's core features are expounded upon, with a keen emphasis on ethical considerations and safeguarding personal data, a critical aspect explored within the paper. Furthermore, the article elaborates on the creation of a surgical simulator tailored for procedures like angioplasty and coronary artery stenting, showcasing the tangible advancements within the realm of medical technology. [ABSTRACT FROM AUTHOR]

The perception of size in virtual objects in Augmented Reality (AR) and Virtual Reality (VR) is a not trivial issue, as the effectiveness of manipulating and interacting with virtual content depends on the accuracy of size perception. However, there are missing straightforward comparisons between VR and AR in terms of size perception for the deep understanding of size perceptual differences. Understanding these perceptual differences can inform designers on how to adapt content when transitioning between these two spatial computing platforms. In this paper, we conducted two psychophysical experiments to measure the perceptual thresholds of size discrimination for virtual objects. Our results indicated that users are more sensitive to size changes in VR than in video see-through AR, suggesting that size differences are easier to be perceived in VR than in AR. Additionally, for increase or decrease of sizes, the accuracy of judgments showed an asymmetric trend in video see-through AR. [Display omitted] • A comparative experiment to understand the difference in size perception in AR vs VR. • The thresholds for size discrimination in AR and VR are not the same. • The accuracy of judgments is asymmetric for increases and decreases of sizes in AR. [ABSTRACT FROM AUTHOR]

The authors have proposed an active text system (A-txt), which is a next-generation electronic teaching material that can make general books digitally more extensible with a general-purpose mobile terminal using augmented reality (AR). A-txt content is created by software called Contents Maker (C-mkr). This paper discusses the development of C-mkr for mobile terminals and this development can realize new learning methods using it by students. A-txt is our original system that can easily add and show digital contents by using figures and sentences written on papers as augmented reality (AR) markers. Since Unity is used for the development of A-txt, users can use it regardless of the OS type of the mobile terminal. C-mkr used to need PCs exclusively so far, but now that we have developed an application for mobile terminals, it is possible to create contents on smartphones and tablet computers owned by every user. Along with that, A-txt itself has undergone various improvements. In fact, the A-txt system cannot be used by anyone at present because it is operated by an intra server, but we considered how to solve the problem by reconstructing the server using cloud type. With the above development, users can easily create and upload content anytime and anywhere. We are planning to use this system for students to make textbooks into reference books by themselves. This method is named "Self-decoration (Sel-Deco)", and its effectiveness will be verified in the future. [ABSTRACT FROM AUTHOR]

The digitization and optimization of processes in the industry 4.0, especially in the context of assembly, is becoming more and more important. To improve the link between digital information and production technology is an essential step in the digitization effort, specifically for assembly. In this context, the connection of the real and virtual world is relevant for the system to be able to react to changes in the real world and vice versa. This paper presents and discusses three sequentially developed concepts for an assembly workstation. First, we developed a pick-by-light concept with paper guidance, and then we digitized the paper guidance and displayed it using an overhead projection on the work surface. Based on these concepts, we developed a tangible interface that allows the user to interact with the virtual system using physical objects. Applying an iterative development process, we were able to continuously improve our concepts. The three concepts were each evaluated individually and compared with each other. The results provide an insight into the improvement of the efficiency in processing times, picking times and picking errors. [ABSTRACT FROM AUTHOR]

Despite the large-scale digitalization and automation of production lines, human operators still play a vital role in the shopfloor. Operators provide flexibility and agile responsiveness with their actions, as well as capability to react autonomously based on their technical knowledge and experience. Bridging the gap between modern digital systems of information creation and management and humans in the shopfloor is a current challenge for both the academia and the technology integrators. One emerging way for delivering instructions to the operators is Augmented Reality (AR). AR allows the visualization of the instructions in the operator's field of view, using digital designs, animations and text instructions. As this technology gains increasingly more ground in the shopfloor, there is a need for agile generation of content, automatizing most of the instructions' generation process. Towards that end, this paper presents an authoring tool for generating digital instructions for manual operations. The authoring tool allows the identification of the (dis-)assembly sequence of a product and also to include intermediate manual operations, such as surface treatment, and visualizations. In order to determine which assembly tasks and instructions are the most commonly needed, contextual inquiries were conducted in collaboration with the industry. These findings, together with the existing literature on manual processes on the shopfloor, served as a starting point for a taxonomy of assembly task types that are also presented in this paper. The taxonomy serves as a guide to define the processes on which digital instructions and visualizations can be provided. The result can be delivered as digital on-screen instructions or as an augmented reality application that may target mobile devices and headsets. The proposed approach is validated in an industrial use case of a compressor assembly. [ABSTRACT FROM AUTHOR]

Injury at living spaces accounts for over 70% of injuries among children under the age of 5 years and its prevention is essentially important in terms of children's health. This paper proposes an effective method of integrating knowledge graphs along with object recognition to determine the dangerous situations for infants and provide preventive measures to avoid such situations. This also leads to the proposal of a new system called "Empowering Reality (ER)" that enables a lecturer to educate parents on preventing childhood unintentional injuries at home while communicating with the parents using Augmented Reality (AR) technology. The proposed ER system consists of knowledge graphs for explaining dangerous situations, an online video capturing part, and a situation recognition part. This paper describes major advantages of knowledge graphs that takes into consideration of not only relation between objects and injuries but also dangerous layouts with the help of "inclusion" and "collocation" features. The feasibility and effectiveness of the system was evaluated through tests among 11 parents. The system allows the lecturer to conduct in-situ suggestion on specific preventive measures adapted to the home environment via online learning. [ABSTRACT FROM AUTHOR]

Astronauts are at risk for pneumothorax, a condition where injury or disease introduces air between the chest wall and the lungs (i.e., the pleural cavity). In a worst-case scenario, it can rapidly lead to a fatality if left unmanaged and will require prompt treatment in situ if developed during spaceflight. Chest tube insertion is the definitive treatment for pneumothorax, but it requires a high level of skill and frequent practice for safe use. Physician astronauts may struggle to maintain this skill on medium- and long-duration exploration-class missions, and it is inappropriate for pure just-in-time learning or skill refreshment paradigms. This paper proposes semi-automating tool insertion to reduce the risk of complications in austere environments and describes preliminary experiments providing initial validation of an intelligent prototype system. Specifically, we showcase and analyse motion and force recordings from a sensorized percutaneous access needle inserted repeatedly into an ex vivo tissue phantom, along with relevant physiological data simultaneously recorded from the operator. When coupled with minimal just-in-time training and/or augmented reality guidance, the proposed system may enable non-expert operators to safely perform emergency chest tube insertion without the use of ground resources. • System design of a desktop testbed that facilitates data-driven event labelling. • Use of a lightweight robot enables semi-automation during simulated surgical tasks. • Needle-tissue interaction forces are useful for surgical semi-automation. • Robotics and wearables allow for human-in-the-loop system performance monitoring. [ABSTRACT FROM AUTHOR]

Intelligent technologies are widely implemented in different areas of modern society but specific approaches should be applied in services. Basic relationships refer to supporting customers and people responsible for services offering for these customers. The aim of the paper is to analyze and evaluate the state-of-the art of artificial intelligence (AI) applications in the hospitality industry. Our findings show that the major deployments concern in-person customer services, chatbots and messaging tools, business intelligence tools powered by machine learning, and virtual reality & augmented reality. Moreover, we performed a survey (n = 178), asking respondents about their perceptions and attitudes toward AI, including its implementation within a hotel space. The paper attempts to discuss how the hotel industry can be motivated by potential customers to apply selected AI solutions. In our opinion, these results provide useful insights for understanding the phenomenon under investigation. Nevertheless, since the results are not conclusive, more research is still needed on this topic. Future studies may concern both qualitative and quantitative methods, devoted to developing models that: a) quantify the potential benefits and risks of AI implementations, b) determine and evaluate the factors affecting the AI adoption by the customers, and c) measure the user (guest) experience of the hotel services, fueled by AI-based technologies. [ABSTRACT FROM AUTHOR]

The advancement of technology towards the realization of the evolving mobile computing paradigm brings a rapid paradigm shift in its usage, especially in the Internet, computation, and communications, that has a profound impact on businesses, services, and users. With the rise in resource-intensive or edge-based mobile applications such as autonomous driving, Amazon Go, virtual and augmented reality, and healthcare-related applications, countless challenges in computation and communication parameters like latency, bandwidth, and energy consumption are evolving. As a result, the multi-access edge computing (MEC) paradigm receives enormous attention where some portions of the user applications are offloaded to powerful machines for their efficient execution to optimize different evaluation metrics or to achieve performance goals. While a few survey works are available in this direction, none of them focuses explicitly on the emerging machine learning (ML) based computation offloading techniques and various associated sub-problems together. This paper aims to provide a detailed but precise overview of the research on using ML techniques for MEC environments. In this survey, we focus on how authors and researchers utilize the ML models in computation offloading problems on MEC architecture. We extend our study by considering several edge architectures, offloading parameters, ML approaches, and problem formulation strategies concerning computation offloading. Additionally, this paper discusses the potential challenges in the direction of computation offloading on MEC architecture. [ABSTRACT FROM AUTHOR]

This paper proposes the development of a markerless augmented reality (AR) application for Indonesian traditional house education. The application aims to provide an immersive and interactive way of visualizing traditional houses from various regions of Indonesia, with the potential to raise public awareness about the importance of preserving traditional culture. The prototyping method was employed as the most appropriate approach to software development, and the ARFoundation platform was used to integrate plane detection into the AR application. The results showed that 80% of tested devices were compatible with ARCore, and the AR plane detection could detect up to 250cm from the device position. In addition, a feedback survey conducted on 17 testers showed that the application design and mechanism brought a good experience to users, with 53% stating that the app is easy to use. This research project contributes to the development of technology-based solutions to promote Indonesian culture and preserve traditional houses, especially for younger generations who may be less familiar with traditional culture. [ABSTRACT FROM AUTHOR]

Physics learning is often challenging for students due to its abstract and complex concepts. This research is made to overcome the problem of lack of understanding related to physics learning due to abstract concepts. This research aims to develop and evaluate an Augmented Reality (AR) application that focuses on learning Newton's Law by interacting with 3D objects like balls, cars, and rockets. AR-based technology has been recommended for use in education due to its excellent potential in helping to improve the understanding of the concept of a material to be better. Therefore, this research will develop and evaluate the use of augmented reality in physics learning related to newton's law. This paper uses the ADDIE model method as the basis for developing Augmented Reality applications by involving the stages of analysis, design, development, implementation, and evaluation. The study results show that the developed AR application can help students understand the concept of Newton's Law and increase interest in learning. Student feedback obtained through questionnaires indicated that they rated this application positively regarding ease of use, engagement, and effectiveness in supporting the learning process. The AR application developed in this study improves the quality and effectiveness of physics learning through innovative and interactive technology. Further research could focus on developing additional content and features and exploring the impact of this application on a broader group of students and in different areas of education. [ABSTRACT FROM AUTHOR]

Augmented Reality is a technology that overlays computer-generated information and images in a natural environment to enhance or augment the contextual perception of the user's environment. The utilization of AR is currently one of the most important in developing several industrial sectors, such as architecture, engineering, and construction development. Nowadays, the property sector industry has always been an issue of sale for users that do not have direct access to the property. The pandemic and the economic problem in different countries have also reduced consumer interest in purchasing houses. Due to these issues, this paper aims to provide a platform for addressing these pain areas. The software can apply Augmented Reality to real estate in real-time using a mobile device. Not only can they see the outside of the property, but they can also see the interior design, furniture design, and property mapping in 3D. Our test results show that an application is needed to provide the property sector with high demands. Over 80% of our respondents confirm that our application's presence will help ease the sales problem. Because it can save the customer time, viewing property frequency, and cost saving. These increased demands, we are developing an AR-based application for the market to use and gain more traction in the property sector. [ABSTRACT FROM AUTHOR]

• A systematic literature review of immersive technologies (ImTs) for occupational safety and health (OSH) in construction is conducted. • OSH areas, hazards and conditions that are addressed by ImTs are provided. • Challenges and future research associated with the use of ImTs for OSH are provided. Introduction : The construction industry employs about 7% of global manpower and contributes about 6% to the global economy. However, statistics have depicted that the construction industry contributes significantly to workplace fatalities and injuries despite multiple interventions (including technological applications) implemented by governments and construction companies. Recently, immersive technologies as part of a suite of industry 4.0 technologies, have also strongly emerged as a viable pathway to help address poor construction occupational safety and health (OSH) performance. Method: With the aim of gaining a broad view of different construction OSH issues addressed using immersive technologies, a review on the application of immersive technologies for construction OSH management is conducted using the preferred reporting items for systematic reviews and meta-analysis (PRISMA) approach and bibliometric analysis of literature. This resulted in the evaluation of 117 relevant papers collected from three online databases (Scopus, Web of Science, and Engineering Village). Results : The review revealed that literature have focused on the application of various immersive technologies for hazard identification and visualization, safety training, design for safety, risk perception, and assessment in various construction works. The review identified several limitations regarding the use of immersive technologies, which include the low level of adoption of the developed immersive technologies for OSH management by the construction industry, very limited research on the application of immersive technologies for health hazards, and limited focus on the comparison of the effectiveness of various immersive technologies for construction OSH management. Conclusions and Practical Applications: For future research, it is recommended to identify possible reasons for the low transition level from research to industry practice and proffer solutions to the identified issues. Another recommendation is the study of the effectiveness of the use of immersive technologies for addressing health hazards in comparison to the conventional methods. [ABSTRACT FROM AUTHOR]

In the automotive sector, panel fitting operations represent a delicate phase of the assembly process, during which car bodywork components are manually aligned attempting to comply with spacing tolerances. Digital technologies currently promoted by the Industry 4.0 approach, such as collaborative robots and augmented reality (AR), could assist workers for reducing execution times of this "trial and error" procedure. On the one hand, human-robot collaboration (HRC) can enhance assembly process efficiency, by combining human dexterity and cognitive capabilities with robot repetitiveness and support in heavy load handling; on the other, AR can provide interactive instructions to guide workers during the process. In this regard, the present paper is focused on the development of a novel assembly workstation using HRC and AR to support workers during car panel fitting operations. The system is based on the implementation of an algorithm able to convert the values on panel spacing, which are measured by laser gauge positioned on the collaborative robot, in the instructions for the worker to correctly carry out the panel fitting operation. The paper finally presents the application of the system to a real assembly example. [ABSTRACT FROM AUTHOR]

This study collected literature on augmented reality (AR) from academic and patent databases to plot the historic development trajectory of AR and forecast its future research and development trends. A total of 3193 and 13,629 papers were collected from academic and patent databases, respectively. First, a network was established using references from the academic literature; main path analysis was conducted on this reference network to plot the overall development trajectory. Subsequent cluster and word cloud analyses revealed the following five major groups of AR research topics: AR surgical navigation applications, AR education applications, AR applications in manufacturing, AR applications in architecture, and AR applications in visual tracking. Subsequently, the relationships between the overall development trajectory and the five AR research topics were compared. Next, the title and abstract of AR-related academic and patent papers were subjected to text mining to identify keywords with a high frequency of occurrence. The results can provide a reference for industry, government, and academia when planning future development strategies for the AR field. This research adopted an integrated analysis procedure to plot the trajectory of AR technology development and applications successfully and effectively, predict future patent research and development directions and produce technological forecasts. [ABSTRACT FROM AUTHOR]

Remote support tools offer great savings potential for maintenance work and simplify communication between on-site workers and remote experts in the back-office. Despite the predicted benefits and the existence of an increasing number of commercial augmented reality (AR) remote support tools, the technology still struggles with various challenges, mainly caused by technical limitations, safety concerns or industry-specific constraints. In this paper, we describe the implementation of an open source AR remote support application with a strong industry focus. The software was developed based on the feedback of four industry partners with different needs in the field of maintenance work. Therefore, we set the focus on configurability to provide the right tools for each use case. The developed remote support tool was then compared with traditional support measures in a user study. This paper presents the lessons learned from the expert discussions with our company partners and the results of the user study. [ABSTRACT FROM AUTHOR]

Mixed Reality (MR) technologies are rapidly establishing themselves in the space industry. From assisting with assembling the Orion capsule via Augmented Reality (AR) to using highly immersive virtual environments for astronaut training, MR technologies provide a powerful mechanism to alter the perception of the physical world and deliver realistic personalized visual stimuli to users. In this paper, we discuss a novel strategy to utilize MR technologies as a design element to enhance the interior architecture of the space habitat and enrich the inhabitants' personal experience. We discuss two scenarios that entail long duration missions as well as a customized experience for space tourists in Low Earth Orbit (LEO). We report a series of spacecraft volumetric studies of the ergonomics associated with the application of MR technologies. Physical, Virtual and Combined experiences mapped within the volumes with respect to crew ConOps provide a basis for further analysis and are translated to architectural design requirements that inform criteria for the development of personalized MR-based visualizations. The paper concludes with a discussion of directions for future research and design-based investigations. Compilations of mission-influencing factors such as launch mass and volume reduction per habitat, technology limitations and integration requirements are presented and evaluated by the level of importance for achieving mission goals and objectives. • Long duration space missions can cause complex psychological difficulties. • Immersive MR technologies used as a psychological countermeasure in space habitats. • Alternative MR technologies to avoid using HMD. • Projection-based MR system integrated with space habitat design. [ABSTRACT FROM AUTHOR]

Programming by Demonstration (PbD) is a method to program robots through the performance of a task by humans. Most implementations are online methods that use visual or force feedback of the demonstrator. However, we developed an offline programming approach for PbD with a special input device within an Augmented Reality Environment. Therefore, this paper aims to answer how the characteristics and functionality of the end effector of a jointed-arm robot can be represented by a haptic input device in order to perform PbD. The PbD process is first carried out on a digital twin of the robot, visualized to the user in real physical space by means of augmented reality technology. The programming of the digital twin can later be transferred to the real robot. The haptic input device in this context is the main part of the Cyber-Physical-System (CPS), which enables the user to interact with the virtual robot. Therefore, the specification of the mechanical and software components of the CPS is of main importance. Within this paper, strategies for the implementation of shape and function abstraction, as well as for ensuring communication, have been worked out. The physical shape of the CPS is kept generic and is only subject to ergonomic restrictions. However, Augmented Reality overlays the physical shape with an exact digital image of the end effector used later in the process. Nevertheless, the physical characteristics of the real robot should be represented as real as possible by the CPS. Therefore, the CPS is equipped with various sensors and actuators. With the CPS it is possible to determine contact forces and to manipulate objects to a certain extent in order to teach gripping strategies to the digital twin. An operating system was developed for communication and control of the electronic components. For the validation of the functionality of the CPS an exemplary PbD process was developed, the results were analyzed and evaluated. [ABSTRACT FROM AUTHOR]

The railway industry is moving towards a complex socio-technological system that relies on computer control and human-machine interfaces. Digitization and convergence of information technology (IT) with operational technology (OT) becomes increasingly important. Therefore, enabling innovations, lowering costs, increasing safety systems, enhancing performance, and increasing flexibility gains. In this scenario, opportunities arise for Augmented Reality (AR) capabilities to enhance maintenance operations of digitized trains. Initial research and tests have enabled training technicians and assistance of train drivers during specific activities by facilitating interactions with machines that go beyond traditional training manuals. Despite the positive results AR has shown, there are no specific indications available regarding the 'deployability' of the technology related to maintenance tasks. This position paper presents arguable boundaries and challenges for a structural appraisal of AR on maintenance operations of IT/OT converged trains. Potential AR solutions and specifications were based on current maintenance operations. Semi-structured interviews and surveys were conducted with maintenance providers to determine existing challenges. Moreover, the paper comprises an analysis to reveal the potential application AR has in maintenance procedures of digitized trains. Finally, this paper provides future research directions of AR technologies related to maintenance procedures of trains. [ABSTRACT FROM AUTHOR]

Connecting machines and systems is becoming increasingly important, especially in technology-based companies. The use of Augmented Reality (AR) based systems can bring significant advantages, such as improved quality or increased productivity. However, the implementation barriers often seem to outweigh the benefits for many companies. This is particularly true for small and medium-sized enterprises (SMEs), which leads to important questions: To what extent can AR applications be efficiently implemented using standard Industrial Internet of Things (IIoT) software? Is it possible for SMEs without specialized knowledge to implement AR applications with appropriate effort by utilizing an IIoT software? How would a software and hardware architecture for this look like? This paper presents an approach - based on commercially available standard software – to outline the necessary framework and demonstrating the benefits of this technology through practical use cases. The results show that useful applications can be implemented quickly and require comparatively little expertise when using the right toolchain. [ABSTRACT FROM AUTHOR]

Augmented reality (AR) applications have great potential to assist maintenance workers in their operations. However, creating AR solutions is time-consuming and laborious, which limits its widespread adoption in the industry. It therefore often happens that even with the latest generation machines, instead of an AR solution, the user only receives an electronic manual for the equipment operation and maintenance. This is commonplace with legacy machines. For this reason, solutions are required that simplify the creation of such AR solutions. This paper presents an approach using an electronic manual as a basis to create fast and cost-effective AR solutions for maintenance. As part of the approach, an application was developed to automatically identify and subdivide the chapters of electronic manuals via the bookmarks in the table of contents. The contents are then automatically uploaded to a central server and indexed with a suitable marker to make the data retrievable. The prepared content can then be accessed for creating context-related AR instructions via the marker. The application is characterized by the fact that no developers or experts are required to prepare the information. In addition to complying with common design criteria, the clear presentation of the contents and the intuitive use of the system offer added value for the performance of maintenance tasks. Together, these two elements form a novel way to retrofit legacy machines with AR maintenance instructions. The practical validation of the system took place in a factory environment. For this purpose, the content was created for a filter change on a CNC milling machine. The results show that inexperienced users can extract appropriate content with the software application. Furthermore, it is shown that maintenance workers, can access the content with an AR application developed for the Microsoft HoloLens 2 and complete simple tasks provided in the manufacturer's electronic manual. [ABSTRACT FROM AUTHOR]

Intelligent Virtual Agents (IVAs) can provide users with a friendly experience and have a wide range of applications in the era of artificial intelligence. However, most of existing IVAs are designed for personal computers. Design and user studies of IVAs on smartphones are uncommon. Therefore, developing IVAs for smartphones is an interesting topic. Considering Augmented Reality (AR) technology can provide more potential application value for IVAs, we mainly investigate users' experiences of AR IVAs on smartphones in this paper. To make an IVA more suitable for a smartphone, a lightweight IVA's cognitive architecture is proposed. To find out the factors that affect users' interaction experiences, the effects of humanoid embodiment and emotional expressions of IVAs on users' perceptions and experiences are explored. A museum is used as a specific task scenario to measure users' experiences. Three forms of AR agents are evaluated in this scenario: a voice assistant without an entity, a humanoid IVA without emotional expressions, and a humanoid IVA with emotional expressions. The results show that compared with the voice assistant, a humanoid embodiment can significantly improve the user's experience, and compared with humanoid IVA without emotional expressions, a humanoid IVA with emotional expressions is more welcome. Moreover, we use the cloud model to describe the uncertainty of IVAs' actions (blinking and body orientation). The results show that the uncertainty of actions can increase the believability of IVAs. [ABSTRACT FROM AUTHOR]

With increasing digitalization and a shift towards Industry 4.0, new technologies are also finding their way into production. Especially in the training of technical professions, many processes are becoming more digital in order to also create a familiarization for the workforce of the future in manufacturing. To support the training of aircraft mechanics, a concept to transfer work instructions into a digital format was developed. For this purpose, a digitized system based on paper instructions was designed, in which manufacturing procedures are stored as templates in a standard elements toolbox (SET), and instructors can assemble these into work instructions in a workflow editor (WFE). Furthermore, an augmented reality (AR) display supports trainees in implementing projects using these instructions, as well as a learning platform to overview the project progress. The concept was implemented in interactive prototypes and evaluated in a training centre for aircraft mechanics. The results show a good usability of the system and give a positive impression with special requirements for apprenticeships for further development of the prototypes into a usable product and an integration into the general workflow of an aircraft mechanic. [ABSTRACT FROM AUTHOR]

This paper presents a concept of how AR can be implemented for learning in university laboratories. The concept includes videos from the first-person perspective and virtual 3D elements to impart knowledge as well as a database connection to check understanding. It is based on improvement potential identified in an experimental physics laboratory. General recommendations for actions are derived as to how AR can be used in the various laboratories of technical courses. The influences on the learning effect are evaluated using the "Confidence-based Assessment" method. [ABSTRACT FROM AUTHOR]

This paper describes a development study for mobile based Augmented Reality (AR) application prototype for simple remote collaboration scenario. The AR technology is implemented by using ARCore with cloud anchor into two different mobile devices as the host and client. A host is a user device that able to create and share a session of a camera viewpoint that could be connected with another client device remotely through the internet. For testing purposes of remote collaboration scenario in this application prototype, both users are able to add and manipulate location of virtual objects that overlay on each screen from their own device. Based on the functionality test, before placing the virtual object on the screen, a calibration of cloud anchor is required with minimum success performance in 250 to 1200 lumens of lights. The result for cloud anchor is being hosted with average delay up to 700+ milliseconds. In this paper, the result of the experiment shows an early stage of the utilization of AR technology in simple remote collaboration scenario. However, it shows the potential of mobile based AR technology for future remote collaboration scenario development. [ABSTRACT FROM AUTHOR]

Due to rapid technical advancements and the increasing diffusion of information and communications technologies, Augmented Reality (AR) has left its fledgling stages and is now on the verge of a breakthrough. Especially in industrial applications, AR holds great potentials for performance improvements: By enriching real world environments with context-specific virtual information, manual operations can be carried out more efficiently, costly mistakes can be avoided and the mental effort for transferring information from an abstract representation (e.g. monitor) to the physical world can be significantly reduced. However, a lack of transparency regarding the equally numerous and manifold applications and benefits makes it difficult for companies to weigh the impact of AR for their business. Existing classification approaches in scientific literature mainly focus on technical aspects of AR, neglecting information essential for the strategic planning of AR. The current paper aims at filling this gap by providing a classification of industrial AR use cases. The basis is a classification scheme consisting of eight classification criteria, each with several predefined characteristics, specifically tailored to the industrial use of AR. In a comprehensive literature research, 75 industrial application examples for AR were determined and described using the classification scheme. By performing a cluster analysis and multidimensional scaling, the AR application examples were grouped according to their similarity, resulting in 16 clusters, each representing a generic use case for AR. Further information was researched for each use case (e.g. benefits, opportunities, risks) and summarized in a profile. Thus, the paper provides two core results: (1) A classification scheme for describing industrial AR applications, extending the state of the art with an use-case-related classification approach. (2) A catalogue with 16 AR use case profiles, providing transparency on industrial applications and potential benefits of AR and inspiring companies on how to utilize AR for their own business. [ABSTRACT FROM AUTHOR]

In the current day scenario, teaching takes place either on the blackboard or on a power point presentation projected on the wall. Traditional methods of teaching are going to become a thing of the past. Instead, imagine students focusing their mobile screens in the middle of the classroom and they will be all viewing holographic 3D objects surfacing from a table and the teacher explaining the visuals. This is going to be a reality in the near future and this technological innovation will transform the teaching-learning process. The objective of this paper is to propose a framework for using Augmented Reality in mobile phones for engineering education. Use of mobile devices in education provide a new educational paradigm, called M-Learning, It offers many opportunities for students to work on their creativity, while at same time it becomes an element of motivation and collaboration. This paper proposes the modern way of AR technology in engineering education, a handy tool to make teaching and learning effective and also proposes a experimental setup to convert a topic to an Android App. [ABSTRACT FROM AUTHOR]

The writing of this paper and the creation of this application is a means to improve and add on facilities on the local state-run attraction. This subject matter was picked in conjunction with the decline of tourism in the said historical site due to a pandemic that rankles Indonesia's tourism industry and drives it to the ground. Augmented Reality as a method of deliverance was picked due to its popularity and freshness in the tourism market. The research method was conducted starting with analysis, development, implementation, then evaluation. Analysis was done using sourcing available to the public and a questioner. Implementation was done using Unity, Vuforia, and Maya. And with the positive responses of 66.6 percent of the sample market finding enjoyment in the use of this application in their exploration during User Acceptance testing with the existing prototype. This shows that the resulting use of this application improves user enjoyment in experiencing the state attraction. [ABSTRACT FROM AUTHOR]

In the Metaverse, 3D modeling techniques and autoencoders offer a novel approach for handling 2D portraits of Non-Fungible Tokens (NFTs). These techniques have significant applications in the metaverse, a virtual, shared, and persistently online space that combines the real world, virtual reality, and augmented reality. Within the metaverse, NFTs can represent virtual items and assets, and 3D modeling techniques can be used to create three-dimensional models of these virtual items and assets. In this paper, we propose a novel method of inferring 3D structure and texture from 2D Non-Fungible Token (NFT) portraits using image-decoupled autoencoders. By implementing 3D facial modeling, depth values are associated with each pixel in the canonical view, thereby modeling 3D faces with fine textures and accurate structures from 2D NFT portraits. The input image is decomposed into four elements: depth map, albedo image, light direction, and viewpoint, all of which are used in the 3D reconstruction process. Asymmetry in NFT portraits is also addressed, and a symmetry confidence map is used to record the symmetry prediction probability for each pixel. In the experimental section, datasets including human faces and anime faces are used to better adapt to the diverse styles of NFT images. The Adam optimizer is used for training, and a set of new evaluation metrics, including cosine similarity, PSNR, SSIM, and LPIPS, are used to assess the quality of texture reconstruction. The proposed method achieves state-of-the-art performance in 3D facial reconstruction and performs exceptionally well in 3D facial reconstruction of anime faces compared to other methods. • We proposed an autoencoder method for 3D reconstruction of 2D NFT portraits in the metaverse, inferring 3D structure and texture. • We designed techniques for consistent 3D NFT portraits under various lighting conditions, enhancing their visual quality. • Additionally, we introduced a novel approach to model facial symmetry, improving both quality and realism of 3D NFTs. [ABSTRACT FROM AUTHOR]

This research paper explores the impact of augmented reality (AR) tracking characteristics, specifically an AR head-worn display's tracking registration accuracy and precision, on users' spatial abilities and subjective perceptions of trust in and reliance on the technology. Our study aims to clarify the relationships between user performance and the different behaviors users may employ based on varying degrees of trust in and reliance on AR. Our controlled experimental setup used a 360° field-of-regard search-and-selection task and combines the immersive aspects of a CAVE-like environment with AR overlays viewed with a head-worn display. We investigated three levels of simulated AR tracking errors in terms of both accuracy and precision (+0°, +1°, +2°). We controlled for four user task behaviors that correspond to different levels of trust in and reliance on an AR system: AR-Only (only relying on AR), AR-First (prioritizing AR over real world), Real-Only (only relying on real world), and Real-First (prioritizing real world over AR). By controlling for these behaviors, our results showed that even small amounts of AR tracking errors had noticeable effects on users' task performance, especially if they relied completely on the AR cues (AR-Only). Our results link AR tracking characteristics with user behavior, highlighting the importance of understanding these elements to improve AR technology and user satisfaction. [Display omitted] • Augmented Reality (AR) tracking factors include accuracy and precision. • Search-and-selection task tested effects of tracking factors on performance, trust. • Results indicate even small AR tracking errors impact user performance, trust. • Negative performance effects can be mitigated if users do not rely solely on AR. [ABSTRACT FROM AUTHOR]

Failures in timber construction are predominantly attributed to human errors, which can be mitigated by enhancing process management and control. To reduce human errors in timber connections, an augmented reality (AR)-assisted method for fastening has been developed, targeting enhancements in accuracy, productivity, and construction safety. This method employs markerless inside-out tracking technology combined with an AR user interface to provide real-time visualization of construction data through a head-mounted display, coupled with a near real-time feedback control system. The method was evaluated across multiple case studies, yielding a mean position error of 2.1 mm and an orientation error of 2° in screwing tasks, and 2.7 mm and 3.1° in nailing tasks, complying with standards. These results were validated using paired t -tests. This paper establishes a foundation for the integration of AR-assisted technologies in various timber construction processes, aiming to minimize potential human errors and improve the overall quality of construction work. • AR-assisted method for timber fastening, enhancing accuracy, productivity, and safety. • Feedback control, disabling the tool while error constraints are not satisfied. • Safety system via hand-tracking, enhancing applicability in real-world construction. • Results indicate significant accuracy improvement compared to other methods. • Lays the foundation for AR-assisted technologies to reduce potential human errors. [ABSTRACT FROM AUTHOR]

Augmented Reality (AR) has gained significant attention in recent years as a technology that enhances the user's perception and interaction with the real world by overlaying virtual objects. Simultaneous Localization and Mapping (SLAM) algorithm plays a crucial role in enabling AR applications by allowing the device to understand its position and orientation in the real world while mapping the environment. This paper first summarizes AR products and SLAM algorithms in recent years, and presents a comprehensive overview of SLAM algorithms including feature-based method, direct method, and deep learning-based method, highlighting their advantages and limitations. Then provides an in-depth exploration of classical SLAM algorithms for AR, with a focus on visual SLAM and visual-inertial SLAM. Lastly, sensor configuration, datasets, and performance evaluation for AR SLAM are also discussed. The review concludes with a summary of the current state of SLAM algorithms for AR and provides insights into future directions for research and development in this field. Overall, this review serves as a valuable resource for researchers and engineers who are interested in understanding the advancements and challenges in SLAM algorithms for AR. • Summarized AR products and SLAM algorithms in recent years and presents a comprehensive overview of SLAM algorithms including feature-based method, direct method, and deep learning-based method, highlighting their advantages and limitations for AR. • Provided an in-depth exploration of classical SLAM algorithms for AR, with a focus on visual SLAM and visual-inertial SLAM. • Analyzed sensor configuration, datasets, and typical algorithm performance for AR SLAM which are highly valuable for product developers. [ABSTRACT FROM AUTHOR]

Augmented Reality (AR) technology has emerged as a promising tool for enhancing safety in the construction industry by improving the Situation Awareness (SA) of onsite workers. However, there is a lack of methods to quantify the impact of real-time AR visual warnings on developing and updating SA. To address this gap, this paper presents an eye-tracking-based method that quantifies the impact using three metrics: Time to First Fixation (TFF), Dwell Time (DT), and Revisit Interval (RI). A quasi-onsite experiment validated the feasibility of the proposed method and confirmed that AR warnings could reduce the time to reach Level 1 SA by 40.7% and reduce the interval for updating Level 2 and Level 3 SA by 43.45%. This method can be further combined with advanced visualisation measures to address perception, memory, thinking and mobility, eventually leading to insights on mental effort, decision making, interaction with computers, human reliability and work stress. • An eye-tracking-based method was developed to measure worker situation awareness. • Three metrics were proposed to quantify the impact of AR warnings on situation awareness. • A quasi-onsite experiment confirmed the feasibility and effectiveness of the proposed method. • The AR warning system has been demonstrated to assist workers in enhancing situation awareness. [ABSTRACT FROM AUTHOR]

Augmented reality (AR) and Artificial Intelligence (AI) are technologies pioneers in innovation and alteration in several domains. AR allows the creation of an entirely new and interactive experience for users. However, there are several drawbacks in developing AR applications, such as the marker identification process and the creation of content itself. These are very time-consuming procedures and require ad-hoc development. The advantages of using AI to solve AR limitations have recently been explored in literature. Motivated by these findings, in this paper it is proposed DeepReality, a software toolkit plug-in for Unity 3D. It is conceived for allowing developers to integrate any Deep Learning (DL) models into Unity, through AR Foundation and Barracuda inference engine. DeepReality is aimed at simplifying and streamlining the usage of DL models in conjunction with AR. As such, users skilled in Unity and DL can easily create mobile applications (iOS and Android) to: extract visual features of real-world objects (framed with the device camera) via DL; Show on-screen content on top of those real-world objects, via AR. DeepReality performs object semantic processing within the scene, and extended semantic effects for incongruent objects, overcoming the environmental tracking, which is feature-based. In order to test DeepReality usability, experiments have been performed on the execution time and memory usage data, demonstrating the feasibility and possibility of integrating and using DNNs models in mobile applications for AR. The complexity analysis confirms that DeepReality can be completely executed on mobile devices. DeepReality is also open-source and it is freely available in the Unity asset store. By fostering accessible AI-AR integration, DeepReality addresses key shortcomings in existing approaches, encapsulating contributions such as versatile DL integration, open-source accessibility, operational validation, and comprehensive metrics analysis. DeepReality empowers developers to transcend boundaries, enriching AR applications with AI's transformative potential. Our proposed framework fosters benchmarking, comparison, and a future harmonised by AR-AI synergy. [Display omitted] • DeepReality is an open-source toolkit, freely available in the Unity asset store. • DeepReality integrates Deep Learning models for streamlined mobile apps. • DeepReality leverages AR Foundation and Barracuda inference engine. • It demonstrates efficient execution and memory usage in mobile AR. • Complexity analysis confirms that it can be fully executed on mobile devices. [ABSTRACT FROM AUTHOR]

The governance of Virtual-Reality Integration, which seamlessly merges the virtual world (metaverse) with the physical reality, represents an emerging approach to addressing perception and comprehension challenges in complex computational environments. Such Virtual-Reality Integration systems have the capability to streamline data analysis complexity, offer real-time visualization, and provide user-centric interaction, thereby delivering crucial support for data analysis and profound decision-making in complex computational settings. In this paper, we introduce a real-time perception and interaction methodology that combines computer vision with Virtual-Reality Integration technology. We employ the Grid-ORB algorithm-based approach for high-precision feature extraction and three-dimensional registration tracking on resource-constrained devices, enabling the perception of physical entities. Furthermore, we utilize the Kriging method, augmented with a drift term, to fill gaps in numerical physical space data, aiding users in observing real-world physical values and trend fluctuations. To facilitate a unified cognitive experience for data and knowledge, we devise a user-centric interaction interface using augmented reality technology. Within this interface, users can interact with charts and controls through methods such as eye movement and gestures. Finally, we validate our system within a real thermodynamics experimental environment, with results demonstrating a significant enhancement in user efficiency for comprehending data and knowledge within complex environments. • In order to eradicate the decoupling issues present within the user analytics data process, we have constructed a novel immersive situated analytics practice predicated on augmented reality devices. • To attain high robustness and availability of visual perception on existing augmented reality devices, we have designed and implemented a motion grid statistical algorithm based on generalized enhancement to accomplish feature point matching tasks in various scenarios. • We have designed and implemented an interaction model based on an immersive interaction framework for near-far-end interaction to accomplish high-speed interaction in situated analytics tasks, utilizing multimodal interaction methods to support users' varying degrees of interaction and control over views. [ABSTRACT FROM AUTHOR]