Search

Augmented reality technologies provide transformative solutions in various surgical fields. Our research focuses on the use of an advanced augmented reality system that projects 3D holographic images directly into surgical footage, potentially improving the surgeon's orientation to the surgical field and lowering the cognitive load. We created a novel system that combines exoscopic surgical footage from the "ORBEYE" and displays both the surgical field and 3D holograms on a single screen. This setup enables surgeons to use the system without using head-mounted displays, instead viewing the integrated images on a 3D monitor. Thirteen surgeons and surgical assistants completed tasks with 2D and 3D graphical surgical guides. The NASA Task Load Index was used to assess mental, physical, and temporal demands. The use of 3D graphical surgical guides significantly improved performance metrics in cochlear implant surgeries by lowering mental, physical, temporal, and frustration levels. However, for Bonebridge implantation, the 2D graphical surgical guide performed better overall (p = 0.045). Participants found the augmented reality system's video latency to be imperceptible, measuring 0.13 ± 0.01 s. This advanced augmented reality system significantly improves the efficiency and precision of cochlear implant surgeries by lowering cognitive load and improving spatial orientation. [ABSTRACT FROM AUTHOR]

Introduction: Video-assisted telescope operating monitor (VITOM®) with 3D Visualization technology was developed and has been used with favorable results by several surgical specialties. Our study aims to be a preliminary report for initial experience using the VITOM® 3D system for microsurgical varicocelectomy on varicocele patients. Methods: We performed 35 microsurgical varicocelectomy procedures using the VITOM® 3D system on varying types and grades of varicoceles. The surgeon had the option of using either a 2.5 or 3.5 magnifying loupe in addition to the exoscope for each operation evaluated. The exoscope is a standalone camera head with an integrated 3D telescope and remote control with zoom and focus functions. It is connected to the 3D monitor via a mechanical holding arm. During the procedure, surgeons, assistants, and observers were able to view the 3D high-definition stream displayed on a 26-inch 3D monitor at a convenient viewing angle and distance. The varicocele ligation was performed using a Carl Zeiss Meditec AG microscope. Results: There were 35 patients with varicocele aged 31.51 years old on average, which were included in this report. Most patients had grade 3 bilateral varicocele (n = 13, 37.1%). All procedures were performed without any intraoperative complications. After the procedures, only a few patients suffered from postoperative complications. Three patients suffered scrotal edema (8.6%), while another had hydrocele (2.9%). The postoperative pain results were also very minimal from.89 1 day after the operation to.26 3 days after the operation. Conclusion: The VITOM® 3D system showed promise in microsurgical varicocelectomy. [ABSTRACT FROM AUTHOR]

Endoscopic spine surgery has evolved exponentially. However, the two-dimensional (2D) view results in lack of stereoscopic vision and depth perception, contributing to the steep learning curve. This case report recounts a world first trial of a three-dimensional (3D) endoscopic system that converts 2D to 3D images and explores its potential role in the surgical management of degenerative lumbar spine diseases. The 3D endoscopic system was used for two patient cases and both 2D and 3D images were displayed side by side and compared. Advantages of the 3D endoscopic system include increased perception of depth, rapid identification of bleeding points, and greater visualization of anatomical details. Field of view and exposure were identical in 2D and 3D views. Limitations include costs and need for additional equipment. Overall, 3D endoscopy improved depth perception, instrument manoeuvrability, and recognition of anatomical details. This case report can guide further research and training in endoscopic spine surgery. [ABSTRACT FROM AUTHOR]

Previous work on visual short-term memory (VSTM) has encompassed various stimulus attributes including spatial frequency, color, and contrast, revealing specific time courses and a dependence on stimulus parameters. This study investigates visual short-term memory for binocular depth, using dynamic random dot stereograms (DRDS) featuring disparity planes in front of or behind the plane of fixation. In a delayed match-to-sample paradigm, we employed four distinct reference disparities (17.5', 28.8' either crossed or uncrossed) at two contrast levels (20%, 80%), spanning interstimulus intervals (ISI) of up to 4 s. Test stimuli represented a range of equally spaced values centered around the reference disparity of the ongoing trial. In addition, the impact of a memory masking stimulus was also tested in a separate experiment. Accuracy and point of subjective equality (PSE) served as performance markers. The performance, indicated by the accuracy of responses, was better for smaller reference disparities (±17.5') compared to larger ones (±28'), but both deteriorated as a function of ISI. The PSE demonstrated a consistent shift with increasing ISIs, irrespective of the magnitude of the initial disparity, converging gradually toward the range of 20–22' and deviating from the reference disparity. Notably, the influence of masking stimuli on the PSE was more marked when the mask disparity diverged from the reference value. The findings from our study indicate that the retention of absolute disparity in memory is imprecise, it deteriorates with retention time or due to perturbation by dissimilar masking stimuli. As a result, the memory trace is gradually replaced by a default depth value. This value could potentially signify an optimal point within low-level perceptual memory, however, our results are better explained by perceptual averaging whereby the visual system computationally derives a statistical summary of the presented disparities over time. The latter mechanism would aid in the computation of relative disparity in a dynamically changing environment. [ABSTRACT FROM AUTHOR]

Purpose: Stereopsis, the ability of humans to perceive depth through distinct visual stimuli in each eye, is foundational to autostereoscopic technology in computing. However, ensuring stable head position during assessments has been challenging. This study evaluated the utility of artificial intelligence (AI)-enhanced face tracking technology in overcoming this challenge by ensuring that each eye consistently receives its intended image. Methods: The Lume Pad 2, an autostereoscopic tablet with AI-enhanced face tracking, was utilized to simulate quantitative parts of the Stereo Fly test and TNO Stereotests for contour and random dot stereopsis. The study recruited 30 children (14 males and 16 females, mean age of 9.2 ± 0.3 years, age range of 6–12 years) and 30 adults (10 males and 20 females, mean age of 29.4 ± 1.0 years, age range of 21–42 years) to assess the tablet's inter-session reliability. Agreement between conventional and the autostereoscopic tablet-simulated stereotests was tested in a larger group of 181 children (91 males and 90 females, mean age of 9.1 ± 0.4 years, age range of 6–12 years) and 160 adults (69 males and 91 females, mean age of 38.6 ± 2.1 years, age range of 21–65 years). Inter-session reliability and agreement were analyzed using weighted Kappa coefficient and non-parametric Bland-Altman analysis. Results: The autostereoscopic tablet demonstrated high inter-session reliability (κ all > 0.80), except for the simulated TNO Stereotest in adults, which demonstrated moderate inter-session reliability (κ = 0.571). Non-parametric Bland-Altman analysis revealed zero median differences, confirming consistent inter-session reliability. Similar patterns were observed in comparing AI-based and conventional methods, with both the weighted Kappa coefficient (κ all > 0.80) and non-parametric Bland-Altman analysis indicating significant agreement. The agreement between methodologies was confirmed by permissible differences, which were smaller than the minimum step range. Conclusion: The integration of AI-based autostereoscopic technology with sub-pixel precision demonstrates significant potential for clinical stereopsis measurements. [ABSTRACT FROM AUTHOR]

Background: Operation with a 3D exoscope has recently been introduced in clinical practice. The exoscope consists of two cameras placed in front of the operative field. Images are shown on a large 3D screen with high resolution. The system can be used to enhance precise dissection and provides new possibilities for improved ergonomics, fluorescence, and other optical-guided modalities. Methods: Initial experience with the ultra-high-definition (4K) 3D exoscope in thyroid and parathyroid operations. The exoscope (OrbEyeTM) was mounted on a holding system (Olympus). Results: We used the exoscope in parathyroidectomy (N = 6) and thyroidectomy (N = 6). Immediate advantages and disadvantages were discussed and recorded. The learning curve for use of the exoscope may be shorter for surgeons with training in endoscopic or robotic procedures. There may be improved ergonomics compared with normal open-neck operations. Further, the optical guided operations can be used with fluorescence and have potential for different on-lay techniques in the future. The 4 K 3D image quality is state-of-art and is highly appreciated during fine surgical dissection and eliminates the need for loupes. Conclusion: In several ways, using the ORBEYE™ in thyroid and parathyroid surgery provides the surgical team with a new and enhanced experience. This includes improved possibility for teaching, surgical ergonomics, and a 4K 3D camera with a powerful magnification system. However, it is not clear if utilization of these features would improve surgical outcomes. Furthermore, the ORBEYE™ lacks incorporation of parathyroid autofluorescence, and the current costs for the system do not facilitate general access to exoscope assisted operations. [ABSTRACT FROM AUTHOR]

The three-dimensional heads-up display system (3D HUDS) is increasingly utilized by ophthalmologists and suggested to offer ergonomic benefits compared to conventional operating microscopes. We aimed to quantitatively assess the surgeon’s neck angle and musculoskeletal discomfort during cataract surgery using commercially available 3D HUDS and conventional microscope. In this single-center comparative observational study, the surgeon conducted routine phacoemulsification surgeries using Artevo® 800 and Opmi Lumera® 700 (both from Carl Zeiss Meditec, Jena, Germany). The surgeon’s intraoperative neck angle was measured using the Cervical Range of Motion device. Postoperative musculoskeletal discomfort was assessed using the Visual Analog Scale (VAS) score after each surgery. A total of 80 cataract surgeries were analyzed, with 40 using Artevo® 800 and 40 using Opmi Lumera® 700. The neck angle was extended when using Artevo® 800 and flexed when using Opmi Lumera® 700 during continuous curvilinear capsulorhexis (CCC), phacoemulsification, and intraocular lens (IOL) placement (− 8.18 ± 2.85° vs. 8.27 ± 2.93° in CCC, − 7.83 ± 3.30° vs. 8.87 ± 2.83° in phacoemulsification, − 7.43 ± 3.80° vs. 7.67 ± 3.73° in IOL placement, respectively; all p < 0.001). The VAS score was significantly lower in surgeries performed with Artevo® 800 (1.27 ± 0.55 vs. 1.73 ± 0.64, p < 0.001). The findings suggest that 3D HUDS help reduce neck flexion and lower work-related musculoskeletal discomfort through ergonomic improvements. [ABSTRACT FROM AUTHOR]

To date, robotic surgery has gained much popularity, impacting deeply on surgical fields such as genitourinary system branches, general surgery, and cardiac surgery. We aim to outline the landscape of robotic surgery, focusing on design improvements, which have improved both the technical skills of surgeons and the outcomes of minimally invasive technique for patients. A thorough narrative literature review was conducted on PubMed/MEDLINE, employing keywords such as "robotic surgical system", "robotic surgical device", and "robotics AND urology". Furthermore, the reference lists of the retrieved articles were scrutinized. The analysis focused on urological surgical systems from the 2000s to the present day. Beginning with the daVinci® Era in the 2000s, new robotic competitors, including Senhance®, Revo-I®, Versius®, Avatera®, Hi-notori®, and HugoTM RAS, have entered the medical market. While daVinci® has maintained a high competitiveness, even more new platforms are now emerging in the medical market with new intriguing features. The growing competition, driven by unique features and novel designs in emerging robotic technologies, has the potential to improve application fields, enhance diffusion, and ameliorate the cost effectiveness of procedures. Since the impact of these new surgical technologies on different specialties and healthcare systems remains unclear, more experience and research are required to define their evolving role. [ABSTRACT FROM AUTHOR]

As automotive technology advances in the realm of digitization, vehicles are becoming smarter and, at the same time, more vulnerable to various threats. This paper focuses on techniques for detecting faults to mitigate the risk of freight transportation. Our observations show that vehicle uptime varies significantly even under similar operating conditions. This variation stems from differences in the wear and tear of moving and stationary parts, the characteristics of transported loads, driving styles, the quality of maintenance, etc. These factors are particularly crucial for abnormal vehicles designed to carry AILs (Abnormal Indivisible Loads). Such vehicles are especially prone to surprising threats, requiring efficient techniques for monitoring separate vehicle components and providing drivers with vital information about their operational status. The presented article proposes an original concept of an integrated three-level monitoring system based on the AOP (All-in-One Platform) principle, using the DBSCAN (Density-Based Spatial Clustering of Applications with Noise) algorithm, which is a tool oriented to distinguish points from three categories: basic, boundary, and external. This is a solution not yet found in the literature. It is based on assessments of LOFs (Local Outlier Factors) and to detect anomalies in the measured values of operational parameters. The purpose of our study was to determine whether providing truck drivers with current information from an active threat warning system could help reduce unplanned downtimes. [ABSTRACT FROM AUTHOR]

Introduction: The use of robotic systems in the surgical domain has become groundbreaking for patients and surgeons in the last decades. While the annual number of robotic surgical procedures continues to increase rapidly, it is essential to provide the surgeon with innovative training courses along with the standard specialization path. To this end, simulators play a fundamental role. Currently, the high cost of the leading VR simulators limits their accessibility to educational institutions. The challenge lies in balancing highfidelity simulation with cost-effectiveness; however, few cost-effective options exist for robotic surgery training. Methods: This paper proposes the design, development and user-centered usability study of an affordable user interface to control a surgical robot simulator. It consists of a cart equipped with two haptic interfaces, a VR visor and two pedals. The simulations were created using Unity, which offers versatility for expanding the simulator to more complex scenes. An intuitive teleoperation control of the simulated robotic instruments is achieved through a high-level control strategy. Results and Discussion: Its affordability and resemblance to real surgeon consoles make it ideal for implementing robotic surgery training programs in medical schools, enhancing accessibility to a broader audience. This is demonstrated by the results of an usability study involving expert surgeons who use surgical robots regularly, expert surgeons without robotic surgery experience, and a control group. The results of the study, which was based on a traditional Peg-board exercise and Camera Control task, demonstrate the simulator's high usability and intuitive control across diverse user groups, including those with limited experience. This offers evidence that this affordable system is a promising solution for expanding robotic surgery training. [ABSTRACT FROM AUTHOR]

The evolving landscape of industrial manufacturing is increasingly embracing automation within smart factories. However, the critical role of human operators, particularly in manual assembly and disassembly tasks, remains undiminished. This paper explores the complexities arising from mass customization and remanufacturing, which significantly enhance the intricacy of these manual tasks. Human involvement is essential in these tasks due to their complexity, necessitating a structured learning process to enhance efficiency and mitigate the learning–forgetting cycle. This study focuses on the utilization of virtual reality (VR) as an innovative training tool to address these challenges. By conducting a systematic literature review (SLR) on the impact of VR on training operators for assembly and disassembly tasks, this paper evaluates the current level of VR application, the used technologies, the operator performance, and the VR benefits and limitations. The analysis reveals a limited but promising application of VR in training, highlighting its potential to improve learning outcomes, productivity, and safety while reducing costs. However, the research also identifies gaps in the practical application of VR for training purposes suggesting a future research agenda to explore its full potential. [ABSTRACT FROM AUTHOR]

Purpose. To investigate effects and complications of endoscopic vitrectomy combined with 3D heads‐up viewing system in treating traumatic ocular injury. Patients and Methods. This is a retrospective interventional case series in a tertiary referral center in Taiwan, and we included patients of traumatic ocular injury, and they underwent endoscopic vitrectomy combined with a 3D heads‐up viewing system. Results. Fourteen eyes of traumatic globe injury from 14 patients were studied over a 30‐month period. Preoperative VA ranged from no light perception (NLP) to 6/6. Postoperative visual acuity improved in 11 of the 14 eyes (79%). Until 6 months after surgery, all eyes had attached retina. The median logMAR BCVA was 2.4 at the first visit and 1.19 at the last visit (p = 0.0028). No subject suffered from retinal detachment, endophthalmitis, or other severe complications. Conclusions. Vitrectomy using endoscopy combined with 3D heads‐up viewing system allowed early evaluation and intervention in traumatic ocular injuries. Most of our cases showed both anatomical and visual acuity improvements. [ABSTRACT FROM AUTHOR]

Objectives: Ophthalmic three-dimensional (3D) digital surgery can reproduce high-definition surgical images; however, 3D digital surgery is limited by recording capacities. We examined the relationship between the minimum image quality required to reproduce surgical images and recording capacity. Methods: Patients who underwent simultaneous vitrectomy and cataract surgery by the same surgeon using a 3D digital surgery system at Juntendo University Urayasu Hospital between February and October 2021 were evaluated. Various quality (Q) and frame rate (FR) settings were used for each case. Four vitreous surgeons evaluated the reproducibility of recorded images of macular manipulation for epiretinal membrane (ERM) and macular hole (MH) cases and those of peripheral retinal manipulation for rhegmatogenous retinal detachment (RRD) cases. The video bitrate and minimum settings required to reproduce surgical images and factors affecting surgical image reproducibility were examined. Results: A total of 129 eyes of 129 patients were observed. The minimum image quality required to reproduce surgical images was 11.67 Mbps. The Q and FR for periretinal processing and Q for macular manipulation affected surgical image reproducibility (p = 0.025, p = 0.019, and p = 0.07, respectively). The minimum recording settings required to obtain highly reproducible images were Q = 3 and FR = 40. The total file size for vitrectomy video recordings with these settings was as compact as 3.17 GB for 28 min. Conclusions: During 3D digital surgery, highly reproducible surgical images can be obtained with a small storage capacity using settings of at least Q = 3 and FR = 40. [ABSTRACT FROM AUTHOR]

Objective: The aim of the present pilot study was to assess the effectiveness of the platelet-rich fibrin (PRF) apical barrier for the placement of MTA for the treatment of teeth with periapical lesions and open apices. Methods: A total of thirty teeth on twenty-eight patients with open apices and periapical periodontitis were enrolled and divided into two groups in the present pilot study. In the PRF group (fourteen teeth in thirteen patients), nonsurgical endodontic treatment was performed using PRF as an apical matrix, after which the apical plug of the MTA was created. For the non-PRF group (fourteen teeth in fourteen patients), nonsurgical endodontic therapy was performed using only the MTA for an apical plug with no further periapical intervention. Clinical findings and periapical digital radiographs were used for evaluating the healing progress after periodic follow-ups of 1, 3, 6, and 9 months. The horizontal dimension of the periapical lesion was gauged, and the changes in the dimensions were recorded each time. The Friedman test, Dunn-Bonferroni post hoc correction, and Mann-Whitney U test were used for statistical analysis, with P < 0.05 serving as the threshold for determining statistical significance. Results: All patients in both groups in the present pilot study had no clinical symptoms after 1 month, with a significant reduction in the periapical lesion after periodic appointments. The lesion width of the PRF group was significantly smaller than that of the non-PRF group in the sixth and ninth month after treatment. Conclusions: PRF is a promising apical barrier matrix when combined with MTA for the treatment of teeth with open apices and periapical periodontitis. Small number of study subjects and the short time of follow-up period limit the generalizability of these results. Trial registration: TCTR, TCTR20221109006. Registered 09 November 2022 - Retrospectively registered, https://www.thaiclinicaltrials.org/show/TCTR20221109006. [ABSTRACT FROM AUTHOR]

Copyright of NTT Gijutsu Journal is the property of Nippon Telegraph & Telephone Corporation and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Virtual reality (VR) has good potential to promote technology-enhanced learning. Students can benefit from immersive visualization and intuitive interaction in their learning of abstract concepts, complex structures, and dynamic processes. This paper is interested in evaluating the effects of VR learning games in a Virtual and Augmented Reality Technology-Enhanced Learning (VARTeL) environment within an engineering education setting. A VARTeL flipped classroom is established in the HIVE learning hub at Nanyang Technological University (NTU) Singapore for the immersive and interactive learning. Experiments are designed for the university students conducting the learning, with three interactive and immersive VR games related to science, technology, engineering and mathematics (STEM), i.e., virtual cells, a virtual F1 racing car, and vector geometry. These VR games are a part of the VARTeL apps designed in-house at NTU for STEM education. Quantitative and qualitative analyses are performed. A total of 156 students from Mechanical Engineering participated in the experiment. There are 15 participants selected for an interview after the experiment. Pre-tests and post-tests are performed using two different models, the developed VARTeL and the modified Technology-Rich Outcome-Focused Learning Environment Inventory (TROFLEI), in order to measure the efficiency of the VARTeL environment in Higher Education. Significant improvements of about 24.8% are observed for the post-tests over the pre-tests, which illustrate the effectiveness of the VARTeL for Engineering education. Details of the VR simulation games, methods of data collection, data analyses, as well as the experiment results are discussed. It is observed from the results that all the underlying scales of the modified TROFLEI are above the threshold for the 'Good' category, indicating that a very reliable questionnaire is designed in this research. The mean 'Ideal' values are about 0.7–2.6% higher than the mean 'Actual' values. The limitations of the experiment and future works with recommendations are also presented in this paper. [ABSTRACT FROM AUTHOR]

In medicine and healthcare, augmented reality (AR) has been used by physicians during surgical procedures. It has proved helpful in preoperative planning and procedure navigation by allowing them to display in-depth information and visualize details in real time during surgery, prioritizing patient safety and healthcare. Due to the critical nature of surgical procedures, extreme accuracy is required when using ar technology to maintain patients' health. A few years ago, ar faced several challenges and limitations in surgeries, such as noise in real-time images, cutting errors, navigation errors, wrong implant placement, overlay errors, navigating narrow areas, geometric accuracy limitations, image alignment, image registration, and occlusion handling. This paper reviews several recently published articles exploring ar technology usage in jaw and knee replacement surgery, focusing on identifying the newest technologies, methods, and solutions for the abovementioned limitations. Based on data collected from the published papers, the results were compared for each problem solved in each article regarding accuracy and processing time. [ABSTRACT FROM AUTHOR]

Background: To compare the value and efficiency of the three-dimensional (3D) heads-up surgical system and traditional microscopic (TM) system in teaching and learning vitreoretinal surgeries. Methods: Twenty ophthalmologists and scrub nurses were recruited as teachers, and 45 junior ophthalmology residents and trainee doctors, trainee nurses, and medical students were recruited as observers. Each teacher and observer were assigned to both a 3D-assisted and TM-assisted vitreoretinal surgery and then asked to complete satisfaction questionnaires for both surgical systems at the end of each surgery. Results: The 3D heads-up surgical system was rated significantly higher in most of the subscales and overall satisfaction score by both teachers and observers (P < 0.05). However, ratings for instrument adjustment were significantly higher in the TM group compared to the 3D group for junior ophthalmology residents and trainee doctors (6.1 ± 1.7 vs. 8.8 ± 1.1, P < 0.001). Conclusions: The 3D heads-up surgical system has great didactical value in the medical education of vitreoretinal surgeries, but it is important to consider the specific needs of different learners when choosing between the two systems. Trial registration: Not applicable. [ABSTRACT FROM AUTHOR]

Introduction: Binocular color fusion and rivalry are two specific phenomena in binocular vision, which could be used as experimental tools to study how the brain processes conflicting information. There is a lack of objective evaluation indexes to distinguish the fusion or rivalry for dichoptic color. Methods: This paper introduced EEGNet to construct an EEG-based model for binocular color fusion and rivalry classification. We developed an EEG dataset from 10 subjects. Results: By dividing the EEG data from five different brain areas to train the corresponding models, experimental results showed that: (1) the brain area represented by the back area had a large difference on EEG signals, the accuracy of model reached the highest of 81.98%, and more channels decreased the model performance; (2) there was a large effect of inter-subject variability, and the EEG-based recognition is still a very challenge across subjects; and (3) the statistics of EEG data are relatively stationary at different time for the same individual, the EEG-based recognition is highly reproducible for an individual. Discussion: The critical channels for EEG-based binocular color fusion and rivalry could be meaningful for developing the brain computer interfaces (BCIs) based on color-related visual evoked potential (CVEP). [ABSTRACT FROM AUTHOR]

The paper presents a novel offline programming (OLP) method based on programming by demonstration (PbD), which has been validated through user study. PbD is a programming method that involves physical interaction with robots, and kinesthetic teaching (KT) is a commonly used online programming method in industry. However, online programming methods consume significant robot resources, limiting the speed advantages of PbD and emphasizing the need for an offline approach. The method presented here, based on KT, uses a virtual representation instead of a physical robot, allowing independent programming regardless of the working environment. It employs haptic input devices to teach a simulated robot in augmented reality and uses automatic path planning. A benchmarking test was conducted to standardize equipment, procedures, and evaluation techniques to compare different PbD approaches. The results indicate a 47 % decrease in programming time when compared to traditional KT methods in established industrial systems. Although the accuracy is not yet at the level of industrial systems, users have shown rapid improvement, confirming the learnability of the system. User feedback on the perceived workload and the ease of use was positive. In conclusion, this method has potential for industrial use due to its learnability, reduction in robot downtime, and applicability across different robot sizes and types. [ABSTRACT FROM AUTHOR]

Augmented reality technologies provide transformative solutions in various surgical fields. Our research focuses on the use of an advanced augmented reality system that projects 3D holographic images directly into surgical footage, potentially improving the surgeon’s orientation to the surgical field and lowering the cognitive load. We created a novel system that combines exoscopic surgical footage from the “ORBEYE” and displays both the surgical field and 3D holograms on a single screen. This setup enables surgeons to use the system without using head-mounted displays, instead viewing the integrated images on a 3D monitor. Thirteen surgeons and surgical assistants completed tasks with 2D and 3D graphical surgical guides. The NASA Task Load Index was used to assess mental, physical, and temporal demands. The use of 3D graphical surgical guides significantly improved performance metrics in cochlear implant surgeries by lowering mental, physical, temporal, and frustration levels. However, for Bonebridge implantation, the 2D graphical surgical guide performed better overall (p = 0.045). Participants found the augmented reality system’s video latency to be imperceptible, measuring 0.13 ± 0.01 s. This advanced augmented reality system significantly improves the efficiency and precision of cochlear implant surgeries by lowering cognitive load and improving spatial orientation.

Background: Vision is an important and defining element of laparoscopy and significantly affects the outcome of surgery in terms of time, error, and precision. Several new imaging systems have become available for laparoscopic surgery, including three-dimensional (3D) high-definition (HD) and two-dimensional (2D) ultra-high-resolution (4K) monitors. 3D HD systems offer a number of potential benefits to surgeons and patients over traditional 2D systems, including reduced operating time, blood loss, and hospital stay. However, the performance of 3D systems against the new, ultra-high definition 4K systems is barely known and highly controversial. There is a paucity of studies comparing them in clinical settings. The aim of this study is to compare 2D 4K and 3D HD perspectives in gastric bypass surgery. Methods: Forty-eight patients with an indication for gastric bypass will be randomized to receive laparoscopic gastric bypass surgery using either 2D 4K or 3D HD systems. The operations will be performed by a well-coordinated team of three senior surgeons. The primary outcome is operative time. Secondary outcomes include intraoperative complications, blood loss, operator workload as assessed by the validated Surg-TLX questionnaire, and postoperative complications according to the Clavien-Dindo classification. An interim analysis is planned after enrollment of 12 participants for each group. Discussion: This prospective, randomized trial is designed to test the hypothesis that the use of a 3D HD system will result in a significant improvement in operative time compared to a 2D 4K system in bariatric surgery. The objective is to provide clinical evidence for new laparoscopic imaging systems and to evaluate potential benefits. Trial registration: This trial is registered at clinicaltrials.gov under the identifier NCT05895058. Registered 30 May 2023. BASEC2023-D0014 [Registry ID Swissethics, approved 3 May 2023]. SNCTP000005489 [SNCTP study register, last updated 13 July 2023]. [ABSTRACT FROM AUTHOR]

Neural responses to sensory inputs can scale with the likelihood of encountering the input. This is consistent with the predictive coding framework, in that the human brain is expected to be less responsive to predicted inputs. Typically, however, prediction is not explicitly measured. It is inferred from the probability of encountering an event. When an input is explicitly predicted, responses to predicted inputs can be enhanced. Here, we ask if this effect can be ascribed to a generic priming effect, from pre-cogitating about one of two possible inputs. Consistent with this, we find that P300s (a relatively late event-related potential measured with electroencephalography) are greater for explicitly predicted audio and visual inputs, and that this effect cannot be distinguished from a priming effect from pre-imagining audio or visual presentations. Evidence indicates that participants engaged in pre-imagining presentations, as we were able to decode online what type of presentation (audio or visual) they were imagining with a high success rate (approx. 73%), and we encouraged compliance with neuro-feedback regarding this success rate. Our data confirm that human cortex can be more responsive to inputs that have been subject to pre-cogitation—including explicit predictions. This highlights that while anticipatory processes can reduce responding to likely inputs, they can also enhance responding to explicitly predicted inputs. [ABSTRACT FROM AUTHOR]

Partial nephrectomy (PN) represents a procedure where the use of a robot has further enabled successful completion of this complex surgery. The results of this procedure using Versius Robotic Surgical System (VRSS) still need to be evaluated. Our working group described the technique and reported the initial results of a series of PN using VRSS. We presented our setting, surgical technique and outcomes for PN, using VRSS. Between 2022 and 2023, 15 patients underwent PN performed by two surgeons in two different centers. Fifteen patients underwent PN. The median lesion size identified on preoperative imaging was 4 (IQR 2.3–5) cm. Median PADUA score was 8 (IQR 7–9). Two procedures were converted to radical nephrectomy for enhanced oncological disease control. Of the 13 nephrectomies that were completed as partial, 7 were performed clampless and 6 with warm ischemia clamping. Median clamping time was 10 (IQR 9–11) minutes. No procedure was converted to open. Median blood loss was 200 (IQR 100–250) mL. Median total operative time was 105 (IQR 100–110) minutes. Median console time was 75 (IQR 66–80) minutes. Median set-up time was 13 (IQR 12–14) minutes. No intraoperative complications were reported. The median hospitalization time was 4 (IQR 3.5–4) days. None of the patients were transfused and none of the patients required readmission. In a pathology report, one patient had a positive surgical margin. Our initial experience suggests that performing PN using VRSS is feasible with good short-term outcomes. [ABSTRACT FROM AUTHOR]

Objectives: To investigate the effect of a three-dimensional (3D) exoscope for decompression of single-segment massive lumbar disc herniation (LDH). Methods: The study included 56 consecutive patients with single segment massive LDH who underwent decompression assisted by a 3D exoscope from October 2019 to October 2022 at a university hospital. The analysis was based on comparison of perioperative metrics including decompression time, estimated blood loss (EBL) during decompression and postoperative length of stay (PLS); clinical outcomes including assessment using the visual analogue scale (VAS) and the Oswestry disability index (ODI); and incidence of reoperation and complications. Results: The mean decompression time was 28.35 ± 8.93 min (lumbar interbody fusion (LIF)) and 15.50 ± 5.84 min (fenestration discectomy (LOVE surgery)), the mean EBL during decompression was 42.65 ± 12.42 ml (LIF) and 24.32 ± 8.61 ml (LOVE surgery), and the mean PLS was 4.56 ± 0.82 days (LIF) and 2.00 ± 0.65 days (LOVE surgery). There were no complications such as cerebrospinal fluid leakage, nerve root injury and epidural hematoma. All patients who underwent decompression assisted by a 3D exoscope were followed up for 6 months. At the last follow-up, the VAS and ODI scores were significantly improved from the preoperative period to the last follow-up (P < 0.05). Conclusions: A 3D exoscope provides a visually detailed, deep and clear surgical field, which makes decompression safer and more effective and reduces short-term complications. A 3D exoscope may be a good assistance tool during decompression for single-segment massive LDH. [ABSTRACT FROM AUTHOR]

Detecting imminent collisions is essential for survival. Here, we used high-resolution fMRI at 7 Tesla to investigate the role of attention and consciousness for detecting collision trajectory in human subcortical pathways. Healthy participants can precisely discriminate collision from near-miss trajectory of an approaching object, with pupil size change reflecting collision sensitivity. Subcortical pathways from the superior colliculus (SC) to the ventromedial pulvinar (vmPul) and ventral tegmental area (VTA) exhibited collision-sensitive responses even when participants were not paying attention to the looming stimuli. For hemianopic patients with unilateral lesions of the geniculostriate pathway, the ipsilesional SC and VTA showed significant activation to collision stimuli in their scotoma. Furthermore, stronger SC responses predicted better behavioral performance in collision detection even in the absence of awareness. Therefore, human tectofugal pathways could automatically detect collision trajectories without the observers' attention to and awareness of looming stimuli, supporting "blindsight" detection of impending visual threats. [ABSTRACT FROM AUTHOR]

Most people can conjure images and sounds that they experience in their minds. There are, however, marked individual differences. Some people report that they cannot generate imagined sensory experiences at all (aphantasics) and others report that they have unusually intense imagined experiences (hyper-phantasics). These individual differences have been linked to activity in sensory brain regions, driven by feedback. We would therefore expect imagined experiences to be associated with specific frequencies of oscillatory brain activity, as these can be a hallmark of neural interactions within and across regions of the brain. Replicating a number of other studies, relative to a Resting-State we find that the act of engaging in auditory or in visual imagery is linked to reductions in the power of oscillatory brain activity across a broad range of frequencies, with prominent peaks in the alpha band (8–12 Hz). This oscillatory activity, however, did not predict individual differences in the subjective intensity of imagined experiences. For audio imagery, these were rather predicted by reductions within the theta (6–9 Hz) and gamma (33–38 Hz) bands, and by increases in beta (15–17 Hz) band activity. For visual imagery these were predicted by reductions in lower (14–16 Hz) and upper (29–32 Hz) beta band activity, and by an increase in mid-beta band (24–26 Hz) activity. Our data suggest that there is sufficient ground truth in the subjective reports people use to describe the intensity of their imagined sensory experiences to allow these to be linked to the power of distinct rhythms of brain activity. In future, we hope to combine this approach with better measures of the subjective intensity of imagined sensory experiences to provide a clearer picture of individual differences in the subjective intensity of imagined experiences, and of why these eventuate. [ABSTRACT FROM AUTHOR]

The article explores the implications of the widespread adoption of virtual technology in courtrooms, particularly in response to the COVID-19 pandemic. It discusses the shift towards online hearings, examining the challenges and opportunities presented by virtual technology for the administration of justice. It distinguishes between different technological settings, such as video-enabled hearings, virtual hearings, and immersive virtual hearings.

Real-time 3D scanning of a scene or object using multiple depth cameras is often required in many applications but is still a challenging task for the computer vision community, especially when the object or scene is partially occluded and dynamic. If active depth sensors are used in this case, their resulting depth map quality gets degraded due to interference between active radiations from each depth sensor. Passive 3D sensors like stereo cameras can avoid the issue of interference as they do not emit any active radiation, but they face correspondence problems. Since releasing the commodity depth sensor Microsoft Kinect, researchers are getting more interested in active depth-sensing. However, Kinect sensors have some easily noticeable limitations concerning 3D reconstruction such as: they can provide depth maps for a limited range, their field of view is restricted and holes are observed in the depth map due to occlusion. The above-mentioned limitations can be overcome if multiple Kinect sensors are used simultaneously instead of a single Kinect sensor. Still, the challenge here is to avoid interference between these sensors. We present a comprehensive review of possible solutions to avoid interference between multiple Kinect sensors. Furthermore, we introduce the Kinect technology in detail along with applications where multiple Kinect sensors are used in the literature. We expect that this paper will be helpful to the researchers who want to use multiple Kinect sensors in sharing the workplace in their research. [ABSTRACT FROM AUTHOR]

Background: Head-mounted display (HMD) arises as an alternative display system for surgery. This study aimed to assess the utility of a stereoscopic HMD for exoscopic neurosurgery. Methods: The leading operator and assistants were asked to assess the various aspects of the HMD characteristics compared to the monitor display using a visual analog scale (VAS)-based questionnaire. The VAS score ranged from 0 to 10 (0, HMD was significantly inferior to the monitor; 5, HMD and monitor display were equal; and 10, HMD was significantly superior to the monitor). Results: The surgeons and assistants used and evaluated HMD in seven exoscopic surgeries: three tumor removal, one aneurysm clipping, one anterior cervical discectomy and fusion, and two cervical laminectomy surgeries. The leading operators' assessment of HMD-based surgery was not different from monitor-based surgery; however, the assistants evaluated the field of view, overall image quality, and the assisting procedure as better in MHD-based surgery than monitor-based surgery (P = 0.039, 0.045, and 0.013, respectively). Conclusion: HMD-based exoscopic neurosurgery can be performed at a similar quality as monitor-based surgery. Surgical assistants may benefit from using HMD-based surgery. [ABSTRACT FROM AUTHOR]