1. Augmented reality navigation for liver resection with a stereoscopic laparoscope.
- Author
-
Luo H, Yin D, Zhang S, Xiao D, He B, Meng F, Zhang Y, Cai W, He S, Zhang W, Hu Q, Guo H, Liang S, Zhou S, Liu S, Sun L, Guo X, Fang C, Liu L, and Jia F
- Subjects
- Algorithms, Animals, Deep Learning, Depth Perception, Disease Models, Animal, Image Processing, Computer-Assisted, Imaging, Three-Dimensional, Laparoscopes, Neoplasms diagnostic imaging, Reproducibility of Results, Software, Surgery, Computer-Assisted, Swine, Tomography, X-Ray Computed, Video Recording, Augmented Reality, Laparoscopy methods, Liver diagnostic imaging, Liver surgery
- Abstract
Objective: Understanding the three-dimensional (3D) spatial position and orientation of vessels and tumor(s) is vital in laparoscopic liver resection procedures. Augmented reality (AR) techniques can help surgeons see the patient's internal anatomy in conjunction with laparoscopic video images., Method: In this paper, we present an AR-assisted navigation system for liver resection based on a rigid stereoscopic laparoscope. The stereo image pairs from the laparoscope are used by an unsupervised convolutional network (CNN) framework to estimate depth and generate an intraoperative 3D liver surface. Meanwhile, 3D models of the patient's surgical field are segmented from preoperative CT images using V-Net architecture for volumetric image data in an end-to-end predictive style. A globally optimal iterative closest point (Go-ICP) algorithm is adopted to register the pre- and intraoperative models into a unified coordinate space; then, the preoperative 3D models are superimposed on the live laparoscopic images to provide the surgeon with detailed information about the subsurface of the patient's anatomy, including tumors, their resection margins and vessels., Results: The proposed navigation system is tested on four laboratory ex vivo porcine livers and five operating theatre in vivo porcine experiments to validate its accuracy. The ex vivo and in vivo reprojection errors (RPE) are 6.04 ± 1.85 mm and 8.73 ± 2.43 mm, respectively., Conclusion and Significance: Both the qualitative and quantitative results indicate that our AR-assisted navigation system shows promise and has the potential to be highly useful in clinical practice., Competing Interests: Declaration of competing interest The authors declare that they have no conflicts of interest., (Copyright © 2019 Elsevier B.V. All rights reserved.)
- Published
- 2020
- Full Text
- View/download PDF