Search

Neuronavigation is a computer-assisted technique for presenting three-dimensional images of a patient's brain to facilitate immediate and precise lesion localization by surgeons. Neuronavigation systems use preoperative medical images of patients. In neurosurgery, when the dura mater and arachnoid membrane are incised and the cerebrospinal fluid (CSF) drains out, the brain loses the CSF buoyancy and deforms in the direction of gravity, which is referred to as brain shift. This brain shift yields inaccurate neuronavigation. To reduce this inaccuracy, an intraoperative brain shift should be estimated. This paper proposes a dynamic simulation method for brain-shift estimation combining the moving-particle semi-implicit (MPS) method and the finite element method (FEM). The CSF was modeled using fluid particles, whereas the brain parenchyma was modeled using finite elements (FEs). Node particles were attached to the surface nodes of the brain parenchyma in the FE model. The interaction between the CSF and brain parenchyma was simulated using the repulsive force between the fluid particles and node particles. Validation experiments were performed using a gelatin block. The gelatin block was dipped into silicone oil, which was then gradually removed; the block deformation owing to the buoyancy loss was measured. The experimental deformation data were compared with the results of the MPS-FEM coupled analysis. The mean absolute error (MAE) between the simulated deformation and the average across the four experiments was 0.26 mm, while the mean absolute percentage error (MAPE) was 27.7%. Brain-shift simulations were performed using the MPS-FEM coupled analysis, and the computational cost was evaluated.

Laparoscopic surgery is a minimally invasive procedure that is performed by viewing endoscopic camera images. However, the limited field of view of endoscopic cameras makes laparoscopic surgery difficult. To provide more visual information during laparoscopic surgeries, augmented reality (AR) surgical navigation systems have been developed to visualize the positional relationship between the surgical field and organs based on preoperative medical images of a patient. However, since earlier studies used preoperative medical images, the navigation became inaccurate as the surgery progressed because the organs were displaced and deformed during surgery. To solve this problem, we propose a mixed reality (MR) surgery navigation system in which surgical instruments are tracked by a motion capture (Mocap) system; we also evaluated the contact between the instruments and organs and simulated and visualized the deformation of the organ caused by the contact. This paper describes a method for the numerical calculation of the deformation of a soft body. Then, the basic technology of MR and projection mapping is presented for MR surgical navigation. The accuracy of the simulated and visualized deformations is evaluated through basic experiments using a soft rectangular cuboid object.

Kinect has been utilized as a cost-effective, easy-touse motion capture sensor using the Kinect skeleton algorithm. However, a limited number of landmarks and inaccuracies in tracking the landmarks' positions restrict Kinect's capability. In order to increase the accuracy of motion capturing using Kinect, joint use of the Kinect skeleton algorithm and Kinect-based marker tracking was applied to track the 3D coordinates of multiple landmarks on human. The motion's kinematic parameters were calculated using the landmarks' positions by applying the joint constraints and inverse kinematics techniques. The accuracy of the proposed method and OptiTrack (NaturalPoint, Inc., USA) was evaluated in capturing the joint angles of a humanoid (as ground truth) in a walking test. In order to evaluate the accuracy of the proposed method in capturing the kinematic parameters of a human, lower body joint angles of five healthy subjects were extracted using a Kinect, and the results were compared to Perception Neuron (Noitom Ltd., China) and OptiTrack data during ten gait trials. The absolute agreement and consistency between each optical system and the robot data in the robot test and between each motion capture system and OptiTrack data in the human gait test were determined using intraclass correlations coefficients (ICC3). The reproducibility between systems was evaluated using Lin's concordance correlation coefficient (CCC). The correlation coefficients with 95% confidence intervals (95%CI) were interpreted substantial for both OptiTrack and proposed method (ICC > 0.75 and CCC > 0.95) in humanoid test. The results of the human gait experiments demonstrated the advantage of the proposed method (ICC > 0.75 and RMSE = 1.1460 degrees) over the Kinect skeleton model (ICC < 0.4 and RMSE = 6.5843 degrees).