Search

Objective: For Minimally Invasive Surgery (MIS) procedures, specular highlights constitute important visual cues for gauging tissue deformation as well as perceiving depth and orientation. This paper describes a novel reflectance modeling technique that is particularly suitable for simulating light interaction behavior with mucus-covered tissue surfaces., Methods: The complex and largely random tissue-light interaction behavior is modeled with a noise-based approach. In the proposed technique, Perlin noise is used to modulate the shape of specular highlights and imitate the effects of the complex tissue structure on reflected lighting. For efficient execution, the noise texture is generated in pre-processing and stored in an image-based representation, i.e., a reflectance map. At run-time, the graphics hardware is used to attain per-pixel control and achieve realistic tissue appearance., Results: The reflectance modeling technique has been used to replicate light-tissue reflection in surgical simulation. By comparing the results acquired against those obtained from conventional per-vertex Phong lighting and OpenGL multi-texturing, it is observed that the noise-based approach achieves improved tissue appearance similar to that observed in real procedures. Detailed user evaluation demonstrates the quality and practical value of the technique for increased perception of photorealism., Conclusion: The proposed technique presents a practical strategy for surface reflectance modeling that is suitable for real-time interactive surgical simulation. The use of graphics hardware further enhances the practical value of the technique.

Computer-based simulation is an important tool for surgical skills training and assessment. In general, the degree of realism experienced by the trainees is determined by the visual and biomechanical fidelity of the simulator. In minimally invasive surgery, specular reflections provide an important visual cue for tissue deformation, depth and orientation. This paper describes a novel image-based lighting technique that is particularly suitable for modeling mucous-covered tissue surfaces. We describe how noise functions can be used to control the shape of the specular highlights, and how texture noise is generated and encoded in image-based structure at a pre-processing stage. The proposed technique can be implemented at run-time by using the graphics processor to efficiently attain pixel-level control and photo-realism. The practical value of the technique is assessed with detailed visual scoring and cross comparison experiments by two groups of observers.