Towards a clinical stereoscopic augmented reality system for laparoscopic surgery

Document Type

Conference Proceeding

Publication Date



Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)


8361 LNCS




Clinical prototype; Laparoscopic surgery; Real-time AR; Stereoscopic augmented reality (AR)


We describe our development of a complete real-time stereoscopic augmented reality system that overlays laparoscopic ultrasound (LUS) images on stereoscopic laparoscopic video for conventional laparoscopic surgery. The system was designed and developed to achieve near-term clinical evaluation as a primary goal. Special consideration was paid to system interactivity, accuracy and easy integration within the existing clinical workflow. Custom-designed fixtures for the two imaging devices were created to avoid their recalibration in the operating room and thus to minimize setup time. The system was assembled on a rolling cart to make it portable for the use in the operating room. Utilizing our optimized design and hardware-accelerated implementation, the system achieved a low system latency of approximately 150 ms. The LUS image-to-video registration accuracy, measured in terms of target registration accuracy and recorded separately for the left and right eye channels of the stereoscopic camera, was 3.34±0.59 mm and 2.76±0.68 mm. © 2014 Springer International Publishing.

This document is currently not available here.