With the development of so-called stitching technologies, panoramic images with high spatial resolution are possible by way of post-processing continually captured image sequences. These technologies allow showing multiple fields of view of the camera simultaneously. Due to the high computational effort of conventional methods, these pictures generally cannot be stitched together “online“ during surgery, but are available only at a later point in time. We developed the “Endo-stitch system“ to circumvent this limitation and to be able to capture and use panoramic pictures in real time during the endoscopic procedure.
The calculation of the panoramic images with “Endorama“ is based on a sequence of image operators, which are applied to any new image of the connected camera. After distortion has been corrected in the endoscopic image, the image features are used to spatially align the image sequence. This way the scene captured by the endoscope is gradually established as panoramic image at a data rate of 8 to 10 frames per second. The latest image is constantly projected onto the panoramic image, always providing the endoscopist with real-time perspective in the anatomical context.