Panoramic Endoscopy of the stomach and colon

Initial situation

The endoscopic examination of the stomach, esophagus and colon serves the early detection and treatment of changes in the tissue. Due to the limited field of view through the endoscopic "keyhole perspective", however, only a small section of the intestine walls is visible. The physician must therefore combine all examined views in his mind to a „complete view“.

Virtual model of a section of the colon that we use to train the computation of the depth map. The use of synthetic material has the advantage that it is precise distance of the virtual camera to the tissue is always known exactly.


Within the context of the project, components for a real-time cartography of the gastro-intestinal surfaces of stomach and colon shall be developed, examined and evaluated.
The goal is that the physician will receive a panoramic image of the cavities directly during the endoscopic examination and can then use these images for the documentation of the procedure.
Furthermore, in the panoramic images visible lesions can be interactively augmented and the panoramic images can be transferred to other physicians.

Project partners

The company E & L will provide project management and coordination, and will develop an infrastructure to integrate and manage image panoramas of stomach and colon into clinical documentation systems.


Image analysis methods for the creation of panoramic images from stomach and colon (ideally in real time) will be developed at the Fraunhofer Institute for Integrated Circuits IIS.

In the Department of Endoscopy of the Malteser Waldkrankenhaus St. Marien endoscopic image sequences of the stomach and intestine are collected and anonymized, and experiments are conducted on biophantoms.

As a supplier of software solutions in the healthcare sector the NEXUS AG is responsible for the integration of patient data.

The company CHILI develops components for tele-endoscopy in order to exchange endoscopic sequences and image panoramas between different clinical facilities.

GastroMapper - Panoramic Endoscopy of the stomach, esophagus and colon

The project is funded by the Bavarian Research Foundation from April 1, 2019 to March 31, 2022.

Go on to Bavarian Research Foundation