ORALHYPE 2.0 – Oral Health using Hyperspectral Imaging and Computer Vision

ORALHYPE 2.0 – Oral Health using Hyperspectral Imaging and Computer Vision Shirley Sidharta for i3mainz, CC BY SA 4.0

Supported by DFG, this project strive to identify tumorous tissue from the human mouth and throat region automatically using hyperspectral imaging and AI-driven machine vision methods.


Carcinoma is a malignancy. Carcinomas in humans are treated by surgical intervention in order to remove both, the altered tissue and conspicuous precursor lesions. Typically, the removal affects a large area for the sake of minimizing the risk of spread. Especially in the mouth and neck region, this therapy is disadvantageous for the patients aesthetics. For this reason, the project aims to identify tissue changes - particularly at the edges of the altered tissue - non-invasively and thus optimize the medical therapy standard expansively. To this end, the advantages of hyperspectral imaging and AI-based machine vision methods are going to be combined.


The project’s scope is to detect changes in the human mucosa automatically using machine lerning approaches. Therefore, creating high-quality and extensive training data is inevitable. This step represents the initial and one of the most integral milestone on the path to a successful project closure. Multiple ways of data analysis and appropriate model training will be connected to the data acquisition in favor of building a automated pipeline for real-time tissue change detection.


The project kick-off in March 2023. Results are going to publish regularly in certain scientific publications.