Facial cancer patients undergoing nasal ablation face significant psychological challenges related to the loss of their visual identity. The current method for creating nasal prostheses is time-consuming, expensive, and invasive, requiring multipphysical fittings. This thesis presents "Magic Mirror," a non-invasive solution enabling patients to visualize their new appearance with different virtual prostheses in real-time.
The developed method combines 3DDFA V3 technologies for realistic nose texture generation and 3DDFA V2 for fast facial reconstruction. Robust face tracking is ensured by BlazeFace via MediaPipe, capabof detecting faces without noses. 3D registration algorithms, using Principal Component Analysis (PCA) coupled with the ICP algorithm, enabprecise positioning of prosthesis models. The Minilag filter ensures smooth movements without perceptibdelay.
Experimental results demonstrate an average placement accuracy of 9.70 pixels, drift below one pixel, and an average latency of 23 ms meeting the comfort threshold for immersive applications. System robustness was validated on videos of faces with and without noses, meeting the criterion of 95% of the prosthesis model within the region of interest in most cases. Current processing speed (4.33 frames per second) remains limited, but using a graphics processor would achieve the performance necessary for real-time operation.
"Magic Mirror" offers an innovative and respectful method for supporting patients in choosing their prosthesis, naturally integrating into the AUDACE project and paving the way for a new approach to facial prosthesis creation adapted to modern medical needs.
| Date | 28 Jan 2026 |
|---|
| Original language | French |
|---|
| Awarding Institution | - École de technologie supérieure
|
|---|
| Supervisor | Carlos Vázquez (Supervisor) |
|---|
Dessolies, A. (Author),
Vázquez (Supervisor),
28 Jan 2026Student thesis: Master's thesis › Master in Engineering: Engineering