filename     : llingens23a.pdf
entry        : book
conference   : MICCAI 2023, Vancouver, Canada 8-12 October, 2023
pages        : 94–103
year         : 2023
month        : October
title        : International Workshop on Applications of Medical AI
subtitle     : AMAI 2023: Applications of Medical Artificial Intelligence
author       : Lasse Lingens1, Baran Gözcü, Till Schnabel, Yoriko Lill, Benito K.Benitez, Prasad Nalabothu, Andreas A. Mueller, Markus Gross, Barbara Solenthaler
booktitle    : 
ISSN/ISBN    : 978-3-031-47076-9
editor       : Shandong Wu, Behrouz Shabestari, Lei Xing
publisher    : Springer Cham
publ.place   : LNCS
volume       : 14313
issue        : 1
language     : English	
keywords     : Image-based 3D reconstruction, data-driven modeling, shape prior, cleft lip and palate
abstract     : We present a novel pipeline that takes smartphone videos of the intraoral region of newborn cleft patients as input and produces a 3D mesh. The mesh can be used to facilitate the plate treatment of the cleft and support surgery planning. A retrained LoFTR-based method creates an initial sparse point cloud. Next, we utilize our collection of existing scans of previous patients to train an implicit shape model. The shape model allows for refined denoising of the initial sparse point cloud and; therefore, enhances the camera pose estimation. Finally, we complete the model with a dense reconstruction based on multi-view stereo. With Moving Least Squares and Poisson reconstruction we convert the point cloud into a mesh. This method is low-cost in hardware acquisition and supports minimal training time for a user to utilize it.