Automatic 3D tooth segmentation using convolutional neural networks in harmonic parameter space

Abstract Automatic segmentation of 3D tooth models into individual teeth is an important step in orthodontic CAD systems. 3D tooth segmentation is a mesh instance segmentation task. Complex geometric features on the surface of 3D tooth models often lead to failure of tooth boundary detection, so it is difficult to achieve automatic and accurate segmentation by traditional mesh segmentation methods. We propose a novel solution to address this problem. We map a 3D tooth model isomorphically to a 2D harmonic parameter space and convert it into an image. This allows us to use a CNN to learn a highly robust image segmentation model to achieve automated and accurate segmentation of 3D tooth models. Finally, we map the image segmentation mask back to the 3D tooth model and refine the segmentation result using an improved Fuzzy-Clustering-and-Cuts algorithm. Our method has been incorporated into an orthodontic CAD system, and performs well in practice.