ArtiSynth designing a modular 3D articulatory speech synthesizer

ArtiSynth is a modular, component‐based system for performing dynamic 3D simulations of the human vocal tract and face. It provides a test bed for research in areas such as speech synthesis, linguistics, medicine, and dentistry. ArtiSynths framework enables researchers to construct, refine, and exchange models of all parts of the vocal tract and surrounding structures. ArtiSynth introduces a probe concept to unify input and output data flow, which allows control of and access to models with time varying data series. ArtiSynth supports interconnected heterogeneous models, such as rigid body, mass‐spring, and parametric, using a point‐set connection method, called markers, for constraint satisfaction. Using ArtiSynth, we created a muscle‐driven rigid body jaw model, a parametric principle component tongue model from MRI images, a parametric lip model, and mass‐spring face tissue model. We combined them in various ways. Data from medical imaging (MRI, CT, and ultrasound) and other technologies such as optica...