Recombinant speech synthesis: Natural text‐to‐speech synthesis with prosodic control.

Unit selection text‐to‐speech synthesis methods rely on large corpora to cover all phoneme sequences in as many prosodic contexts as possible. This coverage is rarely complete except in limited domains. This becomes particularly salient when using prosodic markup to generate specific prosodic patterns (e.g., emphatic stress). An architecture is proposed combining the naturalness of unit‐selection synthesis with the requirement of prosodic control. The speech corpus consists of multiple sub‐corpora, each optimized to cover a “linguistic subspace”; subspaces include phoneme sequences, left‐headed feet, sentence structures, and paralinguistic categories. The system relies on the superpositional model of intonation to decompose natural pitch contours into component contours, e.g., phrase curves (corresponding to phrases) and accent curves (corresponding to left‐headed feet); on analogous methods for timing; and on hybridization methods to implement paralinguistic features. During synthesis, phoneme sequences,...