Mareüil, P., D'Alessandro, C., Raake, A., Bailly, G., Garcia, M., and Morel, M.
    A Joint Intelligibility Evaluation of French Text-to-speech Synthesis Systems: The EvaSy SUS/ACR Campaign

    In: Proc. 5th International Conference on Language Resources and Evaluation (LREC 2006), IT-Genoa, 2034-2037.

    Abstract
    The EVALDA/EvaSy project is dedicated to the evaluation of text-to-speech (TTS) synthesis systems for the French language. It is intended to expand upon the ARCAUPELF (now AUF) campaign of 1996-1999, the only previous formal evaluation campaign for TTS systems in French. The EvaSy project is subdivided into four components: evaluation of the grapheme-to-phoneme conversion module (Boula de Mareüil et al., 2005), evaluation of prosody (Garcia et al., 2006), evaluation of intelligibility, and global evaluation of the quality of the synthesised speech. This paper reports on the intelligibility and global evaluation of the synthesised speech. It focuses on intelligibility, but a comparison with absolute category rating in terms of e.g. pleasantness and naturalness is also provided.