Xiao Xiao (De Vinci Innovation Center & MIT Media Lab)
This talk explores how vocal synthesis controlled in real-time by hand gestures (chironomy) can be used by non-native speakers for intonation practice of a foreign language. Such practice addresses three sources of difficulty for intonation learning. First, it can train the ear to perceive unfamiliar features in speech by presenting them through visual and kinesthetic modalities. Second, the control of pronunciation with hand gestures bypasses ingrained patterns in the natural voice that are difficult to correct. Finally, vocal synthesis enables a learner to focus on the suprasegmental level without being preoccupied with fine-phonetic detail on the segmental level. I present findings from two experiments: a pilot with non-native speakers of French and a study with francophone learners of English, discussing lessons learned and perspectives for future directions.
Prochains événements
Voir la liste d'événements18 Oct19 Oct 2024
SRPP de Susanne Fuchs
ZAS Berlin
24 October 2024
SRPP de Johanna Cronenberg
Université Paris Cité/LLF
08 November 2024
SRPP de Indranil Dutta
School of Languages and Linguistics, Jadavpur University
15 November 2024
SRPP de Michael Neumann
Modality.AI, Inc.