In this talk, recent research activities are introduced in sentiment correlation analyses among speech, language and color studied at our research laboratory. Following the findings of fundamental correlations between communicative speech prosody and its impressions expressed by language, communicative F0 pattern is calculated. Using Japanese sentences consisting of adverbs showing magnitude, adjectives and final particles, the possibility of F0 control for communicative speech synthesis is shown. The other experimental trial is also introduced to show that this sentiment mapping between impression (language) and prosody (speech) can also be observed between speech and color. These two research studies indicate a new paradigm of cross-modal computational modeling of sentiment information processing between speech, language and image.
Prochains événements
Voir la liste d'événementsSRPP Beyond reaction time: Articulatory evidence of perception-production link in speech using the Stimulus-Response Compatibility paradigm.
Takayuki Nagamine (Department of Speech Hearing and Phonetic Sciences, University College London)
SRPP 13/03/2026 Christophe Corbier
Christophe Corbier (CNRS, IReMUS)
SRPP 20/03/2026 Claire Njoo
Claire Njoo (Université Paris-Sud)
SRPP 27/03/2026 Rasmus Puggaard-Rode
Rasmus Puggaard-Rode(University of Oxford)


