Culture and measurement strategies are influential factors when evaluating the perception of emotion in speech. However, multilingual databases suitable for such a study are missing, and there is no agreement on the most suitable emotional model. To address this gap, we present EmoFilm, a new multilingual emotional speech corpus, consisting of 1115 English, Spanish, and Italian emotional utterances extracted from 43 films and 207 speakers. We have performed a within-culture categorical vs dimensional perceptual evaluation, employing 225 native Italian listeners, who evaluated the Italian section of the database with the emotional states of anger, sadness, happiness, fear, and contempt. The aim of this study is to assess whether the emotional model (categorical or dimensional), taken as reference for measurement, influences a listener's perception of emotional speech, and-to what extent-both models are complementary or not. We show that the measurement strategy chosen does influence a listener's response, especially for some emotions, e. g., contempt. The confusion patterns typical of a categorical evaluation are not always mirrored by the dimensional assessment.

Parada-Cabaleiro, E., Costantini, G., Batliner, A., Baird, A., Schuller, B.w. (2018). Categorical vs dimensional perception of Italian emotional speech. In 19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES (pp.3638-3642) [10.21437/Interspeech.2018-47].

Categorical vs dimensional perception of Italian emotional speech

Parada-Cabaleiro E.;Costantini G.;
2018-09-01

Abstract

Culture and measurement strategies are influential factors when evaluating the perception of emotion in speech. However, multilingual databases suitable for such a study are missing, and there is no agreement on the most suitable emotional model. To address this gap, we present EmoFilm, a new multilingual emotional speech corpus, consisting of 1115 English, Spanish, and Italian emotional utterances extracted from 43 films and 207 speakers. We have performed a within-culture categorical vs dimensional perceptual evaluation, employing 225 native Italian listeners, who evaluated the Italian section of the database with the emotional states of anger, sadness, happiness, fear, and contempt. The aim of this study is to assess whether the emotional model (categorical or dimensional), taken as reference for measurement, influences a listener's perception of emotional speech, and-to what extent-both models are complementary or not. We show that the measurement strategy chosen does influence a listener's response, especially for some emotions, e. g., contempt. The confusion patterns typical of a categorical evaluation are not always mirrored by the dimensional assessment.
Annual Conference of the International Speech Communication Association, INTERSPEECH 2018
Hyderabad, INDIA
2018
Rilevanza internazionale
set-2018
Settore ING-IND/31 - ELETTROTECNICA
English
Intervento a convegno
Parada-Cabaleiro, E., Costantini, G., Batliner, A., Baird, A., Schuller, B.w. (2018). Categorical vs dimensional perception of Italian emotional speech. In 19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES (pp.3638-3642) [10.21437/Interspeech.2018-47].
Parada-Cabaleiro, E; Costantini, G; Batliner, A; Baird, A; Schuller, Bw
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2108/206729
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 29
  • ???jsp.display-item.citation.isi??? 18
social impact