Several studies demonstrate that since emotions are spontaneously manifested through different measurable quantities (e.g. vocal and facial expressions), this makes possible a sort of automatic estimation of emotion from objective measurements. However, the reliability of such estimations is strongly influenced by the availability of the different sensor modalities used to monitor the affective status of a subject, and furthermore the extraction of objective parameters is sometime thwarted in a noisy and disturbed environment. This paper introduces a personalized emotion estimation based on a heterogeneous array of physical sensors for the measurement of vocal, facial, and physiological (electro-cardiogram and electro-dermal) activities. As a proof of concept, changes in the levels of both emotion reactiveness and pleasantness are estimated under critical operative conditions. The estimator model takes advantage from the time-varying selection of the most relevant non-spurious sensors features and the adaptation of the k-nearest neighbour paradigm to the continuous identification of the most affine model templates. The model, once trained, demonstrated to autonomously embed new sensorial input and adapt to unwanted/unpredicted sensor noise or emotion alteration. The proposed approach has been successfully tested on the RECOLA database, a multi-sensorial corpus of spontaneous emotional interactions in French.

Mosciano, F., Mencattini, A., Ringeval, F., Schuller, B., Martinelli, E., & Di Natale, C. (2017). An array of physical sensors and an adaptive regression strategy for emotion recognition in a noisy scenario. SENSORS AND ACTUATORS. A, PHYSICAL, 267, 48-59 [10.1016/j.sna.2017.09.056].

An array of physical sensors and an adaptive regression strategy for emotion recognition in a noisy scenario

Mosciano, Francesco;Mencattini, Arianna;Martinelli, Eugenio;Di Natale, Corrado
2017

Abstract

Several studies demonstrate that since emotions are spontaneously manifested through different measurable quantities (e.g. vocal and facial expressions), this makes possible a sort of automatic estimation of emotion from objective measurements. However, the reliability of such estimations is strongly influenced by the availability of the different sensor modalities used to monitor the affective status of a subject, and furthermore the extraction of objective parameters is sometime thwarted in a noisy and disturbed environment. This paper introduces a personalized emotion estimation based on a heterogeneous array of physical sensors for the measurement of vocal, facial, and physiological (electro-cardiogram and electro-dermal) activities. As a proof of concept, changes in the levels of both emotion reactiveness and pleasantness are estimated under critical operative conditions. The estimator model takes advantage from the time-varying selection of the most relevant non-spurious sensors features and the adaptation of the k-nearest neighbour paradigm to the continuous identification of the most affine model templates. The model, once trained, demonstrated to autonomously embed new sensorial input and adapt to unwanted/unpredicted sensor noise or emotion alteration. The proposed approach has been successfully tested on the RECOLA database, a multi-sensorial corpus of spontaneous emotional interactions in French.
Pubblicato
Rilevanza internazionale
Articolo
Esperti anonimi
Settore ING-INF/07 - Misure Elettriche e Elettroniche
eng
Con Impact Factor ISI
Adaptive regression strategy; Emotion recognition; Sensor array; Electronic, Optical and Magnetic Materials; Instrumentation; Condensed Matter Physics; Surfaces, Coatings and Films; 2506; Electrical and Electronic Engineering
Mosciano, F., Mencattini, A., Ringeval, F., Schuller, B., Martinelli, E., & Di Natale, C. (2017). An array of physical sensors and an adaptive regression strategy for emotion recognition in a noisy scenario. SENSORS AND ACTUATORS. A, PHYSICAL, 267, 48-59 [10.1016/j.sna.2017.09.056].
Mosciano, F; Mencattini, A; Ringeval, F; Schuller, B; Martinelli, E; Di Natale, C
Articolo su rivista
File in questo prodotto:
File Dimensione Formato  
SSA_final.pdf

non disponibili

Licenza: Copyright dell'editore
Dimensione 1.49 MB
Formato Adobe PDF
1.49 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2108/199196
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 9
  • ???jsp.display-item.citation.isi??? 7
social impact