The Reading Everyday Emotion Database (REED): a set of audio-visual recordings of emotions in music and language

Ong, J. H. ORCID: https://orcid.org/0000-0003-1503-8311, Leung, F. Y. N. and Liu, F. ORCID: https://orcid.org/0000-0002-7776-0222 (2023) The Reading Everyday Emotion Database (REED): a set of audio-visual recordings of emotions in music and language. Language Resources and Evaluation. ISSN 1574-0218 doi: 10.1007/s10579-023-09698-5

Abstract/Summary

Most audio-visual (AV) emotion databases consist of clips that do not reflect real-life emotion processing (e.g., professional actors in bright studio-like environment), contain only spoken clips, and none have sung clips that express complex emotions. Here, we introduce a new AV database, the Reading Everyday Emotion Database (REED), which directly addresses those gaps. We recorded the faces of everyday adults with a diverse range of acting experience expressing 13 emotions—neutral, the six basic emotions (angry, disgusted, fearful, happy, sad, surprised), and six complex emotions (embarrassed, hopeful, jealous, proud, sarcastic, stressed)—in two auditory domains (spoken and sung) using everyday recording devices (e.g., laptops, mobile phones, etc.). The recordings were validated by an independent group of raters. We found that: intensity ratings of the recordings were positively associated with recognition accuracy; and the basic emotions, as well as the Neutral and Sarcastic emotions, were recognised more accurately than the other complex emotions. Emotion recognition accuracy also differed by utterance. Exploratory analysis revealed that recordings of those with drama experience were better recognised than those without. Overall, this database will benefit those who need AV clips with natural variations in both emotion expressions and recording environment.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/113611
Item Type	Article
Refereed	Yes
Divisions	Interdisciplinary Research Centres (IDRCs) > Centre for Integrative Neuroscience and Neurodynamics (CINN) Interdisciplinary centres and themes > ASD (Autism Spectrum Disorders) Research Network Life Sciences > School of Psychology and Clinical Language Sciences > Department of Psychology Life Sciences > School of Psychology and Clinical Language Sciences > Language and Cognition
Publisher	Springer
Download/View statistics	View download statistics for this item