AUDIOVISUAL CLASSIFICATION OF VOCAL OUTBURSTS IN HUMAN CONVERSATION USING LONG-SHORT-TERM MEMORY NETWORKS
Audio/Visual Detection of Non-Linguistic Vocal Outbursts
Přednášející: Stavros Petridis, Autoři: Florian Eyben, Technische Universitaet Muenchen, Germany; Stavros Petridis, Imperial College London, United Kingdom; Björn Schuller, Technische Universität München, Germany; George Tzimiropoulos, Stefanos Zafeiriou, Maja Pantic, Imperial College London, United Kingdom
We investigate classification of non-linguistic vocalisations with a novel audiovisual approach and Long Short-Term Memory (LSTM) Recurrent Neural Networks as highly successful dynamic sequence classifiers. As database of evaluation serves this year’s Paralinguistic Challenge’s Audiovisual Interest Corpus of human-to-human natural conversation. For video-based analysis we compare shape and appearance based features. These are fused in an early manner with typical audio descriptors. The results show significant improvements of LSTM networks over a static approach based on Support Vector Machines. More important, we can show a significant gain in performance when fusing audio and visual shape features.
Informace o přednášce
| Nahráno: | 2011-05-25 15:05 - 15:25, Club D |
|---|---|
| Přidáno: | 19. 6. 2011 17:31 |
| Počet zhlédnutí: | 33 |
| Rozlišení videa: | 1024x576 px, 512x288 px |
| Délka videa: | 0:24:42 |
| Audio stopa: | MP3 [8.38 MB], 0:24:42 |
Příbuzné přednášky
0:19:47
LOCALIZATION OF NON-LINGUISTIC EVENTS IN SPONTANEOUS SPEECH BY NON-NEGATIVE MATRIX FACTORIZATION AND LONG SHORT-TERM MEMORY
Audio/Visual Detection of Non-Linguistic Vocal Outbursts
Přidáno: 19. 6. 2011 17:19
0:24:57
PANEL DISCUSSION
Audio/Visual Detection of Non-Linguistic Vocal Outbursts
Přidáno: 20. 6. 2011 02:07
Komentáře