AUDIO-VISUAL SYNCHRONIZATION RECOVERY IN MULTIMEDIA CONTENT
Joint Audio Visual Processing
Presented by: Jong-Seok Lee, Author(s): Jong-Seok Lee, Touradj Ebrahimi, Swiss Federal Institute of Technology in Lausanne, Switzerland
This letter proposes a method recovering audio-visual synchronization of multimedia content. It exploits the correlation between the acoustic and the visual signals in order to estimate the audio-visual drift existing in the content. By shifting the audio signal relative to the visual signal, the estimation of the drift is obtained by searching for the shift producing the maximal audio-visual correlation. We consider two correlation measures, namely, mutual information and canonical correlation, and compare their performance. Experimental results demonstrate that the method using the canonical correlation is effective in recovering the audio-visual synchronization for both speech and non-speech sequences.
Lecture Information
| Recorded: | 2011-05-24 16:15 - 16:35, Club H |
|---|---|
| Added: | 7. 6. 2011 19:18 |
| Number of views: | 11 |
| Video resolution: | 1024x576 px, 512x288 px |
| Video length: | 0:19:08 |
| Audio track: | MP3 [6.54 MB], 0:19:08 |
Related Lectures
0:18:16
UNSUPERVISED EXTRACTION OF AUDIO-VISUAL OBJECTS
Joint Audio Visual Processing
Added: 15. 6. 2011 11:16
0:18:52
TRACKING CHANGES IN CONTINUOUS EMOTION STATES USING BODY LANGUAGE AND PROSODIC CUES
Joint Audio Visual Processing
Added: 9. 6. 2011 11:32
Comments