MULTISTREAM SPEAKER DIARIZATION THROUGH INFORMATION BOTTLENECK SYSTEM OUTPUTS COMBINATION

Speaker Diarization

Presented by: Petr Motlíček, Author(s): Deepu Vijayasenan, Fabio Valente, Petr Motlicek, Idiap Research Institute, Switzerland

Speaker diarization of meetings recorded with Multiple Distant Microphones makes extensive use of multiple feature streams like MFCC and Time Delay of Arrivals (TDOA). Typically the combination happens using separate models for each feature stream. This work investigates if the combination of multiple feature streams can happen through the combination of multiple diarization systems performed using those features. The paper extends the previously proposed Information Bottleneck method to handle the combination of several probabilistic diarization outputs. In contrast to the conventional model-based feature combination, this technique is referred as system-based combination. Furthermore the paper introduces an hybrid model-system combination. Experiments are run on data from the Rich Transcription campaigns and show that the system based combination largely outperforms the model based combination by (37\%) relative. The hybrid approaches improve by (10-20\%). The analysis of errors shows that the improvements come from the recordings where the individual MFCC and TDOA systems provide very different performances.

You need the Flash Player.

Share:

Download subtitles | Enlarge video

1. slide