Effects of the New Testing Paradigm of the 2012 NIST Speaker Recognition Evaluation
Alvin F. Martin, Craig S Greenberg, Vincent M. Stanford, John M. Howard, George R. Doddington and John J. Godfrey |
---|
The 2012 NIST Speaker Recognition Evaluation was substantially different from the prior NIST speaker evaluations in its basic paradigm regarding system knowledge of most of the target speakers. This involved both a substantial increase in the amount of training data for most targets, and the provision of this data in advance to the system for all evaluation trials. We examine the performance effects of these changes, with contrasts provided by a limited number of targets with limited training not made known in advance and by one participant's system designed not to take advantage of the prior knowledge of multiple targets.