SuperLectures.com

DYNAMICS OF TONGUE GESTURES EXTRACTED AUTOMATICALLY FROM ULTRASOUND

Full Paper at IEEE Xplore

Medical Imaging

Přednášející: Jeff Berry, Autoři: Jeff Berry, Ian Fasel, University of Arizona, United States

We describe a system for automatically extracting dynamics of tongue gestures from ultrasound images of the tongue using translational deep belief networks (tDBNs). In tDBNs, a joint model of the input and output vectors are learned during a generative pretraining stage, and then a translation step is used to transform input-only vectors into this joint representation. A final fine-tuning stage is then used to reconstruct the desired outputs given input vectors. We show that this technique dramatically improves performance on segmenting ultrasound image sequences of continuous speech into individual consonant gestures compared with the original DBN method of Hinton et al. (2006) as well as alternative methods using PCA and support vector machines.

  Přepis řeči

|

  Slajdy

Zvětšit slajd | Zobrazit všechny slajdy

0:00:16

  1. slajd

0:00:23

  2. slajd

0:03:17

  3. slajd

0:04:17

  4. slajd

0:05:24

  5. slajd

0:05:55

  6. slajd

0:07:31

  7. slajd

0:09:18

  8. slajd

0:09:31

  9. slajd

0:10:16

 10. slajd

0:12:31

 11. slajd

0:12:58

 12. slajd

0:13:52

 13. slajd

0:14:49

 14. slajd

0:16:09

 15. slajd

0:17:00

 16. slajd

0:17:57

 17. slajd

  Komentáře

Please sign in to post your comment!

  Informace o přednášce

Nahráno: 2011-05-26 16:55 - 17:15, Club H
Přidáno: 9. 6. 2011 20:46
Počet zhlédnutí: 25
Rozlišení videa: 1024x576 px, 512x288 px
Délka videa: 0:19:41
Audio stopa: MP3 [6.72 MB], 0:19:41