SuperLectures.com

DYNAMICS OF TONGUE GESTURES EXTRACTED AUTOMATICALLY FROM ULTRASOUND

Full Paper at IEEE Xplore

Medical Imaging

Presented by: Jeff Berry, Author(s): Jeff Berry, Ian Fasel, University of Arizona, United States

We describe a system for automatically extracting dynamics of tongue gestures from ultrasound images of the tongue using translational deep belief networks (tDBNs). In tDBNs, a joint model of the input and output vectors are learned during a generative pretraining stage, and then a translation step is used to transform input-only vectors into this joint representation. A final fine-tuning stage is then used to reconstruct the desired outputs given input vectors. We show that this technique dramatically improves performance on segmenting ultrasound image sequences of continuous speech into individual consonant gestures compared with the original DBN method of Hinton et al. (2006) as well as alternative methods using PCA and support vector machines.

  Speech Transcript

|

  Slides

Enlarge the slide | Show all slides in a pop-up window

0:00:16

  1. slide

0:00:23

  2. slide

0:03:17

  3. slide

0:04:17

  4. slide

0:05:24

  5. slide

0:05:55

  6. slide

0:07:31

  7. slide

0:09:18

  8. slide

0:09:31

  9. slide

0:10:16

 10. slide

0:12:31

 11. slide

0:12:58

 12. slide

0:13:52

 13. slide

0:14:49

 14. slide

0:16:09

 15. slide

0:17:00

 16. slide

0:17:57

 17. slide

  Comments

Please sign in to post your comment!

  Lecture Information

Recorded: 2011-05-26 16:55 - 17:15, Club H
Added: 9. 6. 2011 20:46
Number of views: 25
Video resolution: 1024x576 px, 512x288 px
Video length: 0:19:41
Audio track: MP3 [6.72 MB], 0:19:41