PERCEIVING GRAPHICAL AND PICTORIAL INFORMATION VIA TOUCH AND HEARING

Joint Audio Visual Processing

Presented by: Thrasyvoulos Pappas, Author(s): Pubudu Madhawa Silva, Thrasyvoulos N. Pappas, Northwestern University, United States; Joshua Atkins, James E. West, The Johns Hopkins University, United States

With the ever increasing availability of the Internet and electronic media rich in graphical and pictorial information -- for communication, commerce, entertainment, art, education -- it has been hard for the visually impaired community to keep up. We propose a non-invasive system that can be used to convey graphical and pictorial information via touch and hearing. The main idea is that the user actively explores a two-dimensional layout consisting of one or more objects on a touch screen with the finger while listening to auditory feedback. We have demonstrated the efficacy of the proposed approach in a range of tasks, from basic shape identification to perceiving a scene with several objects. The proposed approach is also expected to contribute to research in virtual reality, immersive environments, and medicine.

You need the Flash Player.

Share:

Download subtitles | Enlarge video

Recorded:	2011-05-24 17:15 - 17:35, Club H
Added:	9. 6. 2011 12:19
Number of views:	45
Video resolution:	1024x576 px, 512x288 px
Video length:	0:17:21
Audio track:	MP3 [5.93 MB], 0:17:21