Obstacle Detection and Avoidance for the Blind

extending The vOICe with Google Tango for depth mapping

« The vOICe Home Page
« The vOICe for Android

January 8, 2016: failed attempt to get support from 2016 Project Tango App Incubator.
This web page is obsolete and will no longer be maintained.

The real-time 3D depth mapping enabled by the Google Tango project lets us create a live sonic depth map for blind people. This serves to support obstacle detection and avoidance beyond the reach of the white cane, and even enables blind detection of the shape of nearby objects, thus aiding with nearby object identification.

Under this proposal, the existing Android app The vOICe for Android (available for free on  Google Play ) will be extended with the capability of sounding live depth maps!

The vOICe on HTC One X

In the longer run, blind people will benefit from fully wearable depth mapping through the use of future mass market augmented reality glasses that incorporate Google Tango technology (The vOICe for Android already ran on Google Glass).

Android camera glasses? Augmented reality glasses as shown in the EG5 presentation by Ralph Osterhout, 2011
ODG augmented reality glasses (no Google Tango support yet)

Optinvent ORA-X augmented reality headphones
Optinvent ORA-X smart headphones (no Google Tango support yet)

Precursor work on creating depth maps from stereo vision using a Windows PC was done as described on the Stereoscopic Vision for the Blind page, but The vOICe for Android is much more suitable for mobile use, so development focus had shifted towards that and awaited availability of 3D camera technology for intuitive feedback on nearby obstacles for the blind. Google Tango will now enable this on mass-market mobile devices.

Red image component
Red color component of greyscale left-eye image.
Cyan image component
Cyan color component of greyscale right-eye image.
Red-cyan anaglyph image
Combined red-cyan 3D anaglyph.
Depth map
The vOICe depth map as extracted from anaglyph image.
Vuzix stereo camera glasses, CES 2010

Depth mapCamera view (use red/green glasses to depth)
Milestones:
  • Q2-Q4 2016: development & testing

  • End 2016: release on Google Play

Visual and auditory mockup:
Click on image on the far right to hear one-second MP3 sound clip of sonified depth map
(preferably set your audio player to auto-repeat this soundscape for better understanding)

Team:  Peter Meijer (LinkedIn)

App portfolio:
The vOICe for Android
The vOICe for Windows (for use with camera glasses)
The vOICe Web App (platform-independent, WebRTC based)
The vOICe for Symbian (of course Symbian is now obsolete)

About The vOICe

Copyright © 1996 - 2016 Peter B.L. Meijer