Rxivist logo

Augmented Reality Powers a Cognitive Prosthesis for the Blind

By Yang Liu, Noelle R. B. Stiles, Markus Meister

Posted 22 May 2018
bioRxiv DOI: 10.1101/321265

To restore vision for the blind several prosthetic approaches have been explored that convey raw images to the brain. So far these schemes all suffer from a lack of bandwidth and the extensive training required to interpret unusual stimuli. Here we present an alternate approach that restores vision at the cognitive level, bypassing the need to convey sensory data. A wearable computer captures video and other data, extracts the important scene knowledge, and conveys that through auditory augmented reality. This system supports many aspects of visual cognition: from obstacle avoidance to formation and recall of spatial memories, to long-range navigation. Neither training nor modification of the physical environment are required: Blind subjects can navigate an unfamiliar multi-story building on their first attempt. The combination of unprecedented computing power in wearable devices with augmented reality technology promises a new era of non-invasive prostheses that are limited only by software.

Download data

  • Downloaded 2,456 times
  • Download rankings, all-time:
    • Site-wide: 4,833
    • In animal behavior and cognition: 31
  • Year to date:
    • Site-wide: 25,486
  • Since beginning of last month:
    • Site-wide: 16,765

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide


Sign up for the Rxivist weekly newsletter! (Click here for more details.)