Why The vOICe vision BCI for the blind can and will likely defeat Neuralink Blindsight and other brain implants for restoring vision
Neuralink Blindsight and most other brain implants aimed at restoring vision to the blind work by implanting electrodes in (or on) the primary visual cortex (V1). A small current through an electrode can give a visual percept in the form of a phosphene, a flash of light. The assumption is that by stimulating a grid of many electrodes one can evoke the perception of an image, and thereby restore a form of vision. The vOICe visual-to-auditory sensory substitution approach instead uses normal hearing to convey images encoded in sound, and the human brain must first learn to decode these sounds to obtain a form of (functional) vision through sound-guided mental imagery. In the following, we will focus mostly on comparing The vOICe with Neuralink Blindsight, but much of what is said about the latter also applies to other brain implants in the visual cortex. The vOICe approach too is not without limitations and unknowns, but overall has many key advantages. To scientists: we greatly welcome your feedback, insights and particularly studies!
|
| |
---|---|---|
Invasive or non-invasive? |
Invasive: requires brain surgery with risks of infection, hemorrhage, seizures and death, as well as inevitably some damage to the cortical tissue where electrodes are inserted, both physical damage from the act of insertion and from possible subsequent inflammatory reactions and gliosis. Biocompatibility remains a major challenge.
Invasive BCIs can be characterized by a dimensionless "Butcher number" (Meister, 2019): the number ratio of damaged or killed neurons and stimulated or recorded neurons. Optogenetic approaches that avoid inserting electrodes introduce other risks, by for instance using viruses (viral vectors) to deliver genes into cells, potentially increasing cancer risk through mutations, while those genes themselves may trigger immune responses or prove cytotoxic through new protein expression.A Neuralink brain implant is a Class III medical device. |
Non-invasive: no known medical risks beyond the avoidable risk of hearing damage
when sounds are played at high volume for prolonged periods of time, like with loud music. No neurons are damaged or killed. The approach is 100% biocompatible.
The vOICe is not a medical device. The vOICe enables training for functional vision by conveying live visual imagery through sound, but it is not intended to treat, cure, or prevent any disease or condition - including blindness. |
Messy or orderly? |
Messy: phosphenes (light flashes) at somewhat random-offset positions (like "stars-in-the-sky"), with variable sizes and shapes, sometimes flashing, with non-veridical colors and with gaps between sometimes partially overlapping phosphenes. Phosphenes are further affected by representational drift, causing neural response changes that may require frequent recalibration to undo. Moreover, the apparent
![]() ![]() Quality of vision will be far worse than |
Orderly: sounds appearing at perfectly orderly and uniform spatial and temporal positions through pitch (tone frequency), stereo position and time. Negligible if any representational drift at the perceptual level. (![]() Eye movements do not affect the view, but eye-tracking in combination with zoom slice selection and a higher scan rate could be used to create the auditory equivalent of eye saccades, giving a higher effective visual resolution despite the lower resolution per shortened soundscape scan. It is still unknown to what extent this would make seeing with The vOICe more intuitive and easy to master. |
See light? |
Yes: visual percepts (light flashes) for late-blind people right upon first-time use, giving a great honeymoon experience, but it does
![]() ![]() An analogy is what happened with the Argus II retinal implant of Second Sight Medical Products (out of production since 2019): initially, blind recipients were thrilled to perceive light and flashes of light again, but subsequently they never developed |
Not from the start: initially perceived as an annoying cacophony of "just sound". The focus is on functional vision. Visual percepts and vision may or may not arise from extensive
![]() ![]()
Some blind users have reported having visual percepts (cf. "Visual experiences in the blind induced by an auditory sensory substitution device"), and the sounds may become mostly unnoticeable over time as the brain becomes increasingly aware of the visual information content rather than the auditory information carrier. |
Late-blind and congenitally blind? |
Works only for late-blind people - no matter what Elon Musk
![]()
Congenitally (totally) blind people do not get visual percepts from electrically stimulating their "visual" cortex (occipital cortex), because |
Works for both congenitally blind and late-blind people.
This assumes that they have more or less normal hearing, but some existing blind users are hard of hearing and use hearing aids, so this is a soft requirement. It does not require visual percepts nor neuroplasticity to understand that a rising (falling) tone means a rising (falling) bright line, such that |
Textures and shading? |
Cannot convey textures and shading, only a couple of lines and edges.
Conveying textures, shading and uniform areas would require simultaneously activating many electrodes above phosphene threshold, but this would likely evoke seizures or could even cause death. E.g., activating 10,000 electrodes with a |
Can convey
![]()
Shading and smooth surfaces give smooth noise-like sounds. Textures give characteristic complex dense "rhythms", and can be perceptually more useful than edges when following a path, where edges of surrounding objects or of sharp path-crossing shadows from buildings or trees can be very confusing. |
Scalable? |
Barely scalable.
Expensive surgery with special implant hardware limits the potential market to a small number of rich countries with a low incidence of near-total blindness, and even there further limited by reimbursement policies in health insurance, because even there few blind people have the financial resources to pay for the brain implant themselves. Surgery for a visual cortical prosthesis is further complicated by the fact that the visual cortex lies in part hidden within the banks of the calcarine sulcus. Elon Musk may in line with his general ambitions force the company to move on to greener (more lucrative, mass-market) pastures once the technology has been proven to work, somewhat. |
Highly scalable at extremely low cost.
The vOICe can already run on billions of existing devices: The vOICe for Windows on PCs (over 100,000 downloads), |
Device lifetime? |
Device lifetime is still unknown, likely only several years.
Previous work with implanted penetrating electrodes in visual cortex showed effective lifetimes of up to several years (often less), but much depends on the specific proprietary electrode technology. Electrodes typically show signs of corrosion, cracks and other damage after prolonged use in vivo, with best results thus far reported using PEDOT electrode coatings. One cannot do accelerated longevity (lifetime) testing of brain implants in vivo, so with any new brain implant technology one can only wait for years and hope for the best. Penetrating electrodes may also retract and fail due to movement of the brain relative to the skull. Only the external components can be replaced without surgery, but may become obsolete once the company decides to no longer support the hardware. The implant itself cannot be replaced without yet another brain surgery, each time leading to some additional tissue damage in the visual cortex. Research into long-term biocompatibility of penetrating electrodes is |
Device lifetime is effectively unlimited.
Using globally available mature hardware such as smartphones and stereo earbuds, lifetime per hardware component is likely on the order of a decade or more, while replacing the hardware is easy and affordable. Some basic but fully functional versions of the software are open source as well as publicly archived in for instance the |
Training support? |
Unspecified support for rehabilitation training. "Vision" with a brain implant is totally different from normal vision or even low vision eyesight, so it will after recovery from brain surgery require extensive rehabilitation to learn to make good, practical and safe use of the brain implant in daily living situations.
|
The vOICe too requires extensive training for best results.
There is still lack of 1-on-1 training support that would seem to best fit local blindness institutes already involved in training for safe blind use of the white cane and/or guide dog, and other daily living skills.
An online English self-training manual for The vOICe is available, with translations into Russian, Portuguese and Chinese. Its use requires self-discipline, and results would greatly benefit from supplemental on-site feedback and continued motivation by sighted instructors, including existing O&M (orientation and mobility) instructors in your area. |
Resolution? |
Visual resolution is still unknown, but unlikely to benefit much from more than 1,000 - 10,000 electrodes in view of the fact that only lines and edges can be conveyed, to limit seizure risk. This would limit resolution to between 30 × 30 and 100 × 100 for a few lines and edges, but overlapping
![]() ![]() ![]() |
![]() ![]() A visual acuity on the order of 20/160 to 20/240 seems achievable in combination with a field of view on the order of 60°, even without foveal enlargement. An acuity worse than 20/200 (or tunnel vision with a field of view smaller than 20°) defines legal blindness in the US, so an acuity slightly below or slightly above this acuity appears plausible. Importantly, unlike with human vision this acuity is uniform across the entire field of view, and in the visual periphery it can therefore even exceed normal vision. |
Field of view? |
The field of view (FOV) is still unknown, but has with prior brain implants in visual cortex been limited to a cortical area corresponding to the fovea, perceptually giving severe tunnel vision (1° to 2° visual angle, about the size of a thumbnail at arm's length).
All image content is squeezed into this narrow field of view. Since the definition of legal blindness in the US applies when having a field of view smaller than 20°, the implant recipient would likely still count as legally blind no matter how high the visual acuity. |
The field of view (FOV) is typically 60° to 120° depending mostly on the choice of camera.
For all vision systems there is an inevitable trade-off between visual acuity and field-of-view, but as stated above a visual acuity on the order of 20/160 to 20/240 seems achievable in combination with a field of view on the order of 60°. |
Frame rate? |
Frame rate is still unknown, but neural recovery time after stimulation (refractory period plus perceptual fading upon repeated stimulation) may limit effective frame rate to, say, 4 to 8 frames per second (4-8 fps).
![]() | Frame rate is by default 1 frame per second (1 fps), optionally set to a higher 2 or 4 fps (or even higher) in a trade-off with effective visual resolution. |
Masking? |
Need not cause sensory masking, but this only applies to totally blind people.
Visual cortex stimulation likely interferes with and degrades natural low vision, for instance because the field of view of both types of sensory input does not match, but other forms of detrimental interference seem likely. |
Some degree of masking of hearing natural sounds is inevitable.
Minimized by using a modest sound volume in relation to ambient sound levels, and by using bone conduction headphones that do not block echolocation and natural hearing. The gains in functional vision should outweigh auditory masking effects. |
Ambiguity? | Unknown apart from general visual ambiguities and illusions, and the limitations of ultralow vision (ULV). |
Very rare, and easily disambiguated.
In rare cases, soundscapes of for instance horizontal line segments may sound similar to environmental sounds such as the beeping of a truck backing up. If you then look slightly up or down and the pitch changes, you know it is not a truck backing up. |
Literature? |
Virtually no peer-reviewed scientific literature. It is for believers or NDA-signers.
Also note that the term |
Extensive peer-reviewed scientific literature.
|
Patient/user reports? |
Blind patient reports? Nothing yet at the time of writing.
The lack of any video demo in the |
Blind user reports in numerous places and contexts.
![]() For example, former Dobelle brain implant recipient |
Deaf-blind users? |
No known reason why a brain implant in visual cortex would not work for late-blind people who are also profoundly deaf.
|
The vOICe assumes more or less normal hearing, but is known to be also used by totally blind people who are hard of hearing, in combination with hearing aids.
The vOICe will not work for people who are profoundly deaf, but may work to some extent for totally deaf-blind people who received a cochlear implant. There are no known reports about this yet. |
Cortical blindness? |
A brain implant in the visual cortex requires a functioning visual cortex to restore some form of vision. It cannot work for people with cortical blindness.
Blindness caused by stroke, trauma or other causes of visual cortex damage will be an exclusion criterion. |
The vOICe likely activates visual cortex when visual cortex is functional, but should still offer functional vision to people with cortical blindness.
For example, understanding that a rising (falling) tone means a rising (falling) bright line is possible from hearing alone, requiring no (mental) visual imagery nor brain plasticity. Blind people with aphantasia may therefore be able to use it as well. |
AI support? | Unknown. |
AI-based recognition of camera view content can be extremely useful but is not always reliable or sufficient, and is therefore considered supplemental and optional.
|
Funding? | Essentially unlimited funding as long as Elon Musk believes in it. He is likely after bigger fish than the niche market of Neuralink Blindsight for totally blind people. |
![]()
See also the section about device lifetime. |
Animal experiments? |
Experiments with non-human primates and other animals are required to establish safety and thereby gain regulatory approval for use in humans.
In the past there has been a lot of controversy about |
No animal experiments are required nor needed for safe deployment of The vOICe with humans.
That said, it is possible that animal experiments are performed by independent institutes in the context of neuroscience studies on for instance crossmodal brain plasticity and functional rewiring. |
Ethical issues? |
The above and other aspects of brain implants raise numerous
![]() There can for instance be harmful medical side-effects as described above, unwarranted expectations due to media or company hype, the implant may fail and device support may end (e.g. due to company bankruptcy or newer products), image pre-processing to keep only a few selected edges may inadvertently filter out important safety cues, etc, etc. |
Expectation management toward and by the (prospective) blind user.
Expectation management is hampered by lack of population data on likely end results: training effort in relation to (perceived) benefit might prove unacceptable or inadequate. Also, blind users may misinterpret the visual content of soundscapes, so for their own safety they should never rely solely on The vOICe in mobile use but should keep relying on their cane, guide dog and/or trusted sighted guide. Lack of resources for 1-on-1 training support for best rehabilitation results is a concern. |
Availability? |
Unavailable at the time of writing. No FDA approval (for US) nor CE mark (for Europe) yet, and no patient has received a Blindsight implant as part of a clinical trial yet.
Your can join the
![]() Neuralink received |
Already globally available, actively used (but anonymously unless the user reports) on many thousands of devices, and compatible with billions of existing devices, ranging from PCs and smartphones to stand-alone AR smart glasses. There is even a version of The vOICe bundled in the free ![]() ![]() Meta should in due course lift their current policy constraints on using third-party apps with pixel-level camera access on their Meta Quest 2 and Quest 3 devices as well as their Meta Ray-Ban glasses, because these currently block blind people from using The vOICe sensory substitution on Meta devices (both Android app and web app). In the United States this may require |
Connecting the dots
Note that The vOICe and Neuralink Blindsight (and other brain implants) need not be mutually exclusive. A hybrid approach is conceivable where Neuralink Blindsight and The vOICe share the same camera view, such that the distorted and limited visual view of a Neuralink Blindsight brain implant can be supplemented with rich and undistorted visual feedback from The vOICe's soundscapes, including for instance the textures and shading missing from an edges-only Blindsight implant view. This combination may help the blind user to interpret the live camera view. Even OpenAI's
ChatGPT
non-invasive sensory substitution will remain the superior choice (PDF) for restoring functional vision to blind individuals.
Furthermore, hyped super-human abilities such as "predator vision" by perceiving light outside the spectrum of visible light, e.g. infrared for
thermal vision
transcranial focused ultrasound stimulation (tUS/tFUS).
The phased array technology being developed by
Nudge might lead to phosphene vision in V1 of comparable visual resolution through ~1 mm ultrasound focusing accuracy, provided its safety in chronic use can be ensured, its bulky helmet form factor be made aesthetically acceptable, and movement of the human brain inside the skull can be tracked and compensated for in real-time. Vision is very multi-faceted, and it is naive to presume that any single visual prosthesis approach will address all aspects of human vision. Also keep in mind that hardware eventually fails, while software eventually works.
In May 2025, ChatGPT
In June 2025, ChatGPT
There are still many open questions regarding the role of neural plasticity: with blind adults, the brain's connectome ("physical wiring diagram") will be mostly fixed, but this need not apply to the brain-wide projectome (defining functional connectivity among brain areas): both brain implants and sensory substitution devices may lead to functional rewiring through changes in e.g. dendritic spines, thereby modifying the projectome. Plenty of room for scientific studies with practical relevance far beyond blindness. With both brain implants and sensory substitution, visual feature detectors may be missing for properties such as curvature (corners), contour closure, overlap (occlusion) and containment (nesting), and to what extent these can be acquired through prolonged training is unknown. Vice versa, very few if any studies address possibilities for boosting top-down visual mental imagery, i.e., mental imagery engineering.Other companies working on or toward brain implants for restoring vision include
Investor note: Smart glasses with AI-based scene description, OCR for reading print, and visual-to-auditory sensory substitution for "raw vision" will erode the market opportunities for all implantable visual prostheses (retinal implants and brain implants for restoring vision to the blind). Cf. ChatGPT's AI assessments in(PDF), VASS vs visual implants
(PDF) and benchmark Neuralink vs The vOICe
(PDF). For Android devices, including smart glasses, AI-based scene description and OCR is already offered by for instance Neuralink Blindsight reasons
and Google Lookout
, while visual-to-auditory sensory substitution is offered by Microsoft Seeing AI
. Moreover, how does one convince the FDA that it is safe to use a high resolution visual cortical prosthesis for more than a short clinical trial, i.e., bring such a medical device to the market for daily (chronic) use? Run after numerous animal experiments a 5-year pilot study with a few human volunteers before potentially getting FDA approval with stringent post-market review requirements? Investors here need deep pockets and lots of patience for an uncertain and relatively small market. With The vOICe, by analogy with Linux, money may be made on training and support, and need not depend on poorly scalable proprietary hardware. Apart from visual prostheses, interest in electrode-based BCIs will wane more generally (aside from niche markets), as non-implantable ("non-invasive") phased array focused ultrasound will take over for both brain stimulation and measuring brain activity. The vOICe for Android
Existential threat: Smart glasses that see, listen and respond in real-time, with web searches, AI-based scene description and OCR for reading print, but lacking incentives for also mastering "raw vision" (through a brain implant and/or sensory substitution) can be seductive up to the point of dumbing you down: no need to think or see for yourself anymore once you get plausible answers in real-time without effort. (AI assessment by ChatGPT inSome brain implant companies for their own convenience exclude sensory substitution devices from their BCI benchmarking publications and reporting to their investors, on the grounds that (by certain definitions) BCIs must interact directly with target neurons (e.g. in visual cortex), and not indirectly via other neurons (e.g. in auditory cortex). Similarly, some brain implant companies conveniently exclude sensory substitution devices from their reporting for not being medical devices. However, if it walks like an invasive BCI, talks like an invasive BCI, i.e. here offers much the same functional vision as an invasive BCI, it probably should be considered a (non-medical) BCI and visual prosthesis for all practical purposes - even if it non-invasively and indirectly activates or modulates target neurons in the brain. No hiding behind definitions and conventions., PDF.) empowerment vs assistance for blind
Cf.Finally, it should be stressed that BCIs in the form of cortical brain implants look very promising for restoring motor functions, e.g. treating paralysis caused by ALS (amyotrophic lateral sclerosis) or spinal cord injury, or certain speech impairments, as well as for treating certain mental conditions such as depression, but their net benefit as a visual prosthesis remains questionable. The history of the Dobelle brain implant and the Argus II retinal implant may repeat itself with Elon Musk's Neuralink Blindsight brain implant: media hype, excitement, theAn application-based taxonomy for brain–computer interfaces (Nature Biomedical Engineering, 2024), "We advocate that the term BCI should be used to define any technology that records brain activity and processes it on an electronic device, or any technology that stimulates brain activity based on computations performed on an electronic device, regardless of whether the technology is implanted or not." However, experts from different backgrounds are still struggling to come up with a good definition of what constitutes a BCI, as exemplified by BCI Society's 2024
BCI Working Definition that excludes the Dobelle and Orion brain implant for restoring vision just because these devices do not measure any brain activity. New proposal: "A BCI (Brain-Computer Interface) is a direct or indirect technological interface between the brain and a computing device, with the goal of substantially improving (restoring) communication and interactions between the brain and its physical environment and/or improving (restoring) functioning of the brain itself."
Summarizing, smart glasses offering a combination of sensory substitution based "raw" vision and AI-based scene description and OCR appears to be technically and economically the most feasible and sustainable way toward meeting expectations, needs and interests of many blind people at a global scale.
Note: bone conduction stereo earbuds can be hidden in the legs of smart glasses for the blind.
quote attributed to Albert Einstein