US-based neurotechnology company Synchron has announced the world’s first use of Apple Vision Pro, by a patient implanted with its brain-computer interface (BCI) technology.
A 64-year-old man with amyotrophic lateral sclerosis (ALS), named Mark, was the first to use his direct thoughts to control the cursor on the Apple Vision Pro.
Mark played Solitaire, watched Apple TV, and sent text messages on Apple Vision Pro hands-free, using the Synchron BCI.
Apple Vision Pro requires hand gestures to make item selections, and without Synchron BCI, Mark is unable to use the Apple Vision Pro due to impairment of his upper limbs.
Mark said: “This is pretty cool; I’ve been wanting to try this for a while now. It’s like watching it in the theatre, it really comes to life.
“Using this type of enhanced reality is so impactful and I can imagine it would be for others in my position or others who have lost the ability to engage in their day-to-day life.
“It can transport you to places you never thought you’d see or experience again.”
Apple Vision Pro is an advanced spatial computer that easily integrates digital content with the physical world, allowing users to stay present and connected to others.
Vision Pro creates an infinite canvas for apps and introduces a fully three-dimensional user interface controlled by a user’s eyes, hands, and voice.
Synchron said that the integration of its BCI with Apple Vision Pro allows users who have lost mobility of their limbs and voice to engage with the device.
Its BCI is implanted in the blood vessel on the surface of the motor cortex of the brain through the jugular vein, in a minimally invasive endovascular procedure.
Once implanted, the BCI detects and wirelessly transmits motor intent out of the brain, helping paralysed people to control personal devices with hands-free point-and-click.
Synchron CEO and founder Tom Oxley said: “BCI is a platform to re-connect people with injury or disease back to the fast-moving consumer technology landscape.
“Vision Pro is a powerful system, but it relies on the use of hand gestures to exert control over the UI. We are sending control signals directly from the brain to replace the need for hand gestures.
“We are moving towards a new Bluetooth standard for Human Computer Interactions that don’t require touch or speech. This is a critical unmet need for millions of people with paralysis.”
Earlier this month, Synchron integrated OpenAI’s generative AI (GenAI) into its BCI platform, in the form of a new chat feature, to help paralysed people interact with the digital world hands-free.
