UC Davis develops brain computer, helps man with ASL speak in real time
(FOX40.COM) — Possible new hope has flourished for those who have lost the ability to speak after researchers at the University of California, Davis developed an investigational brain-computer interface that helps restore the ability to hold real-time conversations.
Video Above: Illness took away her voice. AI created a replica she carries in her phone (May 2024)
The new technology is able to translate the brain activity of the person attempting to speak into a voice, according to researchers in a new study published in the scientific journal Nature.
The study participant, who has amyotrophic lateral sclerosis, was able to speak to his family, change his intonation and even 'sing' simple melodies. UC Davis Health said that the system's digital vocal tract has no detectable delays.
'Translating neural activity into text, which is how our previous speech brain-computer interface works, is akin to text messaging. It's a big improvement compared to standard assistive technologies, but it still leads to delayed conversation. By comparison, this new real-time voice synthesis is more like a voice call,' said Sergey Stavisky, senior author of the paper and an assistant professor in the UC Davis Department of Neurological Surgery.
Stavisky went on to say that with the use of instantaneous voice synthesis, neuroprosthesis users will be able to be more interactive and included in conversations.
The clinical trial at UC Davis, BrainGate2, used an investigational brain-computer interface that consists of surgically implanting four microelectrode arrays into the area of the brain that produces speech.
The firing pattern of hundreds of neurons was measured through electrodes, followed by the alignment of the patterns with the attempted speech sound the participant was producing.
The activity of neurons in the brain is recorded and then sent to a computer that interprets the signals to reconstruct voice, researchers said.
'The main barrier to synthesizing voice in real-time was not knowing exactly when and how the person with speech loss is trying to speak,' said Maitreyee Wairagkar, first author of the study and project scientist in the Neuroprosthetics Lab at UC Davis. 'Our algorithms map neural activity to intended sounds at each moment of time. This makes it possible to synthesize nuances in speech and give the participant control over the cadence of his BCI-voice.'
The neural signals of the participant were translated into audible speech in one-fortieth of a second, according to the study.
'This short delay is similar to the delay a person experiences when they speak and hear the sound of their own voice,' said officials.
The participant was also able to say words unknown to the system, along with making interjections. He was able to modulate the intonation of his generated computer voice to ask a question or emphasize specific words in a sentence.
60% of the BCI-synthesized words were understandable to listeners, while only 4% were understandable when not using BCI, the study said.
Events, discounted tattoos, piercings this Friday the 13th
'Our voice is part of what makes us who we are. Losing the ability to speak is devastating for people living with neurological conditions,' said David Brandman, co-director of the UC Davis Neuroprosthetics Lab and the neurosurgeon who performed the participant's implant. 'The results of this research provide hope for people who want to talk but can't. We showed how a paralyzed man was empowered to speak with a synthesized version of his voice. This kind of technology could be transformative for people living with paralysis.'
Researchers said that brain-to-voice neuroprostheses are still in the early phase, despite promising findings. They said that a limitation is that the research was done on only one participant with ALS. The goal would be to replicate the results with more participants who have speech loss from other causes.
More information on the BrainGate2 trial can be found on braingate.org.
Copyright 2025 Nexstar Media, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
CBS News
an hour ago
- CBS News
Trump administration's National Science Foundation research funding cuts blocked by judge
A federal judge has blocked President Trump's administration from making drastic cuts to research funding provided by the National Science Foundation. U.S. District Judge Indira Talwani in Boston struck down on Friday a policy change that could have stripped universities of tens of millions of dollars in research funding. The universities argued the move threatened critical work in artificial intelligence, cybersecurity, semiconductors and other technology fields. Talwani said the change, announced by the NSF in May, was arbitrary and capricious and contrary to law. An email by the Associated Press on Saturday to the NSF was not immediately returned. At issue are "indirect" costs, expenses such as building maintenance and computer systems that aren't linked directly to a specific project. Currently, the NSF determines each grant recipient's indirect costs individually and is supposed to cover actual expenses. The Trump administration has dismissed indirect expenses as "overhead" and capped them for future awards by the NSF to universities at 15 % of the funding for direct research costs. The University of California, one of the plaintiffs, estimated the change would cost it just under $100 million a year. Judges have blocked similar caps that the Trump administration placed on grants by the Energy Department and the National Institutes of Health. In a recent interview on "CBS Mornings Plus," Todd Wolfson, president of the American Association of University Professors — whose organization sued the Trump administration over federal funding cuts to Columbia University — said examples of research that has been cut includes a research project that looks at discerning when AI is making fake videos or a project that examines when people start to believe lies that are repeatedly told. "We are losing all the critical research that helps us understand truth and fiction in our social media platforms, whether it's Facebook or X or any other platform," he said.
Washington Post
2 hours ago
- Washington Post
Judge blocks the Trump administration's National Science Foundation research funding cuts
BOSTON — A federal judge has blocked President Donald Trump 's administration from making drastic cuts to research funding provided by the National Science Foundation. U.S. District Judge Indira Talwani in Boston struck down on Friday a policy change that could have stripped universities of tens of millions of dollars in research funding. The universities argued the move threatened critical work in artificial intelligence, cybersecurity, semiconductors and other technology fields. Talwani said the change, announced by the NSF in May, was arbitrary and capricious and contrary to law. An email Saturday to the NSF was not immediately returned. At issue are 'indirect' costs, expenses such as building maintenance and computer systems that aren't linked directly to a specific project. Currently, the NSF determines each grant recipient's indirect costs individually and is supposed to cover actual expenses. The Trump administration has dismissed indirect expenses as 'overhead' and capped them for future awards by the NSF to universities at 15 % of the funding for direct research costs. The University of California, one of the plaintiffs, estimated the change would cost it just under $100 million a year. Judges have blocked similar caps that the Trump administration placed on grants by the Energy Department and the National Institutes of Health.
Associated Press
2 hours ago
- Associated Press
Judge blocks the Trump administration's National Science Foundation research funding cuts
BOSTON (AP) — A federal judge has blocked President Donald Trump 's administration from making drastic cuts to research funding provided by the National Science Foundation. U.S. District Judge Indira Talwani in Boston struck down on Friday a policy change that could have stripped universities of tens of millions of dollars in research funding. The universities argued the move threatened critical work in artificial intelligence, cybersecurity, semiconductors and other technology fields. Talwani said the change, announced by the NSF in May, was arbitrary and capricious and contrary to law. An email Saturday to the NSF was not immediately returned. At issue are 'indirect' costs, expenses such as building maintenance and computer systems that aren't linked directly to a specific project. Currently, the NSF determines each grant recipient's indirect costs individually and is supposed to cover actual expenses. The Trump administration has dismissed indirect expenses as 'overhead' and capped them for future awards by the NSF to universities at 15 % of the funding for direct research costs. The University of California, one of the plaintiffs, estimated the change would cost it just under $100 million a year. Judges have blocked similar caps that the Trump administration placed on grants by the Energy Department and the National Institutes of Health.
