Brain Implant Lets Man with ALS Speak and Sing with His ‘Real Voice'

A man with a severe speech disability is able to speak expressively and sing using a brain implant that translates his neural activity into words almost instantly. The device conveys changes of tone when he asks questions, emphasizes the words of his choice and allows him to hum a string of notes in three pitches.
The system — known as a brain–computer interface (BCI) — used artificial intelligence (AI) to decode the participant's electrical brain activity as he attempted to speak. The device is the first to reproduce not only a person's intended words but also features of natural speech such as tone, pitch and emphasis, which help to express meaning and emotion.
In a study, a synthetic voice that mimicked the participant's own spoke his words within 10 milliseconds of the neural activity that signalled his intention to speak. The system, described today in Nature, marks a significant improvement over earlier BCI models, which streamed speech within three seconds or produced it only after users finished miming an entire sentence.
On supporting science journalism
If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.
'This is the holy grail in speech BCIs,' says Christian Herff, a computational neuroscientist at Maastricht University, the Netherlands, who was not involved in the study. 'This is now real, spontaneous, continuous speech.'
Real-time decoder
The study participant, a 45-year-old man, lost his ability to speak clearly after developing amyotrophic lateral sclerosis, a form of motor neuron disease, which damages the nerves that control muscle movements, including those needed for speech. Although he could still make sounds and mouth words, his speech was slow and unclear.
Five years after his symptoms began, the participant underwent surgery to insert 256 silicon electrodes, each 1.5-mm long, in a brain region that controls movement. Study co-author Maitreyee Wairagkar, a neuroscientist at the University of California, Davis, and her colleagues trained deep-learning algorithms to capture the signals in his brain every 10 milliseconds. Their system decodes, in real time, the sounds the man attempts to produce rather than his intended words or the constituent phonemes — the subunits of speech that form spoken words.
'We don't always use words to communicate what we want. We have interjections. We have other expressive vocalizations that are not in the vocabulary,' explains Wairagkar. 'In order to do that, we have adopted this approach, which is completely unrestricted.'
The team also personalized the synthetic voice to sound like the man's own, by training AI algorithms on recordings of interviews he had done before the onset of his disease.
The team asked the participant to attempt to make interjections such as 'aah', 'ooh' and 'hmm' and say made-up words. The BCI successfully produced these sounds, showing that it could generate speech without needing a fixed vocabulary.
Freedom of speech
Using the device, the participant spelt out words, responded to open-ended questions and said whatever he wanted, using some words that were not part of the decoder's training data. He told the researchers that listening to the synthetic voice produce his speech made him 'feel happy' and that it felt like his 'real voice'.
In other experiments, the BCI identified whether the participant was attempting to say a sentence as a question or as a statement. The system could also determine when he stressed different words in the same sentence and adjust the tone of his synthetic voice accordingly. 'We are bringing in all these different elements of human speech which are really important,' says Wairagkar. Previous BCIs could produce only flat, monotone speech.
'This is a bit of a paradigm shift in the sense that it can really lead to a real-life tool,' says Silvia Marchesotti, a neuroengineer at the University of Geneva in Switzerland. The system's features 'would be crucial for adoption for daily use for the patients in the future.'

Try Our AI Features

Explore what Daily8 AI can do for you:

Learn with AIFact CheckingText to SpeechAI Summary

Related Articles

The Hill

5 hours ago

• The Hill

Trump THREATENS US Food Security By Slashing Science Funding, Experts Warn

The Trump administration's cuts to climate research and weather forecasting are 'blinding' the U.S. to oncoming threats to its food supply — and kneecapping efforts to protect it. Heat waves and drought driven by fossil fuel burning could pose an existential threat to key parts of the American food supply, according to a recent study published in the journal Nature. Forecasting and adaptation could cut those crop failures almost in half, the study found. But those measures are under attack from President Trump's mass staff reductions at agencies tracking weather and climate. READ MORE:

Yahoo

8 hours ago

• Yahoo

Study Finds 'Huge Surprise' About Ancient Humans in Africa

A new study published June 18 in the journal Nature has uncovered a 'huge surprise' about humans in Africa 50,000 years ago. Previous studies have shown that humans, who arrived in Africa 300,000 years ago and began leaving around 270,000 years ago, are descended from a small group of humans who left Africa just 50,000 years ago. Scientists have long wondered why earlier migration waves didn't leave any genetic traces in modern humans, and now the new study may explain why. To determine results, scientists analyzed evidence such as ancient plant and animal remains from various sites across Africa dating between 120,000 to 14,000 years ago. They reconstructed the habitats and climates in which people lived during those times to better understand the climate, rainfall, and vegetation of those environments. They discovered that modern humans actually began living around 70,000 years ago in the forests of West, North, and Central Africa, environments where temperatures were much harsher."Humans have been successfully living in challenging habitats for at least 70,000 years," study co-lead author Emily Hallett told Live Science. She added that the discovery was 'a huge surprise.' "Our ecological flexibility is part of what enabled our species to disperse across the globe and thrive in each habitat we encountered," she said. "What we see about 70,000 years ago is Homo sapiens becoming the ultimate generalist, and pushing into more and more extreme environments," co-author Andrea Manica explained. "That newly found additional flexibility gave them an edge 50,000 years ago, allowing them to spread rapidly across the whole globe, and thriving in environments that were novel and sometimes very challenging, such as those found at very northern latitudes." The discovery illuminates not only the evolution of humans in Africa, but the evolution of all mankind. Though it's unclear what began pushing humans out of Africa, the researchers say it was likely out of 'necessity.' Study Finds 'Huge Surprise' About Ancient Humans in Africa first appeared on Men's Journal on Jun 20, 2025

Scientific American

2 days ago

• Scientific American

Humpback Whales Are Blowing ‘Bubble Rings' at Boats. Are They Trying to Communicate?

Humpback whales are known for their extensive use of bubbles—from powerful, aggressive bursts that prove their prowess during courtship to the bubble-net 'curtains' they produce to round up prey in a spectacle that often draws tourists from around the world. Now a new study published in Marine Mammal Science explores rare instances when humpbacks (Megaptera novaeangliae) create dramatic, doughnut-shaped vortex bubbles that look like a rolling underwater smoke ring. On supporting science journalism If you're enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today. Video credit: Simon Hilbourne, Molly Gaughan, Karime Nicholas Researchers at the University of California, Davis, and their colleagues at other institutions—including the SETI Institute, which is known for focusing on the search for extraterrestrial intelligence (SETI) but is also interested in nonhuman intelligences on Earth—were looking for examples of whales' general bubble behavior when they uncovered a striking video taken by videographer Dan Knaub in 1988. In the footage, a humpback called 'Thorn' blows 19 bubble structures—including 11 rings—over a 10-minute period. 'We were just gobsmacked—like, 'What the hell is going on?'' says Fred Sharpe, a whale biologist at U.C. Davis. 'For a team that's interested in assisting astrobiologists parse unusual signals coming from deep space, it just fell real neatly into our paradigm.... It's so bizarre.' Sharpe and his colleagues soon found more examples on social media and from other researchers. Study co-author Jodi Frediani, a wildlife photographer who is also at U.C. Davis, even noticed a telltale circle in a photograph a friend showed during a presentation about humpback whales. With this phenomenon on her mind, she says, 'I went, 'Gee, there's a bubble ring!'' For the study, the team recorded 12 events across the North and South Pacific and North Atlantic Oceans in which 11 individual humpbacks were seen blowing bubble rings. The researchers described 39 rings in total. 'It's not a lot in the world of whales but enough—and in multiple oceans,' Frediani says. 'It's a really fun paper,' says Syracuse University biologist Susan E. Parks, who studies bubble-net feeding in humpbacks and wasn't involved in the new study. 'It reads like a detective story that's trying to piece together information about something that's not widely studied and happens rarely.' Parks hasn't observed any bubble rings herself—as far as she knows, she says, 'I may have seen them before and never really thought anything of them.' Despite compiling so many examples of the rings, Sharpe still doesn't know what to think about their purpose. 'My guess is that this is what it's going to feel like when we first make contact with aliens,' he says. The researchers speculate that the behavior could be playful. One whale would blow a bubble ring and then swim through it or 'do a spy hop right through the middle of it,' Frediani says—when performing such a spy hop, the whale would peep its head vertically above the surface, right through the bubble ring. Or perhaps the animals' behavior could respresent curiosity toward humans: of the 12 recorded events, nine involved whales that approached the human observers more closely before they blew rings. 'We need the entire human brain trust's help deciphering this. It's almost like [the whales'] blowhole is a mouth, and the symbols coming out are bubbles, as opposed to sounds.' —Fred Sharpe University of California, Davis Could the whales be trying to communicate with us? Sharpe doesn't rule this out as a possibility. He posits that the presence of humans seems to trigger bubble blowing and that humpbacks improve with practice. 'This may be a species-atypical signal that's crafted for people,' he says, 'whales reaching out to humans ... using their own parlance, their own form of communication.' Parks thinks it's plausible that the animals are putting on a display for humans, but she adds that it's too soon to tell with such a small sample size. 'They'd want a lot more [observations] before they could say with certainty,' she says. Because most of the observations were made by people, this could skew the data, she notes, although there were 'two observations from planes, so we know [the whales] do produce them [bubble rings] when people aren't present, too.' Now that more researchers know to look for these bubble rings, Parks says, reported sightings may greatly increase. With more data, Sharpe and his colleagues hope to figure out what the purpose of these swirling doughnuts of air is—and whether the rings could possibly contain information. 'We need the entire human brain trust's help deciphering this,' Sharpe says. 'It's almost like [the whales'] blowhole is a mouth, and the symbols coming out are bubbles, as opposed to sounds.' Sharpe hopes footage from the study will help people feel connected with whales and make them want to protect the animals from human threats such as ship strikes, entanglement, noise and chemical pollution, habitat loss and disruption of the food web. He says that he also wants to find a way to let the whales 'know that they've been heard.' For him, trying to decipher potential messages and find a way to respond puts the team 'in the same place you would be if you were trying to communicate with aliens—and you got a message.'