Friday , February 26 2021

They manage to convert brain signals into speech



Newcomers from Columbia University in New York (USA) have created a system that translates thoughts into an intelligible and recognizable speech, which could mean new ways for computers to communicate directly with the brain, according to a well-known investigation this Wednesday.

In order to monitor someone's brain activity, technology can recreate the words a person can hear with unprecedented clarity. This breakthrough, which takes advantage of the power of speech synthesizers and artificial intelligence, puts the foundation for people who can not speak, such as those who live with amyotrophic lateral sclerosis (ELA) or recover from an accident Stroke, recover the ability to communicate with the outside world.

"Our voice helps us connect with our friends, family and the world around us, so losing the power of the voice because of an injury or illness is so devastating," said Nima Mesgarani, principal investigator at the Mental Health Behavioral Institute Mortimer B. Zuckerman of Columbia University. The expert considered that they have shown that "with the right technology, the thoughts of these people can be deciphered and understood by any other listener."

Decades of research have shown that when people speak and even imagine speaking, they appear revealing patterns of activity in their brains.

A different signal pattern also appears when we hear someone talk or imagine that we hear. The researchers team resorted to a "vocoder", an algorithm that can synthesize words after having received training in recordings of people who speak. «This is the same technology used by Amazon Echo and Siri Apple that gives verbal answers to our questions», explained Mesgarani.

To teach in the # 39; & # 39; vocoder & # 39; In interpreting brain activity, Mesgarani teamed up with Ashesh Dinesh Mehta, a neoregioner at the Northwell Health Physician Partners Neuroscience Institute, who serves patients with epilepsy, some of whom must regularly undergo brain surgery. «Working with Dr. Mehta, we asked epileptic patients who had already undergone brain surgery to listen to the phrases spoken by different people as we measured the patterns of brain activity», said Mesgarani, who pointed out That these neural patterns train the vocoder ".

The team plans to try the most complicated words and phrases later and even aspires to have a system part of an implant similar to those used with some patients with epilepsy that translate the thoughts of the user directly in words. "This would give someone who has lost their ability to speak, whether it's an injury or illness, a new opportunity to connect with the world," he added.


Source link