-
Published: 30 March 2023
The system can decode brain activity that creates the 'voice in our head'
EDITED BY | CHRISTIAN MEGAN
SCIENCE SECTION
30 MARCH 2023
Scientists believe they have found a way to read our minds. They have created a computer program that can decode brain activity that creates the 'voice in our head' and put it into words.
The breakthrough could give the 'locked in' or paralyzed hope that they could one day communicate using the system.
Mind-boggling! Science creates computers that can decode your thoughts and put them into words Technology could offer a lifeline for stroke victims and people hit by degenerative diseases In the study, a computer analyzed brain activity and reproduced words that people were hearing
In their 2011 study, the team recorded the brain activity of seven people undergoing epilepsy surgery while they looked at a screen displaying the nursery rhyme Humpty Dumpty, the Gettysburg Address, or the inaugural speech of President John F Kennedy.
Their brain activity was monitored as they read aloud the text and when they read it silently in their heads.
From the spoken data, the team managed to build a personal 'decoder' for each patient which interpreted the information and turned it into a visual representation.
They then applied the decoder to brain activity during silent reading and found that they could reconstruct several words that were being thought of just through neural imaging alone.
'If you're reading text in a newspaper or book, you hear a voice in your own head,' Brian Pasley told New Scientist.
'We're trying to decode the brain activity related to that voice to create a medical prosthesis that can allow someone who is paralyzed or locked in to speak.'
The team conducted its first experiments in 2011 and is currently looking at patients who suffer from Aphasia, a condition that robs you of the ability to communicate.
Aphasia can affect your ability to express and understand language, both verbal and written and typically occurs suddenly after a stroke or a head injury.
In their first experiments, the team recorded the brain activity of seven people undergoing epilepsy surgery while they looked at a screen displaying the nursery rhyme Humpty Dumpty, the Gettysburg Address.
Their brain activity was monitored as they read aloud the text and when they read it silently in their heads.
From the spoken data, the team managed to build a personal 'decoder' for each patient which interpreted the information and turned it into a visual representation.
They then applied the decoder to brain activity during silent reading and found that they could reconstruct several words that were being thought of just through neural imaging alone.
The researchers also tested the decode and algorithm with Pink Floyd's sons to see which neurons respond to different musical notes.
Although, at an early stage, the team is hopeful that eventually it could be used to monitor what people are thinking when they can no longer speak.
They say it could offer a lifeline to those whose speech has been affected by stroke or degenerative disease, but many will be concerned about the implications of a technique that can eavesdrop on thoughts and reproduce them.
In the earlier experiment, neuroscientists at the University of California Berkeley put electrodes inside the skulls of brain surgery patients to monitor information from their temporal lobe, which is involved in the processing of speech and images.
As the patient listened to someone speaking, a computer program analyzed how the brain processed and reproduced the words they had heard.
The scientists believe the technique could also be used to read and report what they were thinking of saying next.
In the journal PLoS Biology, they wrote that it takes attempts at mind reading to a whole new level'.
Robert Knight, professor of psychology and neuroscience, added: 'This is huge for patients who have damage to their speech mechanisms because of a stroke or Lou Gehrig's [motor neuron] disease and can't speak.
'If you could eventually reconstruct imagined conversations from brain activity, thousands could benefit.'
In the first study in 2012, researchers tested 15 people who were already undergoing brain surgery to treat epilepsy or brain tumors.
They agreed to have up to 256 electrodes put onto the brain surface, as they listened to men and women saying individual words including nouns, verbs, and names.
A computer program analyzed the activity from the electrodes and reproduced the word they had heard or something very similar to it at the first attempt.
Co-author Brian Pasley said there is already mounting evidence that 'perception and imagery may be pretty similar in the brain'.
Therefore with more work, brain recordings could allow scientists to 'synthesize the actual sound a person is thinking, or just write out the words with a type of interface device.'
Their study also shows in sharp relief how the auditory system breaks down sound into its individual frequencies - a range of around 1 to 8,000 Hertz for human speech.
{source}<script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-4474625449481215"
crossorigin="anonymous"></script>
<!-- moss test ad -->
<ins class="adsbygoogle"
style="display:block"
data-ad-client="ca-pub-4474625449481215"
data-ad-slot="6499882985"
data-ad-format="auto"
data-full-width-responsive="true"></ins>
<script>
(adsbygoogle = window.adsbygoogle || []).push({});
</script>{/source}
