Fabulous

'New AI System Translates Brain Activity into Text, Opening Communication Possibilities'

'New AI System Translates Brain Activity into Text, Opening Communication Possibilities'
Published 2 years ago on May 24, 2023

The system shows promise in helping individuals who are mentally conscious but unable to physically speak, such as those affected by strokes, to communicate intelligibly once again.

Published in the journal Nature Neuroscience, the study utilizes a transformer model similar to those employed by OpenAI's ChatGPT and Google's Bard. The decoder measures brain activity using a functional MRI scanner after extensive training. Participants listen to hours of podcasts while inside the scanner, and later, the machine generates corresponding text based solely on the brain activity captured during the session.

Although the system does not provide a word-for-word transcript, it effectively captures the essence of what is being said or thought. After training the decoder to monitor participants' brain activity, it accurately reproduces the intended meanings of the original words around 50% of the time.

For instance, when a participant heard someone mention not having a driver's license, the system translated their thoughts as, "She has not even started to learn to drive yet." The researchers are working on refining the model to decode continuous language over extended periods, encompassing complex ideas.

Latest News

The system shows promise in helping individuals who are mentally conscious but unable to physically speak, such as those affected by strokes, to communicate intelligibly once again.

Published in the journal Nature Neuroscience, the study utilizes a transformer model similar to those employed by OpenAI's ChatGPT and Google's Bard. The decoder measures brain activity using a functional MRI scanner after extensive training. Participants listen to hours of podcasts while inside the scanner, and later, the machine generates corresponding text based solely on the brain activity captured during the session.

Although the system does not provide a word-for-word transcript, it effectively captures the essence of what is being said or thought. After training the decoder to monitor participants' brain activity, it accurately reproduces the intended meanings of the original words around 50% of the time.

For instance, when a participant heard someone mention not having a driver's license, the system translated their thoughts as, "She has not even started to learn to drive yet." The researchers are working on refining the model to decode continuous language over extended periods, encompassing complex ideas.

Comments

  • Written news comments are in no way https://www.showbizglow.com it does not reflect the opinions and thoughts of. Comments are binding on the person who wrote them.