27 September 2021

BCI Turns Imagined Handwriting into Text

Electrodes in a paralyzed man’s brain turned his imagined handwriting into words typed on a screen. The translation from brain to text may ultimately point to ways to help people with disabilities like paralysis communicate using just their thoughts. A 65-year-old man had two grids of tiny electrodes implanted on the surface of his brain. The electrodes read electrical activity in the part of the brain that controls hand and finger movements. Although the man was paralyzed from the neck down, he imagined writing letters softly with his hand.

With an algorithm, researchers then figured out the neural patterns that went with each imagined letter and transformed those patterns into text on a screen. From his brain activity alone, the participant produced 90 characters, or 15 words, per minute. That’s about as fast as the average typing rate of people around the participant’s age on smartphones. The thought-to-text system worked even long after the injury. Thought-powered communication is still in its early stages. Research with more volunteers is needed, but there’s little doubt that this will work again in other people. The researchers plan to test the system with a person who has lost both the ability to move and speak.

More information:

https://www.sciencenews.org/article/brain-implants-translate-handwriting-text