This website uses cookies primarily for visitor analytics. Certain pages will ask you to fill in contact details to receive additional information. On these pages you have the option of having the site log your details for future visits. Indicating you want the site to remember your details will place a cookie on your device. To view our full cookie policy, please click here. You can also view it at any time by going to our Contact Us page.

First successful mind-controlled robotic arm without brain implants

25 June 2019

Researchers from Carnegie Mellon University, alongside the University of Minnesota, made a breakthrough in the field of non-invasive robotic device control.

Shutterstock image

Using a non-invasive brain-computer interface (BCI), researchers have developed the first-ever successful mind-controlled robotic arm exhibiting the ability to continuously track and follow a computer cursor.

Being able to non-invasively control robotic devices using only thoughts will have broad applications, in particular benefiting the lives of paralysed patients and those with movement disorders.

BCIs have been shown to achieve good performance for controlling robotic devices using only the signals sensed from brain implants. When robotic devices can be controlled with high precision, they can be used to complete a variety of daily tasks. Until now, however, BCIs successful in controlling robotic arms have used invasive brain implants. These implants require a substantial amount of medical and surgical expertise to correctly install and operate, not to mention cost and potential risks to subjects, and as such, their use has been limited to just a few clinical cases.

A grand challenge in BCI research is to develop less invasive or even totally non-invasive technology that would allow paralysed patients to control their environment or robotic limbs using their own "thoughts." Such non-invasive BCI technology, if successful, would bring much needed technology to numerous patients and even potentially to the general population.

However, BCIs that use non-invasive external sensing, rather than brain implants, receive "dirtier" signals, leading to current lower resolution and less precise control. Thus, when using only the brain to control a robotic arm, a non-invasive BCI doesn't stand up to using implanted devices. Despite this, BCI researchers have forged ahead, their eye on the prize of a less- or non-invasive technology that could help patients everywhere on a daily basis.

Bin He, Trustee Professor and Department Head of Biomedical Engineering at Carnegie Mellon University, is achieving that goal, one key discovery at a time.

"There have been major advances in mind controlled robotic devices using brain implants. It's excellent science," says He. "But non-invasive is the ultimate goal. Advances in neural decoding and the practical utility of non-invasive robotic arm control will have major implications on the eventual development of non-invasive neurorobotics."

Using novel sensing and machine learning techniques, He and his lab have been able to access signals deep within the brain, achieving a high resolution of control over a robotic arm. With non-invasive neuroimaging and a novel continuous pursuit paradigm, He is overcoming the noisy EEG signals leading to significantly improve EEG-based neural decoding and facilitating real-time continuous 2D robotic device control.

Using a non-invasive BCI to control a robotic arm that's tracking a cursor on a computer screen, for the first time ever, He has shown in human subjects that a robotic arm can now follow the cursor continuously. Whereas robotic arms controlled by humans noninvasively had previously followed a moving cursor in jerky, discrete motions – as though the robotic arm was trying to "catch up" to the brain's commands – now, the arm follows the cursor in a smooth, continuous path.

In a paper published in Science Robotics, the team established a new framework that addresses and improves upon the "brain" and "computer" components of BCI by increasing user engagement and training, as well as spatial resolution of non-invasive neural data through EEG source imaging.

The paper, "Non-invasive neuroimaging enhances continuous neural tracking for robotic device control," shows that the team's unique approach to solving this problem not only enhanced BCI learning by nearly 60% for traditional centre-out tasks, it also enhanced continuous tracking of a computer cursor by over 500%.

The technology also has applications that could help a variety of people, by offering safe, non-invasive "mind control" of devices that can allow people to interact with and control their environments. The technology has, to date, been tested in 68 able-bodied human subjects (up to 10 sessions for each subject), including virtual device control and controlling of a robotic arm for continuous pursuit. The technology is directly applicable to patients, and the team plans to conduct clinical trials in the near future.

"Despite technical challenges using non-invasive signals, we are fully committed to bringing this safe and economic technology to people who can benefit from it," says He. "This work represents an important step in non-invasive brain-computer interfaces, a technology which someday may become a pervasive assistive technology aiding everyone, like smartphones."

Materials provided by College of Engineering, Carnegie Mellon University.

Source: ScienceDaily 


Print this page | E-mail this page