Technology with attitude

Brain-Kinect Interface, a hybrid BCI system for rehabilitation


Research director of Microsoft’s Kinect said himself that “brain-computer interfaces are amazing”, but this is probably not the main reason why Jhon Edison Muñoz Cardona, a BCI researcher from Colombia is working on a combination of brainwave signals and Kinect’s bio-mechanical signals. His goal is to make a hybrid BCI system for children in rehabilitation. Cardona sent us a video and the link to the paper for his work, which we gladly share with our readers.According to the paper, the research is proposing a novel hybrid BCI system which combines bio-mechanical signals acquired by the Kinect sensor with signals from the Emotiv EPOC headset through the strategy of selective attention, using SSVEP signals (see explanation below).

The combination of motion capture signals (Kinect) and the EEG-based brain-computer interface (EPOC) is used for interaction in a rehabilitation game for patients with motor and/or cognitive impairments. The system, providing a long and fluid interaction time, enables effective data collection that is aimed to objectively describe body movements through software developed for this purpose.

The interaction with the BCI system is performed by the SSVEP which allows the user to explode objects in the air, through the controlled focus in a particular visual stimulus; the EEG signals are processed in the OpenVibe software.

The system is being tested in the “Interactive Room for Rehabilitation”, a real space mixed with digital environment where patients with neuromotor disabilities can interact through their movements and thoughts, allowing specialists to perform objective assessments of motor and/or cognitive aspects.

Check out the video below, and visit the website where Cardona and his team expose all of their works with videogames and BCI systems: