CORDIS - EU research results

The first mental joystick based on Artificial Intelligence for Multi-Modal Human Machine Interaction

Project description

AI for communication assistance in cases of severe impairment

Degenerative neuromuscular diseases and ischemic or traumatic brain injuries cause paralysis and communication problems, with millions of patients worldwide being in a locked-in state or complete locked-in state (CLIS). Therefore, accessible and cost-effective solutions to help these patients communicate must be found. The Italian company LiquidWeb recently introduced the first medical device focussed on CLIS patients and based on artificial intelligence and wireless non-invasive sensors. The EU-funded BrainControl project is dedicated to the development of the horizontal multi-modal platform that allows the user to utilise the same interaction software despite disease progression, creating a truly adaptive interaction system for the specific needs of each patient by responding to the different degrees and types of impairments.


Degenerative neuromuscular diseases or ischemic or traumatic brain injuries can cause paralysis and communication
problems. Around 5 million of patients worldwide are in Locked-in State (LIS) or Complete LIS (CLIS).
The problem is therefore the actual difficulty of people with an intact cognitive ability but suffering from diseases that
completely or partially paralyze them, to find easy to use and cost-effective solutions to communicate with other people and
their environment that consequently help them to enhance their autonomy and quality of life.
The game changer solution is BrainControl. LiquidWeb, an Italian company founded in 2012, introduced into the market the
first BCI AAC medical device focused on CLIS patients: “BrainControl BCI AAC”. This MVP has demonstrated through
clinical pilots to be a game changer solution assisting CLIS patients thanks to its core technological core based on artificial
intelligence and EEG sensors (wireless, non-invasive).After this milestone, the company has been focused on the
development of the first horizontal multimodal platform in the assistive technologies market that lets the user utilize the same
solution and interaction software despite disease progression. BrainControl is indeed a truly personalized and adaptive
interaction system, meeting specific needs of each patient at any time by responding to the different degrees and types of
impairments. It can manage multiple biofeedback sensors: EEG (for BCI), wireless inertial sensors and cameras (for patterns
recognitions), etc.
The uniqueness: BrainControl brings a new era of personalized and adaptive human computer interaction -HCI- through
multimodal bio-feedback, achieving an extraordinary improvement of social inclusion & quality of life: Increasing autonomy,
reducing up to 30% the severity of anxiety and depression -measured following rating scales and questionnaires as HRS-D,
HRS-A, ALSAQ-40, MQOL- and getting a rate of satisfaction after using our solution of 75/100

Call for proposal


See other projects for this call

Sub call



Net EU contribution
€ 747 250,00
53100 Siena

See on map


The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Centro (IT) Toscana Siena
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Total cost
€ 1 080 000,00