Email: info@braincontrol.com - Tel. +39 05771916187 - Fax +39 05770831169

Liquidweb s.r.l. - www.braincontrol.com - Via Cesare Maccari,1 – 53100 Siena - P.I. 01293870521 v.3.3.4.2

The human brain is

made up of billions

of neurons. Their

chemical

interactions

generate electrical

impulses that can be measured. Brain-computer

interface (BCI) technology interprets the electric

signals corresponding to specific brain activities

allowing to control the computer or other devices.

BrainControl AAC is a Alternative Augmentative Communication (AAC) device based on

Artificial Intelligence for human-machine interaction through bio-feedback.

It consists of two main modules: BCI AAC and Sensory AAC.

Degenerative neuromuscular disease,

ischemic or traumatic injury may cause

paralysis and communications problems.

5.000.000 Severe cases

BrainControl BCI AAC

BrainControl BCI AAC is a Brain Computer Interface (BCI), it works like a “mental joystick”, using

thoughts related to movements, such as up down, left, right, etc. These thoughts create unique

patterns of electrical activity in our brain that can be identified. The general pattern of electrical

activity is the same from person to person, with small differences that can be aligned with a

calibration of the system. The aim of the device is to overcome severe physical and communicative

disabilities due to neuromuscular disease (such as Amyotrophic Lateral Sclerosis, ALS), ischemic or

traumatic injuries and muscular dystrophies of various kinds, motor and communication disabilities.

The device is therefore aimed, first of all, at patients who have an intact cognitive ability but who

suffer from diseases that completely or partially paralyze the person. The system will give these

patients the opportunity to interact and communicate.

It fills a technological void for most locked-in patients (those who cannot use eye-tracking systems)

and meets many of the unmet needs for patients in less advanced states who are currently using or

cannot use other assistive technologies on the market.

The first version of BrainControl includes a sentence finder and a

virtual keyboard. The interface uses a scanning method to move

between available options and utilizes just one thought related to

a movement to select the desired choice. The pre-defined

sentences in the sentence finder are completely customizable,

including the addition of images,

audio feedback and the creation of sub-menus. BrainControl is also

highly portable, whereas it consists of a tablet PC and a wireless

EEG headset.

braincontrol.it/media

Future versions will implement advanced communication and entertainment (web browsing,

interaction via SMS, social networks, e-mail, web radio), home automation (lighting, alarms,

temperature, etc.) and robotics (humanoid robots and exoskeletons).Working prototypes of home

automation, wheelchair control and humanoid robot control have already been developed.

The training

To start using the device it is needed to undertake a series of training in order to find the correct

calibration of the system and train the user for a robust and easy interaction. In many cases one/two

sessions, of one hour each, are sufficient, but in case of CLIS patients we suggest to plan at least six

sessions within two months. This allow to reduce the risk of failure due to momentary problems.

The trainings are conducted remotely via video conference by our speech therapists. Then, the user

can be trained at home, in a familiar environment and with the closeness of loved ones and

caregivers. In case of special needs, our staff is available to perform on-site training.

Yes – No – Don’t know Sentence finder Virtual Keyboard

BETA version available

BrainControl Sensory AAC

BrainControl Sensory AAC is a variant (non-BCI) of BrainControl BCI AAC, designed for patients

with a residual movement of the pupil or of any other part of the body. It is a variant of the BCI

AAC version, which does not use a BCI technology. It can integrate motion or infrared sensors,

accelerometers, camera (image processing) and eye tracking.

Thanks to a modular and personalized approach, allows to fit the heterogeneous needs of the

patients and, for patients with neurodegenerative diseases, to use the same device despite disease

progression.

The interaction methods integrated to date are:

Eye-Tracking “Standard”

The Eye-tracking technology detects and uses eye movements, enabling to control external devices

without using a mouse and giving the possibility to interact

again with love ones.

The Standard systems require a good eye movement skill,

necessary to sustain the gaze control and select the desired

choice. The Eye-Tracking “standard” is based on Tobii

technology and can also be used with the software Grid 3.

Eye-Tracking “Easy”

The Eye-Tracking Easy is a simplified eye-tracking

functionality usable even in case of reduced mobility of

the pupil and without the need for calibration. The

instrument is based on a scanning method to move

through the different options available and uses the

residual movement of the eye as a selector of the

desired choice.

Currently the interaction is possible on the interfaces of the BrainControl system: an area of

configurable size has been defined in the center of the screen and within this area any eye movement

is not interpreted as a selection, so it allows the scan to proceed. Every movement of the gaze

outside this area will be interpreted as a desire for selection.

Motion detection

It uses inertial sensors, infrared and/or webcam tablet PC to map and detect residual voluntary

movements. Through the movement detected by the sensors, it will be possible to make a selection

of cells and send signals or alarms.

Touch

The touch mode is used in the presence of a residual mobility, even minimal, of the hands. It includes

three interaction functionalities:

• Touch Standard: the selection is performed, as usual, by a touch to a specific item.

• Touch Easy: it works in scanning mode, the selection is performed by a touch in any part of

the screen when the desired choice is proposed.

• Touch Easy - Reverse mode: the system scan the available choices when the user put his

hand on the screen, the selection is performed when he raises the hand.

A stand-alone version of BrainControl “Touch” AAC, is also available on the Microsoft Windows

Store.

The next version of the product, BrainControl AAC PLUS, is under development and will include further

functionalities addressed to improve the quality of life, allowing to control external devices such as drones,

robots and wheelchairs:

BrainControl AAC PLUS (prototype)

BrainControl AAC PLUS includes the followings functionalities:

• Wheelchair control

• Avatar: telepresence functionalities through the remote control of electronic devices

equipped with camera, microphone and speakers (see the image below)

• Home automation (lights, alarms, temperature, etc.)

Figure 1 - Telepresence functionality

Working prototypes of the above functionalities have been developed and available through multimodal interaction (both BCI and Sensory).

Multimodal Interaction

BrainControl is certified as class I CE medical device and is not intended for the diagnosis, therapy,

monitoring or treatment of any disease, injury or handicap. For other information visit the website

www.braincontrol.com and the presentation of BrainControl on EASTIN portal.

Frequently asked questions (FAQs)

BrainControl BCI AAC

Who is this aimed at?

BrainControl BCI AAC is aimed at people affected by pathologies that paralyze all or part of the

body, but do not affect the intellectual abilities, as Amyotrophic Lateral Sclerosis (ALS), Multiple

Sclerosis and many cases of “locked-in” state.

In order to make a better evaluation we request to fill the prescription sheet (link).

What kind of thought BrainControl can interpret?

The system interprets thoughts related to imagined movement, such as forward, back, left, right, etc.

It use the same brain signals that precede the movements that we perform with our body, but we do

not need the ability to actually move our muscles. It works completely by reading brain waves and

does not use facial muscles or head movement.

Is BrainControl able to interpret all kinds of thoughts?

No, BrainControl cannot interpret all kinds of thoughts. For example, it cannot make a direct

interpretation of no/yes or hot/cold thoughts. The interpretation passes through a thought of an

imagined movement.

Who can use BrainControl?

BrainControl can be used by almost anyone. It only requires complete cognitive and hearing ability

(sight is not required) and the desire to use thoughts related to movement as a "mental joystick".

BrainControl does not require physical movement, making it usable even for people with severe

disabilities.

What is the margin of error of the system?

If the user does not have cognitive impairments, setting the configuration parameters in an

appropriate manner with respect to the level of training and to the user's physiological capabilities,

the margin of error can be considered close to zero.

Is BrainControl portable and can it be used outside?

Yes, since the hardware components consist of a wireless headset and a tablet PC. The outdoor use

has no contraindications.

Are subsidies available for BrainControl?

Subsidies vary from country to country. Ask your local health care provider, assistive technology

centre or please contact us for more information.

How long does the training last?

The training is carried out in one-hour sessions. In many cases, one/two sessions are sufficient, but

it is good to provide six sessions during the first two months. The assistance / training sessions can

be carried out both on-site, if specifically indicated on the order form, and remotely. The latter will

be conducted via videoconference.

Is it possible to try BrainControl for a short period?

We have provided for that purpose the possibility to activate a service mode on a monthly basis.

Microsoft Health Innovation Awards

2016 Winner

Bibliography • P. Fedele, M. Gioia, “Results of a 3 years study of a BCI-based communicator for advanced ALS

patients”. In Proceedings of the International Society for Augmentative and Alternative Communication (ISAAC) 2016.

• P.Tressoldi , L. Pederzoli , M. Bilucaglia , P. Caini ,P. Fedele , A. Ferrini , S. Melloni , D. Richeldi, F. Richeldi

, A. Accardo, “Brain-to-Brain (mind-to-mind) interaction at distance: a confirmatory study”. F1000 Research, 2014.

• P. Fedele, P. Federighi, R. Molfino, G. G. Muscolo, C. T. Recchiuto, A. Rufa, “High Energy Efficiency

Biped Robot controlled by the Human Brain for people with ALS disease”. 17th IEEE Mediterranean Electrotechnical Conference 2014.

More …

Media/Press

• China News - 12/05/2017, 芬兰全球创新创业大会在成都举行

• Digital Health Italia – 23/01/2017, BrainControl: la tecnologia assistiva che legge il pensiero

• Il Sole 24 Ore - 5/03/2016, La tecnologia BrainControl premiata a Las Vegas

More …

Awards and Recognition • 1st place at SLUSH UP! Chengu, China 12 May 2017

• Microsoft Health Innovation Awards 2016

• 1st place, MEDTEC Europe Start-up Academy 2015, MEDTEC Stuttgart, 2015

More …