COI WEARABLE SENSORS
BERNARD GRUNDLEHNER
RUBEN DE FRANCISCO
CHRIS VAN HOOF
IMEC INNOVATION PLATFORM
© IMEC 2016
EEGv024-Channel EEG Readout
ASIC
ECGv01-Channel ExG Readout ASIC
EEG v2Complete 8-channel EEG
Acquisition ASIC
ECGv1Analog Signal Processor for ECG
Monitoring
ECGv3Analog Signal Processor for ECG
Monitoring
ECG SoC v1(EEG AFE v2)
Mixed Signal ECG Acquisition ASIC
Active v08-Channel Active Electrode Readout for
EEG
EEG v38-Channel Active Electrode Readout for
EEG
BASIC v0Low-Power Bio-Impedance
Measurement IC
BASIC v1Low-Power Bio-Impedance
Measurement IC
BioDSP (2009)Custom low-power RAM, power
gating, duty-cycled
ULP-SRP (2013)Multi-mode ASIP, Near-VT operation, Fine-grained power domains, Multiple voltage
domains, Dynamic Voltage Frequency Scaling
CoolBIO (2011)Low-voltage logic, level
shifters
Large track record25+ ISSCC publications in bio-medical ICs
Analog MPPT DC/DC Buck Convertor
Energy Aware IC for Piezoelectric Harvestors
MUSEIC v1 (2014)ECG+ETI (3x), BIOZ,
ARM,128kB, accelerators
MEGIC (2015): SOC+PMICECG+ETI, BIOZ, GSR, PPG, LED drivers, ARM,128kB, accelerators
3
HISTORY OF IC DESIGN AT IMEC
© IMEC 2016
42016 / IMEC © IMEC 2016
LOW POWER | HIGHLY MINIATURIZED | MEDICAL GRADE
Sensors in Information out
MULTI SENSOR IC MIXED-SIGNAL PLATFORM
imec MUSEICIndustries smallest and most power efficient sensor hub
© IMEC 2016
GENERIC HARDWARE
PLATFORMS FOR MULTISENSOR APPLICATIONS
BIO-IMPEDANCE
POSTURE
ACTIVITY
HEART RATE
HEART RATE VARIABILITY
PHOTOPLETHYSMOGRAPHY
© IMEC 2016
INTEGRATION INTO DEDICATED FORM FACTORS, SUCH AS HEALTH PATCH
VALIDATED IN CLINICAL PILOT STUDIES
The Center of Innovation (COI) Program
The Center of Innovation (COI) ProgramThree visions of COI STREAM (The society in 10 years ahead that we want to create)
Vision 1
Secure sustainability as a country advanced in its aging population and
declining birth rateSmart Life Care, Ageless Society
Key concepts (function)Medical health, Mental health,Motivation, Sports, Food, Ties⇒ Realization of happiness
Vision 2
Vision 3
Create a living environment with a high Quality of life as a prosperous and
reputable countrySmart Japan
Establish a sustainable societywith vitality
Active Sustainability
Key concepts (function)勘 ( intuition)ing thinking, Active thinking, Serendipity, Six senses ⇒ Innovative thinking
method
Key concepts (function)(Personalization, Resilience,
Sustainability, Functionalization, Flexibility) - Waste
⇒ Development of a durable town
for centuries
Change People
Change Society
The Center of Innovation (COI) Program
The Center of Innovation (COI) ProgramThree visions of COI STREAM (The society in 10 years ahead that we want to create)
Vision 1
Secure sustainability as a country advanced in its aging population and
declining birth rateSmart Life Care, Ageless Society
Key concepts (function)Medical health, Mental health,Motivation, Sports, Food, Ties⇒ Realization of happiness
Vision 2
Vision 3
Create a living environment with a high Quality of life as a prosperous and
reputable country
Smart Japan
Establish a sustainable societywith vitality
Active Sustainability
Key concepts (function)勘 ( intuition)ing thinking, Active thinking, Serendipity, Six senses ⇒ Innovative thinking
method
Key concepts (function)(Personalization, Resilience,
Sustainability, Functionalization, Flexibility) - Waste
⇒ Development of a durable town
for centuries
Change People
Change Society
Osaka Univ.Hiroshima Univ.Tokyo Inst TechTokyo Univ. Arts
Hokkaido Univ.Hirosaki Univ.Tohoku Univ.Univ. TokyoRitsumeikanKyoto Univ.
Yamagata Univ.Keio Univ.Kanazawa Inst TechUniv. TokyoShinsyu Univ.Nagoya Univ.Kyusyu Univ.
Super Nippon-jinrepresents those who can
always fulfill their potential
Happy SocietyWhere each and every Super Nippon-jin can maximize their potential and enjoy
their life to the fullest
Brain networks
Community networks
Activation by group with the communication quality improved
Further activation of brain by eliminating stress
Education
Childhood
Adulthood
“The Self-Empowerment Society where people can fulfill their potential”
public scene private sceneActivation sceneCreate a living space where stress will be eliminated and motivation be encouraged
Status Detec-
tion
Provision of activation method
Further activation
Evaluation of activation
level
Health
parent-child communication
Sports
Sympathetic Robot
At home
School Education
Business/Community
In motionAt school
Brain managementVisualizationand activation
AfterBefore
in a stressful situation -
Stress detection
in a activated situation+
Exercise for brain activation
Direct stimuli
Brain music
112016 / IMEC © IMEC 2016
Companies(26) Panasonic(leading company), imec International, Hitachi, DAIKIN, YAMAHA, SYOWA DENKO, SEMEDAIN, KANEKA, MEKTRON, MEDHINET, Quantum Biosystems, ORGANO, etc
Univ. and Research Institute(14)
Osaka Univ., Kanazawa Univ., CiNet, Univ. Tokyo, National Cardiovascular Center, Institute of Telecommunications Engineers, Kinki Univ., etc
Grouping Development theme(14) Partners(40)
Status detection
Stress maker of tear fluid, blood serum, and breath Osaka Univ.(MED, ISIR), NCC, MEDHINET, PanasonicCortisol detection by TOF MS Osaka Univ.(FOS), MSI. TOKYOBacterial flora Osaka Univ.(ISIR), Fine
Brain mechanism
Brain function imaging (7T fMRI) CiNet, Osaka Univ.(ISIR), PanasonicGMN(Gene Matched Network) theory Osaka Univ.(BIO), Hitachi
Imperceptible sensing
DNA sequencer Osaka Univ.(ISIR), Quantum BiosystemsWearable sensor Osaka Univ.(ISIR), Kanazawa Univ., imecWearable sensor technologies(printing, packaging, patch-type EEG sensor)
Osaka Univ.(ISIR), SYOWA DENKO, KANEKA, SEMEDAIN, KONICA, MEKTRON, Panasonic
Activation method
Activation of community(education, sports)by GMN approach
Osaka Univ.(MED, Child, Sports), Hokkaido Univ. Doshisya Univ., Hitachi
Activation by deep sleeping Osaka Univ.(Child, ISIR), CiNet, DAIKIN, YAMAHA
Activation by music Osaka Univ.(ISIR), CiNet, Tokyo City Univ., ITE, imec, Brains
Immunity up by hydrogen generation in the intestine
Osaka Univ.(MED, ISIR), NISSHIN KASEI, SHINKO, ORGANO
tDCS stimulation Osaka Univ.(MED), Kanazawa Univ. Hamamatsu MED,KANSAI MED, imec
Kanazawa satellite Upbringing autism child by brain personality Kanazawa Univ., Osaka Univ.(ENG), Univ. Tokyo, PFU
Osaka Univ. COI theme and our partners
122016 / IMEC © IMEC 2016
Companies(26) Panasonic(leading company), imec International, Hitachi, DAIKIN, YAMAHA, SYOWA DENKO, SEMEDAIN, KANEKA, MEKTRON, MEDHINET, Quantum Biosystems, ORGANO, etc
Univ. and Research Institute(14)
Osaka Univ., Kanazawa Univ., CiNet, Univ. Tokyo, National Cardiovascular Center, Institute of Telecommunications Engineers, Kinki Univ., etc
Grouping Development theme(14) Partners(40)
Status detection
Stress maker of tear fluid, blood serum, and breath Osaka Univ.(MED, ISIR), NCC, MEDHINET, PanasonicCortisol detection by TOF MS Osaka Univ.(FOS), MSI. TOKYOBacterial flora Osaka Univ.(ISIR), Fine
Brain mechanism
Brain function imaging (7T fMRI) CiNet, Osaka Univ.(ISIR), PanasonicGMN(Gene Matched Network) theory Osaka Univ.(BIO), Hitachi
Imperceptible sensing
DNA sequencer Osaka Univ.(ISIR), Quantum BiosystemsWearable sensor Osaka Univ.(ISIR), Kanazawa Univ., imecWearable sensor technologies(printing, packaging, patch-type EEG sensor)
Osaka Univ.(ISIR), SYOWA DENKO, KANEKA, SEMEDAIN, KONICA, MEKTRON, Panasonic
Activation method
Activation of community(education, sports)by GMN approach
Osaka Univ.(MED, Child, Sports), Hokkaido Univ. Doshisya Univ., Hitachi
Activation by deep sleeping Osaka Univ.(Child, ISIR), CiNet, DAIKIN, YAMAHA
Activation by music Osaka Univ.(ISIR), CiNet, Tokyo City Univ., ITE, imec, Brains
Immunity up by hydrogen generation in the intestine
Osaka Univ.(MED, ISIR), NISSHIN KASEI, SHINKO, ORGANO
tDCS stimulation Osaka Univ.(MED), Kanazawa Univ. Hamamatsu MED,KANSAI MED, imec
Kanazawa satellite Upbringing autism child by brain personality Kanazawa Univ., Osaka Univ.(ENG), Univ. Tokyo, PFU
Osaka Univ. COI theme and our partners
© IMEC 2016
3 DEVICES FOR 3 FIELDS OF APPLICATION
1) Wristband for measuring GSR (Galvanic Skin Response) and skin temperaturereflecting autonomic nervous system responses, emotional responses
2) ECG patch for very precise detection of heart beatsheart rate variability reflecting ANS modulation, emotional responses,
sleep
3) Easy to use EEG headset for measuring brain wavesmeasuring sleep quality, emotions and responses of the central nervous
systemto auditory and visual stimulation
© IMEC 2016
3 DEVICES FOR 3 FIELDS OF APPLICATION
1) Wristband for measuring GSR (Galvanic Skin Response) and skin temperature> 7 days autonomy, comfortable to wear, large dynamic range
2) ECG patch for very precise detection of heart beats> 7 days autonomy, comfortable for wide range of skin types
3) Easy to use EEG headset for measuring brain wavesEasy to put on, medical grade signal quality
▸ Synchronized acquisition of all devices▸ Smart phone interface for monitoring data and
controlling devices
© IMEC 2016
Brain music▸ EEG headset▸ GSR band▸ ECG patch
Psychiatry▸ EEG headset▸ GSR band▸ ECG patch
Sleep research▸ ECG patch▸ GSR band
3 DEVICES FOR 3 FIELDS OF APPLICATION
© IMEC 2016
3 DEVICES FOR 3 FIELDS OF APPLICATION
IMEC WEARABLE SENSORS | MARCH 14, 2016 | ANNUAL CONFERENCE | OSAKA UNIVERSITY
EEG headset ECG patch GSR wristband
Disposable patch
Reusable electronics
can be controlled from an Android smart phone, tablet P
182016 / IMEC © IMEC 2016
GSR WristbandAccurate recording of GSR,3D acceleration and skin temperature for 7 days without charging.
From prof. Kikuchi, Kanazawa Univ.
Use case: managing depression ▸ Diary:
• Patient is sent home with sensor for 1 week or longer
• Mood changes are logged▸ Treatment:
• Finding correlates between life style and mood swings
192016 / IMEC © IMEC 2016
Enabling to measure human activities, skin temperature, skin conductance for long days(10 days)
GSR WristbandAccurate recording of GSR,3D acceleration and skin temperature for 7 days without charging.
Skin temperature measurement
24 hours
Acceleration measurement
24時間
1日目2日目・・・・9日目
Sleep
Skin conductance measurement
24時間
Temp.
From prof. Kikuchi, Kanazawa Univ.
202016 / IMEC © IMEC 2016
体動
の周
波(
Hz)
desk work
Standingwork
walking running steps
Comparison among vehicles
Human activities evaluation by GSR frequency analyses(frequency analyses per 5 seconds)
→ time axis
Comparison among various works
Quite active around 2H
z!
Limited expressShirasagi
City busShinkansen(700series)
212016 / IMEC © IMEC 2016
FFT per 6 min➡ extraction of 2Hz power
Change in 2Hz
Divided per 6 min period1st day2nd day・・・・9th day
Activities are found to be around 2HzContinuous acceleration measurementfor 9 days
24 hours
1st day2nd day・・・・9th daySleep
From prof. Kikuchi, Kanazawa Univ. Data analyses of 9 days continuous acceleration measurement
222016 / IMEC © IMEC 2016
Time series extraction of9 days continuous 2Hz power
24hours
2HzPower値
Sleeping timeClearly seen ! Wake
morning
occu
rrenc
e fr
equn
cey
per 6
min
.
weak ← exercise → strong→ 強い
Frequency distribution
From prof. Kikuchi, Kanazawa Univ.
FFT per 6 min➡ extraction of 2Hz power
Change in 2Hz
Data analyses of 9 days continuous acceleration measurement
232016 / IMEC © IMEC 2016
Log
occu
rrenc
e fre
quen
cy p
er 6
min
weak ← exercise intensity → strong
As for distribution of occurrence frequency of exercise intensity per day, strong linear relation can be seen through 9 days by logarithmic transformationFrom now on, this analysis (including body temperature, skin conductance) will be considered whether can be handled as the objective index of depression disease
Δ
From prof. Kikuchi, Kanazawa Univ. Data analyses of 9 days continuous acceleration measurement
Thank you for attention