AI Doctor - Future of Integrative Medicine with Deep Learning and Artificial Intelligence

Future of Health Technology Institute - FHTI Happier, Longer Lives™

Future of Health Technology Institutewww.futureofhealth.org www.fhti.org© 2016, FHTI.

Future of Integrative Medicine with

Deep Learning / Artificial Intelligence

May 13, 2017, New York

3rd East-West Integrative Medical for Immunology &

Wellness - Practice, Science, & Technology

Renata Bushko, [email protected] @FutureofHealth,

https://twitter.com/FutureofHealth

https://www.youtube.com/user/FutureofHealthTech

mailto:[email protected]

https://twitter.com/FutureofHealth

https://www.youtube.com/user/FutureofHealthTech

Future of Health Technology Institute (FHTI) @FutureofHealth FutureofHealth.org fhti.org

Happier, Longer Lives ™

@RenataBushko [email protected] Future of Health Technology Institute (FHTI)© 1996-2017 FHTI. All Rights Reserved.

Future of Health Technology Institute (FHTI)

Brings Together Creative Minds since 1996 to:

Stop disease before it even begins

Stop suffering before tears occur

Stop symptoms before they hurt

Stop medical errors and aging before they kill

Stop Cyborgs before….they control us….

Future of Health Technology Institute tries to achieve this by:

Fostering ideas-exchange

Promoting scientists with breakthrough-ideas

Developing World Health Strategy

Thinking about long-term global future

Translating research into health products

Empowering consumers

Encouraging investments in health

https://www.youtube.com/watch?v=dPN2gTslyoA


https://www.youtube.com/watch?v=dPN2gTslyoA




World Health Strategy eBook ED. Renata G. Bushko

1. Big Questions in the Future of Health – Overview

2. Future of Medicine and Global Health

Ramesh Raskar, Xing Jijun, Michael Gillam, Chris Gibbons, Guergana Savova, Joseph Kvedar, Gary

Kreps, Nick van Terheyden, Renata Bushko

3. Consumer Empowerment Era - Self-care

4. Big Data and Analytics in Health

5. Future of Brain’s Health

6. From Artificial Intelligence to Intelligent Health

7. Future of Drugs and Pharmacology

8. Future of Regenerative Medicine

9. Future of Mental Health and Happiness

10. Future of Pain Management

11. Future of Computing

12. Healing Plants and Modern Science

Xiu-Min Li, Jing-Ke Weng, Mariana Castells, Barbara Winston, Henry Ehrlich, Renna Bushko

13. Future of Surgery, Pathology and Medical Devices

14. Selected Future Health Challenges

15. Caring Emotional Machines and Avatars

16. Investment in Health and Commercialization

17. Future of NanoMedicine

18. Fashion as Future of Health Technology

19. Future of Healthy Cities and Transportation

20. Connection Science – Mobile Social Networks

21. Unite Science, Art, Technology and Medicine

http://futureofhealth.org/

“Magnificent book with rich contents. I am impressed by

the wide range of topics – all important to form a strategic

vision of the future.”PD Dr. med. Urs-Vito Albrecht, MPH, Deputy Director PI

PLRIMedAppLab, Hannover Medical School

“Renata’s strategic thinking in "World Health Strategy"

eBook is right on target. Invaluable resource for healthcare

decision makers and investors.”Alex (Sandy) Pentland MIT, US, World Economic Forum


http://futureofhealth.org/




Integrative Medicine Power in Patients’ Hands - DemocratizationFree mobile app downloads exceed 40 billion in 2012. Global Massive Health App Development by 2020

© 2011, Northeastern University

Western

Medicine

Traditional

Chinese

Medicine

Doctor of the Future

Automatic question

answering and Artificial

Intelligence - based

Health Avatar/App





2016 JAMA publication by Google BrainDeep learning program can diagnose a cause of blindness from retina images

as well as doctor.

436 | NATURE | VOL 521 | 28 MAY 2015 REVIEW

Deep learning Yann LeCun, Yoshua Bengio & Geoffrey Hinton

Proc. Advances in Neural Information Processing Systems 25 1090–1098,

2012. ImageNet classification with deep convolutional neural networks.

Krizhevsky, A., Sutskever, I. & Hinton, G.This report was a breakthrough that used convolutional nets to almost halve the error rate for object

recognition, and precipitated the rapid adoption of deep learning by the computer vision community.

Nature 2016 Deep Mind publications on: AlphaGo defeats human in the ancient game of Go

Neural network with memory can adapt to new tasks and can recognize new objects from just one

picture. E.g. can recognize a dog after seeing it just once.

Nvidia’s latest AI Chip = Tesla V100

The First Deep Learning Paper Ever in JAMA

Journal of American Medical Association in Dec 2016





First AI Personal Health Assistant

Basic triage on patients by

UK National Health Services

AI assures all information is personalized

(age, gender, location, time of the year)

9.5 Million sessions

Good performance in head-to-head

comparison with nurses(asking similar questions, coming to same conclusions)

“The app typifies a new approach to mobile health.. It is intelligent, personalized, and gets cleverer as it

gets data from its users.” The Economist

Power in Patients’ Hands – Your.MD http://www.your.md


http://www.your.md/




“With Melody, our goal is to provide patients with an online experience that is close to a human conversation. We believe this

natural type of interaction will help patients feel more comfortable with their doctors and result in a more beneficial patient-doctor

relationship.” Wei Fan, senior director in Baidu’s Big Data Lab

“The new AI-based medical assistant functionality in Baidu Doctor will increase doctor productivity and enable patients to get

quicker answers to their health-related questions,” Zheng Li, General Manager, Baidu Medical Services Business Unit.

Designed to provide relevant information to doctors to assist with recommendation and treatment options.

Based on deep learning and natural language processing.. Integrated with Baidu Doctor release in 2015.

https://www.theverge.com/2016/10/11/13240434/baidu-medical-chatbot-china-melody

http://research.baidu.com/baidus-melody-ai-powered-conversational-bot-doctors-patients/

Melody - Baidu AI Conversational Bot for Doctors and Patients

Melody is built into the Baidu’s iOS and

Android Baidu Doctor app, launched in China

in 2015.

Baidu Doctor allows users to contact local

doctors, book appointments, and ask questions,

with the chatbot intended to speed up this

process.


https://www.theverge.com/2016/10/11/13240434/baidu-medical-chatbot-china-melody

http://research.baidu.com/baidus-melody-ai-powered-conversational-bot-doctors-patients/

http://www.recode.net/2015/8/9/11615446/baidus-medical-robot-chinese-voice-diagnostic-app




Power in Patients’ and Physician’s Hands – IBM Watson

IBM Watson analyzes medical literature and clinical records to provide insights

and treatment options to physicians. Reads 100,000 academic papers in

seconds!

Watson Oncology is a cognitive computing system supporting oncology

physicians as they consider treatment options with their patients.

Memorial Sloan Kettering clinicians train Watson Oncology to interpret cancer

patients’ clinical information and identify individualized, evidence-based

treatment options that leverage specialists’ decades of experience.

“Once Watson for Oncology has the patient's information, it can instantly sort through medical literature from all

over the world, find the literature that is most relevant to that patient's specific cancer, and prioritize potential

treatment options based on the evidence and the patient's health record.

With the use of its different APIs, the system can also read radiological data, hand-written notes, identify images in

specific terms (i.e. being able to identify a particular patient's hand by recognizing distinguishing features), and has

voice recognition ability. It also understands context. If Watson is ingesting a breast cancer patient and it reads in

the notes that the patient's sister had a mastectomy, Watson knows that's an indication of family history even

though the word ‘family' may not appear,” said Merkel, IBM CEO

esearc

Hangzhou CognitiveCare will introduce IBM Watson for Oncology to hospitals

in China (21 hospitals to start)





Babylon puts AI Doctor in your pocket, Ali Parsa, founder and CEO of Babylon

Babylon's aim is to build the world's most advanced AI platform in healthcare,

support medical diagnosis, and predict personalized health outcomes

globally.

Cooperation with the NHS in January 2017 on a trial project to use AI doctor

used to power the NHS 111 app, available to a million London residents.

Londoners will be able to type their symptoms into an app instead of calling a

human to describe their health problems over a phone.

The app will then provide advice to the person on what to do next.

In the UK, call with a primary doctor starts at £25; calls with a specialist cost

more or Babylon users can pay £5 a month for a subscription. In Rwanda

(450,000 users) 50p for a consultation.

Plans for Comprehensive AI Platform by Babylon - $60 Millionhttps://www.babylonhealth.com/


https://www.babylonhealth.com/




Stephen Weng, University of Nottingham UK

Based on 2005 medical records predict cardiac events in 2015 with AI

Compare with real records from 2015

Neural Networks trained on 378,256 medical records

correctly predicted 7.6% more cardiac events than ACA/AHA

guidelines method.

It raised 1.6% fewer false alarms.

In the test samples of 83,000 records it amounts to 355 lives that could

have been saved

AI predicts heart attacks better than doctors – 20 more variables considered showing complexity





A. Clinical Ontology C. Genomic OntologyB. Phenotype Ontology

Advanced AI - Machine Learning with Clinical, Phenotype and

Gene Ontology can discover new diseases, predict disease

possible onset, and clinical outcomes better than humans

World Health Strategy eBook futureofhealth.org Tom Chittenden Ph.D., D.Phil.. https://youtu.be/rZ9h-mokXSU

Founding Director, Advanced Artificial Intelligence Research Laboratory, WuXi NextCODE Genomics


https://youtu.be/rZ9h-mokXSU




By 2018, machine learning (AI) will have been incorporated into

almost half of all Apps developed,

By 2020 savings from AI will be about $60 billion for U.S. companies.

(according to IDC)

Sophia - robot, created by Dr. David

Hanson, Hanson Robotics,

humanlike robots with greater-than-

human wisdom, that are capable of

developing a deep, trusted

relationship with people.”

http://www.geminoid.jp/en/index.html

http://boston.crains.com/article/news/can-your-phone-count-calories-boston-

company-takes-ai-food-

photos?utm_source=natlnewsletter&utm_medium=email&utm_content=boston

&utm_campaign=Boston_20160930_0810


http://www.hansonrobotics.com/

http://www.geminoid.jp/en/index.html

http://boston.crains.com/article/news/can-your-phone-count-calories-boston-company-takes-ai-food-photos?utm_source=natlnewsletter&utm_medium=email&utm_content=boston&utm_campaign=Boston_20160930_0810




Accelerate Uncovering TCM’s Scientific Bases with new tools:

When Google Glass Meets Organs-on-Chips – 20th FHTI Project Recognition

Y. Shrike Zhang in World Health Strategy, eBook www.futureofhealth.org

© Wyss Institute

Expansion Microscopy with swell-able polymers - Ed Boyden

Boyden Lab, MIT - Tissue sample swell to 4.5 times its size – it makes features of

brain cells visible under conventional microscopes.

https://www.bostonglobe.com/news/science/2015/01/15/instead-zooming-mit-scientists-blow-

brain-cells/ahqpkctFFKJsER5xcNEQXO/story.html

Autopatching enables in vivo intracellular investigations. Nature-Protocols

11, 634–654, March 2016

http://www.nature.com/nprot/journal/v11/n4/full/nprot.2016.007.html


http://www.futureofhealth.org/

https://www.bostonglobe.com/news/science/2015/01/15/instead-zooming-mit-scientists-blow-brain-cells/ahqpkctFFKJsER5xcNEQXO/story.html

http://www.nature.com/nprot/journal/v11/n4/full/nprot.2016.007.html




Join Artificial

Intelligence

Integrative

Medicine

Revolution

$55 Billion Digital

Health Market

“Using algorithms

and computers

to figure out

Increasingly

Complex tasks.”

10/2016 Wired Magazine

95+ Health AI startup

companies

AI

© 2017, FHTI, Renata Bushko, Xiu-Min Li,

Barbara Winston at 20th FHTI Summit


Data & Analytics

AI Doctor - Future of Integrative Medicine with Deep Learning and Artificial Intelligence