IBM Watson Developer Cloud + IoT @ RoboUniverse 2015

IBM Watson Developer Cloud+

IoT

Nathan Friedly ([email protected])German Attanasio Ruiz ([email protected])

RoboUniverseMay, 2015

mailto:[email protected]

mailto:[email protected]

CONFIDENTIAL© 2015 International Business Machines Corporation 2

Watson Developer Cloud Services

CONFIDENTIAL

Personality InsightsWhat is it?Improves understanding of people's preferences to help engage users on their own terms.

How does it work?

The IBM Watson Personality Insights service uses linguistic analytics to extract cognitive and social characteristics, including Big Five, Values, and Needs, from communications that the user makes available, such as email, text messages, tweets, forum posts, and more. By deriving cognitive and social preferences, the service helps users to understand, connect to, and communicate with other people on a more personalized level.

Example Use Cases• Improve customer engagement by personalizing and

differentiating products and offerings using customer’s public communication (e.g., twitter feed)

© 2015 International Business Machines Corporation 3

http://en.wikipedia.org/wiki/Big_Five_personality_traits





© 2014 International Business Machines Corporation

• C++ & Python

• SPI-based display

• Battery-friendly

• https://github.com/watson-developer-cloud/arduino-pi-badge-demo

Arduino Yún + Personality Insights

https://github.com/watson-developer-cloud/arduino-pi-badge-demo

https://github.com/watson-developer-cloud/arduino-pi-badge-demo

CONFIDENTIAL© 2014 International Business Machines Corporation© 2015 International Business Machines Corporation 4

Personality Insights Demo

http://your-celebrity-match.mybluemix.net/

http://www.msnbc.com/msnbc/how-supercomputer-sees-the-state-the-union







CONFIDENTIAL

Question and AnswerWhat is it?

Direct responses to users inquiries fueled by primary document sources

How does it work?

Interprets and answers user questions directly based on primary data sources (brochures, web pages, manuals, records, etc.) that have been selected and gathered into a body of data or ‘corpus’. The service returns candidate responses with associated confidence levels and links to supporting evidence. The current data corpora on Bluemix focuses on the Travel and Healthcare industries.

Example Use Cases

Healthcare: •What is a stroke? What is the cause of Wilson Disease?

Travel: •Where is the best place to stay in Prague?



Question and Answer Demo

http://watson-qa-demo.mybluemix.net/



CONFIDENTIAL

Speech To TextWhat is it?

Automatic recognition of the words that are being spoken in a live audio stream, and presents the highest-scoring textual representation of that message.

How does it work?

In addition to converting a raw audio signal into a best-guess of the words that are being spoken, intelligence about the relevant grammar / how language is used within a specific context is incorporated to generate a more accurate transcription.

Example Use Cases• A new integration paradigm for mobile apps.• Voice-control of applications / embedded devices. • Transcription of meetings and conference calls. Dictation of

emails. • Critical building block for “Speech-to-Speech” translation.



Speech To Text Demo

https://speech-to-text-demo.mybluemix.net/



CONFIDENTIAL

Text To SpeechWhat is it?

Generates an audio file that has a verbal representation of the input text – complete with appropriate cadence and intonation, and, in the future, the ability to customize the pronunciation of specific words.

How does it work?

Generates an audio file that has a verbal representation of the input text – complete with appropriate cadence and intonation.

Example Use Cases• Enable a new interaction paradigm for mobile apps.• Assistance tools for the vision-impaired. • Read texts / emails aloud. • Critical building block for enable “Speech-to-Speech

Translation”


© 2014 International Business Machines Corporation

• Node.js

• Interrupt-based IO

• Minimal Resource Usage• https://github.com/watson-developer-

cloud/rpi-time-weather-demo

Raspberry pi + Text to Speech

https://github.com/watson-developer-cloud/rpi-time-weather-demo

https://github.com/watson-developer-cloud/rpi-time-weather-demo


Text To Speech Demo & Sample

http://text-to-speech-demo.mybluemix.net/

https://github.com/watson-developer-cloud/node-tts-player




https://github.com/watson-developer-cloud/node-tts-player

CONFIDENTIAL

Visual RecognitionWhat is it?

Analyzes the visual content of images and videos to understand their content without requiring a textual description.

How does it work?

The Visual Recognition service enables you to analyze the visual appearance of images or video frames to understand what is happening in a scene. Using machine learning technology, semantic classifiers recognize many visual entities, such as settings, objects, and events. The service applies these pre-learned models to imagery that you have uploaded to the service and returns a score for each image for each model, indicating the likelihood of that visual element being present in the image.

Example Use Cases• Audio-visual indexing and search of media archive• Automatic “Smart Album” generation• Marketing data analysis from social media - For e.g., mine

Pinterest images and perform segmentation



Visual Recognition Demo

http://visual-recognition-demo.mybluemix.net/




CONFIDENTIAL

Tradeoff Analytics

What is it?Helps make better choices under multiple conflicting goals. Combines smart visualizations and analytical recommendations for tradeoff exploration. How does it work?Tradeoff Analytics helps people make better choices when multiple conflicting goals come into play. Tradeoff Analytics uses Pareto filtering techniques in order to surface out only the optimal alternatives across multiple criteria. It then help the decision maker analyze the tradeoffs within the optimal set of alternatives helping them select the option that best meets their preferences and priorities.

Use Cases•Wealth management using the technology to help choose

mutual funds



Tradeoff Analytics Demo

http://tradeoff-analytics-demo.mybluemix.net/

http://hedge.mybluemix.net/

http://personalized-recommendations.mybluemix.net/








CONFIDENTIAL© 2015 International Business Machines Corporation

IBM Watson Developer Cloud in Github

17

http://www.ibm.com/watsondevelopercloud/https://github.com/watson-developer-cloud

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/



https://github.com/watson-developer-cloud




Thanks

More IBM Watson:

Knowledge Engines and AI – Applications Beyond Gaming

• Aadhar Garg• Tomorrow, May 12 • 3:30pm – 4:15pm• Technology Track


Additional Services

CONFIDENTIAL

Concept ExpansionWhat is it?

Maps euphemisms or colloquial terms to more commonly understood phrases

How does it work?

The Concept Expansion service analyses text and interprets its meaning based on usage in other similar contexts. For example, it could interpret “The Big Apple” as meaning “New York City”. It can be used to create a dictionary of related words and concepts so that euphemisms, colloquialisms, or otherwise unclear phrases can be better understood and analyzed.

Example Use Cases

“drugs” can be expanded to:

start seed terms motrin, aspirin, Keflex

post expansion allegra, lisinopril, metformin, aspirin, equagesic, cimetidine, fiorinal, vancomycin, avelox, protonix, glimepiride


CONFIDENTIAL

Relationship Extraction

What is it?From unstructured text, Relationship Extraction can extract entities (such as people, locations, organizations, events), and the relationships between these entities (such as person employed-by organization, person resides-in location)

How does it work?Based on statistical modeling, Relationship Extraction performs linguistic analysis of the input text, finds spans of text that refers to entities, clusters them together to form entities, and extracts relationships between them.

Example Use CasesAny application that want to use NLP data extracted from text.



Relationship Extraction Demo

http://ibmlaser.mybluemix.net/siredemo.html



CONFIDENTIAL

Concept InsightsWhat is it?Locate relevant documents that may not directly mention your query.

How does it work?The Concept Insights service links documents you provide with a pre-existing graph of concepts based on Wikipedia (e.g. 'The New York Times', 'Machine learning', etc.). Two types of links are identified: explicit links when a document directly mentions a concept, and implicit links which connect your documents to relevant concepts that are not directly mentioned in them.

Example Use Cases• A legal firm could utilize this service to identify cases which

may be related to the case in question• Improve engagement on any external website



Concept Insights Demo

http://concept-insights-demo.mybluemix.net/



CONFIDENTIAL

Language IdentificationWhat is it?

Identifies the language in which text is written.

How does it work?

The Language Identification service detects the language in which text is written. This helps inform next steps such as translation, voice to text, or direct analysis. The service can be used in tandem with the Machine Translation service. Today, the service can identify 15 languages – Arabic; Chinese (Simplified); Chinese (Traditional); Cyrillic; Danish; Dutch; English; Farsi; Finnish; French; German; Greek; Hebrew; Hindi; Icelandic; Italian; Japanese; Korean; Norwegian (Bokmal); Norwegian (Nynorsk); Portuguese; Spanish; Swedish; Turkish; Urdu

Example Use CasesA building block for Machine Translation and future

tech



Language Identification Demo

http://ibmlaser.mybluemix.net/liddemo.html



CONFIDENTIAL

What is it?

Globalize on the fly. Translate text from one language to another. Customize the translation algorithm for your specific use case, or use a generic (news) one.

How does it work?

The Machine Translation service converts text input in one language into a destination language for the end user. Today, bi-directional generic translation is available between English and [French, Spanish, Portuguese]; uni-directional generic translation is available from Arabic to English. More languages and customization capabilities coming soon!

Example Use Cases• A news agency is able to curate articles from across the globe,

and present them to a local audience in their native language. • An e-commerce website can enable a truly global marketplace. • Travel apps can deliver on the promise of a fully guided,

interactive experience.

Machine Translation

© 2015 International Business Machines Corporation27


Machine Translation Demo

http://ibmlaser.mybluemix.net/mtdemo.html





CONFIDENTIAL

Visualization RenderingWhat is it?

Graphical representations of data analysis for easier understanding

How does it work?The service takes input data and graphically renders it as an interactive visualization which can range from a common business chart to more advanced layouts. The visualizations can be easily modified to match user needs, visual styling, and types of data being analyzed.

Example Use Cases

The service could represent neighborhood demographic data as mini pie charts showing income levels centered on geographic locations on maps, or as tree maps that can switch from looking at income by age to house size or by education level.



If you need help with BlueMix, Watson, or anything else (or or if you just want to show off your latest creation), reach out to us on twitter:

@nfriedly

@germanatt

https://twitter.com/nfriedly

https://twitter.com/germanatt

Engineering

IBM Watson Developer Cloud + IoT @ RoboUniverse 2015