IBM Watson  Developer  CloudVision  Services  Alyssa  SimpsonSr.  Product  Manager:  Watson  Vision  

What  are  WDC  Vision  Services?

2

3

WDC  Vision  Services  is  the  technology  suite  which  enables  customers  to  find  new  insight,  derive  significant  value,  and  take  meaningful  action on  visual  information  of  any  kind.  

Vision  Services  are  available  on  IBM  Watson  Developer  Cloud!

4General  Availability Experimental BETA  (GA  Q1  2016)  

5

Use  Cases  by  API  Building  BlockImage  Tagging

Text  from  images

Visual  Learning

Facial  Detection

Link  extraction

Similarity  Search

Visual  Insights

AlchemyVision (beta)Use  Case:  “Tell  me  If  there  is  a  person  is  in  this  picture  so  that  I  can  identify  them”  

AlchemyVisionUse  case:  “Get  the  most  relevant  image  off  of  this  website  URL”

Visual  Insights  (experimental)Use  Case:  “Tell  me  common  themes  contained  in  this  group  of  images”  

AlchemyVisionUse  Case:  “Give  me  natural  language  which  describes  this  image  ”  

AlchemyVision (beta)Use  Case:  “Transcribe  any  text  or  natural  language  contained  in  this  image”

AlchemyVisionUse  Case:  “Find  other  images  similar  to  this  image”

VisualRecognition (beta)Use  Case:  “Learn  about  my  custom  content  in  this  image  as  a  unique  classifier”

Use  Watson  Vision  to  answer  these  questions

6

• What  is  this  a  picture/video/image  of?  

• Which  ones  and  how  many  pictures/videos/images  do  I  have  which  are  similar  to  this  one?  

• What  is  the  relevance  to  my  bottom  line  of  using  one  image  vs.  another  image?

• What  are  the  common  themes  in  this  batch  of  1MM  photos?  • Is  this  ship  a  known  entity?  • What  is  my  audience  interested  in?  

• What  user-­generated  content  matches  which  products  I  sell?• Which  images  will  resonate  best  in  a  marketing  campaign?  

• Which  image  should  I  feature  on  my  front  page  of  my  app?  

How  Does  It  Work?

7

WDC  Vision  Services  takes  images  and  matches  them  with  known  tags  and  classifiers.  

8

1.  Input  image 2.  Train  image  in  classifier 3.  Output  classifier  likelihood

2a.  Image  is  expressed  as  RGB  values  for  set  of  pixels

2b.  Values  converted  into  highly  dimensional  representation  (features)

2c.  Features  are  either  mapped  positively  or  negatively  to  classifier

Use  Cases

©  2014  International  Business  Machines  Corporation©  2014  International  Business  Machines  Corporation 9

Branding  Strategy

Design  more  efficient  promotions  &  campaigns

Brand  sentiment  analysis

Campaign  performance  improvements

Audience  segmentation  

Personalized  advertising  by    offering  individualized  value

Campaign  creation  image  search

*Diagnostic  assistance

*Voice  of  the  patient

*Suicide   Prevention

*Care  givers  &  patients  matching  

Customer  Segmentation  and  Promotions

Product  Search

Conversion  optimization  

Review  analysis  and  user-­generated  content  placement

Extract  life-­changing  events  from  social  media  for  reengagement  campaigns

Finance

Use  Cases  By  Industry

*  In  grey  are  listed  use  cases  that  we  still  need  to  develop  with  your  help

Marketing  +  Advertising  

Brand  Analytics Healthcare* Retail Finance

10

Industry  Use  cases:  detail

SolutionPlay

Commerce IoT / Geo-Spatial Healthcare Security

High Level Description

Conversion improvements  for  clients  with  consumer  facing  products  and  services.  

Auditing need  for  action  from  physical  location  of  things.  

Driving  speed  and  reliability  of  medial   diagnosis  on  individual   and  group  scale.  

Improving  security of  transactions  and  facilities  leveraging  visual  data.  

VisionOffering:

SolutionPackage

- Visual Recognition API- Visual Insight API- Social media integration - IBM Commerce integration

(*in development)

- Visual Recognition API- Visual Insight API- Weather Channel data

integration- Video Analytics - Trigger-event alerting

- Solution Architecture- Visual Recognition API- Watson Health / Merge

Integration- HIPPA Compliance

- Visual Recognition API- Visual Insight API- Facial Recognition- Video Analytics- Trigger-event alerting - PII compliant

Use Cases • Social  Commerce  (Analyze  social  images  for  improved  engagement  and  conversion.)

• Contextual  Ad  placement  (tell  me  what  this  content  is  about  so  I  can  place  relevant  ads)

• Audience  Segmentation  (Extract  customer  demographic,  and  interests  so  I  can  created  targeted  campaigns)  

• Visual  Search  /  Find  Similar  (surface  like  products  from  broad  inventory  to  increase  conversion)  

• Market  Research  (Informme  of  global   changes  in  weather  or  other  physicality  changes  which  can  impact  my  local  business)  

• Auditing (Alert  me  when  physical  items  are  out  of  compliance  or  have  a  state  change  which  requires  intervention)  

• Operational  Efficiency  (tell  me  where  I  should  drill   for  oil  based  on  geographic  patterns)  

• Diagnosis (Inform  me  if  a  patient  has  an  abnormality  that  requires  follow  up)  

• Research (find  patterns  in  groups  of  images  to  inform  me  of  insights)  

• Accessibility (Help  me  “see”  the  world  better  if  I  am  visually   impaired)  

• Authentication (Ensure  that  personal  transactions  are  being  made  by  the  authenticated  individual  ex:  Samsung  payments)  

• Physical  Site  Security  (Alert  me  when  abnormalities   are  happening   in  a  secure  facility)  

Future  Development

Commerce  Use  Cases:  Deep  DiveDomain Solution Pattern Use Cases Example

Target Customers

Marketing Visual  Recognition:  Custom  Learning  

Visual  Insights:  Audience  Segmentation  

Visual  Recognition

Visual  Recognition:  Personalization  

Use  Case  #1: Identify  my  logo  in  social  media  posts  so  that  I  can  understand  ROI  of  marketing  activities  

Use  Case  #2:  Extract  customer  demographic,  emotions,  and  interests  so  I  can  created  targeted  campaigns

Use  Case  #3:  Tell  me  what  this  user-­posted  is  about  so  that  I  can  organize  and  place  in  an  appropriate  place  on  my  product  reviews

Use  Case  #4:  Which  image  should  I  use  to  drive  the  best  conversion  for  click-­through?  

ConversionOptimization  

Visual  Recognition:  Similar   Images

Visual  Recognition:  Similar   Images

Use  Case  #1:  Find  similar  products  to  offer  to  my  customer  to  increase  conversion.  

Use  Case  #2:  Watsonize product  search  and  search  for  products  based  on  images  captured.  

Purchase  and  Authentication  

Visual  Recognition:  Custom  Learning  &  Facial  Recognition  

Use  Case  #1:    Watsonize a  banks  mobile  app  leveraging  facial  recognition  for  authentication.

IBM  Confidential

Packaging  and  Pricing

(Current  as  of  Jan  2016)13

14

General  Availability ExperimentalFREE

BETA  (GA  Q1  2016)FREE  

Customer  Stories

15

CrowdFlower classifies  images  and  organizes  dataCrowdFlower trains  Visual  Recognition  to  turn  big  data  into  rich  data  that  is  useful

NeedSave  time  determining  what  is  going  on  in  images

Organize  photos  and  classify  them  

SolutionHuman-­curated  training  models  using  rich  data  to  determine  if  humans  are  present  in  photos  or  in  medical  cases,  determine  if  tumors  are  present  in  photos

BenefitsReduce  human  effort  and  time  categorizing  photos

Streamline  data  enrichment  and  classify  accurately

16

Ad  Agency  transforms  everyday  photos  into  marketing  contentAn  ad  agency  harnesses  the  power  of  Visual  Recognition  to  categorize  and  recommend  photos  posted  on  Social  Media  channels  for  marketers

NeedDerive  context  within  photos

Intelligently  categorize  photos  based  on  a  variety  of  criteria

SolutionA  sophisticated  recommendation  algorithm  to  provide  relevant  user  generated  content  for  brands  to  use  in  marketing  

BenefitsIdentify  top  brand  influencers

Personalize  marketing  and  ad  campaigns  with  user  created  images

Increased  marketing  ROI

17

A  retailer  recommends  products  based  on  customer  tasteRetailers  can  train  Watson  through  customer’s  history  searches  and  product  catalog

NeedProvide  visually  similar  product  recommendations  for  existing  catalog

Provide  personalized  shopping  experience

SolutionSpidering retailer  website  and  extracting  and  indexing  product  information  and  photos  into  an  AlchemyVision instance

BenefitsEnhanced  faceted  search  capability  (ex.  “Show  me  dresses  under  $50  that  look  like  this  one”)  

Avoid  cold  start  problem  common  in  many  recommendation  engines  (ex.  Recently  added  products  to  the  catalog)

18

Where  to  Find  Help

19

Support  for  WDC  Vision  Services  Engagements  

1) Watson  Developer  Cloud  1) AlchemyVision

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/alchemy-­vision.html2) Visual  Recognition

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/visual-­recognition.html3)        Visual  Insights

http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/visual-­insights.html

• Documentation  about  WDC  Vision  APIs  on  WDC• Live  demonstrations  and  demo  scripts• Videos

3)  Contact  our  team  

Alyssa SimpsonSenior  Offering  Manager:  Watson  Visionsasimpson@us.ibm.com

Rahul SinghalProgram  Director:  IBM  Watson  Product  Management  &  Strategy

John SmithIBM  FellowIBM  Research  

Devin HarperDevTeam  Lead:  Watson  Vision

Acknowledgements  and  DisclaimersAvailability.    References  in  this  presentation  to  IBM  products,  programs,  or  services  do  not  imply  that  they  will  be  available  in  all  countries  in  which  IBM  operates.  

The  workshops,  sessions  and  materials  have  been  prepared  by  IBM  or  the  session  speakers  and  reflect  their  own  views.    They  are  provided  for  informational   purposes  only,  and  are  neither   intended  to,  nor  shall  have  the  effect  of  being,   legal  or  other  guidance  or  advice  to  any  participant.    While   efforts  were  made  to  verify  the  completeness  and  accuracy  of  the  information  contained  in  this  presentation,  it   is  provided  AS-­IS  without  warranty  of  any  kind,  express  or  implied.   IBM  shall  not  be  responsible  for  any  damages  arising  out  of  the  use  of,  or  otherwise  related  to,  this  presentation  or  any  other  materials.  Nothing  contained  in  this  presentation  is  intended  to,  nor  shall  have  the  effect  of,  creating  any  warranties  or  representations  from  IBMor  its  suppliers  or  licensors,  or  altering  the  terms  and  conditions  of  the  applicable   license  agreement  governing  the  use  of  IBMsoftware.

All  customer  examples  described  are  presented  as  illustrations  of  how  those  customers  have  used  IBM  products  and  the  results  they  may  have  achieved.    Actual  environmental  costs  and  performance  characteristics  may  vary  by  customer.    Nothing  contained  in  these  materials   is  intended  to,  nor  shall  have  the  effect  of,  stating  or  implying   that  any  activities  undertaken byyou  will  result  in  any  specific  sales,  revenue  growth  or  other  results.

©  Copyright  IBM  Corporation  2015.  All  rights  reserved.U.S.  Government  Users  Restricted  Rights  -­ Use,  duplication  or  disclosure  restricted  by  GSA  ADP  Schedule  

Contract  with  IBM  Corp.

IBM,  the  IBM  logo,   ibm.com,  IBM  Watson,  Personality  Insights,  Tradeoff  Analytics  are  trademarks  or  registered  trademarks  of  International   Business  Machines  Corporation  in  the  United  States,  other  countries,  or  both.  If  these  and  other  IBM  trademarked  terms  are  marked  on  their  first  occurrence  in  this  information  with  a  trademark  symbol  (®  or  ™),  these  symbols  indicate  U.S.  registered  or  common  law  trademarks  owned  by  IBM  at  the  time  this  information  was  published.  Such  trademarks  may  also  be  registered  or  common  law  trademarks  in  other  countries.  A  current  list  of  IBM  trademarks  is  available   on  the  Web  at  “Copyright  and  trademark  information”  at  www.ibm.com/legal/copytrade.shtmlOther  company,  product,  or  service  names  may  be  trademarks  or  service  marks  of  others.

• Acknowledgement  to  the  companies  contributing  their  pictures  for  the  presentations  as  follows:  deviantart.com  &  pixabay.com21

©  2014  International  Business  Machines  Corporation©  2014  International  Business  Machines  Corporation 22

Thank  Youibmwatson.com

facebook.com/ibmwatson

twitter:  @ibmwatson