v P ] ( ] ] o / v o o ] P v d Z v } o } P ] ] v E Á } l ] v Pon-demand.gputechconf.com/gtc/2018/presentation/s8971-adopting... · &lvfr dqg ru lwv diiloldwhv $oo uljkwv uhvhuyhg

Adopting Artificial Intelligence Technologies in Networking Hugo Latapie

Chief Technology and Architecture Office

March 28, 2018

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Confidential

AI Wins


AI looks at riffles and sees

AI Fails


Deep Fusion Reasoning Engine – High-Level View

Symbolic LayerConceptual Layer

SOLUTION DOMAINDEEP DATA FUSION MODELGEOMETRIC

CONCEPTUAL SPACE

KNOWLEDGE GRAPH

Solution Domain

Inference EnginesCausal, Abductive,

Probabilistic, Pattern Mining

Domain Expertise via Domain Specific Language

(DSL)

Actions and Visualizations

Knowledge FlowsPrior and New Knowledge Learned by Inference Engine

Person (device(s)/RF fingerprint, tracklet, black cap, height, behaviors)Workplace Assets (collab devices, shared computers, screens and audio devices)Network Info (telemetry, configuration, performance)

Security risk domain (person behaviors, devices, network behavior) / Collaboration domain (disruptive, none, small group, large group), Quality of experience domain (network, workplace)

Employee / Visitor / Malicious Activities / Network Performance (Issues/potential causes/ potential solutions)/ Security (issues/ potential responses) , Best Practices

ISE Contextual Identity Services for Enterprise, Transportation, Smart City, Retail, Manufacturing(May be live or simulated)

ML/DL Analytics

Visual Profiling Services +

Deep FusionDeep Data

Fusion Model

Subsymbolic Layer

Geometric Conceptual

Space

apple

bananaX

color domain

shape domain

IoT API Gateway

Jan’s Platform for Orchestrated Data Plane Microservices


Industry Moves Toward New Networking ParadigmReactive Compute, Network, Storage and Security


Our Big PictureReactive Networking + Deep Fusion Inference Engine


• Cisco Identity Services Engine (ISE) offers a suite of robust secure network access solutions

• CMX provides (device-based) location awareness to ISE access policies, in addition to core features

• ISE APIs (+ ABAC model) allow for third party add-on services and attribute-based identity sources

• Various Cisco solutions, such as Cisco Platform Exchange Grid (pxGrid) and Cisco Defense Orchestrator provide platforms to share data and orchestrate and manage policies across products

• New initiatives, such as AppGuard and IBN Multi-Domain Policy, are developing next-generation unified management/orchestration solutions for security services across cloud platforms, apps, and/or products

• Connected Safety and Security (physical access and video surveillance/analytics) products are offered by Cisco and partners – with almost no clear path toward integration with above access control solutions

• DeepFusion (early stage) and various IoT related efforts are adding machine learning, sensor fusion, and computer vision to the mix

Cisco’s Key Offering and Related InitiativesAddressing Broad Challenges and Opportunities


Use Case: Anomaly/Threat DetectionVideo Analytics Correlated with Network/Data Activity Patterns

SIMPLIFIED EXAMPLE FOR ILLUSTRATION PURPOSES


Use Case: Visitor Management SystemsUnified Policies For Network (Digital & Analog) Data, and Physical Access

SIMPLIFIED EXAMPLE FOR ILLUSTRATION PURPOSES


General Use CasesState-of-the-Art Solutions for Cisco IoT

• Crowd analytics for smart city, transportation, manufacturing,…

• Traffic analytics

• Behavioral analytics (e.g. man down detection)

• Security analytics (e.g. tailgating detection)

• Queue analytics

• Cross non-overlapping camera tracking

• WiFi + Video tracking

• And more…


Network & APIs

OT Digitized Systems

Augmented Intelligence Intentions, Goals, Decision support

(Big & Small) Data

Sensors, probes // commands, actuators

IT systems

Instructions

Information Policies, Rules

Knowledge, Ontologies & Models, Diagnostics, Moderation/Arbitration

GIS Analytics

SP VNF infra

TS BDP + BORG

Smart Factory & LogisticLive Data Propagation Overlay

Smart Cities

… …

Wisdom

Knowledge

Information

Data Artif

icia

l Int

ellig

ence

Digital-Twin Simulation

Promise Theory

Hyper-Graph processing

Neuro-Symbolic approach

Business Verticals

Complex Distributed Systems Operation/Supervision

Deep Learning

Cognitive Reasoning

Agents

Analytics Solvers, Compilers …

Media DC ENT HMC workloads

Non-axiomatic Reasoning


DNA Analytics – Kairos architecture

Cloud based1 click deployment,Subscription Based,

WNBU and Meraki APs support

Strong anonymizationAll Data sent to the cloud is anonymize and fed in

the ML algorithms to improve experience of other customers

Support of Wireless/Wired/IoTExtensible to all networking gears

Anonymous

AnonymousAnonymous

Anonymous

On-going cross learningBuilding of behavioral models using anonymized data set covering a broad range of deployments

models

Customer A Customer C

Cognitive and Predictive Analytics with Machine LearningCollect Network Data in the cloud, Pipeline of AI

(Machine Learning) Algorithms to address uses casesCognitive analytics and Predictive analytics sis, long term

analysis models, optional close loop control (e.g. network to end device)

Kairos Cloud

Customer B Customer D

NETWORKING DNA Center - Kairos


Encrypted Threat Analytics - Solution overview

OS inference

Endpoint contextOS, Applications, PMTU, RTT, Infection, …

Enhanced NetFlow

flow record

labels

flow record

Ciscoproducts

Enhanced NetFlow

Application inference

Malwaredetection

Malwarefamily

Cryptoaudit

fingerprintrules

classifierdescription auxiliary data

NETWORKING DNA Center - ETA


The Network. Intuitive. Cisco ML/AI

Compute / Multi-Cloud

NetworkingDNA Center

Cisco Catalyst

Collab

Spark Board

Spark

MindMeld

WebEx

Security

TalosUmbrella

CloudlockCTA

NGFWStealthwatch

Services – Creando

AMP

UCS Hyperflex

Tetration Intersight

AppDynamicsOptimizing and securing

the data center

A Look At Typical Customer Work Flow

Data Data Scientist,Data Engineers, etc.

Data SourceData CleanupData Transformation

Training

Model DevModel ValidationModel Execution

Deployment

DC Infrastructure AI/ML/DL Platforms

Data / BigData

Libraries

FrameworkAI/ML

Servers/ Appliances(CPU / GPU)

Simplified DC Infra To Support AI/ML Workloads

AI/ML Apps/ APIs

Services

Manageability

Network

DC Servers and Storage

Model Deploy/Mgmt

NOT EXHAUSTIVE


Cisco AI/ML Value Prop

Experience delivering proven solutions withtechnology partners

Natural extension of existing data

center infrastructure

Full portfolio for all MLneeds end-to-end

© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential

Cisco AI/ML PortfolioTest/Dev and Model Training

4-6 P100/V100

New DL Platform

UCS C240

2 to 6 P4 GPUs

HyperFlex 240

2 P100/V100 2 P100/V100 Per Node

Option of GPU Only Nodes

Deep Learning/ Training

UCS C480

8 GPUs

Inferencing

UCS C220 / C240

HXAF240+GPU

2 to 6 P4 GPUs

HyperFlex 240

Option of GPU Only Nodes

HXAF240+GPU

Available Today CY Q2/Q3’ 18 CY Q3’/Q4 18Available Today Available Today CY Q2/Q3’ 18

Validated AI/ML SW For Turnkey

(Work in Progress)

Better Together, Choice to Customers, Cisco Validated Designs

Others

+


AI/ML Demos at the Cisco Booth

Kubeflow On HyperFlex – Extreme Flexibility, VM deployment

Kubeflow On UCS

Insight into data scientists work comparing simplicity, flexibility and performance between on-prem and public cloud infrastructure

+Simplified, Scalable and Flexible On-Premise Infrastructure For AI/ML Workload KubeflowUCS / HyperFlex

(Develop Anywhere, Run Anywhere, Scale as you go!)

Striking a Balance Between On-premise and Cloud Infrastructure for AI/ML Workloads in a Multicloud World

Eco-System Demos

++

+

+

GPU

Cool demos from a couple of companies that run their solution on our AI/ML platform to solve interesting use cases

+

Data GravityData SecuritySimplicityFlexibilityPerformance


Stop by Cisco booth 415 and catch one of our demos• Google Kubeflow on Cisco UCS and HyperFlex• Bitfusion demo on Cisco HyperFlex• Big data with deep learning demo• GPU accelerated desktop and app virtualization• AI powered face detection in Cisco Spark Board Collaboration device

Participate in our daily booth raffles for a chance to win an NVIDIA Shield TV

Participate in our social media contest for a chance to win a Roku stick

Booth415

Documents

v P ] ( ] ] o / v o o ] P v d Z v } o } P ] ] v E Á } l ] v Pon-demand.gputechconf.com/gtc/2018/presentation/s8971-adopting... · &lvfr dqg ru lwv diiloldwhv $oo uljkwv uhvhuyhg