Bot Framework overview & Example architecture

Technology reference

©2019 Avanade Inc. All Rights Reserved

Type Speak

Tap

UserInput

Devices

Channels

Azure BotService

Adaptive Cards

Bot framework & cognitive services

Your AssistantYour Brand

Your Personality

Language Understanding

Speech

VisionQnA

Dispatch

Office Graph

Knowledge Sources

Manuals (PDF)

Data Sources

General Knowledge

Points ofInterest

Mail

Automotive

Custom

OtherBots

Skills (Customizable)

APIs

Directory

Tasks

Calendar

3P Assistants

Anatomy of a Virtual Assistant

©2019 Avanade Inc. All Rights Reserved

Conversational AI: Enterprise customers

1Billion message per month~3000 new bots at week

©2019 Avanade Inc. All Rights Reserved

Windows App

iOS App

Android AppBot Intelligence

Bot Live Data

Bot Memory Data & Cache

Reporting

Bot Logic, UX, Connectors

SkypeS

Telegram

Slack

Teams

Facebook Messenger

Cortana

Alexa

Chan

nels

Voice ImageText

Inputs

Logging and Telemetry

App Insights

Logs

BotService

Bot Security

Bot Key Secrets

Power BI

App Service(Logic, UX, …)

Language Understanding

ContentModerator

Text Analytics

BingSpell Check

Cache Data Store

Bot Data Getters and Seeders

Content APPData APP Lake App

APIs

External API

APIs

Back end API

Bot Scheduled Tasks

Data Loader

Live Events

API and Business Events

Subscriptions Event Hub

Cosmos DB

Microsoft Reference Architecture

QnA Maker

Face API Speech

Web

Google Assistant

Content

Azure Search

©2019 Avanade Inc. All Rights Reserved

TranscriptsDialogs

UX

Bot Framework SDK

Cognitive Services

• Language Understanding

• QnA Maker

EmulatorTraining

Azure Bot Service Channels• 1P: Teams, Skype...• 3P: FB, Slack, Google...• Custom (DirectLine)

AnalyticsActive Learning

Design Build Test Publish Connect Evaluate

The lifecycle of creating a virtual assistant

©2019 Avanade Inc. All Rights Reserved

Natural language model lifecycle

Identify Scenarios

Define Actions

Identify Data Sources

Define Intents and Entities

Create Knowledge Base

Evaluate models

Improve models

Shared Runtime Deployment

Publish knowledge base

Container Deployment

Deploy a bot using Bot Framework

Integrate with other Cognitive Services

App Insights

Active Learning to suggest high

business value topics

Design Build Test Publish Connect Evaluate

©2019 Avanade Inc. All Rights Reserved

Bot Intelligence

Bot Live Data

Bot Memory Data & Cache

Reporting

Bot Logic, UX, Connectors

Facebook Messenger

Chan

nels Text

Inputs

Logging and Telemetry

App Insights

Logs

BotService

Bot Security

Bot Key Secrets

Power BI

App Service(Logic, UX, …) Language

Understanding

ContentModerator

Text Analytics

BingSpell Check

Bot Data Getters and Seeders

Event APP

APIs

Events API

APIs

Events API

Bot Scheduled Tasks

Data Loader

Live Events

API and Business Events

Event Subscriptions

Event Hub

Example Architecture - Phase 0

QnA Maker

Web

Content

Azure Search

C5

C1

C3

C2

C7 C9

C6

C8

C10

C11

C12C13 C14

C4

©2019 Avanade Inc. All Rights Reserved

HPB Phase-0 Component Interaction SequenceComponent Function Scope

C1User can ask question on HPB FB Channel or On Website

Give users ability to converse on HPB Website

C2 Give users ability to converse with HPB Facebook channel

C3First port of call for the different bot frontends it manages the interface between the bot intelligence security and operational reporting

Bot Orchestration logic, UI, Client specific adaptations and integrations, Security Enforcement, Collecting data for bots operational reporting. It also maintains session state, so bot remembers the conversation and not just one question.

C4 Ensure on users authorized to use bot can access its capabilities.

Bot may either be embedded in the overall security context of the application using SSO or enforce its independent security, this component ensures only authorized users can access bot capabilities.

C5 Bot functioning event collection Component collects all the operational data that can be used to understand bots performance and identify areas of improvement

C6 Reporting bot performance This component used data captured by C5 to generate reports that analysts can use to drill and evaluate into bots KPI’s.

C7Understands the ask from question, breakdowns question parts to understand the specifics of the ask

This is bots brain and component stores understanding of what it is trained to answer. It core job is to resolve from user question its intent and help create appropriate response. It uses multi sensory AI capabilities to understand images, txt and other data that C3 may have handed over as part of the user interaction. It interfaces with various back end capabilities to generate/search/obtain appropriate responses

C8 Short and long term memory for storing data for responses

So that bot does not need to go to the source of truth every time the same question gets asked this component is responsible forstoring responses and data needed to build responses. This ensures less load on back end systems and quicker turnaround time in delivering responses to the users. In HPB phase-0 this system will store the website content in a search index format so responses can be delivered without hitting the website.

C9,C10 Interact with back end systems to obtain content for responses and transact

These components interact with the backend systems to obtain data for responses and transact with them. In HPB phase-0 it will interact with the HPB website to obtain the content for responses and the event system to make event reservations,.

C11,C12,C13,C14

These are back end systems that Bot System needs to interact with

In HPB Phase-0 C12, C13, C14 are the Event systems that have information about events and have apis to book envents. C14 is HPB website, whose content is regularly ingested by C10 into C9, so C7 can quickly find good answers to user questions