17
Learn. Connect. Explore. Learn. Connect. Explore.

Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Learn. Connect. Explore.Learn. Connect. Explore.

Page 2: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Real Time Analytics

Sudhir Rawat

Support Escalation Engineer

MCTS, MCITP, MCT | Microsoft SQL Server BI Platform

Microsoft INDIA R&D Pvt Ltd.

Page 3: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

What is Real Time Analytics

• Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time.

• Different people different perspective

• Nanosecond, Milliseconds, Seconds, Hours, Days?

• Proactive Vs. Reactive

Page 4: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Scenario’s…….• Risk Analysis in Finance Domain

• Stock Market

• Call center

• Product Marketing

• Low Latency

• Better Customer experience• Ex. view an Ad, customer move

• Real-time Recommendations

• Business Health• Ex. CRM

• Monitoring Data • Ex. Network counter

• ………….

Page 5: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Real Time Data Analytic Challenges

• Big Data

• Parallel processing

• Event Processing Engine

• Low Latency

Page 6: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Architecture-1

Page 7: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Demo….

Page 8: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Architecture-2

T

w

e

e

t

s

HDInsight (HBase)

HDInsight (Hadoop)

web roleStreaming

user

Page 9: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Why HBase and not Hadoop

• Linear and modular scalability.

• Strictly consistent reads and writes.

• Automatic and configurable sharding of tables

• Automatic failover support between RegionServers.

Page 10: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Demo….

Page 11: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Architecture-3

Queuing

Service

(Kafka,

EventHub..)

StormReal time

processing System

Real time dashboard

Batch Processing

Data

Store

(Hbase, SQL

etc.)

Sentiment

Clickstream

Machine/Sensor

Server Logs

Geo-location

Page 12: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

STORM• Fast

• Reliable

• Scalable

• Easy to Program

• Fault Tolerant

Page 13: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Demo….

Page 14: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

References

• http://azure.microsoft.com/en-in/documentation/articles/hdinsight-hbase-overview/

• http://msdn.microsoft.com/en-us/library/dn749822.aspx

• http://azure.microsoft.com/en-us/documentation/articles/hdinsight-storm-overview/

• http://azure.microsoft.com/en-us/documentation/services/hdinsight/

technet.microsoft.com/en-in

aka.ms/mva

msdn.microsoft.com/

Page 15: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Tell us what you think

Scan the QR code to evaluate

this session.

< QR Code will be given a week before

Tech Ed >

Page 16: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time

Follow us online

Facebookfacebook.com/MicrosoftDeveloper.India

twitter.com/msdevindia

Twitter

Twitter: @rawatsudhir

Email:[email protected]

Facebook:-sudhir.rawat.777

Page 17: Learn. Connect. Explore.... · What is Real Time Analytics •Use data to project it to business decision makers as and when it comes so that effective decisions can be taken on time