Big data the way to success in network management

© 2013 Netka SystemApril 13, 2023 www.netkasystem.com

Big Data andThe Way to Success in Network Management

netksystem

© 2013 Netka System 2

Agenda

What is Big Data? Big Data Challenges in IT Network Netka’s Solution for Big Data

Network Diagram Event Management Data Visualization (Dashboard) Application & Network Analytics


What is Big Data?

netksystem


How much data is generated every minute?

Source: http://www.domo.com/blog/2012/06/how-much-data-is-created-every-minute/?dkw=socf3

netksystem


How big of data?

Source: http://www.theregister.co.uk/2012/12/04/hp_discover_autonomy_vertica_big_data

netksystem


Data Explosion

Source: www.kdnuggets.com/2012/07/data-science-and-prediction-vasant-dhar.html

netksystem


Big Data’s definition?

“Big data is high-volume, high-velocity and high-variety information assets that demand cost-effective,

innovative forms of information processing for enhanced insight and decision making.” … by Gartner

“Big data usually includes data sets with sizes beyond the ability of commonly used software tools to

capture, curate, manage, and process the data within a tolerable elapsed time.” … by Wikipedia

netksystem


Big Data Characteristic

High Volume

High Velocity High Variety

Terabytes to Zettabytes

Batch to Streaming Data Structured to Unstructured


Big Data Challenges in

IT Network

netksystem


Net

wo

rk L

ayer

Big Data rely on IP Network

Ap

plic

atio

n L

ayer

netksystem


IT Network for Big Data

IT Network is super highway of data communication today. All application e.g. client-server app., email, web browsing, social networking app, mobile app, VoIP, IPTV, SaaS run on network infrastructure. So, each byte of big data run on and rely on network infrastructure.

Imagine … what happen if your network have problems? How big of damage will effect to your business?

How to protect network problems, how to enhance insight of your network to process big data, how to understand your network health, how to identify/classify/notify network problem or user application problem. Answer is intelligent network management.

netksystem


3 Vs of Big Data in IT Network

• Terabytes• Records• Transactions• Tables, files

• Batch• Near time• Real time• Streams

• Structured• Unstructured• Semistructured• All the above

VOLUME

VELOCITY VARIETY

3 Vs ofBig Data

How to Identify?

How to Notify? How to Classify?

• Traffic volume• Log volume• Flow volume• Transaction volume

• Bandwidth (bps)• Message per second• Flow per second• Application delay• Application bandwidth

• Voice/Video/Data• Protocol/Port• Application layer


Netka’s Solution for Big Data

netksystem


Product Overview

The carrier-grade network management software provides (FCAPS) Fault Management

Configuration Management Accounting Management Performance Management Security management

for managing multi-vendor IP devices and multi-networking technologies including MPLS, QoS, IP SLA, NetFlow, sFlow, jFlow, cFlow, NBAR, AVC, xDSL, FTTx, wireless technology and site environment

netksystem


Netka SW Framework vs ITU-T M.3010 (TMN)

FaultManagement

SNMP

TELN

ET

ICMP

SYSLO

GSSH

TRAP

FLOW

ConfigurationManagement

AccountingManagement

PerformanceManagement

SecurityManagement

Manage overall business

EventCorrelation

ServiceProvisioning

InventoryManagement

SLA & QoSManagement

Incident/ChangeManagement

Polling Notification

Network Element Layer

Element ManagementLayer (EML)

Network Management Layer (NML)

Service Management Layer (SML)

Business Management Layer (BML)

netksystem


Big Data Pyramid with Network Management

SNMP

TELN

ET

ICMP

SYSLO

GSSH

TRAP

FLOW

Element Management Layer

Network Management Layer

Service Management Layer

Network Element Layer

Data(Polling, Logging, Flow)

Raw

Information(Parsing, Storing, Filtering, Ordering)

Meaning

Knowledge(Correlate, Analysis)

Context

Wisdom(Alert, Control)

Applied

Data Volume

netksystem


Product Line up

• Optional Modules– Customer Module– MPLS Module (Cisco)– QoS Module (Cisco, Juniper, Extreme)– IP SLA Module– OID Monitoring Module– NetFlow Module– NetFlow Customer Module– Alert & Escalation Module– Working Hour Report Module– Visio Diagram Module– Google Map Module– Cisco ACS Module– Accedian NID Module– Wireless AP Module– DSLAM Module– DB Management Module– PON Module– Web Service Module– Site Environment Module– CORBA Module– Mobile Application Module– Dashboard Module – Responsive

Executive View– Self Service Portal Module– System Health Check & Failover Module

Enterprise Edition

Professional Edition

Standard Edition

netksystem


Key Features

Fault Management

• Network Discovery• L3/L2 Network Diagram• Visio Network Diagram• Google Map Diagram• Syslog/SNMP Trap Server

ConfigurationManagement

AccountingManagement

PerformanceManagement

SecurityManagement

• Event Viewer• Event Filtering• Event Suppression• Event Correlation/RCA• Automatic Event Clearing

• Event Holding• Event Journal (Ticket)• Alert (Email, SMS, Sound)• Site Environment (power,

fan, temperature, humidity)

• Config Backup/View• Config Compare• Config Search• Config Deployment• Config Restoration

• Inventory (equipment, port)• VLAN Port Provisioning• VLAN Path Provisioning• ACL Provisioning• QoS Provisioning

• IP SLA Provisioning• MPLS VPN/TE Tunnel

Provisioning• Broadband Service

Provisioning

• Application & Network Analytics

• Flow Analysis (NetFlow, sFlow, jFlow, cFlow)

• NBAR

• CSACS TACACS+ Accounting

• CSACS RADIUS Accounting

• CPU/Memory Utilization• Interface Traffic• Interface Error/Discard• Interface Unicast Packet• Interface Multicast Packet

• Interface Broadcast Packet• Response Time/Packet Loss• Latency/Jitter• MOS/ICPIF• Power Loss, Tx/Rx Power

• Firewall Connection• QoS Class Traffic• DSL Line Statistic• FTTH Line Statistic• Site Environment Statistic

• Network Address Translation Statistic (NAT)

• CSACS AAA Log• Firewall Log• Denial of Service (DOS)

Detection & Alert

netksystem


Netka‘s Key Features for Big Data Management

Event Management

Data Visualization (Dashboards)

Application & Network Analytics

Network Diagram

netksystem


Network Diagram

Network diagram displays current network status and the highest alarm severity of each network device. User can drill-down to see alarm detail and performance statistic reports.

netksystem


Network Diagram

Network diagram displays current network status and the highest alarm severity of each network device. User can drill-down to see alarm detail and performance statistic reports.

netksystem


Event Management

“Event Management is the process that monitors all events that occur through the IT Infrastructure to allow for normal

operation and also to detect and escalate exception conditions.” … by ITIL

SNMP

ICMP

SYSLO

G

TRAP

Notification Polling

Logging Correlation Trigger

Suppression

Root Cause

Analysis

Event View

Filtering Action

netksystem


Event Management - Event Correlation

Correlate both WAN links which direct to same site were down and display useful message to user.

netksystem


Event Management - Event Trigger (open case)

Event which effect with service can be opened as trouble ticket automatically according to predefined rule. This will minimize down time and service interruption to user or customer.

Because when trouble ticket was opened, there will be responsible officer to response and solve the ticket as agreed SLA otherwise system will alert and escalate to their boss.

With good service desk, user can find workaround solution or resolution from knowledge base to fix the same problem which will minimize down time.

netksystem



EventDetected

Identify Status

Technician or Engineer

nks_r3725_01 interface se0/2 down

Solving by Trial & Error

EventDetected

Identify Status

nks_r3725_01 interface se0/2 up

Receiving Alert

Receiving AlertHow long? Report?

Knowledge?

Who doing?

netksystem



EventDetected

Identify Status

Open Case

AgentTechnician or Engineer

Problem & Knowledge Managemen

t

Verify

Consult

Assign

Consult

nks_r3725_01 interface se0/2 down

Solving with Knowledge

EventDetected

Identify Status

Case Close

nks_r3725_01 interface se0/2 up

Verify and Approve

Inform

Update Update

Shorten Time

Under SLA

netksystem


Dashboards - Top N

netksystem


Dashboards - Network Status Map

netksystem


Dashboards - Network CPU Map

netksystem


Dashboards - Inventory Map

netksystem


Dashboards - Capacity Map

netksystem


Application Visibility and Control (Cisco AVC)

Source: http://www.cisco.com

netksystem




netksystem




netksystem




netksystem




netksystem




netksystem


NetkaView Application & Network Analytics

netksystem


NetkaView Application & Network Analytics


Quality

NetkaView Network Manager

netksystem


Awards

The Best of Network Software, FRIT Award 2010

The Best of Telecom Application, TRIDI Telecom Innovation Award 2010

The best of Application & Infrastructure Tools

Thailand ICT Awards 2011

The best of Tools & Infrastructure Application

Asia Pacific ICT Alliance Awards 2011


Q & A

Technology

Big data the way to success in network management