http://www.grnet.gr

GRNET NOC network monitoring &

visualization tools

TF-NOCZurich

Alex Kosiaris (alex@noc.grnet.gr)Leonidas Poulopoulos (leopoul@noc.grnet.gr)

Network monitoring• Constant monitoring of network for components

• Failing• Malfunctioning

• Notification of users via mail, sms, web interface• Monitoring aids in

• Preventing or limiting downtime• Effectively tracing errors and coping with them• Translating from machine errors to user friendly ones• Keeping performance, errors and faults archive

TF-NOC, Zurich 2GRNET NOC network monitoring & visualization tools

TF-NOC, Zurich 3GRNET NOC network monitoring & visualization tools

Visualization• Network Topology

• Clearer view of network topology• Easier reading of links and relations

• Services• Better anticipation of service deployment• Effective and appealing “marketing”

• Any network related set of data• Traffic, Errors, Service requests

• Charts, Maps, Graphs, Tables

Tools• What we do

70% of the tools is developed in-house

Python/Django: 70%, PHP: 30%

Use SNMP (99%) to harvest network data

Release updates every 2-3 months

Use a MySQL database to bind data

Avoid live SNMP queries to devices

• Tool Requirements Developed (if possible) in-house

… using the same (if-possible)development framework

…with a widely deployed and accepted network mgmt middleware

Maintained in-house

Bound together – using a common data source

With the least possible overhead to the network devices, services

TF-NOC, Zurich 4GRNET NOC network monitoring & visualization tools

• In-house grnetdb (~150 tables) MySQL

Topology, devices features discovery: SNMP, PHP, custom RDBMS layer (4 times/day)

Visualization: Google Maps API, Djangoframework, DOJO JS framework, JSON data serialization

Graphs: Django framework, jquery, rrd

Monitoring: Nagios with data feed from grnetdb

• NMS & Monitoring Alcatel & Adva NMS

HP OV

Nagios, Munin, mrtg/rrd

Tools (2)

TF-NOC, Zurich 5GRNET NOC network monitoring & visualization tools

Architecture

GRNET

grnetdbMySQL

PHP SNMP getters

Network discovery core functionality

GRNET RDBMS

DJA

NG

O f

ram

ewo

rk

Device Graphs

Network Topology

Hostmaster

H/W Inventory

L1 topology builder

Widgets

Nagios

Rancid

Ticketing (Jira)

CLI check scripts

TF-NOC, Zurich 6GRNET NOC network monitoring & visualization tools

Device Graphs•http://mon.grnet.gr/rg

•Django (Python) templates - backend

•jQuery & jQuery UI

•Mobile flavour (jQuery mobile)

•Network device configuration retrieved from grnetdb

•Poll devices using a smart algorithm (minimize overhead)

•RRD graphs (rrdtool Python)

•Minor administrative interference

•Devices and ifces discovered by PHP SNMP script automatically

•Device graph types determined automatically

•Personalization

•Custom search engine

•Version releases every 2-3 months

•Not open sourced yet

• Abstraction layer has to be implemented

• Rewrite parts of code – get rid of GRNET-specific parts

TF-NOC, Zurich 7GRNET NOC network monitoring & visualization tools

Device Graphs (2)

Mobile flavor will be soon released

TF-NOC, Zurich 8GRNET NOC network monitoring & visualization tools

9GRNET NOC network monitoring & visualization tools

TF-NOC, Zurich

• http://mon.grnet.gr/network/maps/

Google Maps API v2 (soon to be ported to v3)

Django Framework

DOJO Javascript Framework

Data serialized to JSON and fed to API

Topology (L1, L2, L3)

Network weathermap (live data from rrd files)

Points of presence – GRNET clients

Lightweight edition eases integration with other apps

Network Topology

10GRNET NOC network monitoring &

visualization toolsTF-NOC, Zurich

Network Topology (2)

TF-NOC, Zurich 11GRNET NOC network monitoring & visualization tools

Alarming

• Nagios based

Common Infrastructure

• Network – Django Python tool to query grnetdb and generate

configuration

• Servers/Services– Populated through automation tool Puppet

An effort to maximize SNR

• Notifications go to interested parties only

• Web interface supports authorization so only relevant information is available

Plans for Load Balancing/HA setup

TF-NOC, Zurich 12GRNET NOC network monitoring & visualization tools

Alarming (2)

• Visualization

Standard interface not topology aware

• Hates circular (aka rendundant) links

• Nagios map cgi ugly

• Information decimation difficult

Nagvis to the rescue

• Supports multiple maps

• Maps web editable

• Visual and audible alarming

• Still a work in progress

TF-NOC, Zurich 13GRNET NOC network monitoring & visualization tools

Alarming (3)

Thank you

TF-NOC, Zurich GRNET NOC network monitoring & visualization tools

14

Questions ?