2002 Called; They want their rrdtool shell scripts back
Dave Josephsen
[email protected]
2002 Called; They want their rrdtool shell scripts back
A Brief history of time-series data visualization
architectectures
Dave Josephsen
[email protected]
2002 Called; They want their rrdtool shell scripts backA Brief
history of time-series data visualization Architectures
A Tale of 3 Sysadmin
Dave Josephsen
[email protected]
Jer, Per, and quitter (aka Dave)
Jer, traditional needs for Fortune-500
Suitcorp>5000 hosts
>20,000 services
1, 9-story office building
Plenty of BudgetBeefy Hardware
1.5m/1000 hosts
Nagios + NG + Drraw (ho-hum)
Per, near real-time data from Lots of hosts
Singularity.gov80,000 hosts in 80 clusters
No budget
Mad ScientistsNo measurable impact allowed
15 second polling interval (max)CPU, Mem, Disk, Net
Needs to alert on performance thresholds
Enter Ganglia
That's all fine but what about Nagios?
Awesome Nagios IntegrationEasily send data from Nagios to
Ganglia with gmetric
Monitor server metrics stored in Ganglia with Nagios with a
series of included Nagios plug-insCheck host heartbeat
Check single metric on a specific host
Check multiple metrics on a specific host
Check multiple metrics on a set of hosts
Verify a single metric is the same on a set of hosts
Display Ganglia graphs in Nagios via the Gweb URL interface
Monitor Ganglia with Nagios (duh)
Not just for mad scientists with supercomputers
Ganglia is a great fit ifYou want to offload Performance data
processing.You're worried about scale
You want a super-lightweight metric gathering agent
You need near-real time data
You want a really great rrdtool FEDrag scaling, trend-lines,
holt-winters forecasting, time-shifts
Lots more
Quitter.. er.. Dave: Graph everything always
Massive GinormicDevOps paradise (nightmare)
Visualize datapoints on irregular intervalsCode promotions
Function calls
LOTS of metrics (millions)
Centralized time-series visualization for LOTS of very different
data sourcesNagios
Application instrumentation
Sales... thingies
Enter Graphite
Graphic Stolen from:
http://www.aosabook.org/en/graphite.html
Life after RRDToolCarbonTrivial, remote, updates
Smart buffering/cacheing
Horizontal scalability
WhisperAutomatic provisioning
Interval-agnosticism
Type agnosticism
GraphiteFunctions!
Typeglobs!
Not just for billion dollar mega-giants
Graphite works great ifYou want to combine data from multiple
monitoring systemsNagios, Ganglia, Collectd etc..
You want to assimilate data from other groups or business
unitsDev, Sales, etc..
You want really flexible centralized visualization that
scales
You want to empower non-ops groups to explore their own data
Functions!
Say you have counter data:
&target=router1.bytes&target=router2.bytes
OR: &target=router[12].bytes
Rate is the derivative of the counter:
&target=derive(router1.bytes)
But actually, the raw counter data is kind of interesting if We
visualize it correctly:
&target=router1.bytes&target=secondYAxis(router2.bytes)
Moar functions!
&target=summarize(user.registrations,1h)
&target=user.registrations
&target=summarize(user.registrations,1h)
&target=summarize(user.registrations,1h)&target=threshold(400,goal)
&target=summarize(user.registrations,1h)&target=timeShift(summarize(user.registrations,1h),30d)&target=threshold(400,goal)
OK BYE!
(and speaking of buy...)
http://www.aosabook.org/en/graphite.html
http://ganglia.sourceforge.net
https://launchpad.net/graphite
Click to edit the outline text format
Second Outline Level
Third Outline Level
Fourth Outline Level
Fifth Outline Level
Sixth Outline Level
Seventh Outline Level
Eighth Outline Level
Ninth Outline Level
Click to edit the title text format
2012
Click to edit the title text format
Click to edit the outline text formatSecond Outline LevelThird
Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline
LevelSeventh Outline LevelEighth Outline LevelNinth Outline
Level
