44
Configuration management and #monitoringlove #devops #monitoringlove #opschef #dadops @ulfmansson the #swedishchef

Configuration management and #monitoringlove

Embed Size (px)

DESCRIPTION

I will tell a story about how we changed from our old monitoring monolith to monitoring based on Sensu and friends driven by configuration management, how #monitoringsucks become #monitoringlove for us. Monitoring in virtual environments like the cloud has changed the way how monitoring solution needs to work and look like. The configuration of monitoring needs to be driven by configuration management and not by discovering or manually processes via UIs. The monitoring solutions needs to be flexible, scalable and easy to configure. I will tell how we have done at Recorded Future to implement a state-of-the-art solution based on Sensu, RabbitMQ, Redis, Graphite, collectd, mcollective, etc driven by Chef.

Citation preview

Page 1: Configuration management and #monitoringlove

Configuration management and #monitoringlove

#devops

#monitoringlove

#opschef

#dadops

@ulfmansson the #swedishchef

Page 2: Configuration management and #monitoringlove
Page 3: Configuration management and #monitoringlove
Page 4: Configuration management and #monitoringlove
Page 5: Configuration management and #monitoringlove
Page 6: Configuration management and #monitoringlove
Page 7: Configuration management and #monitoringlove
Page 8: Configuration management and #monitoringlove
Page 9: Configuration management and #monitoringlove
Page 10: Configuration management and #monitoringlove
Page 11: Configuration management and #monitoringlove
Page 12: Configuration management and #monitoringlove
Page 13: Configuration management and #monitoringlove
Page 14: Configuration management and #monitoringlove
Page 15: Configuration management and #monitoringlove
Page 16: Configuration management and #monitoringlove
Page 17: Configuration management and #monitoringlove
Page 18: Configuration management and #monitoringlove
Page 19: Configuration management and #monitoringlove
Page 20: Configuration management and #monitoringlove
Page 21: Configuration management and #monitoringlove
Page 22: Configuration management and #monitoringlove
Page 23: Configuration management and #monitoringlove
Page 24: Configuration management and #monitoringlove
Page 25: Configuration management and #monitoringlove
Page 26: Configuration management and #monitoringlove
Page 27: Configuration management and #monitoringlove
Page 28: Configuration management and #monitoringlove
Page 29: Configuration management and #monitoringlove
Page 30: Configuration management and #monitoringlove
Page 31: Configuration management and #monitoringlove
Page 32: Configuration management and #monitoringlove
Page 33: Configuration management and #monitoringlove
Page 34: Configuration management and #monitoringlove
Page 35: Configuration management and #monitoringlove
Page 36: Configuration management and #monitoringlove
Page 37: Configuration management and #monitoringlove
Page 38: Configuration management and #monitoringlove
Page 39: Configuration management and #monitoringlove

Some example from Monigusto – monitoring up by @patrickdebois

git clone https://github.com/monigusto/vagrant­monigusto.git

Page 40: Configuration management and #monitoringlove

Handler config

sensu_handler "default" do

  type "set"

  handlers [ "pagerduty", “mail” ]

end

sensu_handler "pagerduty" do

  type "pipe"

  command "pagerduty.rb"

  severities ["ok", "critical"]

end

Page 41: Configuration management and #monitoringlove

Creating a check

sensu_check "redis_process" do

  command "check­procs.rb ­p redis­server ­C 1"

  handlers ["default"]

  subscribers ["redis"]

  interval 30

  additional(:notification => "Redis is not running")

end

Page 42: Configuration management and #monitoringlove

Sensu admin (state, db)

Page 43: Configuration management and #monitoringlove

Questions?

Community Track – Bayview B

The Sensu team (- Sean Porter)

Page 44: Configuration management and #monitoringlove

Sensu-dashboard (stateless, no db)