Hammer of the Sysadmins

Menu de jour

1. Intro2. Problem statement3. Brief therapy4. Used tools5. Live demo6. Autoscaling

Intro

• ~50 servers• 3 teams (customer,dev,ops)• Unpredictable heavy load (req/s and

traffic)• Heterogenous infrastructure (apache,

lighttpd, node-js, solr, redis, percona, mms-rtmpd, LVS, keepalived, etc.)

Heavy load?

Brief therapy

• Consistent configuration• Track all changes• Manage changes

Used tools

• Puppet• Redmine• Git• Bash scripts

Live demo

• http://www.joj.sk• joj-web@bonet.sk• https://redmine.joj.sk

Questions?

peter.mihalik@bonet.sk

…ouch and we are hiring

• job@bonetics.com (for developers)• job@bonet.sk (for sysadmins)

Autoscaling

• Vmware clean system snapshot• Provisioning profile for each node type• Zabbix collecting performance data• Zabbix trigger for new server deployment• 10s of new webservers in 3 minutes at your

service