Code but not as we know it - Infrastructure as code

Infrastructure as Code Patrick Deboishttp://www.tumblr.com/tagged/star-trek-quotes

Wednesday 17 October 12

Blog: http://jedi.be/blog - Twitter : @patrickdebois - #devops

Technical ReviewerMonitoring Chapter Co-Author Veewee / Sahara / Mccloud

Organizer Since 2009 Europe Organizer 2010

Engineer

First Europe Training 2010

Libvirt - Fog

Speaker

Freelance consultant http://github.com/jedi4ever

CONFIGURATION MANAGEMENT SYSTEMS

http://ansible.cc/

http://opscode.com/chef/

http://cfengine.com/http://palletops.com/http://puppetlabs.com/

http://www.nerdnirvana.org/wp-content/uploads/2010/12/apology-form.jpg

Chef & Puppet focusedbased on my experience

GIVE ME THE CODE:“LANGUAGE”

Puppet Chef

class myapache {

package “apache2”

service “apache2”: ensure => “running”, require => Package[“apache2”]

package “apache2”

service “apache2 do action [:enable , :start]end

EXAMPLE SYNTAX

TERMINOLOGY

Java Puppet Chef

*.javamanifests

*.pprecipes

package module cookbook

TERMINOLOGY (2)

Java Puppet Chef

singletonparametrized

classesrecipes with attributes

classdefines, classes

definitions, libraries

SYNTAXPuppet Chef

Limited DSL(by design) DSL + full ruby

Extended by Definitions

Light Weight Resource Providers /

DefinitionsCustom Resource providers

Providers, Light Weight Resource

ProvidersERB & Custom Libraries Libraries

LOOPING CONSTRUCTS

Puppet Chef

pass array of elementserb template for loops

create_resource (:type, hash)

do while , repeat etc. available through

native ruby

VARIABLES

Puppet Chef

special syntax$bla = “aa”

string interpolation$bla_string = “${bla}”

native rubybla = “aa”

string interpolationbla_string = #{bla}

SINGLE CLASSINHERITANCE

Puppet Chef

override via ‘module path’

override via ‘cookbook’ path

+> operator “cookbook” attribute

Puppet Module Chef Cookbook

files/lib/

README.rdocmanifests/templates/

attributes/definitions/files/libraries/metadata.rbproviders/README.rdocrecipes/resources/templates/

PROJECT STRUCTURE

EXECUTION MODEL

Puppet Chef

Compile catalog(directed graph

model)Then Execute

Top Down execution

CODE EDITOR

VIM SYNTAX HIGHLIGHTIING

https://github.com/rodjek/vim-puppethttps://github.com/t9md/vim-chef

https://github.com/vim-scripts/Cfengine-version-3-syntax

http://cloudsmith.github.com/geppetto/https://github.com/cloudsmith/geppetto

GEPPETTO - ECLIPSE IDE

WYSIWYG CODING

REACTOR8

http://beta.r8network.com/Wednesday 17 October 12

https://github.com/rodjek/puppet-pygments-lexerhttp://redmine.djagios.org/projects/puppet-lexer

CODE GENERATION

REVERSE ENGINEERING

https://github.com/devstructure/blueprint

Existing Server -> Manifest/Recipes

DSL ON TOP OF PUPPET~GRAILS

https://github.com/jnewland/shadow_puppetNote: Not vastly used

CODING STYLE

Puppet Chef

http://puppet-lint.com/ http://acrmp.github.com/foodcritic/

• Must use two-space soft tabs.• Must not use literal tab characters.• Must not contain trailing white space.• Should not exceed an 80 character line width

An exception has been made for source => 'puppet://...' lines as splitting these over multiple lines decreases the readability of the manifests.

• Should align arrows (=>) within blocks of attributes.• ....

• FC001: Use strings in preference to symbols to access node attributes• FC002: Avoid string interpolation where not required• FC003: Check whether you are running with chef server before using server-

specific features• FC004: Use a service resource to start and stop services• FC005: Avoid repetition of resource declarations• FC006: Mode should be quoted or fully specified when setting file

permissions• FC007: Ensure recipe dependencies are reflected in cookbook metadata• FC008: Generated cookbook metadata needs updating• FC009: Resource attribute not recognised• FC010: Invalid search syntax• FC011: Missing README in markdown format• FC012: Use Markdown for README rather than RDoc• FC013: Use file_cache_path rather than hard-coding tmp paths•

http://docs.puppetlabs.com/guides/style_guide.htmlhttps://github.com/ampledata/cookbook-style-guide

http://www.slideshare.net/PuppetLabs/modern-module-development-ken-barber-2012-edinburgh-puppet-camp

CODE VS CONFIG(THINK “PROFILES”)

http://wiki.opscode.com/display/chef/Data+Bags

http://projects.puppetlabs.com/projects/hierahttps://github.com/crayfishx/hiera-gpg

“STOP THE FORK(ING)”

https://github.com/jedi4ever/stop-the-forkWednesday 17 October 12

PRE-COMMIT CHECKS

DEPENDENCY MGMT

GitSubmodules

Subtree à la Pom File

UPSTREAM REPOS

http://forge.puppetlabs.com/http://community.opscode.com/

Puppet Chef

https://github.com/rodjek/librarian-puppet

https://github.com/applicationsonline/librarian

http://berkshelf.com/

site "http://community.opscode.com/api/v1"

cookbook "ntp"cookbook "timezone", "0.0.1"

cookbook "rvm", :git => "https://github.com/fnichol/chef-‐rvm", :ref => "v0.7.1"

cookbook "cloudera", :path => "vendor/cookbooks/cloudera-‐cookbook"

CHEF METADATA

http://bitfieldconsulting.com/puppet-dependency-graphs

Puppet Dependency Graphs

http://wham.cloudsmith.comWednesday 17 October 12

DEBUGGING

LOGGING WITH DIFFERENT LEVELS

Info only, no exceptionChef::Log.info('Some useful info')

Fatal, raising exceptionChef::Log.fatal('Something bad')

REPL - STYLE(READ EVAL PRINT)

http://wiki.opscode.com/display/chef/Shefhttps://github.com/pry/pry

https://github.com/vimeo/simple-black-boxWednesday 17 October 12

DEV ENVIRONMENT

http://vagrantup.com/Virtualbox + (Fusion Soon)

https://github.com/jedi4ever/veewee/Virtualbox, Fusion, KVM,Parallels,

https://github.com/rtyler/blimpy

https://github.com/jedi4ever/mccloud/

Vagrant alike

EC2, KVM, FUSION, HOSTS, Vagrant

UNIT TESTING

https://github.com/nistude/cucumber-puppetWednesday 17 October 12

https://github.com/rodjek/rspec-puppet

https://github.com/calavera/rspec-chefhttps://github.com/acrmp/chefspec

MOCKING

https://github.com/customink/fauxhaiWednesday 17 October 12

AUTO-TRIGGER TESTS RUN

https://github.com/guard/guard-chefhttps://github.com/alister/guard-puppet-linthttps://github.com/johnbintz/guard-puppet

https://github.com/guard/guard-rspec

http://www.cucumber-chef.org/

https://github.com/exceedhl/toft

Faster testing via LXC

EC2+LXC

Vagrant+LXCWednesday 17 October 12

CI INTEGRATION

https://github.com/nicksieger/ci_reporterWednesday 17 October 12

https://github.com/rtyler/vagrant-pluginWednesday 17 October 12

https://travis-ci.org/Wednesday 17 October 12

CROSS OS-TESTING

https://github.com/opscode/test-kitchenhttps://github.com/opscode/bento

https://github.com/tknerr/bills-kitchen

Windows

INTEGRATION TESTING(ON REAL MACHINE)

http://auxesis.github.com/cucumber-nagios/Wednesday 17 October 12

RE-USABLE CUCUMBER STEPS

https://github.com/hedgehog/cukenhttps://github.com/cucumber/aruba

http://www.cucumber-chef.org/

https://github.com/calavera/minitest-chef-handlerhttps://github.com/jedi4ever/puppet-assert

Validate “inside” the provision-run cycle

PERFORMANCE/METRICS

https://github.com/rodjek/puppet-profilerWednesday 17 October 12

https://github.com/joemiller/puppet-graphite_eventhttps://github.com/imeyer/chef-handler-graphite

https://github.com/krux/puppet-module-graphite-report

execution timenumber of classes

TARGETED TESTINGIMPACT OF CHANGE

https://github.com/jedi4ever/puppet-cichttps://github.com/jonlives/knife-preflight

Infrastructure as Code Patrick Deboishttp://www.tumblr.com/tagged/star-trek-quotes

http://foodfightshow.org/

http://wiki.opscode.com/display/chef/Whyrun+TestingWednesday 17 October 12

https://github.com/tbatchelli/vmfestWednesday 17 October 12

CACHING - AMI, SNAPSHOTS

https://github.com/lak/puppet-memcachedWednesday 17 October 12

https://github.com/lak/puppet-static-compilerWednesday 17 October 12

http://puppetlabs.com/blog/what-is-user-experience-in-puppet/

AUDITING

http://www.normation.com/en/solutions/rudderhttp://www.fusioninventory.org/

http://comodit.github.com/synapse-agent/Wednesday 17 October 12

http://saltstack.org/Wednesday 17 October 12

https://github.com/tobami/littlechefWednesday 17 October 12

https://github.com/dwt/vagrant-hostsWednesday 17 October 12

https://github.com/opscode/omnibusWednesday 17 October 12

https://github.com/puppetlabs/puppet-module-toolWednesday 17 October 12

http://wiki.opscode.com/display/chef/Recipes#Recipes-ExceptionsandLogging

http://projects.puppetlabs.com/projects/puppet/wiki/Anchor_Pattern

VENDORING

https://github.com/railsmachine/rumpWednesday 17 October 12

http://www.example42.com/?q=Puppi_A_Puppet_module_for_Deployment_AutomationWednesday 17 October 12

PLUGINS

http://wiki.opscode.com/display/chef/Knife+PluginsWednesday 17 October 12

http://puppetlabs.com/blog/puppet-faces-what-the-heck-are-faces/

TESTING

http://rundeck.org/Wednesday 17 October 12

http://www.sonian.com/cloud-monitoring-sensu/Wednesday 17 October 12

http://docs.puppetlabs.com/guides/parameterized_classes.htmlWednesday 17 October 12

INHERITANCE

NAMESPACING

https://github.com/rerun/rerunWednesday 17 October 12

AUTHENTICATION

DASHBOARDS

http://puppetlabs.com/puppet/related-projects/dashboard/Wednesday 17 October 12

http://blog.mornati.net/2012/01/29/kermit-a-webui-for-mcollective/

http://www.opscode.com/hosted-chef/Wednesday 17 October 12

http://theforeman.org/Wednesday 17 October 12

Code but not as we know it - Infrastructure as code

Documents

Patterns for Infrastructure-as-Code

Infrastructure as Code: Final Report · Infrastructure as code (IaC) is a set of practices that use “code (rather than manual ... The infrastructure managed by this code includes

Infrastructure as Code (BBWorld/DevCon13)

Infrastructure as a code

Infrastructure as Code - ABUG Session

Infrastructure as Code with Chef

AS CODE INFRASTRUCTURE - QCon New York · INFRASTRUCTURE AS CODE “Applying software engineering tools and practices to infrastructure”

Infrastructure-as-Code and CI Infrastructure at OpenStack

Infrastructure as Code - Red Hat

IaC Infrastructure as Code

Infrastructure as code for azure

Deep Dive - Infrastructure as Code

Infrastructure as code on Azure with Puppet & Chef · PDF fileInfrastructure as code on Azure with Puppet & Chef 2 Infrastructure as code on Azure ... proceed as we have no ... Infrastructure

Infrastructure as Code - Controlware...infrastructure, safely and predictably” 1 Übersicht Infrastructure as Code 5 Code Syntax und Demo Probleme und Herausforderungen in Multi-Cloud

infrastructure as code - chariotsolutions.comchariotsolutions.com/wp-content/uploads/2016/04/JoeDamato.pdf · infrastructure as code might be impossible because nothing works. code

Infrastructure as codeのススメ

Infrastructure as Code @BuildStuff2013

Project TIMAT - infrastructure as code

Adventures in infrastructure as code

Infrastructure as Code