Deployment orchestration

;

Deployment orchestrationJan Collijs

February 2, 2015

;

IntroductionBackground

Configuration managementOrchestration

Questions

Table of contents

1 Introductionwhoami

2 Backgroundprojectversioningcontinuous integrationpackagingrepository management

3 Configuration managementpuppetpuppetdb

4 Orchestrationansibleautomationonline-material

5 Questions

Jan Collijs Deployment orchestration

;



Questions

whoami

Profile

SysadminLinux & Open-Source enthusiastConsultant for inuits.eu

@visibilityspots


https://inuits.eu

https://twitter.com/visibilityspots

;



Questions

projectversioningcontinuous integrationpackagingrepository management

University library of Ghent

• 5 developers• devops integration• New website• 2 environments: dev/prod


;



Questions


Versioning

• Software code is based into a repository• History of changes is available• Collaboration• Hooks• Many tools available (git, redmine, gitlab, chili project, . . . )


;



Questions


Jenkins

• Automation tool• Triggered by hooks• Custom scripts


;



Questions


Jenkins flow example


;



Questions


fpm/rpmbuild

• fpm• spec file• rpmbuild


https://github.com/jordansissel/fpm

http://www.rpm.org/max-rpm/s1-rpm-build-creating-spec-file.html

http://www.rpm.org/max-rpm-snapshot/rpmbuild.8.html

;



Questions


Yum-repo-server

• Repository management• One repository per environment (dev/prod)• Only used for own software• Vagrant setup


https://github.com/visibilityspots/vagrant-yum-repo-server

;



Questions

puppetpuppetdb

Puppet

• Configures ALL servers and services• Hiera• Roles & profiles• Custom module for every piece of software• Cron based runs


;



Questions

puppetpuppetdb

Puppetdb

• Consists puppet data (postgresql DB)• Query API (experimental v4)


;



Questions

puppetpuppetdb

Query puppetdb

# Look up the nodes which have the given resource type and name declaredfor NODE in $(curl --silent -G https://PUPPETDB_HOST:PUPPETDB_PORT/v4/ \environments/ENVIRONMENT/resources/TYPE/RESOURCENAME | grep certname | \awk -F ’:’ ’{print $2 }’ | cut -d ’‘‘’ -f2)

donodes=(’’${nodes[@]}" $NODE)

done


;



Questions

ansibleautomationonline-material

Ansible

• Based on ssh• No agent on the servers• User on the clients with public key and sudo rights


;



Questions


Dynamic inventory script

• Static inventory• Dynamic inventory(https://github.com/visibilityspots/ansible-puppet-inventory)

• Pypuppetdb lib(https://github.com/puppet-community/pypuppetdb/pull/34)

• Dynamic inventory ansible core(https://github.com/ansible/ansible/pull/9593)


https://github.com/visibilityspots/ansible-puppet-inventory

https://github.com/puppet-community/pypuppetdb/pull/34

https://github.com/ansible/ansible/pull/9593

;



Questions


Deploy puppet run

• Jenkins• puppet-check script (https://github.com/visibilityspots/ci-scripts/blob/master/puppet/puppet-check.sh)


https://github.com/visibilityspots/ci-scripts/blob/master/puppet/puppet-check.sh

https://github.com/visibilityspots/ci-scripts/blob/master/puppet/puppet-check.sh

;



Questions


Code

for NODE in "${nodes[@]}"do

echo "Process $NODE:"echo ""ansible $NODE -a "puppet agent --test" --sudo;echo "======================================="

done


;



Questions


Console output


;



Questions


online material

• http://visibilityspots.com/ansible-orchestration.html• https://github.com/visibilityspots/ansible-puppet-inventory• https://github.com/visibilityspots/ci-scripts


http://visibilityspots.com/ansible-orchestration.html

https://github.com/visibilityspots/ansible-puppet-inventory

https://github.com/visibilityspots/ci-scripts

;



Questions

Questions


Technology

Deployment orchestration