Embed Size (px)
Citation preview
Continuous Integration
SaaS vs Jenkins in cloud
Why I should prefer on premise Jenkins
vs SaaS like Travis or CircleCI?
What is Jenkins?
Jenkins is a famous cross-platform,
continuous integration and continuous delivery
application
cross platform
support SCM tools
released under MIT license
Java based (war file)
job execution monitoring
reports, notifications
rich of plugins(Docker, Github, Slack, Build Pipeline)
hooks, triggers, conditionals
Let’s talk about $$$
170 US$
130 US$
Travis Startup AWS c4.xlarge
costs estimated on demand c4.xlarge up for 24h/day
I have also to configure and maintain Jenkins…
switch on/off every day???!!
Waste
Boring
Stressful
AWS CLI + CRONJOBS
!/bin/bash
EC2_ID=i-abcdefgh EIP=52.*.*.*. IAM=ideato_jenkins
aws ec2 start-instances --instance-ids ${EC2_ID} profile ${IAM}
aws ec2 associate-address --instance-id ${EC2_ID} --public-ip ${EIP} --profile ${IAM} exit 0
jenkins_on.sh
!/bin/bash
EC2_ID=i-abcdefgh IAM=ideato_jenkins
aws ec2 stop-instances --instance-ids ${EC2_ID} —profile ${IAM}
exit 0
jenkins_off.sh
Let’s talk again about $$$
54 US$
130 US$
Travis Startup AWS c4.xlarge
costs estimated on demand c4.xlarge up for 8h/day
Save more money?
Put your Jenkins on Reserved Instances
Reserved Instances capacity reservation for one or three years inside an AZ
help AWS on capacity planning
hourly billing rate lower
Reserved Instances
switch AZ within the same region
Change the instance size within the same instance type
not just EC2
billing mechanism
Reserved Instances reservation cannot be refundable
applied to a single instance types
restricted inside a region
Reserved Instances
all upfront 3y save up 70%
all upfront 1y save up 30%
Let’s talk again about $$$
34 US$
130 US$
Travis Startup AWS c4.xlarge
costs estimated on reserved 1y upfront c4.xlarge up for 8h/day
Ok but….
different stacks?!• OS (Debian vs RedHat) • PHP(5.x), Java, Python • Elasticsearch(0.9->1.7) • Mongo • MySQL,PostgreSQL
On Travis I just have to edit.travis.yaml
~= Python virtualenv
not suited for CI system
one virtualenv active at once
Containers history
1979 - chroot
unix syscall to change root directory
of a process to a new location only visible by that process
Containers history
2007 - cgroups
used for limiting, isolating and accounting
defining CPU, RAM, I/O
Containers history
2008 - LXC
first implementation of Linux containers with several features:
cgroups, namespace, CAP, API bindings on Ruby,Python..
Containers history
2013 - Docker
it’s a container
technology
was LXC
isolation
encapsulation
portability
was LXC now runc
(Open Container Initiative)
difference between VM &
Docker??
Containers vs VMs
AUFSAdvanced Unification FileSystem
Layered FS
Copy on Write
enable Docker Image layers
Docker Images
read only layer
used to be containers
composed by layers
Our Docker Images
Our Docker ImagesFROM ubuntu:trustyRUN apt-get install -yq \
software-properties-common \ python-software-properties \ git \ vim \ wget \ curl
Our Docker Images
Our Docker ImagesFROM ideato/trustyENV DEBIAN_FRONTEND noninteractiveRUN add-apt-repository -y ppa:ondrej/php5RUN apt-get install -yq --no-install-recommends \
php5 \ php5-cli \ php5-common \ php5-dev \ php5-gd \ php5-curl \ php5-mcrypt \ libapache2-mod-php5
Our Docker Images
Our Docker Images
FROM ideato/trusty_php:5.5RUN apt-get install -yq mysql-server-5.5RUN wget https://phar.phpunit.de/phpunit.pharRUN chmod +x phpunit.phar RUN mv phpunit.phar /usr/local/bin/phpunit
Workflow…
projects should have their Dockerfile
Workflow..
these Dockerfiles should be built on top of CI Images
Our Docker Images
Example ProjectFROM ideato/trusty_php_CI:5.5ENV DB defaultRUN apt-get install -yq \
npm \openjdk-7-jre \openjdk-7-jdk \nodejs
RUN wget https://download.elastic.co/elasticsearch/elasticsearch/elasticsearch-1.7.3.debRUN dpkg -i elasticsearch-1.7.3.debADD bin/run_tests /ENTRYPOINT [“./bin/run_tests”]
Example Project #!/bin/bashcd /exampleproj/workspaceservice mysql startservice elasticsearch startbin/idx build
Our Jenkins
web hook
Our Jenkins
web hook
docker build -q -t ideato:exampleproj -f Dockerfile .
Our Jenkins
web hook
docker build -q -t ideato:exampleproj -f Dockerfile .
docker run --rm=true -v $WORKSPACE:/example_project -t ideato:exampleproj
Our Jenkins
web hook
docker build -q -t ideato:exampleproj -f Dockerfile .
docker run --rm=true -v $WORKSPACE:/example_project -t ideato:exampleproj
channel notification
Resuming….
1 day for Jenkins setup ~ 280$
(one time cost) +
AWS c4.xlarge 34$ x 12 ~ 600$ vs
TravisCI Startup Plan 130€ x 12 = 1560$
oh wait…
~ 1/3 build time than Travis
in the next few months…
built in support for delivery pipelines
pipeline as code
Jenkinsfile!!!
better UX on pipeline
finally batteries included
fully backward compatible
try it !docker pull jenkinsci/
jenkins:2.0-alpha-3
what else?
on dev we are using OSX + Vagrant + Ansible
and no Docker atm
why?
Add more complexity to FE devs
customers won’t pay to migrate old projects
no native support until now…
https://blog.docker.com/2016/03/docker-for-mac-windows-beta/
no more VirtualBox, native hypervisor support
Mac -> xhyve Windows -> HyperV
on Mac, Docker Engine will run inside a Alpine Linux
on top of xhyve
native Windows/Mac app
on OSX….
volume mounting for code/data
with auto update on file changes
(GIT, Sublime,PhpStorm)
tools integrated inside Docker Toolbox
Docker Engine, Docker Compose, Kitematic
LinksJenkinsCI Jenkins 2.0 AWS Reserved Instances Docker Docker on OSX & Windows
Thanks!
Questions ??
