Deploying the Graph

Infrastructure Coders - Melbourne - November 2013Kevin O’Neill - CTO PlayUp - @kevinoneill

Kevin O’Neill CTO PlayUp

Deploying the Graph

@kevinoneill

November 2013

Kevin O’Neill - CTO PlayUp - @kevinoneill Infrastructure Coders - Melbourne - November 2013





A little History


Engage & Entertain Around Live Sport


Mobile Games


SMS Based


Number of Runs


Complex


Carrier Integration


Smart Phone Revolution


Move from a Content Creator to a Content

Enabler


Top 10 in Engagement


Over 3 Million Likes


30% - 40% Active


Manually Curated


We Know there's an Opportunity


The Graph


Scala


Scala

• A Scalable language

• Object-Oriented

• Functional

• Seamless Java Interoperability

• Functions are Objects


AKKA


AKKA

• Actors

• Fault Tolerance

• Location Transparency

• Transactors


Neo4j


Neo4j

• Graph Database

• Vertices and Edges

• Properties

• Full Text Index


WhiteboardOutlining the bits


Runtime


AWS


AWS

• us-west

• m2.2xlarge

• ubuntu 13.04

• jre 7


JVM


JVM

• Graph - 8G of Heap

• Others 128M - 1G

• Parallel GC


The remaining memory is reserved for file system cache and

memory mapped buffers


Building the Components


SBT


Builds the jars


Debian Packages


Debian Packages

• Places binaries in opt

• Adds an upstart file for the

• Permissions on data and log directories


graph-server.upstart

setuid ubuntu setgid ubuntu !console log !chdir /var/lib/playup/spot/graph-‐server !exec java -‐server -‐Xms4096M -‐Xmx8192M -‐Xss1M \ -‐XX:MaxPermSize=256M -‐XX:+UseParallelGC \ -‐jar /opt/playup/spot/graph-‐server/run.jar \ com.playup.spot.graph.service.NeoKernel


Base configuration is for production


Baking


Packer


Create machine images for multiple platforms from a single config


Images have lots of benefits


Fast Deployment


Stability


Testability


Packer makes creating images a breeze


Example


Builders

"builders": [ { "type": "amazon-‐ebs", "instance_type": "t1.micro", "region": "ap-‐southeast-‐2", "ami_name": "spot-‐graph-‐{{user `version`}}-‐{{timestamp}}", "source_ami": "ami-‐4bf26f71", "ssh_username": "ubuntu", "tags": { "Name": "spot-‐graph-‐{{user `version`}} ({{isotime}})", "OS": "Ubuntu", "Version": "{{user `version`}}-‐{{timestamp}}" }, "ami_regions":["us-‐west-‐2"] } …


Builders



Builders



Builders



Builders



Variables

"variables": { "version": "development" }


Provisioners "provisioners": [ { "script": "scripts/update-‐packages.sh", "type": "shell" }, { "script": "scripts/install-‐puppet.sh", "type": "shell" }, { "type": "file", "source": "packages", "destination": "/tmp" }, { "script": "scripts/install-‐spot-‐packages.sh", "type": "shell" }, { "type": "puppet-‐masterless", "manifest_file": "puppet/spot-‐graph.pp", "module_paths": ["puppet/local", "puppet/common"] }, { "script": "scripts/build-‐date.sh", "type": "shell" }








Builder Provisioners

"provisioners": [ ! … ! { "type": "shell", "script": "scripts/vagrant.sh", "only": ["virtualbox"] }, { "type": "shell", "script": "scripts/guest-‐additions.sh", "only": ["virtualbox"] }, ! …


Build

$ packer build -‐-‐only "amazon-‐ebs" template.json


In a few minutes you have a shiny new image


CI


CI

• Variables

• source ami

• region

• default build is for local development


Starting an instance


Remember


Backed config is for Production*


We have staging plus multiple developer environments


CloudInit


Configure values in /etc/playup/…


Configure the puppet master*


Cloud Formation


Which images


What CloudInit values


Challenges


Too many to list …


Persistant Data


Service Registration


Cluster Membership


Investigating


Docker


Apache Mesos


Come Join Us


Disrupting


Hiring Selectively


Talk to Me or Andrea


You miss 100 percent of the the shots you don't take

– Wayne Gretzky


Kevin O’NeillCTO - PlayUp

[email protected]@kevinoneill

Questions?

mailto:[email protected]

Technology

Deploying the Graph