Cloud_Computing_Openstack_discussion_2014-05 -VNG

8/12/2019 Cloud_Computing_Openstack_discussion_2014-05 -VNG

1/48

Cloud ComputingOpenStackVNG Infrastructure platform

Tran Anh Nhan

IRD department headPham Tran Kim Chi Lead System Engineer

May 2014


2/48

Cloud Computing - OpenStack - VNG - IRD

Agenda

VNG - IRD What is Cloud Computing?

OpenStack Architecture

OpenStack Networking

Deployment Model

Ceilometer


3/48


New Section

VNG Corp introduction


4/48


VNG Corporation

Game publisher/developer (VLTK, VLCM,Gunny, Boom, Khu vuon tren may,ZingPlay )

Online music/media (ZingMP3, ZingTV) Social network (Zing Me, Zalo)

E-commerce (123mua.vn, 123pay.vn)


5/48


IRD DepartmentResearch and build the infrastructure platform forVNG to enhance business, optimize quality and cost,meet the new technology. Content Delivery Network (CDN) system is used

by all VNG products that want to optimize static

bandwidth. Live-streaming system is a streaming platform for

Zing events, Talk TV. OpenStack provides servers and networks for

some products with a small scale (in pilot phase.Project Team is receiving feedback for furtherenhancement).

Object storage (in POC phase).


6/48


New Section

What is Cloud Computing?


7/48


References

Gartner Synergy research

The National Institute of Standards and

Technology (NIST) Cloud computing today

451 Research


8/48


Number & trend


9/48


Number & trend


10/48


What is Cloud computing?


11/48


12/48


What is Cloud computing?


13/48


Cloud Services


14/48


Cloud Services

AWS #1 of cloud services provider - What services

AWS provide? Amazon Web Services (AWS) continues to dominate

the IaaS and PaaS space in terms of revenue. AWS:3.8$B revenue (2013)

Compute & Networking (Amazon EC2, Auto Scaling,

Elastic Load Balancing, Route 53 ,..) Storage & CDN (Amazon S3, Amazon Glacier a low

cost storage for backup, Amazon EBS, CloudFront/CDN)

DB Cache: RDS (MySQL, Oracle, SQL Server, and

PostgreSQL), DynamoDB (NoSQL data store),ElastiCache (In-Memory Caching Service), Redshift(Data Warehouse Service)

Application services: Elastic Transcoder,..


15/48


Cloud Orchestration Framework


16/48


17/48


History

OpenStack is an open source IaaSinitiative for managing and creating hugegroups of virtual private servers in a cloud

computing environment. It was initiallydeveloped by Rackspaceand NASA.


18/48



19/48


Nowadays


20/48


Servers Storage

Network switch Network switch Network switch

Virtualization Solution (VMWare VCenter,Citrix XEN Server, Ovirt, Proxmox.)

Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)


21/48


Cloud Infrastructure

Modular architecture Designed to easily scale out

Based on set of core services


22/48


OpenStack Platform

Servers Storage

Network switch Network switch Network switch

Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)


23/48


Infrastructure As A Service Overview


24/48


Infrastructure As A Service roles

Cloud Ops: monitor/add/remove physicalcompute nodes, storage nodes, controllernodes, network nodes.

App Owner: add/remove/upgrade cloud

services, check billing status. Dev Ops: launch/ terminate/ scale instances,

storage. Register/ unregister new image.Backup/ restore instances/ storage. These

tasks can be done via dashboard or API. App Devs: call the dev ops tasks inside

application logical flow.


25/48




26/48



On-Demand Self-Services

Resource

pooling

Broad

Network

Access

Mesearued

services


27/48



Hypervisor

Server

Storage Network

Nova compute Cinder Neutron


28/48



29/48


New SectionOpenStack Networking


30/48



management network


31/48


Network Node Compute Node

phy-br-

em2

phy-br-

em2

em1: 172.16.0.2 em1: 172.16.0.3

em2: no ip address

em2: no ip address

Nova API

ovs/ br-int

dnsmasq

dchp agentIP name space

Nova Compute

tap-xx

qvo-xx

int-br-em2

tap-xx qvb-xx

Linux bridgeqbr-xxxxx

Instance

eth0

ovs/ br-int

qvo-xx

int-br-em2

veth

Neutron API0.0.0.0:9696

dedicated physical VLAN for neutron traffic between nodes

neutron ovs plugin

veth


32/48



33/48


New SectionDeployment Model


34/48


CinderAPI

COROSYNC + HAProxy

Controller 01 Controller 02

RabbitMQ

Keystone

GlanceAPI

NovaAPI

PACEMAKER

Compute node 1

Compute node n

Ceph node 1

Ceph node n

QEMU

Driver

Ceph node 2Compute node 2

RBD Driver


35/48



Neutron Server

Switch InterfaceDriver

Physical switch

Controller Node

OVS Plugin

OVS Plugin

Openvswitch

Instances

Compute Node

Neutron OVS agent

DHCP

InstancesInstances

OVS Plugin

Openvswitch

Instances

Compute Node

Neutron OVS agent

InstancesInstances

L3 Agent DHCP L3 Agent


36/48


Feature

Launch instance

Snapshot/ restore instance

Attach device to instance

Snapshot/ restore attach device Scale up instance

Internal network for instances

Provide instances with VLAN as productrequires.

Instances are stored totally in Ceph Storage.


37/48


DEMO


38/48


New SectionCeilometer


39/48


40/48


Monitoring

Monitor physical host by cacti, graphite,zabbix.

Monitor instances status by ceilometer.

Monitor OpenStack statistics byceilometer.


41/48


Ceilometer

Objectives Ceilometer component

Ceilometer collect data

Access collected data


42/48

Objectives

Provide a infrastructure to collectany information in OPS.

Publish information for other

monitoring. Integrate with Heat for trigger auto

scale.

Celiometer - OpenStack - VNG - IRD


43/48

Ceilometer collect data

Bus listener Polling agent

Push agents



44/48


45/48


Process meter


46/48

Access collected data

Via API Via Ceilometer command



47/48


DEMO


48/48

Q & A

Documents

Cloud_Computing_Openstack_discussion_2014-05 -VNG