CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Next generation of virtual infrastructure with Hyper-V

Michal Kwiatek, Juraj Sucik, Rafal Otto

CERN IT-IS

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

What’s your key initiative?

What is your Infrastructure & Operations priority?

HEPiX Spring ’09 - 2

Source: Gartner (September 2008)

„While server virtualization often is deployed initially to save money and space, agility and disaster recovery benefits are also key drivers”

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Agenda

• Why virtual?• Experience since 2006• New Hyper-V infrastructure• What’s next

HEPiX Spring ’09 - 3

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Why virtual?

HEPiX Spring ’09 - 4

• IT/IS Service: NICE Custom Servers https://cern.ch/winservices/Help/?kbid=251010

• Steady flow of requests for dedicated servers in the CERN computer centre Excellent network connectivity Reliable power supply, cooling 24x365 monitoring with operator’s presence Daily tape backup Use the hardware without owning the responsibility

(maintenance, procurement) Operating System maintenance, patches, security

scans Customer can focus on his application Customer not willing to share his server with others,

but ready to pay for the custom service

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Platform as a Service (PaaS)

HEPiX Spring ’09 - 5

Buy and maintain physical hardware

(and computer centre)

Extra effort to procure and maintain HW

Replication of efforts

Security is affected Impossible to

reproduce Computer Centre services

Delivery time:~ several weeks

Lack of flexibility Not easy to adapt

to dynamic load patterns

Ready in 15 minutes

Highly flexible Efficient

capacity planning

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Platform as a Service (PaaS)

HEPiX Spring ’09 - 6

Buy and maintain physical hardware

(and computer centre)

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Experience since 2006

Server Self Service Center (S3C) Choose your server from a set of predefined

images Take resources from the pool of available HW Available within minutes

HEPiX Spring ’09 - 7

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Requirements have evolved

• New requirements identified Flexibility of resource allocation Higher performance High-availability model

adapted to customers

• Larger scale Efficient

management

HEPiX Spring ’09 - 8

Source: Gartner (August 2008)

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

New Hyper-V infrastructure

HEPiX Spring ’09 - 9

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

New Hyper-V infrastructure

HEPiX Spring ’09 - 10

Microsoft Virtual Machine Manager

Windows powershell

SOAP services

Virtual Machine Manager

AdminConsole

CERN Virtual InfrastructureWeb Interface

Backups

OS Maintenance

LAN DB

Application Management

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

CERN Virtual Infrastructure

• Demo

HEPiX Spring ’09 - 11

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

SOAP method calls

1) Request VM

2) Delete VM

3) Start VM

4) Stop VM

5) Save State of VM

6) Import / Export

7) Snapshots

Virtual Machine

Request (Create) / Delete

Import / Export

SnapshotsSave State

Start / Stop

HEPiX Spring ’09 - 12

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Process flows – Create VM

VMPOOLIP60-13

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Real life use cases

• Video streaming for LHC First Beam Day 6 virtual machines needed for ~1 week

• Terminal Servers for Engineering Apps• Oracle Application servers• CERN Media Archive• CERN Alerter web server

Physical server with 2xCPU, 4GB RAM Upgrade necessary because of OS driver

issue Virtual server set up “on demand” Resources limited to 1xCPU, 2 GB RAM

• Etc, etc. HEPiX Spring ’09 - 14

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

What’s next

• IT-IS group Install more hardware to satisfy the demand

• Hypervisor 2.0 in Windows 2008 R2 Enhanced support for Linux Further performance improvements High availability (live migration, failover) Power efficiency (core parking) Easier management Expected later this year, RC1 since May’09

HEPiX Spring ’09 - 15

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Summary

• Easy to use self-service• Service in production since 2006• Latest edition based on Hyper-V

Improved performance Efficient resource allocation Flexibility of hardware provisioning Ease of management

Web interface, SOAP, SCVMM

Integration with IT services Network database, update distribution, backups, etc.

High-availability model adapted to customer requirements

HEPiX Spring ’09 - 16

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Thank you!

HEPiX Spring ’09 - 17

• Questions? Comments?

• Thank you!

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

More info...

• Amazon Cloud pricing• Hardware• Microsoft Virtualization...• ... and its interoperability• Hyper-V scalability• Microsoft Assessment and Planning (MAP)• Hyper-V V2 Features• System Center Virtual Machine Manager • ... and its new features in R2

HEPiX Spring ’09 - 18

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Amazon pricing compared

HEPiX Spring ’09 - 19

WhatUnit price USD

Initial payment USD

CHF per year

CVI equiv CHF

Amazon EC2 Small (1 CPU, 1.7 GB RAM) per hour 0.11 0 1069.596 597

Amazon EC2 Small (1 CPU, 1.7 GB RAM) with 1y lump payment 0.04 325 749.694 597

Amazon EC2 Large (4 CPU, 7.5 GB RAM) per hour 0.44 0 4278.384 2213

Amazon EC2 Large (4 CPU, 7.5 GB RAM) with 1y lump payment 0.16 1300 2998.776 2213

Amazon prices don't include data transfer used - you need to add it on top:

Amazon EC2 100 GB of data per month 0.17 0 226.44 0

Amazon EC2 1TB of data per month 0.17 0 2318.7456 0

Combining CPU, RAM and data transfer:

Amazon EC2 Small (1 CPU, 1.7 GB RAM) with 1y lump payment + 100 GB data 976.134 597Amazon EC2 Large (4 CPU, 7.5 GB RAM) with 1y lump payment + 1TB of data per month 5317.5216 2213

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

Hardware

• Standard configuration 7 Pyramid servers

• single quad-core CPU• 24 GB RAM,

RAID10 with 10 250MB disks 5 HP Proliant DL360 G5

• 2 quad-core CPU• 32GB RAM• RAID10 with 4 399GB SAS disks

• HA configuration 2 HP Proliants HP MSA2000i SAN

• RAID6 with 10 750 GB disks

HEPiX Spring ’09 - 20

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 21

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 22

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 23

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 24

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 25

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 26

CERN IT Department

CH-1211 Genève 23

Switzerlandwww.cern.ch/

it

HEPiX Spring ’09 - 27