On the Way to GPU Virtualization –

3D Acceleration in Virtual Machine

Sumit Agarwal, AMD

Yizhong Zhang, VMware

TEX5030

#TEX5030

joint-development with AMD

2 2

Disclaimer

This presentation may contain product features that are currently

under development.

This overview of new technology represents no commitment from

VMware to deliver these features in any generally available

product.

Features are subject to change, and must not be included in

contracts, purchase orders, or sales agreements of any kind.

Technical feasibility and market demand will affect final delivery.

Pricing and packaging for any new technologies or features

discussed or presented have not been determined.

3 3

Agenda

• VMware’s GPU virtualization solution

• AMD’s GPU driver for vSphere

• Demo

• Q & A

4 4

GPU Virtualization Background

Current limitation

• GPU becomes more powerful but low utilization

• HW virtualization is the trend. GPU virtualization is the last issue.

• Passthrough is not perfect

Solution

• Fully GPU virtualization

Benefit

• Remote graphics rendering: VDI, CAD

• End user get graphics acceleration on thin client

• Better GPU utilization

• Save cost

• Allocate resource by user requirement. Easy to upgrade

5 5

3D Rendering as a Service

3D workloads

remote client

3D acceleration center

6 6

Fully virtualization on ESXi – vSGA

SVGA

VMware ESXi

SVGA Driver

3rd party driver

graphics stack

SVGA Driver

SVGA

SW pipeline

SVGA

SVGA Driver

7 7

Gallium 3D

vSGA architecture

VMware Guest Driver

SVGA3D protocol

SVGA Device

SVGA State Tracker GL Backend

Kernel Driver llvmpipe

GPU

Guest

Host

Guest graphics stack

3rd party module

Hypervisor module

Guest module

Virtual device

hardware

OGL Driver

CPU

Application

Software pipeline path Physical GPU path

8 8

Task Worker

Basic data

entry/usage is

central to work

Productivity /

Knowledge Worker

Standard productivity

tools are central to work

Desktop Power User

Some compute

intensive apps, require

3D graphics

performance

Workstation Users

Workstation class

performance for

compute with dedicated

graphics

Image Quality

Interactivity

Cost/Seat

2D / 3D

Virtual Desktop User Segmentation

DirectX 9

Diagnostics

5MP Screens

Oil & Gas

OpenGL 2.1

Many-Monitor (3+)

Aero

1080p

Engineering

++Users per GPU -

Heavy Users

Many Applications Light Users

Fewer Applications

vDGA*

GPU PCI

Passthrough

Heavy Users

Native Driver

vSGA

Virtualized 3D Hardware Graphics Resources

--VRAM ++ VRAM

Soft 3D

Software Rendered

Accelerated 3D

CUDA

Note: * vDGA is not available yet

9 9

Partner engagement

GPU driver

life cycle

Upgrade

or Patch Maintenance/

Upgrade Bug fix

Optimization

New feature

General Available Download from

VMware’s website

Certification run test suite

on Workbench

On board Business value

Legal

Plan

Development Develop tools

documents

consultation

co-debug

10 10

AMD FIREPRO™ Technology Unparalleled Value For Customers

The

RELIABILITY you demand

Unified Drivers

OEM Qualifications

ISV Certifications

The

PERFORMANCE you need

Leading Edge

Performance at Every

Price Point

Windows® & Linux®

AMD Eyefinity technology supports up to six DisplayPort™ monitors on an enabled graphics card. Supported display quantity, type and resolution vary by model and

board design; confirm specifications with manufacturer before purchase. To enable more than two displays, or multiple displays from a single output, additional

hardware such as DisplayPort-ready monitors or DisplayPort 1.2 MST-enabled hubs may be required. Maximum two active adapters supported. See

www.amd.com/eyefinityfaq for full details.

™

The

EDGE you expect

4.2

11 11

AMD FIREPRO™ SERVER GRAPHICS One Product for Multiple Segments

Compute VDI Pro Graphics

Co-processing

Data intensive

Clusters

VDI/Remoting

Data + pixels

Servers

Visualization

Pixel intensive

Desktop/Mobile

Price AMD FirePro™

12 12

AMD GPUs Reference

Features FirePro

S7000

FirePro

W7000

FirePro

S9000

FirePro

W9000

FirePro

S10000

Stream

Processors 1280@950Mhz 1280@950Mhz 1792@900Mhz 2048@975Mhz 3584@850Mhz

Memory 4GB GDDR5 4GB GDDR5 6GB GDDR5 6GB GDDR5 6GB GDDR5

Memory B/W 154GB/s 154GB/s 264GB/s 264GB/s 480GB/s

Bus Interface PCIe3.0 x16 PCIe3.0 x16 PCIe3.0 x16 PCIe3.0 x16 PCIe3.0 x16

Form Factor 1 slot FH/FL 1 slot FH/FL 2 slots FH/FL 2 slots FH/FL 2 slots FH/FL

Max Power 150W 150W 225W 274W 375W

ECC No No Yes Yes Yes

API Support

DirectX 11.1, OGL

4.2, OCL 1.2

Yes Yes Yes Yes Yes

Performance

Single Precision 2.4 TFLOPS 2.4 TFLOPS 3.23 TFLOPS 4 .0 TFLOPS 5.91 TFLOPS

Performance

Double Precision 152 GFLOPS 152 GLOPS 806 GFLOPS 1.0 TFLOPS 1.48 TFLOPS

B/W: Bandwidth; FH = Full Height; FL: Full Length; TFLOPS: Tera Floating Point Operations; GFLOPS: Giga Floating Point Operations

13 13

Supported Features - vSGA

Features FirePro

S7000

FirePro

W7000

FirePro

S9000

FirePro

W9000

FirePro

S10000

vSGA

vMotion

OpenGL 2.1 ,

DirectX 9.0c, GLX

Min. ESXi version ESXi 5.5 ESXi 5.5 ESXi 5.5 ESXi 5.5 ESXi 5.5

Min. VMware

View agent

version

5.2 5.2 5.2 5.2 5.2

Min. VMware

View Client

version

5.3* 5.3* 5.3* 5.3* 5.3*

Min. AMD Driver

Version 12.10.3 12.10.3 12.10.3 12.10.3 12.10.3

* - To be released; version number may change

14 14

Packaging, Installation and Support

ESXi AMD graphics driver is developed, qualified and supported by

AMD and certified by VMware

User needs to download AMD graphics driver and updates from

AMD website

Graphics driver issues are reported to VMware and addressed by

AMD

Steps to install AMD graphics driver in vSGA on ESXi host:

• Download AMD graphics driver package from AMD website

• Run commands to install the driver on ESXi host:

• esxcli system maintenanceMode set --enable=true

• esxcli software vib install -v “<location of the driver>”

• esxcli system maintenanceMode set --enable=false

• Reboot the system

15 15

Steps to Use vSGA with AMD GPUs

Prepare the ESXi host with AMD graphics driver

Setup the VM with 3D support

• Expand the Video card and enable 3D support and select Hardware from the

drop down menu

• Update the Total video memory eg. 512MB*

• Can also update the information by editing the vm.vmx file

• mks.enable3d = “TRUE”

• mks.use3dRenderer = “hardware”

• Install VM tools

On ESXi host, run gpuvm to validate whether VM is using

graphics card

* VM version 9 or above required for 512MB memory support

16 16

OpenGL Stack with X and GLX, and EGL

Graphics Application

OpenGL Loader (LibGL and LibEGL)

VMware Host SVGA device and Graphics transport layer

VMware SVGA driver for Guest

Client Side OpenGL AMD

Renderer

AMD GPU CPU

ESX Host

User Space

Guest VM

H/W

Guest VM OS and Runtime libraries

AMD User and Kernel driver interface

VMware VMKernel

AMD Kernel driver

AMD VMKernel Shim

Xorg and supporting libraries

AMD GLX Module

AMD X server driver (DDX) X S

erv

er

X Extension libraries Software Rendering

ESX Host

Kernel Space

17 17

Performance and scalability

Limits Number of

GPUs supported

Number of VMs per

GPU

Performance Consideration

vSGA 4* Variable**

• VM and System configuration

• GPU performance

• Number of VMs running on

single GPU

• GPU memory assigned to

each VM

Soft Rendering versus hardware accelerated rendering

Dedicated graphics versus shared graphics

Workload and applications optimization for vSGA solutions

• *- Number of GPUs limit qualified by AMD; no hard limit imposed by VMware

• **- Depends on type of GPU and GPU memory allocated to VMs

18 18

Looking Forward

Work with VMware in bringing the best graphics experience to end

users

Support forthcoming AMD GPUs and APUs with vSGA

19 19

AMD FIREPRO™ Technology Unparalleled Value For Customers

The

RELIABILITY you demand

Unified Drivers

OEM Qualifications

ISV Certifications

The

PERFORMANCE you need

Leading Edge

Performance at Every

Price Point

Windows® & Linux®

AMD Eyefinity technology supports up to six DisplayPort™ monitors on an enabled graphics card. Supported display quantity, type and resolution vary by model and

board design; confirm specifications with manufacturer before purchase. To enable more than two displays, or multiple displays from a single output, additional

hardware such as DisplayPort-ready monitors or DisplayPort 1.2 MST-enabled hubs may be required. Maximum two active adapters supported. See

www.amd.com/eyefinityfaq for full details.

™

The

EDGE you expect

4.2

20 20

vSGA Demo with AMD graphics card

SW configuration

• ESX5.5 + vSphere client 5.5

HW configuration

• DELL T7600 Workstation - Intel Xeon E5-2630 6c *2；128G Memory（16*8GB

DDR3 1600)； 1T 7200rpm HDD;

• GPU: W9000

22 22

Q & A

23 23

TAP Membership Renewal – Great Benefits

• TAP Access membership includes:

New TAP Access NFR Bundle

• Access to NDA Roadmap sessions at VMworld, PEX and Onsite/Online

• VMware Solution Exchange (VSX) and Partner Locator listings

• VMware Ready logo (ISVs)

• Partner University and other resources in Partner Central

• TAP Elite includes all of the above plus:

• 5X the number of licenses in the NFR Bundle

• Unlimited product technical support

• 5 instances of SDK Support

• Services Software Solutions Bundle

• Annual Fees

• TAP Access - $750

• TAP Elite - $7,500

• Send email to tapalliance@vmware.com

24 24

TAP Resources

TAP

• TAP support: 1-866-524-4966

• Email: tapalliance@vmware.com

• Partner Central: http://www.vmware.com/partners/partners.html

TAP Team

• Kristen Edwards – Sr. Alliance Program Manager

• Sheela Toor – Marketing Communication Manager

• Michael Thompson – Alliance Web Application Manager

• Audra Bowcutt –

• Ted Dunn –

• Dalene Bishop – Partner Enablement Manager, TAP

VMware Solution Exchange

• Marketplace support –

vsxalliance@vmware.com

• Partner Marketplace @ VMware

booth pod TAP1

THANK YOU

On the Way to GPU Virtualization –

3D Acceleration in Virtual Machine

Sumit Agarwal, AMD

yizhong zhang, VMware

TEX5030

#TEX5030

joint-development with AMD