Embed Size (px)
Citation preview
© 2015 IBM Corporation
IBM Power SystemsLinux workloads on Power
Mandie QuartlyLinux on Power technical lead UK&[email protected]: @mandieq020 8818 5283
© 2015 IBM Corporation
This session
1. Opening up the POWER architecture
2. Power Systems
3. So what??
© 2015 IBM Corporation
Moore's Law meets the law of physics
“Moore's law is the observation that, over the history of computing hardware, the number of transistors in a dense integrated circuit doubles approximately every two years.”
Wikipedia
© 2015 IBM Corporation
For almost 5 decades we have relied on exponential technology change
If cars were like chips:
1970 − 15 mpg
1980 − 1,500 mpg
1990 − 150,000 mpg
2000 − 15 Million mpg
2010 − 150 Million mpg
2020 − 1 Billion mpg
...
© 2015 IBM Corporation
And at the same time.. an emerging data challenge
1990’s 2020’s
Exa
Peta
Tera
Giga
2000’s 2010’s
Med
High
Low
Com
put
atio
nal N
eeds
So
phis
tica
tion
of A
naly
sis
Exp
ress
iven
ess
© 2015 IBM Corporation
• Moore’s law no longer satisfies performance gain
• Growing workload demands
• Numerous IT consumption models
• Mature Open software ecosystem
• Rich software ecosystem
• Spectrum of power servers
• Multiple hardware options
• Derivative POWER chips
OpenPOWER is an open development community, using the POWER Architecture to serve the evolving needs of customers.
Performance of POWER architecture
amplified capability
Open Development
open software, open hardware
Collaboration of thought leaders
simultaneous innovation, multiple disciplines
Feeds back … resulting in client choice
OpenPOWER, a catalyst for Open Innovation
© 2015 IBM Corporation
A Fast Start for OpenPOWER!
7
• Collaborative solutions, standards, and reference designs available• Independent members solutions and systems• Sector growth in technical computing and cloud• Global growth with increasing depth in all layers• Broad adoption across hardware, software, and end users
The year ahead
© 2015 IBM Corporation
What a difference a year makes...
© 2015 IBM Corporation
Fueling an Open Development Community
© 2015 IBM Corporation
OpenPOWER Summit Hardware Announcement Mar. 2015
More details available at http://openpowersummit2015.tumblr.com/factsheet
Chuanghe 1S / 1U POWER8 server
Collaborators: Chuanghe
Cirrascale RM4950
Collaborators: Cirrascale, NVIDIA
Virtex 7 CAPI-based Adapter Kit
Collaborators: Convey, Xilinx
TYAN TN71-BP012
Collaborators: Tyan, Mellanox
IBM Memory Technology Innovation Utilizing Altera FPGAs
Collaborators: IBM, Altera
IBM 2U/2S POWER8 / NVIDIA GPU Server “Firestone”
Collaborators: IBM, Wistron,NVIDIA, Mellanox
Inspur 2S / 2U server
Collaborators: Inspur
Mellanox ConnectX-4 CAPI-adapter
Collaborators: Mellanox
Open server specification and Open Compute motherboard mock-up
Collaborators: Rackspace
Suzhou PowerCore CP1 mechanical sample
Collaborators: POWERCORE
Zoom 2S / 2U POWER8 System Planar &
Memory Riser
Collaborators: Zoom Netcom, Byosoft, Unisource
© 2015 IBM Corporation
"ARM (is) not the only game in town” [EE Times]
"The new systems incorporate technologies from IBM and other providers that are part of OpenPower…which allow you to achieve unprecedented computing performance.” [Cloud Times]
“The level of support behind the OpenPOWER Foundation leads me to believe that IBM has a real chance at ending Intel's server chip monopoly.” [IBM is the real threat to Intel’s server dominance, Motley Fool]
IBM and NVIDIA Partner to Make OpenPOWER a Real Threat [Enderle Group]
IBM disrupts the innovation model to protect its industry incumbency [TBR]
How the OpenPOWER Foundation is Taking Open to New Places [LinuxFoundation]
“This announcement is around the OpenPOWER Foundation that has brought together a wide range of companies from chip fabricators to system builders.” [IBM attacks Xeon v3, Business-Cloud]
… doubling the performance of its already powerful predecessor, Power7+. The Power8 specs are mind boggling. [Microprocessor report]
“IBM POWER8 thrashes Intel Xeon” [Business Cloud, January 2015]
What is the market saying?
“POWER8 is everything Intel's Xeon wants to be when it grows up.”“The importance of partnerships with Chinese companies, with the tacit backing of the Chinese government, should not be underestimated.”[IBM's OpenPOWER Foundation: What Is It And Does It Matter? Seeking Alpha, January 2015 ]
© 2015 IBM Corporation
Power Systems
© 2015 IBM Corporation
Linux on IBM POWER8 Systems
Power S812L
• 10, 12 Cores• 3.0 – 3.52 GHz• KVM, PowerVM, Bare
metal
• 16, 20, 24 Cores• 3.0 – 4.15 GHz• KVM, PowerVM,
Bare metal
70 PVU for IBM SW on any Core running Linux
70 PVU for IBM SW on any Core running Linux
• 16, 20, 24 Cores• 3.0 – 4.15 GHz• 1-2 NVidia GPUs• KVM, PowerVM, Bare
metal
PowerE870
• 8 to 80 Cores• 4.0 - 4.19 GHz• PowerVM
PowerE880
• 8 - 192 Cores• 4 - 4.35 GHz• PowerVM
PowerE850
• 16 to 48 Cores• 3.0 – 3.7 GHz• PowerVM
Linux only Scale-Out
PurePower
Power Enterprise IFLs
Customers value initial cost of acquisition
Customers value enterprise class features, robustness
Customers value converged infrastructure
Power S824L
Power S822L
• S822/S822L nodes• Storwize V7000• OpenStack Mgmt• PowerVM, KVM (4Q)
© 2015 IBM Corporation
So what?
© 2015 IBM Corporation
POWER8 => built for performance
* Intel calls this Hyper-Threading Technology (No HT and with HT) *32KB running in “Non-RAS mode” 16KB results in better RAS **85GB running in “Non-RAS mode” and dual-device error NOT supported
1 = The Micro-architecture features above contributed to premium performance for the POWER8 systems compared to Ivy Bridge systems
Sandy Bridge EP
E5-x6xx
Ivy Bridge EP
E5-26xx v2
Ivy Bridge EX
E7-88xx v2
Haswell EP
E5-26xx v3
POWER 7+ Systems
POWER8
Clock rates (GHz)
1.8–3.6 1.7-3.7 1.9-3.4 1.6-3.5 3.1–4.4 GHz 3.0-4.1 GHz
SMT options 1,2* 1, 2* 1, 2* 1, 2* 1, 2, 4 1, 2, 4, 8
Max Threads / sock
16 24 30 36 32 96
Max L1 Cache 32KB 32KB* 32KB* 64 KB 32KB 64KB
Max L2 Cache 256 KB 256 KB 256 KB 256KB 256 KB 512 KB
Max L3 Cache 20 MB 30 MB 37.5 MB 45 MB 80 MB 96 MB
Max L4 Cache 0 0 0 0 0 128 MB
Memory Bandwidth
31.4-51.2 GB/s
42.6-59.7 GB/s
68-85** GB/s
51-68 GB/s
100 – 180 GB/sec
230 - 410 GB/sec
© 2015 IBM Corporation
Analytics & Research
Workload requirements
Workload requirements
Business, E-commerce Apps
Workload requirements
Web, Java and Mobile Apps
Workload requirements
Relational and NoSQL Databases
IBM InfoSphere BigInsights
HPC/HPA apps
Big Data Big Data
Eight threads/core 230 GB/sec memory b/w Large memory, parallel, small jobs on same node Dynamic Energy Optimization
80% faster to setup VMs 65% less datacenter space 40% better performance 65% utilization guarantee Dynamically add/remove
resources
Eight threads/core 10x concurrent users 2.5x more throughput 166% lower TCA6.5x more users/hour
75% less cores $1.6M lower s/w costs 37x faster indexing 24:1 less servers for
Redis NoSQLLinear scalability, higher
throughput
Key Linux workloads for Power Systems
© 2015 IBM Corporation
Superior Cloud Economics
New: SoftLayer Bare Metal POWER cloud
New: Rackspace joins OpenPOWER, declares Open Compute OpenPOWER system
New: Docker for Power Systems
http://labs.runabove.com/power8/
Up to 100xthe power of a classic x86 setup
© 2015 IBM Corporation
MariaDB optimised for Power Systems
Up to 2.2x better per core performance
Up to 1.9x better per system performance
S822L – 10 core POWER8, 3.42 GHz vs.
x3650 M4 – 12 core Ivy Bridge, 2.7 GHz
* Source: http://blog.jelastic.com/2014/08/28/software-stacks-market-share-july-2014/
Final results and more information on solution configuration:
IBM Power Systems Solution for MariaDB whitepaper link
IBM Power S822L vs. IBM x3650 M4 – per core(Both running Ubuntu as KVM guest – Sysbench benchmark)
Read-only
Read-Write
Tra
ns
acti
on
/
sec
on
d /
co
re
Read-only
Read-Write
Tra
ns
acti
on
/
sec
on
d /
sys
tem
IBM Power S822L vs. IBM x3650 M4 - per system(Both running Ubuntu as KVM guest – Sysbench benchmark)
2.2x2.1x
Core – Core
1.7x1.9x System – System
Read-only
Read-Write
Read-only
Read-Write
© 2015 IBM Corporation
Watch the movie!*
MariaDB and IBM POWER8 - the perfect match for ultimative performance and lower TCO
*might not actually be a movie, no popcorn required
YouTube link: http://bit.ly/IBM_MariaDB
© 2015 IBM Corporation
Faster Innovation
Performance and scalability
Compliance and security
Mobile and web apps run better on next generation LAMP stack
Leader in high speed networking for cloud, Big Data
#1 Linux for cloud and scale-out Enterprise
performance and scale for PHP applications
MySQL compatible
database without Oracle T&Cs
Introducing “Turbo LAMP ”
© 2015 IBM Corporation
One POWER8 server
PHP Server/ Magento
Redis Server
PHP Server/ Magento
DB / MySQL PowerKVM + Ubuntu
Single Power S822L FSP
MEL
MEL
MEL
MEL
•$3.98 /user/hour•TCA = $19, 885
Four Dell servers
5,000 users/hour * 32,000 users/hour *
•$1.41 /user/hour•TCA = $45, 100
* @ < 2 sec response time for 86% of
users* @ < 2 sec. response
time for > 90% of users
Key Advantages of Turbo LAMP on POWER8• 65% less $$ per user / hour• 6.4x more users per hour• 4:1 less physical servers • 2:1 less rack space
65% less $$ / user / hour
6.4x more users / hour
Magento is a subsidiary of eBay and serves more than 240,000 retailers worldwide - enabling retailers and brands to create customized, innovative, commerce experiences to accelerate their growth.
Magento benchmark on Turbo LAMP stack
ZE
ND
\Mag
en
to 1
ZE
ND
\Mag
en
to 2
ZE
ND
\Mag
ento
1
Mar
iaD
B
RE
DIS
© 2015 IBM Corporation
IBM Data Engine for NoSQL Reduce server footprint with DRAM-FLASH consolidation
100% Redis compliant (no application changes)
IBM Data Engine for NoSQL• IBM Power S822L• CAPI-Attached FPGA
Accelerator• IBM FlashSystem 840 or 900• Ubuntu Linux• Redis Software
✔ First CAPI-, FPGA-based solution✔ Innovative use of Flash Storage for
emerging open source middleware (Redis)
24:1 infrastructure consolidation
3X cost savings
6x less rack space 2U server+2U FlashSystem vs. typical deployment
Lower Total Cost of Ownership for NoSQL infrastructure with no performance degradation
source: for 24:1 system consolidation ratio (12:1 rack density improvement) based on a single IBM S824, (24 cores, POWER8 3.5 GHz), 256GB RAM, AIX 7.1 with 40 TB memory based Flash replacing 24 HP DL380p, 24 cores, E5-2697 v2 2.7 GHz), 256GB RAM, SuSE Linux 11SP3 . Inbound network limits performance to 1M IOPs in both scenarios, equal capacity (#user, data) in both cases. x86 cost includes 10k$ for 2x 1U switches
© 2015 IBM Corporation
The sky is the limit...
© 2015 IBM Corporation
Summary – why put Linux workloads on Power?
1. Open innovation
2. Key emerging workloads – when it matters
3. Doing more with less
4. Flexibility and commonality
Thank you!Questions?
Mandie [email protected]
Want to know more?
“The Linux on Power Revolution - How to get 'More for Less”
11th June, IBM Southbank http://bit.ly/lopsb
© 2015 IBM Corporation2525
© 2014 IBM Corporation #powersystems
ReferenceMaterial
26
© 2015 IBM Corporation
Where to find more information?
The Linux on Power Community(developerWorks)
Power Systems Linux Portal(Product Information)
www.ibm.com/systems/power/software/linux/
@ibmpowerlinuxplus.google.com/communities/100156952249293416679
http://openpowerfoundation.org/
The OpenPOWER Foundation
© 2015 IBM Corporation
OpenPOWER Work Group Roadmap
2014 2015 2016
Developer Platform
System SW
HW Architecture
Accelerator
Compliance
Proposed Work Groups Integrated Solutions
Pers Med
SP010 – Tyan OpenPOWER Customer Reference System CAPI – Coherent Accelerator Processor InterfaceABI – Application Binary Interface
AFU – Accelerator Function UnitFSI – Field Replaceable Unit (FRU) Service InterfaceSDK – Software Developer Kit
25g IO Compatibility
FSI Spec
Memory
OpenPOWER I/O
Work Group
CharterCompliance SpecificationDraft Review WG Spec
CompSTD
CharterOpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch
OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch
Charter P8 SP010Data
P8 2U2SReference
P8+ 1U1SReference
P8+ 2U2SReference
OPMB Intf. Spec V1Charter
CharterCAPI AFU Intf Spec V1
OpenCL SDK
CAPI AFU Intf Spec V2
Charter
CAPI LinuxSDK
64b ABIPlatform Ref
Sys I/O Enablement GuideCharter
Charter 25g IO Spec
OPMB – OpenPOWER Memory Bus
© 2015 IBM Corporation
Monte Carlo 250x faster
than POWER8 core alone, reduced C code 40x over non-CAPI FPGA
Altera FPGA acceleration and IBM CAPI
© 2015 IBM Corporation
Best-in-class ingredients • IBM POWER8• IBM Java• NVIDIA CUDA GPU acceleration• Ubuntu Little Endian Linux for POWER
8x performanceimprovementGPU acceleration for Java onsegmentation using accelerated machine learning for clustering with Hadoop / Mahout
© 2015 IBM Corporation
• Accelerated appliance with novel data-flow implementation of Memcached on FPGA.
• Up to 36x improved performance and power response times in microsecond range.
• CAPI integration of memory allows both host memory and coherent-attached flash to be used as value store.
Up to 36x performance improvement for Key-Value Store acceleration
© 2015 IBM Corporation
IBM, Mellanox, and NVIDIA awarded $325M U.S. Department of Energy’s Super Computer bids
Two supercomputers for Oak Ridge and Lawrence Livermore Labs in 2017. Sequoia (LLNL)
2012 - 2017Mira (ANL)2012 - 2017
Titan (ORNL) 2012 - 2017
Current DOE Leadership Computers
5x – 10x Higher Application Performance versus Current Systems
>100 PF, 2 GB/core main memory, local NVRAM, Mellanox EDR 100Gb/s InfiniBand,
IBM POWER CPUs, NVIDIA Tesla GPUs
© 2015 IBM Corporation
• Support for little endian applications
• PoCs available through the Power Development Platform
• 50 IBM Innovation Centers and Client Centers Worldwide
Over 1,400 Linux ISVs developing on Power
© 2015 IBM Corporation
Linux on Power transitions to little endian
Standard Release Support Extended Release Support Release/update
See for more details:Red Hat lifecycle information - https://access.redhat.com/support/policy/updates/errata/ SUSE lifecycle information – http://support.novell.com/inc/lifecycle/linux.htm/ l Ubuntu lifecycle information - https://wiki.ubuntu.com/Releases
Today20092006 2007 2008 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019
SLES 11 (3/09)
SLES 12 (4Q14)
14.10 (4Q14)
RHEL 6 (11/10)
RHEL 7 (6/14)
14.04 LTS (4/14)
15.04 (2Q15)
RHEL 7.1 (3/15)
BE
BE
BE
LE
LE
LE
LE
LE
© 2015 IBM Corporation
Linux support for POWER
RHEL 7 (BE / LE) POWER8 (native mode) and
POWER 7/7+ at GA Available June 2014 7.1 adds LE distribution
RHEL 6 • POWER8 supported with U5
(P7-compatibility mode)• Full support of POWER6 and
POWER7(native mode)
Fedora• Fedora 16 was first release to
re-launch POWER• Fedora 20+ has POWER8
support
Supported add-ons• RHEV-H• JBoss• High Performance Network
Add-on
SLES 12 (LE) POWER8 (native mode, LE)
and POWER 7/7+ Technology preview of KVM
host support Available October 2014
SLES 11 (BE) POWER8 with SP3 (P7-
compatibility mode) POWER7+ encryption, RNG
accelerators with SP3 Full support of POWER7
(native mode)
openSUSE• openSUSE 12.2 re-launched
for IBM POWER• openSUSE 13.2 includes
POWER8 support
Supported add-ons• SUSE Linux Enterprise 11
High Availability Extension
Ubuntu 15.04 (LE)● Docker enablement● FPGA support
Ubuntu 14.10 (LE) S824L GPU enablement
Ubuntu 14.04 (LE) POWER8 enabled (native
mode, LE) No official support for
POWER7+ and older systems 64-bit only. KVM hosting enabled in
14.04.02
Supported add-ons• JuJu Charms• MaaS (Metal as a Service)• Landscape
Debian• Debian community supports
Power as of Sid release• Official architecture for Jessie
Same source and distribution release schedules as x86. No special IBM code. Simplified x86 application migration with little endian distributions. Enterprise support for all three from IBM or distributors.
Click on links for download URL
© 2015 IBM Corporation
KVM on Power options
Because KVM is an open source project to which IBM has contributed code for the enablement of Power, KVM can be run the following ways on KVM-enabled servers (S812L and S822L):
IBM● IBM PowerKVM: http://www-03.ibm.com/systems/power/software/linux/powerkvm/ ● GA: June 2014● Most recent version: 2.1.1 (October 2014)
Red Hat● Red Hat Enterprise Virtualization for IBM Power:
https://access.redhat.com/products/red-hat-enterprise-virtualization ● GA: December 2014● Most recent version: 3.4 (December 2014)
SUSE• SLES 12: https://www.suse.com/products/power/ • GA: October 2014 (KVM hosting is Technology Preview at this time)• No Service Packs have been released yet
Canonical• Ubuntu 14.04.2: https://wiki.ubuntu.com/TrustyTahr/ReleaseNotes • GA: October 2014• Most recent version: 14.10
Select the KVM offering that fits your infrastructure needs!
© 2015 IBM Corporation
Simplify and grow software with LE
● “Endian” simply describes the way data is accessed in memory – from the low order or LSB end (“little”) or high order or MSB end (“big”).
● POWER8 processors support execution in both big endian (BE) and little endian mode (LE). Intel processors are LE.
● Linux on Power has chosen to exploit little endian (LE) processor mode based on OpenPOWER partner feedback.– Eases the migration of applications from Linux on x86.– Enables simple data migration from Linux on x86.– Simplifies data sharing (interoperability) with Linux on x86.– Improves Power I/O offerings with modern I/O adapters and devices, e.g.
GPUs.
● LE distributions for Linux on Power does NOT mean x86 applications magically run: applications must still be compiled for Power.
● AIX and IBM i will remain BE.
© 2015 IBM Corporation
What does LE mean to me???
If you are a customer:– You mostly likely don't care about BE/LE.– You will focus on Linux distributions and supported applications.– You will need to do a little more planning when upgrading your OS and HW
while we transition.
If you are an ISV:– If you provide support on multiple hardware platforms, e.g. POWER and
x86, you have already addressed endianness. Today's (BE) Linux distributions can support you today.
– If you only run on x86 systems today, you may benefit from LE distributions when they are available. (A decision tree is included in backup slides.)
If you are a business partner, distributor:– Today's solutions and offerings (BE) are mature and ready.– New solutions will be coming to the market in the coming years. Endianness
details are generally irrelevant in solution selling.
More information can be found in the Linux on Power developerWorks community blog, Removing the FUD and De-mystifying LE (little endian).
