26
Val Bercovici Cloud & Big Data Czar NetApp Future Cloud Infrastructure Science, or Science Fiction?

Future Cloud Infrastructure

Embed Size (px)

Citation preview

Page 1: Future Cloud Infrastructure

Val Bercovici

Cloud & Big Data CzarNetApp

Future Cloud Infrastructure

Science, or Science Fiction?

Page 3: Future Cloud Infrastructure

What I hope to accomplish today...

&

Page 4: Future Cloud Infrastructure

...and avoid this.

Page 5: Future Cloud Infrastructure

CTO Research Themes

Software

Defined

Networks

Page 6: Future Cloud Infrastructure

Cloud – New Infrastructure Control Point

Page 7: Future Cloud Infrastructure

CTO Research Themes

Software

Defined

Networks

Page 8: Future Cloud Infrastructure

Wither POSIX? Capacity Trends(RAID Object RAID Erasure Coding)

S3

Swift

CDMI

Page 9: Future Cloud Infrastructure

CTO Research Themes

Software

Defined

Networks

Page 10: Future Cloud Infrastructure

Wither ACID? (Big) Data Trends

Page 11: Future Cloud Infrastructure

CTO Research Themes

Software

Defined

Networks

Page 12: Future Cloud Infrastructure

Wither OSI? Networking Trends

Software

Defined

Networks

Page 13: Future Cloud Infrastructure

“Intel Watching” - Interconnects

13NetApp Confidential - Internal Use Only

From EE Times: Cray sells interconnect hardware unit to IntelSylvie Barak 4/24/2012 6:34 PM EDT

MOUNTAIN VIEW, Calif.--Supercomputer maker Cray Inc. has signed a definitive

agreement to sell its interconnect hardware development program and related

intellectual property to Intel Corp. for $140 million in cash.

Intel buys Infiniband unit from Qlogic for $125M

Associated PressAssociated Press – Mon, Jan 23, 2012

SANTA CLARA, Calif. (AP) — Intel Corp. on Monday said it had agreed to buy Qlogic Corp.'s line of

Infiniband adapters, used to tie processors together into supercomputing clusters, for $125 million.

Intel said the acquisition would help it reach the goal of supplying computers that can perform one

exaflop, or a quintillion calculations, per second. The Santa Clara, Calif.-based company expects a

"significant number" of Qlogic employees to accept offers to join Intel.

Intel to Acquire Fulcrum Microsystems

Posted by IntelPR in News Stories on Jul 19, 2011 7:55:32 AM

SANTA CLARA, Calif., July 19, 2011 – Intel Corporation today announced it signed a definitive agreement to acquire

Fulcrum Microsystems Inc., a privately held fabless semiconductor company that designs Ethernet switch silicon for

data center network providers.

―Intel is transforming from a leading server technology company to a comprehensive data center provider that offers

computing, storage and networking building blocks,‖ said Kirk Skaugen, Intel vice president and general manager,

Data Center Group.

Page 14: Future Cloud Infrastructure

2001 2010 2014 2017

Ethernet 1Gb/s 10Gb/s 40Gb/s 100Gb/s

Infiniband 10Gb/s 40Gb/s 104Gb/s ??

10x 4x 2.5x

Wither InfiniBand? Networking Trends

Page 15: Future Cloud Infrastructure

Future Networks? EthernetPCIMemory

Page 16: Future Cloud Infrastructure

CTO Research Themes

Software

Defined

Networks

Page 17: Future Cloud Infrastructure

Performance – Storage Class Memory

(SCM)

Page 18: Future Cloud Infrastructure

Revolution from Above, not Below

18

1M

100K

10K

1K

100

10

1

Page 19: Future Cloud Infrastructure
Page 20: Future Cloud Infrastructure

Why SCM will need new Interconnects

Assume 50ns SCM access time (DRAM speed)

PCIe, InfiniBand latency ≈ 1 μsec = 21x latency

Read syscall, file in RAM ≈ 260 nsec = 6x latency

Speed of light in optical fiber ≈ .65 ft / nsec

20

+

5’ server

rack

5 ft = 15nsec = 1.3x latency

10 ft = 30nsec = 1.6x penalty

+40 ft = 120nsec = 3.4x penalty

storage

appliance

Page 21: Future Cloud Infrastructure

Replicated Software Transactional Memory

(STM)

21

Host Networked Storage

Replication

of transaction log

for reliability

and D/R

Application

STM library

transactionalmemory

DRAM/SCM

hypervisor/kernel

transaction logprocessed into

efficientsnapshot

storage

streaming protocol

transaction

manager

Page 22: Future Cloud Infrastructure

TECH 2009-2011 2012-2015 2016-2020

PCM

128Mbit 90nm (Omneo)

512Mbit 65nm

(in mobile handsets)

1Gbit 45nm (Bonelli)

8Gbit 20nm (ISSCC „11) Hynix/IBM 40nm 1Gbit

ReRAM

180nm Evaluator Kit in 2012

Mass-production in 2013/14

30nm 1Gbit in 2013/14

STT-MRAM

16Mbit 130nm MRAM

(SRAM replacement)

130nm SRAM replacement 4Gbit chip with LPDDR2 i/f in ‟16

Expected to compete

with DRAM/Flash

SCM Roadmap Speculation

22

Page 25: Future Cloud Infrastructure

IBM Watson – Circa 2010!(SCM + Fast Interconnect + Hadoop)

http://en.wikipedia.org/wiki/Watson_(computer)

Page 26: Future Cloud Infrastructure