Upload
er1p
View
222
Download
0
Embed Size (px)
Citation preview
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
1/19
TheDeathofDiskPanelSession
ErikRiedel,EMCHECFSIOWorkshop
August2011toppicturefloppydisksforbreakfastbyBludeviaflickr/cc
rightpicturebyAusnMarshallviaflickr/cc
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
2/19
Conclusion
About80%ofstoreddatawillneverbeaccessedagain
About80%oftherestwillbeaccessedpredictably Thatleaves(maybe)4%ofstoreddatathatpotenallyrequiresquickrandomaccess
=>Buyasmuchflashasyoucanafford,usedisksfortherest
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
3/19
MostDataIsIdle
About80%ofstoreddatawillneverbeaccessedagain
Diskdriveshavelongbeendesignedaroundthiskeyfactofthedigitalworld Amorzearelavelysmallamountofexpensiveread/writeelectronicsandfancy
materialscienceoveralargeandcheap
magnecmedia
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
4/19
DavidAnderson,JamesDykes,ErikRiedelSCSIvs.ATA-Morethan
aninterface2ndConferenceonFileandStorageTechnology(FAST) .
SanFrancisco,CA.April2003.www.cs.cmu.edu/~riedel
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
5/19
ConsumerExample(AtMyHouse)
Dinosaur
Train
SidThe
ScienceKid
Super
Why!
Steelers
Games
Meetthe
Press
Nova
Baby
Einstein
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
6/19
MostDataAccessIsPredictable
Caching Prefetching Tiering Staging HierarchicalStorageMgmt allthesetoolshavebeenknownforyears justneedtoopenourtoolbox,sharpensomeofthemtoapplytotodaysinfrastructure/apps
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
7/19
NewToolsIntheCloud
MarkengbuzzIaaSInfrastructureasaService
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
8/19
NewToolsIntheCloud(2)
MarkengbuzzPaaSPlaormasaService
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
9/19
NewToolsintheCloud(3)
KeytakeawaysbothIaaSandPaaSareclosedloopinfrastructures
appscannotbedeployedexceptatthedireconofthesystem
loggingandmonitoringareconstant needtogethighulizaonrates($$) needtosendoutbills($$) wanthighratesofmul-tenancytobeefficient($$)
thisleadstoasignificantlevelofpredictability
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
10/19
GetPredictabilityIntoStorage
Keychallengeishowtotranslatewhatthesystemknowsaboutappsandbehaviorsand
SLAsintoguidanceforoursystem-leveltools(caching,prefetching,ering,etc.)
SecondarychallengeisavoidingsurpriseswhereperformanceoravailabilityordurabilitydontmeettheSLAs(qualityofservice)
Goodnewsisthatthenewinfrastructureshavesomepowerfulnewwaystohelpus
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
11/19
OneExampleNewToolStunning
Theamountofmethevirtualmachineisstunnedis
dependentontheamountof
memorytobewrientodiskforsuchanoperaon,and
thespeedand
responsivenessofthe
datastore'sbackingstorage.
VMwareKnowledgeBase
hp://kb.vmware.com/selfservice/microsites/search.do?
language=en_US&cmd=displayKC&externalId=1013163
picturebyYamashitaYoheiviaflickr/cc
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
12/19
WhatAboutTape?
picturesbyGillWildmanviaflickr/cc
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
13/19
WhatAboutTape?
Tapesarenotacommoditytechnology 2011totalworldwidemarketfortapecartridgesisabout8munits(justunder$1bannual
revenue) ComparetotheHDDbusinessat650munitsin2010(closeto$40bannualrevenue)
80diskdrivesaremanufacturedforeachtapecartridge;robotsarecomplicated
Fitsparcularapplicaonsegmentsverywell,butisnotageneral-purposesoluon
hp://www.storagenewsleer.com/news/tapes/sccg-ww-tape-market-lto-1q11
hp://techreport.com/discussions.x/20890
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
14/19
Conclusion
About80%ofstoreddatawillneverbeaccessedagain
About80%oftherestwillbeaccessedpredictably Thatleaves(maybe)4%ofstoreddatathatpotenallyrequiresquickrandomaccess
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
15/19
PragmacIssues
Power ifthedataispredictablyidle,thendontspinit
Wearout lookatthedataoccasionally(once/month,once/yr);suchaccessforscrubbingisverypredictable
Backupbackup1)isnotanapplicaonand2)ispredictable
Replicaonesmatesrunto75%ofstoreddataiscopies/replicas,only25%uniquebytes;replicaonispredictable
www.zdnet.com/blog/service-oriented/size-of-the-data-universe-12-zeabytes-and-growing-fast/4750
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
16/19
SummaryHowMuchData
1.2millionPBesmatedin2010 25%unique=>leaves300,000PB 80%idle=>leaves60,000PB 80%predictable=>leaves12,000PB at$1/GBforflash,thatrequires$12b isthataffordable? (remembertheworldbought~$40bofHDDin2010)
www.zdnet.com/blog/service-oriented/size-of-the-data-universe-12-zeabytes-and-growing-fast/4750
www.computerworld.com/s/arcle/9180943/NAND_flash_memory_pricing_to_plummet_to_1_per_GB
recentlythepriceofflashhasnotbeendroppingasfastasthesupplierspredicted,August2011
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
17/19
Conclusion
About80%ofstoreddatawillneverbeaccessedagain
About80%oftherestwillbeaccessedpredictably Thatleaves(maybe)4%ofstoreddatathatpotenallyrequiresquickrandomaccess
=>Buyasmuchflashasyoucanafford,usedisksfortherest
n.b.73.6%ofallstascsaremadeup,
dothecalculaonsforyourown
environments,yourmileagemayvarywww.businessinsider.com/736-of-all-
stascs-are-made-up-2010-2
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
18/19
Inthebaleofrustvs.silicon,bothwillsurviverustpicturebyJosFaberviaflickr/cc
siliconpicturefromChipbugvschipbugbyWindellOskayviaflickr/cc
8/3/2019 Aug2011 Riedel Death of Disk Panel Session
19/19
hp://www.emc.com/storage/atmos/atmos.htm
abriefwordfrommysponsors