Upload
others
View
41
Download
0
Embed Size (px)
Citation preview
1 © Copyright 2012 EMC Corporation. All rights reserved.
Cloud meets Big Data
Roger Samdal Sr. Technology Consultant EMC
Børge Wilhelmsen Business Developer EMC ATEA
2 © Copyright 2012 EMC Corporation. All rights reserved.
Source: 2010 IDC Digital Universe Study
IN THIS DECADE THE DIGITAL UNIVERSE
WILL GROW 44X FROM 0.9 ZETTABYTES TO 35.2 ZETTABYTES
3 © Copyright 2012 EMC Corporation. All rights reserved.
90% OF THE DIGITAL UNIVERSE IS
UNSTRUCTURED
Source: 2011 IDC Digital Universe Study
4 © Copyright 2012 EMC Corporation. All rights reserved.
Big Data is Changing Enterprise Storage
2009 2010 2011 2012 2013 2014
0
10
20
30
40
50
60
70
80
90
Source: IDC
File Based: 60.7% CAGR Block Based: 21.8% CAGR
By 2012, 80% of all storage capacity sold will be for file-based data
Big
Data
Sources
5 © Copyright 2012 EMC Corporation. All rights reserved.
500TB
50PB 1PB 1
0P
B
100TB
HOW BIG ?
6 © Copyright 2010 EMC Corporation. All rights reserved.
IT is changing (again)
Cloud Computing
Minicomputer
Mainframe
PC/
Microprocessor
Networked/ Distributed Computing
7 © Copyright 2012 EMC Corporation. All rights reserved.
2003 AND BEFORE
2005
2007
2009
ENTERPRISE STORAGE
INFORMATION LIFECYCLE
MANAGEMENT
INFORMATION & VIRTUAL
INFRASTRUCTURE
JOURNEY TO THE CLOUD
2012
CLOUD &
BIG DATA
The EMC journey
8 © Copyright 2010 EMC Corporation. All rights reserved.
Compute & Storage Convergence
Enterprise Applications Big Data Applications vM
otio
n
Fully Automated Storage Tiering (FAST)
Compute Tier
Storage Tier
Cloud Infrastructure
9 © Copyright 2010 EMC Corporation. All rights reserved.
Back Office:
SAP:
(Revenue accounting, production accounting, plant operations, etc.)
Oracle E-Business Suite, JD Edwards, MS Dynamics, Lawson, others
Upstream MidStream
Technical Computing
Traditional Data Center IT
IT in the Oil & Gas Lifecycle
Downstream Midstream Upstream
Refine Distribute Retail Explore Develop Produce Transport Trade
Downstream
Traditional Computing Requirements
10 © Copyright 2010 EMC Corporation. All rights reserved.
EMC in the Oil & Gas Lifecycle
Downstream Midstream Upstream
Refine Distribute Retail Explore Develop Produce Transport Trade
11 © Copyright 2010 EMC Corporation. All rights reserved.
Upstream Trends
• Increasing survey sizes – New sensor technology
• Growing importance of pre-stack
in interpretation
• Mixing old 3D with new 3D (4D)
• Predictive Analytics
• On-demand virtualized private
cloud – Processing and interpretation from
the same infrastructure
– Global collaboration
12 © Copyright 2011 EMC Corporation. All rights reserved.
Non linear Upstream Processes
Exploration Development Production Engineering
–Seismic acquisition
–Seismic processing
–Seismic interpretation
–Geological interpretation
–Drilling & testing
–Production Development and Optimization
–Reservoir Modeling
–Reservoir Simulation
– Facilities & Reservoir Engineering
–Drilling program
13 © Copyright 2011 EMC Corporation. All rights reserved.
Flexible
Ultra Scale
High Performance
Cloud meets Big Data
TRADISJONELL ARKITEKTUR
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN 16 TB LUN
16 TB LUN
VÅR LØSNING – EMC ISILON
ETT filsystem, ETT volum
Opp til 15+ Petabyte >80% utnyttbar lagring
Høy, forutsigbar YTELSE ENKEL administrasjon og skalering
CIFS NFS iSCSI
X-Noder NL-Noder S-Noder
Automatisk Sikring og Optimalisering
Enkel Administrasjon
ISILON
• Automatisk Tiering • Lastbalansering • Flash optimalisert • Detaljerte Analyser • Lokal- og Fjernsikring
OPERATIVSYSTEMET
ISILON IQ NODER
INFINIBAND NETTVERK
BYGGEKLOSSER
SKALERER PÅ 60 SEKUNDER
NODE NETWORK CPU MEMORY DISK
NODE DISK NETWORK CPU MEMORY
NODE DISK NETWORK CPU MEMORY
NODE DISK NETWORK CPU MEMORY
NODE DISK NETWORK CPU MEMORY
NODE DISK NETWORK CPU MEMORY FORUTSIGBARHET, LAV RISIKO
DAGENS BEHOV
FORUTSIGBAR SKALERING
TOM
TOM
TOM
TOM
TOM
FULL
FULL
FULL
FULL
BALANSERT
BALANSERT
BALANSERT
BALANSERT
BALANSERT
AUTOMATISK BALANSERING
FJERNSIKRING AV DATA
Asynkron replikering over LAN eller WAN
Kun nye/ modifiserte blokker blir
replikert
Sync jobbene skeduleres i
GUI
STAVANGER OSLO
Infi
nib
and
Co
re N
etw
ork
DATASET
DATASET DATASET
DATASET M
B/s
A
rch
ive
I/
Op
s
SMARTPOOLS - AUTOTIERING
Subgrupper av hardware innenfor samme cluster
Atributter dikterer initiell plassering
Automatisk flytting av data
Eliminerer migrering
INSIGHTIQ – DETALJERT ANLYSE
24 © Copyright 2010 EMC Corporation. All rights reserved.
VNX UNIFIED
VMAX
ISILON
DATA
DOMAIN
GREEN- PLUM
CENTERA
ATMOS
25 © Copyright 2010 EMC Corporation. All rights reserved.