Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017 Oracle and/or its affiliates. All rights reserved. |
NAS and Data ProtectionOracle ZFS Storage Innovation
Sandip RanaPrincipal Solutions Consultant
Storage - North America
2
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Engineered for data centers. Optimized for Oracle software.
Oracle’s Complete Storage Portfolio
Engineered Systems
Oracle Exadata
StorageTekSL8500 StoirageTek
SL3000 StorageTekVirtual Storage Manager
StorageTekSL150
StorageTekLTO drive StorageTek T10000
tape drive
Oracle SuperCluster
Oracle ZFS Storage ZS5 Series
Storage Cloud
SAN
Oracle FS1-2
Storage management: Oracle Intelligent Storage Protocol, Oracle Enterprise Manager, Oracle Automatic Storage Management,
Automated tiering: partitions, Oracle Hierarchal Storage Manager, Hybrid Storage Pool (a feature of Oracle ZFS Storage Appliance), StorageTek Virtual Storage Manager Data reduction: Oracle Advanced Compression, Oracle Automatic Data Optimization, Hybrid Columar Compression, Oracle Recovery Manager (Oracle RMAN), Oracle ZFS Storage Appliance deduplication/compressionData protection: Data Guard, Oracle RMAN, Oracle Secure Backup, Oracle ZFS Storage Appliance security/encryption: Oracle Advanced Security, Oracle Key Manager,
Storage Software
NAS and Data Protection
Oracle Exalogic
Oracle Big Data Appliance
Deployment options: private, public, hybrid
Services: IaaS, PaaS, SaaS
Consumption options: Build, manage, subscribe
Tape and Virtual Tape
4
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Built on a Decade of Storage Innovation
2 0 0 6 2 0 1 62 0 1 0 2 0 1 2 2 0 1 42 0 0 8
ZettabyteFile System
Hybrid Storage Pool
Analytics
DatabaseOracle Intelligent Storage ProtocolDatabase
Hybrid Columnar Compression
InlineDeduplication
InlineCompressionUnified
StorageInfiniBand
Triple ParityRAID
AntivirusIntegration
FlexibleEncryption
ShadowMigration
Oracle Snap Management Utility for Oracle Database
Oracle Enterprise Manager
ProvisioningREST/OpenInterfaces
HybridCloud Pools
(HCPs)
AnalyticBundles
TripleMirroring External
L2ARC
Oracle 7*10series
Oracle 7*20series
Oracle ZS3series
Oracle ZS4series
OracleZS5series
256 GB DRAM1 TB Read Flash280 TB Capacity
2.5 GB/sec
FlashStorage
1 TB DRAM4 TB Read Flash3 PB Capacity
10 GB/sec
2 TB DRAM12 TB Read Flash
4 PB Capacity17 GB/sec
3 TB DRAM230 TB Read Flash
7 PB Capacity32 GB/sec
3 TB DRAM307 TB Read Flash
9 PB Capacity41 GB/sec
5
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Oracle ZFS Storage Appliance
Oracle NAS and Data Protection
Oracle ZFS Storage ZS5-2 Oracle ZFS Storage ZS5-4
• Single or dual controllers
• 768 GB or 1.5 TB DRAM
• 4 PCIe expansion slots
• 3 PB capacity (Oracle Storage Drive Enclosure DE3)
• 102 TB read rlash
• 12 TB write flash
• Single or dual controllers
• 3 TB DRAM
• 7 PCIe expansion slots
• 9 PB capacity ((Oracle Storage Drive Enclosure DE3))
• 307 TB read flash
• 38 TB write flash
Oracle ZFS Storage Operating System• Most powerful storage software suite• Engineered integration with Oracle software
35% Faster and More Scalable Than the Previous Generation
NowShipping
6
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
• Oracle Intelligent Storage Protocol
• Fibre Channel
• iSCSI
• InfiniBand
- NFS/RDMA
- IPoIB
- iSER
- SRP
• Object API (OS8.7)
• NFS V3 and V4
• SMB/CIFS
• HTTP
• WebDAV
• FTP/SFTP/FTPS
• ZFS NDMP V4
Comprehensive Suite of Enterprise Software
• Hybrid Columnar Compression
• Hybrid Storage Pool
• Single, double, and triple-parity RAID
• Mirroring and triple mirroring
• End-to-end data integrity
• Local and remote replication
• Snapshots and clones
• Quota(s)
• Deduplication
• Compression
• Encryption
• Thin provisioning
• Antivirus via ICAP protocol
• Online data migration
• Clustering
• RESTful API, OpenStack/Cinder
• Browser and CLI interface
• Management dashboard
• Hardware/component view
• Role-based access control
• Phone home
• Event and thresholdbased alerting
• DTrace Analytics, a feature of Oracle ZFS Storage Appliance
• Scripting
• Workflow automation
• Advanced networking
• Snap Management Utility for Oracle Database
• Source-aware routing
Data Protocols Data Services Management
7
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Oracle ZFS Storage Technical Innovations
Optimal Storage SecurityShare/LUN encryption, two-tier key management, end-to-end integrity checks
Oracle Cloud CoengineeringShadow Migration, a feature of Oracle ZFS Storage Appliance, and rolling upgrades, user-level analytics, workflows
Record-Setting Storage PerformanceDRAM/flash architecture (Hybrid Storage Pool), SMP RTOS, most scalable file system (ZFS)
Industry-Leading Storage EfficiencyReal-time analytics, clone/snap, compression, deduplication, Hybrid Storage Pool, data services
Oracle Database CoengineeringOISP, HCC, ADO, OEM Provisioning, SMU, pluggable database analytics
8
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Adaptive Throttle Algorithm
Determines Pipe Size
3 TBDRAM
144 CoresProcessingPower
307 TBRead Flash
38 TBWrite Flash
All Flash|Re-engineered for Extreme Performance
▪ Automated, real-time data migration from DRAM to multiclass flash, to multiclass disk storage
▪ Software specifically engineered for multilevel flash and disk storage
Most Horsepower Possible Hybrid Storage Pool
Adaptive
I/O Staging
3 T
B D
RA
M
SSDs
WRITE FLASH
LRU MRU
LFU MFU
High EnduranceLog Record
(Evicted)
Flas
h S
tora
ge (
SSD
s)
800GBFlashSSDs
3.2TBFlashSSDs
3.2TBFlashSSDs
3 TB DRAM
1 PB Flash
StoragePool
Wri
te F
lash
Wri
te F
lash
Flash Storage
Pool
10
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OS 8.7 Oracle ZFS Storage ZS5 Series Flash Configuration Choices
FlashStorage Pool
Flash Storage Pool
DiskStorage Pool
DiskStorage Pool
Flash Storage Pool
DiskStorage Pool
zCloudStorage Pool
Flash Storage Configuration
Hybrid Storage Configuration
Hybrid CloudConfiguration
11
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OS 8.7 ZS5 Series All Flash Array
ZS5-2 > 1.5 TB DRAM, 128 TB Flash
▪ 8 K (60% R/40% W): 322 K IOPS
▪ 8 K (100% read): 1.43 M IOPS
▪ 1 MB sequential: 20 GB/sec
Extreme Performance
ZS5-4 > 3 TB DRAM, 256 TB Flash
▪ 8 K (60% R/40% W): 483 K IOPS
▪ 8 K (100% read): 2.1 M IOPS
▪ 1 MB sequential: 34 GB/sec
▪ Best real-time analytics
▪ 20 second failover (1,600 LUNs)
▪ Rapid RAID rebuilds
▪ In-line dedupe and compression
Proven Service Uptime
▪ Fastest create/delete capability
▪ Dynamic database optimizations
▪ Most scalable snaps/clone capability
12
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OS 8.7 What Is Oracle’s Dedupe Solution?✓ Strong dedupe designed by dedupe
experts
✓ Hybrid Storage Pool model reduces data ingest penalty
✓ Dedupe performance scales with meta devices (DDT SSDs)
✓ Dedupe per share or project provides flexibility
✓ Dedupe and LZ4 compression recommended for backup use cases
✓ NEW: LZ4 provides good compression ratios with reduced CPU overhead
WriteZILSSDDedup Table
Meta DeviceSSD
L2ARCSSD
ARC Memory
14
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Actions Taken Prior to Full Backup
Dat
a R
edu
ctio
n R
atio
Deduplication Plus Compression Compression
0
1
2
3
4
5
6
7
8
9
Perform Snapshot Increase VMDK Size Change a File VM+34 Dataset Add 1GB File
average
Measured results in Veaam backup environment
OS 8.7 6x Improvement in Data Reduction
15
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OS 8.7 Deduplicated Replication
Primary Business Values• Bandwidth cost savings• Dramatic benefits for Oracle RMAN backup use case • Increased DR protection by network-efficient
replication• Powerful tool when replicating VDI workloads
Features• Create hash table before each replication to send
only the deduplicated data to the target side• After replication update completes, replication
statistics show the original data set size and the size of the deduplicated data sent
• Performance highly data dependent
Supported Deployment Model• Replication feature in OS 8.7 release
16
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
0GB
500GB
1000GB
1500GB
2000GB
2500GB
3000GB
0hrs 00mins
1hrs 12mins
2hrs 24mins
3hrs 36mins
4hrs 48mins
6hrs 00mins
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9
Nine-Week OLTP Database Backup Offsite Replication Characterization w/50 ms Latency (RT)
OS 8.7 Replication/Deduplication
No Deduplication With Deduplication Replication Lag (no dedup) Replication Lag (with dedup)
17
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
OISPOracle Direct
NFS, InfiniBand HCC
Oracle Coengineering
Dynamic and
automatic
database-to-
storage
tuning
Superior
database,
data
warehousing
compression
Superior
performance
and
efficiency
SMU
Faster and
simpler way to
manage clones
and copies of
Oracle Database
OEM
Centrally monitor and manage ZFS
Storage Appliance
ADO
Advanced
and dynamic
database
(data)
optimization
Technology Advantage| Database Coengineering
19
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Optimized for Oracle and non-Oracle workloadsZFS Storage Appliance: High Value Backup, Restore and Beyond
OracleEngineeredSystems
Oracle Database
ZFS Storage Appliance for Backup
Non-OracleBackups
Fast Backup and Restore for Mixed
Workloads• High-throughput in-
memory architecture
• Database: maintains Oracle RMAN, compression and encryption best practices; optimizes storage configuration on the fly; provides detailed Oracle Database 12cbackup insights
• Non-database backups:includes Symantec, Commvault, Avamar
Extends ROI Beyond Backup
•Virtually unlimited snaps/clones for test, dev, QA, analytics, reporting•Maintaining of Hybrid
Columnar Compression • Ideal for heavily
virtualized environments
20
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Oracle ZFS Storage ZS5, Oracle RMAN Test Results
• Oracle ZFS Storage OS 8.7 software
• InfiniBand connectivity
• Double-parity storage profile
• LZ4 compression enhancements
• Active/active cluster workload
• Synch write bias = throughput
• 1 MB record size
• Level 0 database backup/restore
• Deduplication not in use
Oracle Database and Oracle RMAN throughput characterization with Oracle ZFS Storage ZS5-4
21
Sustained backup rates up to 60 TB/hr.Sustained restore rates up to 62 TB/hr.
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Use Case Purpose Competitive Advantage Best Practice
Database Backup Protect Exadata production DB’s Native InfiniBand connectivityRMAN integration: 2000 threads1MB block sizeHCC, OISP, CompressionZFS Backup Utility
Change threads to 2000Ensure MTU set to 65520Use Backup utility
Test & Dev Enable multiple DB copies for testing, development, reporting.
HCC, OISP, LZJB CompressiondNFS/PerformanceSnap Managment Utility (SMU)
Use SMU to easily provision unlimited DB copies
Storage expansion Free up Exadata space by moving old data/partitions to ZFS Storage
dNFS/Performance HCC, CompressionNative InfiniBand
Move tier-2 or low-use DBsMove cold-data partition (may impact workload)
DB Migration to Exadata
Migrate Oracle DB’s from any platform (i.e. HP) to Exadata
dNFS/Performance HCC, CompressionNative InfiniBand
Bridge FC (old server) to InfiniBand (Exadata)
Disaster Recovery Maintain stand-by remote database on ZFS Storage using DataGuard
SMU integration with DataGuardHigh Performance
Use SMU to automate Standby site creationSet expectation: performance < Exadata.
Oracle Confidential – Internal 22
Exadata plus ZFS Storage: Use Cases and Best Practices
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 23
RMANRMAN
Image
Dev / Test
ZFS clones
Prod
Database
Direct NFS
• Thin cloning of RMAN image files using ZFS snapshots and clones
• Mount thin clones via Direct NFS Client
• Native IB connection to Exadata
• No initial space consumption for Dev Test thin clones
• Increases ROI on your backup storage investment
Oracle Confidential – Internal
ZFS Backup ApplianceExadata
Oracle ZFS Backup Appliance ZS5 Dev/ Test and RMAN backup
https://mosemp.us.oracle.com/epmos/faces/DocContentDisplay?id=2087231.1
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Oracle Intelligent Storage Protocol
• Database and storage coengineering– Intelligence is in the code within both the database and
storage
– Available only with Oracle Database 12c and Oracle ZFS Storage Appliance OS 8 and above
• Storage awareness of database workload– Database sends cues about each I/O to the storage
– Over 70 database I/O types are recognized
– Cues grouped into five distinct categories by storage
– Information used by storage to adaptively and automatically adjust for optimal efficiency
OracleDatabase 12c
Oracle ZFS
Storage
Appliance
dynamically
tunes critical
storage
parameters
I/O cues
exchanged with
Oracle ZFS Storage Appliance
24
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Without Oracle Intelligent Storage ProtocolStandard NFS server
I/O
All I/Os look the same {size, read versus write, file handle}
I/O
I/OI/O
I/O
I/O
I/O
25
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
With Oracle Intelligent Storage ProtocolDirect NFS Client, a feature of Oracle Database, + Oracle ZFS Storage Appliance
Oracle RMAN full
backup
Each I/O is tagged with:-- Who issued it-- What it’s for-- Its priority-- Other interesting metadata
LGWR redo write
Temp write from DB #1
DBWR writeto resolve
“free buffer wait”Buffer cache read for
OLTP transaction, PDB #2
Table scan read from DB #2
Buffer cache read for OLTP transaction, PDB
#3
DBWR write—no threat of
“free buffer wait”
Archive log write
Oracle Real Applications
Cluster voting disk I/O
Oracle RMAN apply
26
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
dNFS TCP IPOISP Network IP TCP dNFS OISP
Dynamic Actions• Dynamically record size, log bias
(shipping)
• Pluggable database analytics (shipping)
• Oracle Enterprise Manager provisioning (Shipping)
• Analytics AWR feed
• I/O fair share scheduling and DB priority
• I/O caching/prefetch
Oracle Intelligent Storage Protocol Technology: DB Coengineering
Oracle Database with Oracle Intelligent Storage Protocol• Extensions built on top of NFSv4 protocol• Each I/O is tagged with data context
– I/O reason– I/O priority– File type (redo log, data file, control file,
backup file)– Database block size for file– Database and/or pluggable database ID– Cache hints– Prefetch hints
27
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Without Oracle Intelligent Storage Protocol Dynamic I/O Tuning With Oracle Intelligent Storage Protocol Dynamic I/O Tuning
Logfile share
Datafile shareMany shares, each with its own record size and log bias setting
Over 20 shares, each manually tunedmnt/dbname/redo* (block size, latency)mnt/dbname/control* (block size, throughput)mnt/dbname/pfile* (block, throughput)mnt/dbname/datafile* (block size, throughput)mnt/dbname/tempfile* (block size, throughput)mnt/dbname/chgtrack* (block size, throughput)mnt/dbname/backup* (block size, throughput)…
Two shares, dynamically tuned directly by the 12c Databasemnt/dbname/logfile(Oracle Intelligent Storage Protocol sets record size, logbias)
redomnt/dbname/datafile(Oracle Intelligent Storage Protocol sets record size, logbias)
controlpfiledatafiletempfilechgtrack, etc.
Dynamic I/O Database-Storage Tuning Oracle Intelligent Storage Protocol 1.0
28
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Oracle Intelligent Storage Protocol 2.0: Efficient Cache Management
OLTP START Oracle RMAN START OLTP START Oracle RMAN START
ARC Evictions
• Simultaneous Oracle RMAN + OLTP workloads
• RPC fair share scheduler with DB I/O prioritization
• Negative cache hints for lower priority like Oracle RMAN and archivelog I/O
Before Extensions With Extensions
29
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Before ExtensionsWith Extensions
86% reduction in LGWR latency
33% faster datafile backup
• Bounded latency for higher priority DB I/O
• RPC fair share scheduler with DB I/O prioritization
• Separate thread pools for READs, WRITEs, and Oracle Intelligent Storage Protocol high-priority I/O
Oracle Intelligent Storage Protocol 2.0: Optimized Database Storage
30
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Database I/O Statistics by Function
Fair Share Scheduling Not Enabled Fair Share Scheduling Enabled
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
2
1 2 3 4 5 6 7 8 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
seco
nd
s
minutes
0
0.2
0.4
0.6
0.8
1
1.2
1.4
1.6
1.8
2
1 2 3 4 5 6 7 8 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
seco
nd
sminutes
PerformanceStabilization
Point
PerformanceStabilization
Point
7.6x faster time to peak performance
Database OLTP performance charted with no data in storage cache at start
Oracle Intelligent Storage Protocol 2.0: Fair Share Scheduling (FSS)
31
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Control FilePerformance
Log FilePerformance
Transactions Per Minute(AWR output)
2.07 ms
27.95 ms
13.5xFaster
7.29 ms
28.95 ms
3.9xFaster
197,274
235,549TPM
19%Faster
Multiple (OLAP/OLTP) database workloads running concurrently
Oracle Intelligent Storage Protocol 2.0: Fair Share Scheduling (FSS)
32
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Problem: Matching the DB I/O to what the DB administrator knows…
Database I/O Statistics by File Type
Database I/O Statistics by Function
• Datafile• Temp File• Archive Log• Data Pump/Dump
• Log Files• Backups• Control File• Flashback Log
• DBWR• Direct Writes• LGWR• Archive
• Oracle RMAN• Recovery• Streams/AQ• XDB
Oracle Intelligent Storage Protocol 2.0: Only Storage with Database (AWR) Analytics
33
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Hybrid Storage Pool serve 86% of I/O from L1 and L2 cache
OS 8.7 Oracle ZFS Cloud (Hybrid Cloud Pool)
0.01 ms latency
0.10 ms latency
10 ms latency
L2ARCSSD
WriteZILSSD
System Storage PoolHDD blocks
512/4 K Record Size
ARC/DRAM
WriteZILSSD
Cloud Storage PoolObjects
4 K-1 M Record Size
ARC/DRAM
L2ARCSSD
ZFS Cloud
Standard
Application
~100 ms latency
35
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Hybrid Cloud Pool (HCP) Technology As a Bridge
Hybrid Cloud Pool
Object API
SMB/NFS
FC/iSCSI
FTP/WebDav
HCP
HSPs serve 85-90% of I/O
from L1 cache/ARC
Hybrid CloudPool (HCP)
Hybrid Storage Pool
0.01 ms latency
0.10 ms latency L2ARCSSD
WriteZILSSD
System Storage PoolHDD blocks
512/4K Record Size
ARC/DRAM
WriteZILSSD
Cloud Storage PoolObjects
4K-1M Record Size
ARC/DRAM
L2ARCSSD
Application
Advanced NAS and data protection storage systems will expand into public clouds natively to provide
virtually unlimited data protection scalability
36
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Uses: Hybrid Data Management, Migration, and DR
• Basic Cloud Gateway: moves data from on-premises to OPC/object storage; can be used for data migration as well.
• Data Protection Using Replication: create a DR copy in the cloud.
• Data Protection/Backup: local/remote targets for NBU, Commvault, and Veeam.
WriteZILSSD
L2ARCSSD
ARC/DRAM
HCP
HCP
L2ARCSSD
ARC/DRAM
WriteZILSSD
HCP
L2ARCSSD
ARC/DRAM
WriteZILSSD
L2ARCSSD
ARC/DRAM
WriteZILSSD
37
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
ZFS Compression and Deduplication
ORACLE CLOUDSocial. Mobile. Complete.
Data Protection
Hybrid Cloud Pool
Oracle Intelligent Storage Protocol, Hybrid Columnar Compression, Advanced Compression/Advanced Data Optimization, Oracle RMAN, Encryption, Compression, etc.
Hybrid Cloud Pool
Up to 20:1 Data Reductionon Ingest
Up to 8:1 Data Reductionon Replication
Oracle ZFS Cloud Integrated with Proven Enterprise Storage Appliance
38
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. |
Oracle’s NAS and Data Protection System
Best performance. Best efficiency. Best security.
Trusted by a majority of the F100 and Oracle IT.
Foundation storage for Oracle Cloud.
Engineered for Oracle software.
Oracle Confidential – Highly Restricted 39