© 2003 EMC Corporation. All rights reserved. EMC Oracle Database on NAS Accelerator Service OracleWorld September 2003

© 2003 EMC Corporation. All rights reserved.

EMC Oracle Database on NAS Accelerator Service

OracleWorld September 2003

© 2003 EMC Corporation. All rights reserved. 22

Agenda

Using NAS for databases

NAS Database architecture overview

Important metrics for planning

Solution: Jointly-developed Oracle database on NAS accelerator service


Using NAS for Databases

Economical– Low attach cost– Low management cost – Leverage existing skill sets– Can be used for lower I/O DBs: ie

development

Functional– Easy to set up and reconfigure – Eliminates disk grooming– Faster backups and MTTR

Compatible – Clients– Applications– Networks


Old days: Server-Centric, Block Access

Sun FS

HP FS

IBM FS

Sun

HP

IBM

UNIX AppsUNIX AppsWindows

Compaq


Sun HP IBM

EMC Storage

UNIX AppsUNIX AppsWindows

New Paradigm – Network Storage

Linux

Cisco

NFS

NF

S

NF

S

NF

S

NF

S

NF

SFS


Changes that made NAS Feasible for Databases Network Enhancements:

– Adaptation of Jumbo Gig E (9000 MTU)– Network data separation

Increases in Host Processing Capabilities:– Increases in Mhz and Processing Power– Decreases in cost of host RAM

Industry Knowledge of Managing Database Objects– Technology Knowledge Sharing: Web Training, Google,

MetaLink…– DBAs are getting better at managing all database objects,

REDOs, temp tablspaces, init.ora …etc.


Changes that made NAS Feasible for Databases

EMC NAS Storage optimizes response time – Enhanced multi path access to disk information – Cache rich environment– Guaranteed referential integrity– 8K UxFS Alignment to Oracle 8k Blocksizes– Increases in MHZ and ram for NAS Device data movers


Why Jumbo Gig E ?

The Alteon Jumbo Frame study:

– Jumbo Frames(9000MTU) provide 50% more throughput with 50% less CPU load than 1500 byte frames.

– Smaller frames usually mean more CPU interrupts and more processing overhead for a given data transfer size.

1500 MTU = +- 330 MB/Second throughput

9000 MTU = +- 900 MB/Second throughput


What do Jumbo Frames do for Database transactions ?

It depends on how the database is writing/reading from disk.

Size of transaction and the number of transactions

Generally Jumbo Frames will enhance OLTP throughput by 10-20%

Most performance gains are realized with DB maintenance, then gains of 300% can be realized.


All Response factors

E = CPU + k * I/O + m * PF

E = transaction response time

CPU = time for the number of CPU clock ticks

k = time for each read/write operation

I/O = number of disk read/write operations

m = elapsed time for each page fault

PF = page faults, or the number of times a program needs another page of memory

Source: Oracle


= Ethernet Cable

= Copper Fibre

Internal Network

Control Station

NAS DM2

NAS DM3

DAE

CX600 SPA

CX600 SPB

Sample NAS Storage NS600

AUX AUX

Storage Network2 x 2.4 Ghz CPU

2 x 4 Gig ram

8 Gig ram

4 – 8 tbytes

Network


Celerra NS600 High Availability

Platform– No single point of failure– N+1 power and battery backup– Redundant, hot-pluggable components– Mirrored write cache– De-stage write cache to DISK upon power failure– SNiiFFER: Sector inspection utility

Function– RAID protection (1, 5)– Dual Storage Processors with automatic failover– Primary / Standby Data Movers with automatic failover– Quick Data Mover reboots

Service– Non-disruptive microcode updates– Remote maintenance, call home, automatic diagnostics


NS600 SnapSure Rapid Database Replication Replicates on the file system level

Makes use of a Celerra meta volume (SavVol)

Copy on first write

SavVol is NOT a BCV volume

Typically uses 10% of space of a mirror copy

Replication and Recovery

Save original DB10

SavVol

Save original DB8Save original DB7Save original DB5Save original DB2

Unchanged = 0, Changed = 1

DB0 0DB1 0DB2 1DB3 0DB4 0DB5 1DB6 0DB7 1DB8 1DB9 0DB10 1DB11 0

Bitmap

PFS Data Blocks

DB0DB1DB2DB3DB4DB5DB6DB7DB8DB9DB10DB11

Production filesystem

Write over PFS DB8Write over PFS DB10Read PFS DB0

Write over PFS DB7Write over PFS DB5Write over PFS DB2Read PFS DB1Read PFS DB0

Read PFS 3

Transactions Bound for PFS


Architecture Planning: Hardware Infrastructure

Once properly setup Oracle EMC NAS Deployments are very easy to manage going forward.

Most organizations have the infrastructure and personnel in place to facilitate rapid deployment of storage using EMC tools

A separate storage network with private VLANS must be set up

Review existing host infrastructure for jumbo GigE (9000MTU) NIC Compatibility through entire storage stack….Host and Switch(s)

Two switches are recommended for DB High availability and recovery


Architecture Planning: Database

Number of databases which will reside on each array

Size of the databases

Type of database (OLTP, data warehouse …etc.)

Combined peak I/O for all databases

Segmentation of I/O by database object

Number of concurrent users

Database response time

Other application activity on the storage

Backup considerations


Data &Indexes

Archives

Logs 2

Data & Indexes

Logs 1, Binaries

Archives

Failover

Logs 2

Sun E4500Oracle Server400 Ghz 10 CPU's10Gb RAM Ethernet

Card

EthernetCard

EthernetCard

EthernetCard

CISCO 6500Switch GigE

CISCO 6500Switch GigE

Solaris 8Patch 21

Trunk 1Jumbo Frame ETH

Trunk 2Jumbo Frame ETH

Logs 1, Binaries

Crossover cable

Shelf 1 15 disks

Shelf 2 15 disks

Shelf 3 15 disks

Data MoversActive/Passive

EMC NS600Jumbo Frame

ETH

Jumbo FrameETH

Vol 1 - Log 1./instance 1./logVol 2 - Archive./instance1./archVol 3 - Sav Vol

Vol 4 - Data 2./instance 1./dataVol 1 - Log 1./instance1./logVol 5 - Data 1./instance 1./dataVol 6 - Log 2./instance1./log

Vol 1 - Data 1./instance 1./dataVol 4 - Data 2./instance1./logVol 6 - Log 2./instance 1./dataVol 5 - Data 1./instance1./logVol 3 - Sav Vol

EthernetCard

EthernetCard

EthernetCard

EthernetCard

EthernetCard

EthernetCard

Crossover cable

EMC Oracle Database Reference Architecture


General NAS Architecture Guidelines for Oracle

Standard Oracle physical disk separation for DB safety

Separate Redo logs on at least two separate physical disk stripe sets

Present mounts for Redo logs down independent network connections or VLANS

If HA is required, place redo’s on separate switches

Design NAS file systems to satisfy I/O demand from each database object

Design IP connections to balance or distribute disk I/O



Qualified DBs move to more cost effective storage

EMC and Oracle conduct a thorough pre-site inspection

Customer runs scripts supplied by Oracle and EMC are run to gather workload data, also new databases

Oracle and EMC will compile, review I/O stats, design, and test NAS Solution

Oracle and EMC Consultants perform: installation, setup, knowledge transfer and documentation

An industry leading EMC robust backup and recovery process will be installed and set up to optimize Mean Time to Recovery or (MTTR)


Oracle Source Database on DAS

or Other

Oracle Database Now on NAS

Ready for High SpeedBackup and Recovery

Source Storage

DAS db1Oracle Database

NAS db1Oracle Database

EMCNAS Storage

Copy DB to robust 8k block EMC NAS

Oracle compiles and reviews database’s I/O for migration to NAS architecture

Oracle and EMC consultants forward engineer alldatabase objects and optimize database I/O on EMC NAS




Working together, Oracle and EMC Technical Specialists will perform the following steps on your Database in eight consecutive days to completion:

Project Scope and Organization– Phase I – Planning

– Phase II – Design, Configure, and Test

– Phase III – Documentation, Overview, Acceptance


Phase I – Planning for a NAS Deployment

EMC Technical Solutions Consultants works closely with Oracle Consulting and your staff during this phase to conduct these pre-site “discovery” tasks:

Run an analytical script in your environment which will:

– Check for existence of specific patches/files– Server,O/S, DB Configurations (Source and Target)– Document the current DB file layout – Document the current storage array topology – Compile and study all I/O in the database– Detailed review and confirmation of the layout – Based on the results from pre-site probe, finalize and

document the existing configuration for an in-depth study


Phase II – Design, Configure, and Test

Step 1 – Design

Application and database mount point layout for optimal NAS forward Engineering on an EMC NS600 NAS Storage array

Specify network and hardware infrastructure requirements (if any)

EMC will configure the NS600 and specify the right stripe depth for each NAS file system based on required Database I/O.

Oracle and EMC will design the backup and recovery process and optimize MTTR using robust and patented EMC technologies

A Test Plan will be set up to attain or exceed current service levels


Step 2 – Configure the NS600 for Optimal DB Deployment

– The init.ora shared memory and semaphore parameters– Set up NAS REDO Log Multiplexing for data safety– Move data files and objects as necessary for NAS io

optimization– Configure the NS600 Disks as specified in design phase– All application and database startup / shutdown scripts – RMAN and EMC Snapsure Backup and Recovery for

all Databases

Phase II – Design, Configure, and Test(Continued)


Celerra Web Manager

Designed to facilitate:

• Efficient storage management

• Complete functional action on entire NAS storage stack

• Performance analysis with Celerra monitor


Step 3 – Test the entire Oracle on EMC NAS Deployment

– Substantiate the transition strategy

– Execute some standard database I/O tests, review stats pack

– Thoroughly review target NAS Database

– Application startup/shutdown testing source and target

– Review and test backup and recovery

– Full system and application stress test

Phase II – Design, Configure, and Test (Continued)


Phase III – Documentation, Functional Overview, and Acceptance EMC Consulting and Oracle Consulting perform these

tasks

– Complete, review and deliver “best practices” engagement documentation for:

• The entire Oracle and EMC NAS Accelerator Service • Before and after: architecture, storage, application, and db

configuration • Application and database backup / recovery processes and

benchmarks

– Allow for knowledge transfer throughout the entire engagement by allowing you or your staff to assist and shadow consultants

– Gain acceptance of all procedures from you and your staff


Benefits of the EMC Oracle Database on NAS Accelerator Service Reduced Cost:

– Fixed price engagement– Rapid installation with proven methodology

Reduced Risk:– Optimal setup has been validated by Oracle in EMC Labs and

is globally supported– Repeatable NAS Database Storage methodology is

established for additional db deployments

Improved SLA– Fully-documented implementation – Oracle Database experts will verify that all database objects

properly relocated and tuned on NAS – World-class and Robust Global Presence provides solutions,

service, and 24x7x365 support for years to come


Solution Presentation Summary

Using NAS for databases : Now Feasible

NAS Database Architecture Overview

Important Metrics for planning: I/O review

Solution: Jointly-developed Oracle database on NAS accelerator service

Full Live Oracle 11i on NAS Demonstration at the EMC Booth


Documents

© 2003 EMC Corporation. All rights reserved. EMC Oracle Database on NAS Accelerator Service OracleWorld September 2003