42
© 2003 EMC Corporation. All rights reserved. © 2003 Dell Inc. All rights reserved. Infrastructure of choice for Oracle Real Application Clusters Bob Ng, EMC Ravi Kumar, Dell Inc

© 2003 EMC Corporation. All rights reserved. © 2003 Dell Inc. All rights reserved. Infrastructure of choice for Oracle Real Application Clusters Bob Ng,

Embed Size (px)

Citation preview

© 2003 EMC Corporation. All rights reserved.© 2003 Dell Inc. All rights reserved.

Infrastructure of choice for Oracle Real Application Clusters

Bob Ng, EMC

Ravi Kumar, Dell Inc

© 2003 EMC Corporation and Dell Inc. All rights reserved. 22

Objectives of This Session

Oracle Real Application Cluster (Oracle RAC) on Linux

EMC CLARiiON Storage platforms – value add for Oracle RAC environments.

Dell | EMC - Oracle RAC joint configuration for Linux

Customer adoption and examples

© 2003 EMC Corporation and Dell Inc. All rights reserved. 33

Linux Emphasis in Oracle Real Application Clusters Drive down TCO for infrastructure running DB service

– RAC technology emphasizes scaling out via clustering– RAC on Linux offers cost effective modular growth

Technical advantages of Linux for Oracle– Open source

• Collaborate, contribute and influence

– Strong alliance with OS delivery partners– Easier transition and adoption from UNIX to Linux

© 2003 EMC Corporation and Dell Inc. All rights reserved. 44

EMC Support for Linux

EMC CLARiiON Application Solution team involvement– Working onsite at Oracle HQ with Linux team

EMC CLARiiON CX600 used in Oracle RAC Linux development

EMC Interoperability lab stepped up Linux qualifications– RH 2.1AS on many server platforms– EMC-qualified HBA drivers (e.g., QLOGIC, EMULEX)– PowerPath 3.0 under Red Hat 2.1AS– Oracle RAC as a special clustering technology– Oracle Cluster File System

Joint support service center with Oracle at Hopkinton

© 2003 EMC Corporation and Dell Inc. All rights reserved. 55

Running Oracle RAC on EMC Clariion Storage Platforms Boosted price performance of the Oracle RAC Linux

solutions– Clariion hardware enhancements– New software features with the Clariion product line

ATA technology integration within Clariion system– Option to increase capacity at attractive cost level

© 2003 EMC Corporation and Dell Inc. All rights reserved. 66

EMC Clariion Family at a Glance

Feature CX200 CX400 CX600Max System Cache 1 GB 2 GB 8 GB

Max Write Cache 512 1 GB 2 GB

Front-End Ports (2 Gb)

4 4 8

Max HA Hosts 15 64 128

Back-End Ports (2 GB)

2 4 4

Min to Max Disks 4 to 30 5 to 60 5 to 240

Max LUNs per System

128 256 512

Max LUNs per Disk 32 32 32

Max IOPS (cached) 40,000 60,000 150,000

Max Bandwidth (cached)

200 MB/s 680 MB/s 1,300 MB/s

© 2003 EMC Corporation and Dell Inc. All rights reserved. 77

Investment Protection for Your Linux RAC Infrastructure

2-Way

CX200

FC direct Connect

Private Cluster Interconnect

© 2003 EMC Corporation and Dell Inc. All rights reserved. 88

Cluster Private interconnect

Switch

Scaling Out to the Full RAC Configuration

CX600/CX400

4-way top end servers

© 2003 EMC Corporation and Dell Inc. All rights reserved. 99

EMC Clariion CX600 value to scaling Oracle RAC

RAC Scale-out Implications Relevant CX600 Enhancements

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1010

EMC Clariion CX600 value to scaling Oracle RAC

RAC Scale-out Implications Relevant CX600 Enhancements

Continual need to be able to add RAC server nodes to fabric

Increased connectivity from expanded front-end ports (4/SP)

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1111

EMC Clariion CX600 value to scaling Oracle RAC

RAC Scale-out Implications Relevant CX600 Enhancements

Continual need to be able to add RAC server nodes to fabric

Increased connectable node due to expanded front-end ports (4/SP)

Higher burst of DB page flushing from server to storage for OLTP

Expanded cache provision extends headroom to absorb flushing burst

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1212

EMC Clariion CX600 value to scaling Oracle RAC

RAC Scale-out Implications Relevant CX600 Enhancements

Continual need to be able to add server nodes to fabric

Increased connectable node due to expanded front-end ports (4/SP)

Higher burst of DB page flushing from server to storage for OLTP

4 GB cache per SP quadruple headroom to absorb flushing burst

Increasing OLTP random I/O requires more physical disk spindles

Increased spindle count support to 240 disks per array

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1313

EMC Clariion CX600 value to scaling Oracle RAC

RAC Scale-out Implications Relevant CX600 Enhancements

Continual need to be able to add server nodes to fabric

Increased connectable node due to expanded front-end ports (4/SP)

Higher burst of DB page flushing from server to storage for OLTP

4 GB cache per SP quadruple headroom to absorb flushing burst

Increasing OLTP random I/O requires more physical disk spindles

Increased SP power supports up to 240 FC disks per array

Larger database in single array Support larger and more databases within the same CX600 array

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1414

EMC Clariion CX600 value to scaling Oracle RAC

RAC Scale-out Implications Relevant CX600 Enhancements

Continual need to be able to add server nodes to fabric

Increased connectable node due to expanded front-end ports (4/SP)

Higher burst of DB page flushing from server to storage for OLTP

4 GB cache per SP quadruple headroom to absorb flushing burst

More spindles support for higher OLTP random I/O

Increased SP power supports up to 240 FC disks per array

Larger database in single array Up to 35 TB per array

Increased degree of parallel DSS operations

Full 2 GB end-to-end internal enhancements boost maximum DSS data streaming rate (700 MB+ sustained)

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1515

EMC Clariion Software - Value to Oracle RAC / Linux

PowerPath– Enterprise level Multi-path I/O with load balancing

Snap View– “Instantaneous” stored data replication– Persistent snapshots (logical copies, reduced space requirement)– Business Continuance Volumes (Full replicas for performance

critical work)– Enabling technology supporting a variety of rapid Oracle

deployment options. Rapid cloning services jointly delivered by EMC/Oracle consulting (e.g. Oracle 11i Apps environment rapid cloning)

SAN Copy– Block storage copy between storage systems

Support for SAN Copy and MirrorView over IP

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1616

Cluster Interconnect

Brocade Switch

EMC PowerPath Software with Oracle RAC

SP-A connect

SP-B connectCX600/CX400

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1717

EMC SnapView Software with Oracle RAC

Production Production RAC nodesRAC nodes

Production DBProduction DB

Gold backup Gold backup BCV copyBCV copy

Restore DB with fast Restore DB with fast reverse resynchronizationreverse resynchronization

Repurposing BCVRepurposing BCV

Backup Backup RAC nodesRAC nodes

Repurposing DB Repurposing DB using split BCVusing split BCV

Establish BCVsEstablish BCVs

Point-in-time BCV splits Point-in-time BCV splits with Oracle in hot backupwith Oracle in hot backup

Linux servers

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1818

EMC SAN Copy Software with Oracle RAC

Production Production RAC nodesRAC nodes

PE6650PE6650

Second Second RAC nodesRAC nodes

Production DB

SV/BCV

Source arraySource array Target arrayTarget array

© 2003 EMC Corporation and Dell Inc. All rights reserved. 1919

Using EMC SAN Copy to Setup an Oracle Standby DB

Production Production RAC nodesRAC nodes

PE6650PE6650Production DB

logs

Production Production site arraysite array

Standby site Standby site arrayarray

Production control filesProduction control files

Standby DB Standby DB RAC nodesRAC nodes

Standby DB filesStandby DB files

Standby logs Standby logs (active/archive)(active/archive)

Standby control filesStandby control filesBackup Backup control filescontrol files

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2020

EMC CLARiiON ATA technology

Integrated component of the CX product offering

Industry unique capability of co-existence with Fibre Channel disks within same storage system

Leverage all processing and caching features of the CX storage systems

Supported by all software that runs on the CX systems

– Snap View, SAN Copy, MirrorView, etc.

Session 36675, Wed, 9/10Session 36675, Wed, 9/10

ATA drives

FC drives

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2121

Linux Oracle RAC Supported Configuration An Oracle concept initiated about three years ago Emphasis on reduction in TCO

– Rapid deployment– Reliability of deployment– Reliable support – Single-point acquisition, single-point support

Oracle/EMC/Dell collaboration on Dell Linux Oracle RAC Supported Configuration

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2222

EMC Contribution and Support for Configuration

EMC CLARiiON Application Solution team involvement– Assist with component definition of configuration– Verify delivery– Provide backing support to Dell’s single-point-of-field support

Interoperability lab– Share product and qualification roadmap plan with Dell and

Oracle– Prioritize effort to fit with joint delivery plans

Joint support service center with Oracle at Hopkinton– Fully leveraged to augment Oracle Unbreakable Linux

support model

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2323

Dell | EMC | Oracle Engineering Partnership History

1997 1998 1999 2000 2001 1H 2002 2H 2002 1H 2003

1998First Dell |

Oracle Products Launch

2000Oracle Linux development

on Dell

2001Oracle begins

migration to Linux on Dell within their

datacenter

Oracle pilots Dell in Oracle datacenter

Dell announces Oracle9i RAC with

EMC storage

1H 2002 Dell Deploys

Oracle 9i RAC for Order

Management

Dell | Oracle | Red Hat Launch

Unbreakable Linux

2H 2002

Over 22,000 Dell|Oracle

installations in past year

Oracle deploys 2,000 Dell servers in

Oracle datacenters

1997Dell | Oracle Partnership

FormedDell SC 1.0

Dell SC 2.0

Dell SC 2.1

2H 2003Dell SC 2.2

Dell SC 2.3

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2424

Dell | EMC | Oracle - Solutions History

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003

Dell Supported Configuration 1.x

Red Hat Linux

7.2 Professional

Oracle Database

9i R1 901

Shared Storage

raw partitions

Dell | EMC EMC FC-4700

PE Servers 6450

Delivery Factory Installed

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2525

Dell | EMC | Oracle - Solutions History

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003

Dell Supported Configuration 2.0

Red Hat Linux

2.1 Advanced Server

Oracle Database

9i R2 9.2.0.1

Shared Storage

raw partitions

Dell | EMC EMC FC-4700-2

PE Servers 6650, 6600, 6450

Delivery Factory Installed

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2626

Dell | EMC | Oracle - Solutions History

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003

Dell Supported Configuration 2.1

Red Hat Linux

2.1 Advanced Server

Oracle Database

9i R2 9.2.0.1

Shared Storage

raw partitions

Dell | EMC EMC CX600, CX400, FC-4700-2

PE Servers 6650, 6600, 6450, 2650, 8450

Delivery Deployment Kit

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2727

Dell | EMC | Oracle - Solutions History

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003

Dell Supported Configuration 2.2

Red Hat Linux

2.1 Advanced Server, e12

Oracle Database

9i R2 9.2.0.2

Shared Storage

raw partitions, OCFS 1.0.5, Powerpath 3.0.2

Dell | EMC EMC CX600, CX400, CX200, 4700-2

PE Servers 6650, 6600, 6450, 2650, 8450

Delivery Deployment Kit

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2828

Dell | EMC | Oracle – Solutions Today

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q3 2003 Q4 2003

Dell Supported Configuration 2.2.1

Red Hat Linux

2.1 Advanced Server, e24

Oracle Database

9i R2 9.2.0.2

Shared Storage

raw partitions, OCFS 1.0.8, Powerpath 3.0.3

Dell | EMC EMC CX600, CX400, CX200, 4700-2

PE Servers 6650, 6600, 6450, 4600, 2650-533

Delivery Deployment Kit

© 2003 EMC Corporation and Dell Inc. All rights reserved. 2929

Dell | EMC | Oracle - Solutions Today

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q4 2003 1H 2004

Dell Supported Configuration 2.3

Red Hat Linux

2.1 EL, e24

Oracle Database

9i R2 9.2.0.4

Shared Storage

raw partitions, OCFS 2.0, Powerpath

Dell | EMC EMC CX600, CX400, CX200, 4700-2

PE Servers 6650, 6600, 6450, 4600, 2650, 2600, 1750

Delivery Deployment Kit

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3030

Dell | EMC | Oracle - Solutions Future

1H 2002 Q3 2002 Q4 2002 Q1 2003 Q2 2003 Q3 2003 Q4 2003 1H 2004

Dell Supported Configuration for Oracle 10g on RH 2.1

Red Hat Linux

2.1 EL, RH 2.1 QU3, RH 3.0 EL

Oracle Database

10g R1 10.0.1.0 (+IB)

Shared Storage

OCFS 2.0 (+shared home), OSM, Powerpath

Dell | EMC All EMC Clariion, other SAN switches, HBAs

PE Servers All Dell 2P, 64-bit

Delivery Deployment Kit using DSA

?

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3131

Dell PC5012 / PC5244 Cluster

Interconnect

Brocade Switch

A typical four node Dell Supported Configuration

CX600/CX400

PE6650

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3232

Dell Linux Oracle RAC Supported Configuration

Emphasis on reduction in TCO– Rapid deployment– Reliability of deployment– Reliable support – Single-point acquisition, single-point support

For more information:

http://www.dell.com/oracle

A bundle that is ordered as a single SKU– Dell servers (2-4-8 nodes)– Dell Deployment Software Tools for Oracle– Dell | EMC CLARiiON storage and SAN switches– Installation service

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3333

Dell Solution Components

Storage

Switch

HBA / RAID

Servers

OS/OCFS versions

DatabaseOracle Oracle

DatabaseDatabase

PERC 3/DCPERC 4/DC

PE2650, 4600, 6600, 6650PE2650, 4600, 6600, 6650, 8450

QLA2342

DASW3800SW3200

CX200FC4700-2 CX600CX400

QLA2340

QLA2310

Red Hat AS Updates/Major Release N and/or OCFS N

Red Hat AS Updates/Major Releases N-1 and/or OCFS N-1

PV220SU320

PV220SU160

Oracle Test Focus

EMC Test Focus

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3434

Dell Test Methodology: Dell performs comprehensive tests on 9i RAC [Clusters of

2-8 nodes] and 9i DB [Single Node] products

Level 1 Testing [Functional Testing]:– Integration Testing [e.g. Oracle patches + OCFS + PowerPath]– Functional Testing [e.g. Install Wizard and Configuration Wizard]– Bounds / Coverage testing– Documentation testing

Level 2 Testing [Integration/Solution Testing]:– Performance, stress testing– Multiple HW Configurations [e.g. 2x2650, 4x6650, 8x8450,

CX200,CX400, CX600 etc.,]– Destructive Testing while running stress test [e.g. PowerPath, Private

interconnect]– Documentation testing

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3535

Dell’s Oracle Solution Deliverables Deployment CD-ROM kit

– Contains all software / source / documentation to deploy Oracle product.

Installation Wizard– Installs Oracle and Red Hat 2.1 AS in a Turnkey fashion.

Live Install– Component of Installation Wizard, allows installation of

Oracle on a pre-existing RH 2.1 AS system.

Configuration Wizard– Configuration framework for pre-Oracle OS/Oracle.

Deployment Guide, Howtos, white papers– Documentation bundle for the solution

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3636

Customer Requirement:

Oracle9i RAC: Lithonia LightingOracle 8i on W2K to Oracle 9iRAC on LinuxApplication Tier

• Oracle 11i: HR, ERP(Financials), Payroll, Manufacturing*• 11.5.3 to 11.5.6 on W2K for 9i

Database Tier • Oracle8i on W2K• 8.1.7/W2K to 9i RAC/RH

Biz Issues: 1200 users load• Oracle/W2K had 4GB Mem Limit• 150 user capable: ea user = 4MB-6MB

Biz Solution: 1200 users + hi-availability• Oracle/Linux has 64GB Mem Limit• ~400 user capable on PE6450• Oracle9i RAC RH cluster = ~1600 users• Convert PE8450 from Oracle8i/W2K to Oracle9i RH and use as development/test box

Applications• 4xPE2300’s

Production Database• PE8450’s

Applications• 4xPE2300’s

9i Development Database• PE8450’s

Dell|EMCSAN Switch

Dell|EMC FC4700+ 3 Enclosures

9iRAC Production Database• 4x PE6450

9iRAC Hot Spare• PE6450’s

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3737

FAA: Oracle 9iRAC on Linux

Deploying Oracle9i RAC solutions from Dell– Two node clusters running on PowerEdge 6450’s– Fiber Channel storage / SAN– Linux provides a solid platform and an easy transition

from proprietary RISC architectures

Customer testimonial"The Oracle9i Real Application Clusters Certified

Configuration for Dell will enable us to take advantage of a highly available, scalable solution that will truly simplify our database implementations, allowing us to operate more efficiently."

Quote from John Kelly, database administrator and project manager with Kenrob & Associates, a technical contractor for

the FAA command center

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3838

Oracle9i RAC: Dell ITOracle 8i to Oracle 9iRAC on Linux

9iRAC Production Database + Apps• 2x PE6450

Enterprise Database• Oracle8i

Enterprise Application• Sales ODS Software• Customers order from dell.com – ODS provide order status Production Database + Apps

Dell Storage

Dell | EMCSAN Switch

Biz Issues: TCO, Mission Critical and Scale•TCO: use Dell to reduce cost of Unix system• SPF, Single Point of Failure, w/ 1 system• Limited Scale-up for performance

Biz Solution: Lower TCO + hi-availability + scale• TCO = Dell hardware + Dell storage• High Availability = Oracle9iRAC• Scale-out = Oracle9iRAC

© 2003 EMC Corporation and Dell Inc. All rights reserved. 3939

Summary

Dell | EMC | Oracle are committed to Linux

EMC and Dell Linux emphasis in sync with Oracle

EMC CLARiiON robustness, scaling, and performance– Key value addition to support Oracle RAC on Linux with

meeting the Enterprise mission-critical challenges

Dell Linux Oracle Solutions Offerings: – Tremendous value as a new infrastructure acquisition for

supporting Oracle database service– Pre-tested on a supportable hardware and software stack

© 2003 EMC Corporation and Dell Inc. All rights reserved. 4040

DELLDELL

Integrate Integrate and Deliverand Deliver

ORACLEORACLE

Lower TCOLower TCO

EMC2

Automated StorageAutomated Storage

Red HatRed Hat

Enterprise LinuxEnterprise Linux

The best choice for running your Oracle The best choice for running your Oracle database on Linuxdatabase on Linux

CollaboratingCollaborating……

© 2003 EMC Corporation and Dell Inc. All rights reserved. 4141

Next Step

For more details on Dell’s Oracle Solutions: – http://dell.com/oracle– Session 40390 [Tue. 9/9 – Moscone 300 - 3:30 - 4:30PM]

• Dell |Oracle Rapid deployment Techniques for Linux

– Session 40379 [Mon. 9/8 – Moscone 301 - 11 - 12 PM]• Scaling-Out with Oracle Grid Computing on Dell Hardware

For more details on EMC storage solution for Oracle:– http://emc.com/oracle– Session 36675 [Wed. 9/10 – Moscone 304 - 8:30 - 9:30 AM]

• Oracle 10G disk based backup and EMC ATA

Visit EMC (#1302) and Dell (#1726) booths to see demo of this system solution

© 2003 EMC Corporation and Dell Inc. All rights reserved. 4242

? Questions ?? Questions ?