Oracle 10g New Feature

Richard JacobsPrincipal ConsultantProduct Technology ServicesOracle Corporation

Oracle 10g Database

Oracle Database 10g Goals

Half the Cost

Highest Quality of Service– Highest Availability, Reliability, Security– Highest Performance, Scalability

Easiest to Manage

Oracle Grid Computing

Low cost Highest quality of service Rapidly adjusts to meet business needs Unified management

Storage Grid Database Grid

Application Server

Grid

Grid

Control




Application Server

Grid

Grid

Control

Automatic Storage Management (ASM)

Automatic StorageManagement

Eliminates need for conventional file system and volume manager

Capacity on demand– Add/drop disks online

Automatic I/O load balancing– Stripes data across disks to

balance load– Best I/O throughput

Automatic mirroring Easy

Storage Grid




Application Server

Grid

Grid

Control

Database Server Grid –Real Application Clusters

Runs Real Applications Proven

– Over 500 production sites– Certified with leading apps

Runs on standard,low cost servers

Fault tolerant Capacity on demand New integrated

clusterware makes it easy everywhere

ERP CRM DW

Database Grid

Database Server Grid -Integrated Clusterware Makesit Easy Portable to all platforms Low Cost

– No need to purchase additional software– Easy to install, manage

Easy– Deploys in hours not days– Improved single system image– Single-vendor support

Remains open to third-party clusterware

Database Grid

Database Server Grid –Workload Management

Push-button, online add/drop server to cluster Automatic Load Balancing

– Based on “service” concept– Automatic routing of service connection requests

to appropriate server with lowest load– On server failure, automatic re-allocation of

surviving servers to services– Dynamic load balancing when service levels not

met (coming soon)

Database Grid

Business Challenge – How to Scale DBA’s to the Grid ?

Software Maintenance 6%

Ongoing System Management 55%

Installation 6%

Others

15%

Creation & Configuration 12 %

Source: IOUG 2001 DBA Survey

DataLoading 6%

Oracle Database 10gSelf-managing Database

Built-in Intelligent Infrastructure – Code instrumentation– Data warehouse to analyze performance of customer

workloads

Automatic Database Diagnostic Monitor – Automatic performance diagnostic engine in the database

Automatic Tuning Optimizer – SQL Profile to tune packaged applications

Automatic PGA and SGA Memory Management Lots more …

Oracle 10g OEM Grid Control

Manages the Oracle Grid environment

Scales to thousands of servers

Application Service Level Management

Configuration Management

– Provisioning– Cloning– Patch Management

ERP EMAIL DW

Business Intelligence on the Grid

Lower Cost– Leverage 10g hardware, software, labor savings– Manage millions of terabytes

Intelligence when you need it– Cross-platform transportable tablespaces– Asynchronous change data capture

More value from your data– Mature OLAP, Data Mining– Improved SQL Analytics – SQL Model Clause

HTML DB –Rapid Web Development Tool

Builds database-driven Web applications For non-programmers App developers and app users just need a web

browser Addresses MS Access proliferation problem

– Supports hosted development and deployment environment

Easy Transition to the Grid

Oracle 10g preserves investment

– Runs all existing apps on clusters

– Moves data to new platforms as fast as FTP

– Low risk - Start small and add capacity on demand

ERP EMAIL DW

Manageability Revolution

Unprecedented Development Effort

Single, biggest effort– 50% of the architects in the organization– 200+ engineers– Gathered customers feedback– Active, focused development – Not just research!

Wide-spread effort– Projects span entire technology stack

Long term commitment


Load Data 6%

Ongoing System Management

55%

Software Maintenance

6%

Install 6%

Create & Configure

12 %

Where DBA’s spend their time

Software Installation

Fast lightweight install– Major redesign of installation process– Single CD, 20 Minutes– CPU, memory, disk space consumption greatly reduced– Extremely lightweight client install (3 files) using Oracle

Instant Client

Automation of All Pre and Post Install Steps– Validate OS Configuration, patches, resource availability

etc.– Configure all components (listeners, database, agent,

OMS, OID etc.) for automatic startup and shutdown

Enhanced silent install

Simplified Creation & Configuration

Greatly reduced database creation time using pre-configured, ready-to-use database

90% reduction of initialization parameters: < 30 Basic parameters

Automatically setup common tasks, e.g. backups

Automatically configures LDAP server Automatic Shared Server Set-up Easy Connect Naming

Basic Parameters

compatible

processes

sessions

pga_aggregate_target

nls_language

nls_territory

db_domain

shared_servers

instance_number

cluster_database

db_block_size

sga_target

control_files

db_name

db_recovery_file_dest

remote_listener

db_recovery_file_dest_size

db_create_online_log_dest_n

db_create_file_dest

log_archive_dest_n

log_archive_dest_state_n

remote_login_passwordfile

db_unique_name

Simplified Upgrade

Pre upgrade checks (e.g. parameter settings) Post upgrade status checks Time estimator Re-startable Guide administrators in using best practices

Out-of-the-Box Database Control No separate install Fully functional

administration and monitoring after database creation

Listener discovery, configuration & monitoring


Load Data 6%


55%


6%

Install 6%

Create & Configure

12 %


Efficient Data Load

Oracle Database 10g Data Pump

– 60% faster than Export (single stream)– 15X-20X faster than Import (single stream)– Automatic Parallelism – multiple streams– Re-startable– Size estimation on export dumpfiles

Cross Platform Transportable Tablespaces


Load Data 6%


55%


6%

Install 6%

Create & Configure

12 %



55% of DBA’s time is spent in ongoing management, monitoring and tuning

1. Performance Diagnosis & Troubleshooting

2. Space & Object Management

3. SQL & Application Tuning

4. System Resource Tuning

5. Backup and Recovery


Manageability Challenges - Today

External Storage Management

Disk Configuration Stripe Size Data Redistribution

Internal Space Management

Table growth trend Space fragmentation

Backup & Recovery ManagementTapes, MTTR

Disaster Recovery

Application & SQL ManagementOptimizer Stats Response time

Throughput Schema/Index

System ResourceManagement

CPU UtilizationMemory PoolsProcesses

Intelligent Infrastructure

Application & SQLManagement


SpaceManagement

Backup & RecoveryManagement

StorageManagement

Database Control

Database Management

Oracle Database 10g – Self-Managing Database


Automatic Workload Repository

Automatic Maintenance Task Infrastructure

Server-generated Alert Infrastructure

Advisory Infrastructure

Automatic Workload Repository

– “Data Warehouse” of the Database

– Code instrumentation Automatic Maintenance

Tasks– Pre-packaged, resource

controlled Server-generated Alerts

– Push vs. Pull, Just-in-time, Out-of-the-box

Advisory Infrastructure– Integrated, uniformity

Automatic Database Diagnostic Monitor (ADDM)

Performance expert in a box Integrate all components

together Automatically provides

database-wide performance diagnostic, including RAC

Provides impact and benefit analysis

Provides Information vs. raw data

Runs proactively Real-time results using the

Time Model




SpaceManagement


StorageManagement

Database Management

ADDM’s Architecture

SQLAdvisor

High-load SQL

IO / CPU issues

RAC issues

Automatic Diagnostic Engine

Snapshots in

Automatic Workload

Repository

Self-Diagnostic Engine

System Sizing Advice

Network + DB config

Advice

Instrument database code paths to produce Time & Wait Model

Classification Tree is based on decades of Oracle performance tuning expertise

Pinpoint root cause and non-problem areas

Active Session History – snapshot of session activity every second

Runs proactively & manually

Performance Diagnostic: Before and Now

Before1. Examine system utilization2. Look at wait events3. Observe latch contention4. See wait on shared pool and library cache latch5. Review v$sysstat (difficult)6. See “parse time elapsed” > “parse time cpu” and #hard

parses greater than normal7. Identify SQL by..

Identifying sessions with many hard parses and trace them, or

Reviewing v$sql for many statements with same hash plan (difficult)

8. Examine objects accessed and review SQL9. Identify “hard parse” issue by observing the SQL contains

literals10. Enable cursor sharing

Oracle10g1. Review ADDM

recommendations

2. ADDM recommends use of cursor_sharing

Scenario: Hard parse problems

Database Home Page

ADDM Findings

ADDM Recommendations

Application and SQL Management

Key to efficient SQL execution: Oracle Cost-based Optimizer

Proven Technology– Over 10 years of production

usage– Adopted by all top-tier

applications vendors

Sophisticated functionality– Automatically-gathered object

and system (CPU, IO, Caching) statistics

– Comprehensive set of access paths, adaptive search strategy

– Cost-based transformations– Automatic allocation of memory

and parallelism– Versioned optimizer statistics




SpaceManagement


StorageManagement

Database Management

Remaining Challenges

How to quickly find optimal plans for complex queries?

– Sub-optimal plans caused by correlations, complex predicate selectivity

What is “bad” SQL? How to work-around ‘bad’ SQL in packaged

applications? How to ‘globally’ optimize an entire application’s SQL

statements? – Adding an index may help one statement, but what is the

impact on the rest of the application

Automatic Tuning Optimizer

Identify ‘bad’ SQL– Automatic workload

capture– Automatic identification

of high-load SQL– Top N highest

resource-consuming SQL Statements

High-load SQL

PackagedApps

CustomizableApps


Automatic SQL Tuning– Learn from past

executions– Dynamic sampling,

partial execution techniques

– Profile the SQL statement to feedback to optimizer

– No change to SQL textSQLProfile

PackagedApps

+

Well-tuned SQL

High-load SQL

PackagedApps

Customizable Apps


Auto SQL Tuning


Automatic SQL Analysis– Optimizer explains

decision points– Advises on badly written

SQL, stale statistics, bad schema

SQLAdvice

Customizable Apps

+

Well-tuned SQL

High-load SQL

PackagedApps

Customizable Apps


Auto SQL Analysis


SQL Access Advisor– Advise on access paths– Indexes, Materialized

Views, Indexes on Materialized Views

– Consider entire workload

– Consider Impact on insert/update/delete

Indexes & MVs

Customizable Apps

+

Well-tuned SQL

High-load SQL

PackagedApps

Customizable Apps


AccessAdvisor


Complete SQL Management

– Automated workload capture, identification of high-load SQL

– Automatic SQL Tuning– Automatic SQL Analysis – SQL Access Advisor

SQLProfile

PackagedApps

+

SQLAdvice

Customizable Apps

+Indexes &

MVs

Well-tuned SQL

High-load SQL

PackagedApps

Customizable Apps


Auto SQL Tuning

Auto SQL Analysis

AccessAdvisor

Customizable Apps

+

Before1. Examine system utilization2. Look at wait events3. See wait on DB scattered read4. Determine scope – system wide, module-dependent, user-

dependent?5. Identify SQL by (difficult)

Identifying sessions with high DB scattered read waits and trace them, or

Reviewing Top Sessions in OEM6. Get explain plan7. Examine objects accessed (size/cardinality)8. Review SQL statistics and/or compare to object statistics (v$sql)

(difficult)9. Identify the problem10. Contact packaged app vendor11. Produce test case for vendor12. Vendor produces patch/upgrade13. Patch/upgrade installed in customer’s next maintenance cycle

Oracle10g1. Review ADDM

recommendations

2. Follow link to run Automatic SQL tuning

3. Accept SQL Profile recommendations from SQL Tuning

SQL Tuning: Before and NowScenario: Bad SQL in Packaged Applications

System Resource Management

Oracle 9i Resource Manager

controls and prioritizes CPU usage

Automatic SQL Memory Tuning




SpaceManagement


StorageManagement

Database Management

Automatically adapts to workload changes

Maximizes memory utilization

Single Parameter makes it easier to use

Helps eliminate out of memory errors

Can help improve performance

SGA

PGA

Large Batch Jobs

sort

Java Pool

SQL Cache

Large Pool

Buffer Cache

SQL Cache

sort

Online

Users

Large Pool

Buffer Cache

Java Pool

Automatic Shared Memory Tuning

Before

1. Launch Buffer Pool Advisor

2. Examine output; check if Buffer Pool is over allocated

3. If so, reduce size of Buffer Pool

4. Launch Shared Pool Advisor

5. Examine output; check if Shared Pool is under allocated

6. If so, increase size of Shared Pool

Oracle10g

(This space is intentionally left blank – No manual steps needed with Automatic Shared Memory Tuning)

SGA Memory Management: Before and NowScenario: Out-of-memory Errors (ORA-4031)

Automatic Space Management

Oracle9i Eliminates external space

fragmentations – Locally Managed

Tablespace Eliminates space allocation

contention– Automatic Segment

Space Management Intelligent Infrastructure



SpaceManagement


StorageManagement

Database Management

Proactive Space Management

Automatically monitor, capture space usage at space allocation time - efficient

Advise and predict space growth trend, fragmentation

“Just-in-Time” Alerts on space pressure

Server-Generated

Alerts

Capacity Planning

Segment running out of space

Proactive Space Management

Online Segment Shrink– Reclaim space from

internal fragmentation

– Improve performance– In-place shrinking of

tables – Wait on DML

operations

Server-Generated

Alerts

Capacity Planning

Fragmented Segment

Segment running out of space

Online Segment

Shrink

Space Management : Before and Now

Before

Check to see which objects in the tablespace have pockets of wasted space due to deletion:

1. Create a script that looks at DBA_TABLES view to compare the total space allocated for each object (BLOCKS * DB_BLOCK_SIZE) in a tablespace to the estimated space used by the object (AVG_ROW_LEN * NUM_ROWS)

(assumes objects have been analyzed)

2. Review script output and identify target objects for reorganization

3. Identify/Create “scratch” tablespace

4. For each object to be reorganized, use the Enterprise Manager Reorg wizard to recreate each object along with its dependencies

Oracle10G

1. Launch Segment Advisor to advise on which object(s) to shrink

2. Accept the recommendations to shrink the objects online and in-place

Scenario: Reclaim Wasted Space

Automatic Backup & Recovery




SpaceManagement


StorageManagement

Database Management

Automatic Backup and Recovery

Fully automatic disk based backup and recovery

– Set and Forget

Nightly incremental backup rolls forward recovery area backup

– Changed blocks are tracked in production DB

– Full scan is never needed– Dramatically faster (20x)

Use low cost ATA disk array for recovery area

Database Area Recovery Area Tape

Nightly Applyof

IncrementalBackup

WeeklyArchive to

Tape

Single-Command Recovery Easy recovery from human errors at all

levels Database Level

– Flashback Database restores the whole database to time

Uses Flashback Logs Table Level

– Flashback Table restores rows in a set of tables to time

Uses UNDO in database– Flashback Drop restores a dropped

table or a index Recycle bin for DROPs

Row Level– Flashback Rows restores rows to time

Uses Flashback Query

Order

Database

Customer

Database Recovery: Before and Now

Before(Tablespace Point-in-time Recovery)

1. Prepare an auxiliary instance by first creating an Oracle password file

2. Create parameter file for auxiliary instance

3. Start auxiliary instance in NOMOUNT mode using SQL*Plus

4. Using RMAN interface to perform TSPITR

5. Using RMAN, connect to target database and bring tablespace in question online

6. Shutdown the auxiliary instance

7. Delete auxiliary instance data files, control files, and redo log files

Oracle10g

1. Single Command Recovery: FLASHBACK TABLE <table_name> TO BEFORE DROP ;

Scenario: Recovering mistakenly dropped a Table

Automatic Storage Management




SpaceManagement


StorageManagement

Database Management

Automatic Storage Management - Benefits

Automates daily storage administration

– Automatic I/O tuning– Eliminates disk fragmentation– Automatically selects allocation

policy per Oracle file type Automates storage re-configuration

– Automatic data copy on disk add/drop, no reconfiguring volume and re-striping

– Online migration to new storage hardwareAutomatic Storage

Management

ASM

The Operational Stack

Disks

Logical Vols

File System

0010 0010 0010 0010 00100010 0010 0010 0010 0010Files

Tablespace

Tables

Disk Group

Logical Vols

File System

Files

Tablespace

Tables

TODAY ASM

“The best way to lower mgmt costs is to remove complexity”

Mirroring with ASM

3 choices for disk group redundancy– External: defers to hardware mirroring– Normal: 2-way mirroring– High: 3-way mirroring

Integration with database removes need for dirty region logging

Create or Delete Disk Groups

CREATE DISKGROUP dgroup1 DISK ‘/dev/raw/raw*’

DROP DISKGROUP dgroupA INCLUDING CONTENTS;

CREATE DISKGROUP dgroupA NORMAL REDUNDANCY

FAILGROUP controller1 DISK

'/devices/diskA1' NAME diskA1 SIZE 120G,

'/devices/diskA2',

'/devices/diskA3'

FAILGROUP controller2 DISK

'/devices/diskB1',

'/devices/diskB2',

'/devices/diskB3';

Traditional vs ASMSetup

1. Determine required storage capacity

2. Install Volume Manager, File System

3. Architect data layout to avoid hot spot

4. Create logical volumes

5. Create file systems

6. Install database

7. Create database

1. Determine required storage capacity

2. Install ASM

3. Create Disk Groups

4. Install database

5. Create database

ASM Architecture

Pool of Storage

ASM Instance

Server

Non–RACDatabase

Oracle

DB Instance

Disk Group

ASM Instance

INSTANCE_TYPE = OSM

OSM_POWER_LIMIT = 11

OSM_DISKSTRING = '/dev/rdsk/*s2', '/dev/rdsk/c1*'

OSM_DISKGROUPS = dgroupA, dgroupB

LARGE_POOL_SIZE = 8MB

• Lightweight instance- Few processes

- No database to mount, metadata tripled mirrored in ASM diskgroup

• Initialization Parameters

Database and ASM Instance Interaction

Server

Operating System

DATABASE ASM

(1) Database opens file

(1A) OPEN

(1B) Extent Map

(2) Database Reads file

(2A) R

EA

D

(2B) I/O

Co

mp

letes(3) Database Creates file

(3A) CREATE

(3B

) Allo

cates file

(3C) Extent Map

(3D) In

itializes file

ASM Architecture

Pool of Storage

ASM Instance

Server

Non–RACDatabase

Oracle

DB Instance

Disk Group

ASM Architecture

Clustered Pool of Storage

ASM Instance ASM Instance

Clustered Servers

RACDatabase

Oracle

DB Instance

Oracle

DB Instance

Disk Group

ASM Architecture

Clustered Pool of Storage

ASM Instance ASM Instance

Clustered Servers

RAC Database

Oracle

DB Instance

Oracle

DB Instance

Disk GroupDisk Group

ASM is NOT!

Not a general purpose FS or CFS Not using any special I/O calls below the OS Not a tool designed for SA or Storage Admins Not vendor or platform specific Not the only tool needed to provision storage Not required do the mirroring Not used for binaries, trace and text files NOT RAW

Grid/Database Control

Open Interfaces for ISV Partners




SpaceManagement


StorageManagement

Database Management

ISVISVISVOpen Interfaces


Load Data 6%


55%


6%

Install 6%

Create & Configure

12 %


View/Search

Compare/Diff

Change Tracking

ReferenceConfigurations

Analyze

Install/Clone

Configure

Patch

Secure

ProvisionLiveLink

Oracle.com

Product Updates

Patches

ProductConfiguration

OracleInventory

SoftwareConfigurations

HardwareConfigurations

Discover

Enterprise Configuration Management

Grid Control

PolicyManager

Oracle Database 10gSimplified Creation & Configuration

Self-Managing Database

Enterprise Configuration Management

Efficient Data Load

Fast Lightweight Install ½ COST

0

4

8

12

16

Num

ber of

Ste

ps

PerformanceDiagnostic

SQL Tuning ResourceManagement(Memory)

SpaceManagement

Backup &Recovery

StorageManagement

Oracle 10g

Oracle9i2

6

2

13

6

21

42

10

4

10

Oracle 10g : Twice as Manageable as Oracle9i

Oracle 10g required 44% less time and 47% fewer steps than Oracle9i.

Oracle 10g required 44% less time and 47% fewer steps than Oracle9i.

Result SummaryResult Summary

So what does the DBA do

now :-)

DBA of the Future Does MORE

MORE sleep at nights! MORE weekends off! MORE databases MORE applications: OLTP, DW, OCS, iAS MORE users, larger databases MORE mission-critical applications MORE proactive and strategic MORE important and valuable!

LESS Cost for Businesses

For customers Less Administration Cost Less Capital Expenditure Less Failures

For Application ISV Partners Less Deployment Cost Less Development Cost Less Support Cost

RAC for Everyone – Integrated Clusterware

Complete Oracle cluster software solution

Single-vendor support Low Cost

– No need to purchase additional software

– Easy to install, manage High quality and functionality

across all platforms Large number of nodes Common event and management

api’s – Multi-tier HA & minimal MTTR

Support for third-party clusterware

Applications

RAC, Other Apps

Services Framework

Cluster Control/Recovery APIs

Automatic Storage Management

Messaging and Locking

Membership

Connectivity

Eve

nt

Ser

vice

s

Man

agem

ent

AP

Is

Hardware/OS Kernel

RAC Enterprise Manager Integration Service Consumer Page Shows alerts for SLA violations Cluster Page Cluster Database Page Performance Page

RAC for Everyone – Server Provisioning

– Provision software to many systems at once– Clone, store and distribute “known good” configurations – Automate patch and update management

SoftwareInventory

EnterpriseManager

RAC for Everyone – Server Provisioning

– Provision software to many systems at once– Clone, store and distribute “known good” configurations – Automate patch and update management

SoftwareInventory

EnterpriseManager

Enterprise Grid – Workload Management

Hands-free allocation and re-allocation of servers to services based on rules

– Automated routing of service requests to appropriate server with lowest load

– On server failure, automated re-allocation of surviving servers to services

Works across all platforms


Normal Server Allocation

Order Entry Supply ChainSpare


End of Quarter

Order Entry Supply Chain


Normal Server Allocation


Enterprise Grid – Cluster Failure

Server Fails



Reallocate Spare server to Order Entry

Order Entry Supply Chain



Failed Server Restored

Automatic Workload ManagementDetails

No application changes required – Services specified in TNS connect data– For example, using Net Easy*Connection in 10g you would

connect using scott/tiger@//myVIP/myservice

Rules specify automatic resource allocations – PREFERRED instances during normal conditions– AVAILABLE instances should failures occur

Enterprise Manager provides manual service controls, e.g.,

– Start/stop, enable/disable, relocate

Automatic Workload ManagementSpecifying rules

• DBCA is the recommended tool for configuring services

• svrctl is an alternative:• Add a service

• Add a node / instance

srvctl add service -d <name> -s <service_name>

[-r <preferred_list>] [-a <avail_list>]

srvctl add service -d <name> -s <service_name>

-u [-r <new_pref_inst> | -a <new_avail_inst>]

ConfigurationExample

ERP

CRM

SS

HOT

STD

ERP

CRM

SS

HOT

STD

ERP

CRM

SS

HOT

STD

ERP

CRM

SS

HOT

STD

RAC01 RAC02 RAC03 RAC04

TransactionServices

Batch JobServices

High

Med

Low

High

Low

Priority0.5/0.75

Thresholds

0.5/1.00

1.0/1.5

1.0/1.5

3.0/5.0

CL

US

NO

DE

-1

CL

US

NO

DE

-2

CL

US

NO

DE

-3

CL

US

NO

DE

-4

Instances

Step 1 – Check Node Applications

CRS has already registered and enabled node applications (nodeapps) (what are these ?)

Does this only work with CRS ?

Check status with crs_stat Use srvctl to add new

nodeapps to new machines

NAME=ora.clusnode-1.gsdTYPE=applicationTARGET=ONLINESTATE=ONLINE

NAME=ora.clusnode-1.oemTYPE=applicationTARGET=ONLINESTATE=ONLINE

NAME=ora.clusnode-1.onsTYPE=applicationTARGET=ONLINESTATE=ONLINE

NAME=ora.clusnode-1.vipTYPE=applicationTARGET=ONLINESTATE=ONLINE

NAME=ora.clusnode-1.LISTENER_clusnode-1.lsnrTYPE=applicationTARGET=ONLINESTATE=ONLINE on clusnode-1

Step 2 – Define Database and Instances

srvctl add database -d ORACLE -o $ORACLE_HOME –s $ORACLE_HOME/dbs/ORACLE_spfile

srvctl add instance -d ORACLE-i RAC01 -n clusnode-1

srvctl add instance -d ORACLE -i RAC02 -n clusnode-2

srvctl add instance -d ORACLE -i RAC03 -n clusnode-3

srvctl add instance -d ORACLE-i RAC04 -n clusnode-4

Step 3 – Define Services

srvctl add service -d ORACLE -s ERP-r RAC01,RAC02 -a RAC03,RAC04

srvctl add service -d ORACLE -s CRM-r RAC03,RAC04 -a RAC01,RAC02

srvctl add service -d ORACLE -s SS -r RAC01,RAC02,RAC03,RAC04

srvctl add service -d ORACLE -s HOT -r RAC01 -a RAC02,RAC03,RAC04

srvctl add service -d ORACLE -s STD -r RAC01,RAC02 -a RAC03,RAC04

Step 4 – Using ServicesERP=(DESCRIPTION= (LOAD_BALANCE=on)(ADDRESS=(PROTOCOL=TCP)(HOST=clusnode-1vip)

(PORT=1521))(ADDRESS=(PROTOCOL=TCP)(HOST=clusnode-2vip)



(PORT=1521))(CONNECT_DATA=(SERVICE_NAME=ERP)))ERP=(DESCRIPTION=(LOAD_BALANCE=on)

…(CONNECT_DATA=(SERVICE_NAME=ERP))(FAILOVER_MODE=(BACKUP=ERP)(TYPE=SELECT)

(METHOD=BASIC)(RETRIES=180)(DELAY =5)))

ERP=(DESCRIPTION=(LOAD_BALANCE=on)…

(CONNECT_DATA=(SERVICE_NAME=ERP))(FAILOVER_MODE=(BACKUP=ERP_PRECONNECT)(TYPE=SESSION)

(METHOD=PRECONNECT)(RETRIES=180)(DELAY =5)))

ERP_PRECONNECT=(DESCRIPTION=(LOAD_BALANCE=on)…

(CONNECT_DATA=(SERVICE_NAME=ERP_PRECONNECT))(FAILOVER_MODE=(BACKUP=ERP)(TYPE=SESSION)

(METHOD=BASIC)(RETRIES=180)(DELAY =5)))

TNS

TNS +TAFBasic

TNS +TAFPre-Connect

Example - Setting Service Priorities

rem Create the consumer groupsexecute DBMS_RESOURCE_MANAGER.CREATE_PENDING_AREA;execute DBMS_RESOURCE_MANAGER.CREATE_CONSUMER_GROUP (CONSUMER_GROUP => 'HIGH_PRIORITY',

COMMENT => 'High priority group');execute DBMS_RESOURCE_MANAGER.CREATE_CONSUMER_GROUP (CONSUMER_GROUP => 'STANDARD_PRIORITY',

COMMENT => 'Standard priority group');execute DBMS_RESOURCE_MANAGER.CREATE_CONSUMER_GROUP (CONSUMER_GROUP => 'LOW_PRIORITY',

COMMENT => 'Low priority group');

Example - Setting Service Priorities

rem Create the service to consumer group mappingexecute DBMS_RESOURCE_MANAGER.SET_CONSUMER_GROUP_MAPPING (ATTRIBUTE => DBMS_RESOURCE_MANAGER.SERVICE_NAME, VALUE =>'ERP',CONSUMER_GROUP =>'HIGH_PRIORITY'); execute DBMS_RESOURCE_MANAGER.SET_CONSUMER_GROUP_MAPPING (ATTRIBUTE => DBMS_RESOURCE_MANAGER.SERVICE_NAME,

VALUE=>'CRM',CONSUMER_GROUP => 'STANDARD_PRIORITY');execute DBMS_RESOURCE_MANAGER.SET_CONSUMER_GROUP_MAPPING (ATTRIBUTE =>DBMS_RESOURCE_MANAGER.SERVICE_NAME,

VALUE=>'SS',CONSUMER_GROUP => 'STANDARD_PRIORITY');execute DBMS_RESOURCE_MANAGER.SET_CONSUMER_GROUP_MAPPING (ATTRIBUTE => DBMS_RESOURCE_MANAGER.SERVICE_NAME,

VALUE=>'HOT',CONSUMER_GROUP => 'HIGH_PRIORITY');execute DBMS_RESOURCE_MANAGER.SET_CONSUMER_GROUP_MAPPING (ATTRIBUTE =>DBMS_RESOURCE_MANAGER.SERVICE_NAME,

VALUE =>'STD',CONSUMER_GROUP => 'LOW_PRIORITY');execute dbms_resource_manager.submit_pending_area;

Oracle 10g Clusterware

End-to-End IntegrationLoad Balancing

ASM

iAS

RAC

Dynamic load balancing with Oracle Application Server 10g

Multiple SLA's satisfied on shared hardware

Self monitoring services– Automatic Workload

Repository (AWR) measures end to end

– Resource manager

End-to-End IntegrationSynchronized Recovery

End to end recovery without human intervention

– < 8 second recovery time for database

– Immediate recovery for mid-tiers

< 4 seconds from 15 minutes Self Correcting

Self verifying Self diagnosing Self correcting


ASM

iAS

RAC

End-to-End IntegrationDisaster Recovery

ASM

iAS


RAC

Data Guard Broker central point of control

Automatic service re-provisioning

Seamlessly integrated Maximum availability

– iAS & customer integration

– End-to-end min MTTR – Rolling Upgrade

ASM

iAS


RAC

Data GuardBroker

Production

Standby

Performance Enhancements

Dynamic file and lock affinity Lower-overhead updates Message aggregation More efficient global cache Fewer buffer copies Less memory usage

No Cost System Changes – Capacity on Demand

CPU– Add/remove CPUs on SMP online

Cluster Nodes– Add/remove cluster nodes online– No data movement needed

Memory– Grow and shrink shared memory

and buffer cache online– Auto tuning of memory online

Disk– Add/remove disks online– Automatically rebalance– Move datafiles

Low Cost Fault Tolerance

Grid ClustersGrid ClustersLow Cost Fault ToleranceLow Cost Fault Tolerance

Computer Computer FailuresFailures

Data Data FailuresFailures

System System ChangesChanges

Data Data ChangesChanges

UnplannedUnplannedDowntimeDowntime

PlannedPlannedDowntimeDowntime

Commercial Grids and Availability

Grid pools standard low cost nodes and modular disk arrays

Perfect for RAC HA Failover can happen to

any node on the grid Grid load balancing will

redistribute load over time

Designed to Tolerate Failures

New Economics forData Protection & Recovery

Disk Based RecoveryDisk Based Recovery







Trade cheap disk spacefor expensive downtime

New World: Disk Based Data Recovery

Disk economics are close to tape

Disk is better than tape– Random access to any data

We rearchitected our recovery strategy to take advantage of these economics

– Random access allows us to backup and recover just the changes to the database

Backup and Recovery goes from hours to minutes

2000’s - 200 GB

1980’s - 200 MB

1000x increase

Resiliency using Low Cost Storage







Storage FailureStorage Failure

Human ErrorHuman Error

CorruptionCorruption

Site FailureSite Failure

Four Failure Types

Data Mirroring with ASM

ASM mirrors data across inexpensive modular storage arrays

Automatically remirrors when disk or array fails

Designed to tolerate failures

Failure Resiliency using Low Cost Storage

Collapsing the Cost of Human Error











Flashback Time Navigation

Flashback Query– Query all data at point in time

Flashback Versions Query– See all versions of a row between two

times– See transactions that changed the

row

Flashback Transaction Query– See all changes made by a

transaction

Tx 1

Tx 2

Tx 3

Select * from Emp AS OF ‘2:00 P.M.’ where …

Select * from Emp VERSIONS BETWEEN

‘2:00 PM’ and ‘3:00 PM’ where …

Select * from DBA_TRANSACTION_QUERY

where xid = ‘000200030000002D’;

Flashback Database A new strategy for point in time recovery Flashback Log captures old versions of

changed blocks– Think of it as a continuous backup– Replay log to restore DB to time– Restores just changed blocks

It’s fast - recover in minutes, not hours It’s easy - single command restore

“Rewind” button for the DatabaseData Files Flashback

Log

New BlockVersion

Disk Write

Old BlockVersion

RMAN> Flashback Database to ‘2:05 PM’

Prevention & Recovery of Corruptions











Oracle End-to-end Data Validation

H.A.R.D. – Hardware Assisted Resilient Data

– Prevents corruption introduced in IO path between DB and storage

Initially introduced in Oracle9iR2 10g HARD provides

– Better checks– All file types & block sizes checked

DB, log, archive, backup, etc.– A.S.M. enables HARD without

using RAW devices Supported by major storage vendors

A.S.M.A.S.M.

OracleOracle

SAN & Virtualization

Blocks validated and Protection info added to block

Protection info validated by storage device

Volume ManagerVolume Manager

Operating SystemOperating System

Host Bus AdapterHost Bus Adapter

SAN InterfaceSAN Interface

Storage DeviceStorage Device

Flash Recovery Area

Fully automatic disk based backup and recovery

– Set and Forget

Nightly incremental backup rolls forward recovery area backup

– Changed blocks are tracked in production DB

Full scan is never needed– Dramatically faster (20x)– Blocks validated to prevent

corruption of backup copy

Use low cost ATA disk array for recovery areaTwo Independent Disk Systems

Flash RecoveryArea

Nightly ApplyValidatedIncremental

WeeklyArchiveTo Tape

DatabaseArea

Optimised Incremental Backup

Optimizes incremental backups– Track which blocks have changed since last

backup

• New change tracking file is introduced– Changed blocks are tracked as redo is

generated– RMAN backup automatically uses changed

block list

Redo Logs Change Tracking File

Redo Generation

List of Changed Blocks

101100101011000011101001

SQL> ALTER DATABASE ENABLE BLOCK CHANGE TRACKING;

Recovering With Incrementally Updated Backups

Incremental backup files

Incrementally Updated Datafile

Image copyof data file

Updated image copy of data file to a more

recent state

RECOVER COPY OF DATAFILE

RMAN> RECOVER COPY OF DATAFILE 10

Low Cost No Compromise Disaster Recovery











Data Guard 10g New Features

General new features– Real Time Apply– Flashback Database Integration

SQL Apply new features – Zero Downtime Instantiation– Rolling Upgrades– Additional Datatypes

Data Guard Broker & Enterprise Manager new features – RAC integration– Simplified browser-based interface focused on best practices

Enhanced DR with Flashback Database

Flashback DB removes the need to delay application of logs Flashback DB removes the need to reinstantiate primary after failover Real-time apply enables real-time reporting on standby

Real Time Apply

No Delay!

Real TimeReporting

Flashback Log

Flashback Log

Primary: No reinstantiation after failover!

RedoShipment

Primary Database Standby Database

SQL Apply: Zero Downtime Instantiation

Logical standby database can now be created from an online backup of the primary database, without shutting down or quiescing the primary database

– No shutdown implies no downtime of production system

– No quiesce implies no wait on quiesce and no dependence on Resource Manager

Highest Data Protection Lowest Cost

Combine the Features to

Achieve Any Level of Data Protection

Dramatic Advances in Ease of Use

ASM Mirroring Storage Failure

Protection

Flashback Human Error

Protection

Data Guard Site Failure ProtectionFlash

Recovery Area

Corruption Protection

Allow any change to the system with no downtime

Online ReconfigurationOnline Reconfiguration

Goal

No Cost System Changes

Rolling UpgradesRolling Upgrades







No Cost System Changes – Capacity on Demand

CPU– Add/remove CPUs on SMP online

Cluster Nodes– Add/remove cluster nodes online– No data movement needed

Memory– Grow and shrink shared memory

and buffer cache online– Auto tuning of memory online

Disk– Add/remove disks online– Automatically rebalance– Move datafiles

Rolling Patch Upgrade using RAC

Initial RAC Configuration Clients on A, Patch B

OraclePatchUpgrades

OperatingSystemUpgrades

Upgrade Complete

HardwareUpgrades

Clients Clients

Clients on B, Patch A

Patch

1 2

34

A B A B

AA B

B

APatch BA B

Rolling Release Upgrades using Data Guard

Major ReleaseUpgrades

Patch SetUpgrades

Cluster Software & Hardware Upgrades

Initial SQL Apply Config

ClientsRedo

Version X Version X

1

BA

Switchover to B, upgrade A

Redo

4

Upgrade

X+1X+1

BA

Run in mixed mode to test

Redo

3

X+1X

A B

Upgrade node B to X+1

Upgrade

LogsQueue

X

2

X+1

A B

Online RedefinitionOnline RedefinitionEvolution without InterruptionEvolution without Interruption

Competitive pressures demand continual change

Need to change data with no interruption to the application

– location, format, indexing, or even definition

Goal

No Cost Data Changes







Online Redefinition Enhancements

Enhanced Online Table Redefinition– Easy cloning of indexes, grants, constraints, etc.– Convert from long to LOB online– Allow unique index instead of primary key

Change tables without recompiling stored procedures– Stored procedures can depend on the signature of a table

instead of the table itself

Online Segment Shrink– Return unused space within the blocks of a segment to the

tablespace

Protection from any cause of downtime







ASMASM

FlashbackFlashback

Recovery AreaRecovery Area

Data GuardData Guard

Real Application Real Application ClustersClusters

Online ReconfigsOnline Reconfigs

Rolling UpgradesRolling Upgrades

Online RedefinitionOnline Redefinition

At Lowest Cost• Grid Servers• Modular Storage Arrays

• Automated & Simple to Use

Oracle10g Cross Platform Transportable Tablespace

Solaris (SPARC)

Open VMS (Intel IA64)

Windows (Intel IA32/64)

Linux (Intel IA32/64)

AIX (PowerPC)

HP-UX (PA-RISC)

Tru64 UNIX (Alpha)

HP-UX (Intel IA64)

Small Endian Platforms Big Endian Platforms

Simple File Copy Within These

Simple File Copy Within These

High SpeedFile Convert

RMAN

Size up to 8 exabytes (8 million terabytes) Use with OSM or VM that supports striping and

dynamically extensible logical volumes CREATE BIGFILE TABLESPACE bigtbs

DATAFILE ‘/u02/oracle/data/bigtbs01.dbf’ SIZE 50G

EXTENT MANAGEMENT LOCALSEGMENT SPACE MANAGEMENT AUTO;

Default SMALLFILE

Bigfile Tablespaces

Oracle HTML DB

Development Approach– Declarative– Model Driven UML

Programming Language: PL/SQL– PL/SQL, SQL, HTML

Deployment Architecture:– RDBMS

HTTP Listener

Database

<html></html>

135

HTML DB: How it Works

Browser Based No Deployment Needed Team Based Development

HTML DB Browser

HTML DB in a Nutshell

Productivity and Ease of Use of a Desktop Database

Quality of an Enterprise Database

Built for the Web

PL/SQL Enhancements

XMLXML ObjectsObjects

SQLSQL

Graphic modified from original courtesy of Sun Microsystems

JavaJava

PL/SQL PL/SQL

New PL/SQL Compiler

A new compiler is available for PL/SQL compilation

Transparent to user PL/SQL is significantly

faster than prior releases

Ability to change full interpreted compiled code to full native compiled code

Set Timing ONSELECT fib_sum(30) FROM dual;

FIB_SUM(30)----------- 832040

Elapsed: 00:00:04.82

Set Timing ONSELECT fib_sum(30) FROM dual;

FIB_SUM(30)----------- 832040

Elapsed: 00:00:08.36

OracleDatabase 10g

Oracle9i R2

PL/SQL Performance

Regular Expression Support

Native Regular Expression Support– Revolutionizes pattern matching and manipulation– POSIX Compliant + Backreference support – LOB support + All Character Sets + Locale Sensitive

Motivation and Requirements– Life Sciences Customers– Sync with GNU, PERL, Java, XQuery, etc.– Competitive Advantage – Not offered in DB2, only small

subset in MS SQL Server– Multitude of applications – will be a highly used feature

Available in SQL and PL/SQL

http://sgt.us.oracle.com/portal/index.php?site_id=1122

http://www.opengroup.org/onlinepubs/7908799/xbd/re.html

Native Floating-Point Data Types

Two new numeric data types BINARY_FLOAT, BINARY_DOUBLE

Based on the IEEE 754 Standard for binary floating point arithmetic

More efficient than the NUMBER type. Arithmetic operations are implemented in hardware on most platforms. These types may also take up less space in memory/disk.

Seamless support in SQL and PL/SQL

Native Floating-Point Data Types

New type conversion functions Seamless support in SQL, PL/SQL, Java,

XML, and OCI/OCCI

CREATE TABLE t (f BINARY_FLOAT, d BINARY_DOUBLE);

INSERT INTO t VALUES (2.0f, 2.0d);

INSERT INTO t VALUES (1.5f/0.5f, 1.5d/0.5d);

LOB Enhancements

Performance improvements Terabyte size LOBs New DBMS_LOB.GET_STORAGE_LIMIT

function OCI now supports LOBs greater than 4GB

Oracle 10g – The High Performance Platform for XML

XSLT ProcessingXML Query ProcessingXML Caching w/HTTP security

XSLT ProcessingXML Query ProcessingXML Caching w/o security

XSLT ProcessingXML Query ProcessingXML Schema/DTD ValidationXML Caching w/ JAAS securityXML J2EE ComponentsXML Messaging & Queuing XML Data Integration

J2EEServer

WebCache

XML DBServer

Client

XMLStream

XMLStream

XMLStream

XMLType PersistenceXML Query ProcessingXML Schema ValidationXSLT Processing XML Messaging & QueuingXML Streams

XML Database 10g New Features

Add Node capabilities– InsertXML(),AppendXML(), DeleteXML()

I18N Support XPath re-write enhancements SQL/XML XPath re-write for XMLType views SQL/XML XMLParse() operator SQL Loader improvements Copy Based Schema Evolution

JDBC New Features

Re-Architecture– Unified Code Path

Thin on par with Thick– Bind variable names– PL/SQL index-by table – Proxy authentication– Encryption algorithms

New Data Types– Native IEEE DOUBLE– Native IEEE Float – Long-to-Lob conversion– Unlimited size LOB– INTERVAL DAY TO SECOND

Fastest JDBC Drivers– Best SPECJApp2002 results

Misc.– Enhanced JDBC VARRAY Support– NLS repackaging– Stop shipping classes111

New JDBC 3.0 features– Named Parameters– New Ref interface– Datalink/URL– JCA Resource Adapter– Connection Pool– JDBC Web RowSet

Implicit Connection Caching– Cache Manager

JDBC WebRowSet

An implementation of JSR-114, extends java.sql.ResultSet capabilities

– Enables reading and writing result sets from/into XML format– Serializable/Distributable– Disconnected, decoupled from Data Source – Extensible to non-tabular data– Can be shipped over Internet using HTTP/XML protocols

JDBC Connection Cache and Connection Cache Manager

Cache Manager

Oracle JDBC Driver

...

Session 1.1

Session n.1

....

Cache# 1

Session 1.m

....Cache# nSession n.m

Oracle9iAS or Java/J2EE Node

JDBC Fast Connection Failover

– Failed connections in JDBC connection caching– Listening to UP/DOWN failover events– Resetting the connections

Database instance in a cache

Database instance in a cache

Fast Connection Failover

Java DB New Features

OracleJVM J2SE 1.4 compatible

– Complete Security– Preferences– Headless AWT

Self Tuning Java Pool Java Stored Proc. now return

all SQL Exceptions New Faster Server-side

JDBC driver

RMI Call-out JSP/Servlet Call-out EJB Call-out Web Services Call-out Native Java Interface Optimized Java Memory

Management (Dedicated Server)

OCI, OCCI, Pro*C, C++

Downloadable OCI client stack – doesn’t require install

– i.e. Homeless OCI/JDBC (Type2)

OCCI – Stateless connection pooling– Statement Caching– XA Support

Varray and Nested Tables Enhancements

• Alter VARRAY and Nested Table Limit Size

• Varray Columns in temporary tables

• Alter VARRAY and Nested Table Limit Size

• Varray Columns in temporary tables

ANSI Collections Support in Nested Tables

Equality and Non-Equality Predicates IN and NOT IN operators MULTISET, SUBMULTISET, POWERMULTISET,

POWERMULTISET_BY_CARDINALITY MULTISET EXCEPT operators

CARDINALITY, Operator SET, IS A SET operators MEMBER OF operator IS EMPTY operator

Oracle 10g on Windows

Fiber model support Large Page support Non Uniform Memory Access (NUMA)

support

64-bit Oracle on Windows

Large memory addressability– Up to 8 TB of memory supported (No 4GB SGA

limit)– Page size can be up to 4GB– Capacity, concurrent users, and performance of

Oracle database increases dramatically with more memory

Provides profile-guided optimization (PGO) – Expect 15%-25% performance improvement from

PGO

Oracle: Best Database for .NET

.NET cannot expose DB functionality that is not there

– Oracle leads the way in advanced DB features RAC, XML DB, grid, interMedia, ASO, etc.

Oracle has a high-performing ADO.NET provider that exposes advanced DB features

– Oracle Data Provider for .NET (ODP.NET) ODP.NET allows full access to .NET

– No limitation to using .NET functionality

Oracle Database 10g Location Features

Locator– Points, lines, polygons– 2D, 3D, 4D data– Spatial Operators

Distance Relationships

– Coordinate Systems– Parallel Query– Deferred Spatial

Indexes

Spatial– Additional Spatial functions

Area/Length calculation Buffer, Centroid, Intersection,

Union, etc. – Linear Referencing– Spatial Aggregates– Coordinate Transforms– Geocoder– GeoRaster– Topology Data Model– Network Data Model– Spatial Data Analysis & Mining

Location Performance Improvements in Oracle Database 10g Index inserts

– 500-1000% faster with arrays inserts Spatial queries

– Up to 1000% faster for distance-based queries– 20-40% improvement for spatial relate queries

Spatial joins– 200-600% faster in 10g using a new JOIN algorithm

Spatial queries with local partitioned indexes– 400 to 600% faster for queries accessing more than one

partition (160 partitions) 2 Patent Applications for this work

Workspace Manager Enhancements

Set system parameters to enforce global settings

Create a multiparent workspace

Communicate workspace events to applications

Import to and export from version-enabled tables

Use SQL*Loader to load version-enabled tables

Change a workspace to be continually refreshed

Determine whether a table is version-enabled

Version-enable tables that have unique constraints, nested tables and Virtual Private Database security

Use TIMESTAMP WITH TIME ZONE with History data

Identify users with system level workspace privileges

Query history views with updated column names

Allow users in workspace tree access to locked rows

Use additional DDL on version-enabled tables

AQ&Q U E S T I O N SQ U E S T I O N S

A N S W E R SA N S W E R S

Documents

Oracle 10g New Feature