88
<Insert Picture Here> What’s New in Oracle Database 11g Glenn Miller Sales Consulting Manager Oracle Public Sector

What’s New in Oracle Database 11g - Oracle User …sfoug.org/Downloads/SFOUG_11g_NewFeatures_2.pdf · What’s New in Oracle Database 11g Glenn Miller

Embed Size (px)

Citation preview

<Insert Picture Here>

What’s New in Oracle Database 11gGlenn MillerSales Consulting ManagerOracle Public Sector

Continuous Innovation

Audit VaultAudit VaultDatabase VaultDatabase Vault

Grid ComputingGrid ComputingAutomatic Storage Mgmt Automatic Storage Mgmt

Self Managing Database Self Managing Database XML DatabaseXML Database

Oracle Data GuardOracle Data GuardReal Application ClustersReal Application Clusters

Flashback QueryFlashback QueryVirtual Private DatabaseVirtual Private Database

Built in Java VMBuilt in Java VMPaPartitioning Supportrtitioning Support

Built iBuilt in Messagingn MessagingObject RelationalObject Relational SupportSupport

Multimedia SupportMultimedia SupportData Warehousing OptimizationsData Warehousing Optimizations

Parallel OperationsParallel OperationsDistributed SQL & Transaction Distributed SQL & Transaction SupportSupport

Cluster and MPP SupportCluster and MPP SupportMultiMulti--version Read Consistencyversion Read Consistency

Client/Server SupportClient/Server SupportPlatform PortabilityPlatform Portability

Commercial SQL ImplementationCommercial SQL Implementation

Oracle 2Oracle 9i

Oracle 5

Oracle 6

Oracle 7

Oracle 8

Oracle 8i

Oracle 10g

Oracle Database 11g Highest Quality R&D

• Over 1500 developers and testers spread across eight development labs around the world

• 479 Development Projects• Over 235,000 functional tests run daily on a grid of

over 2000 processors• Triple the number of cross-functional tests run

versus Oracle Database 10g• Over 15,000,000 hours of testing• Exhaustive battery of security tests

SecureFilesAdvanced CompressionOnline Upgrades and PatchingOLAP-based Materialized ViewsWorkload Capture and ReplayReal Application TestingTotal RecallReal Application ClustersPerformance ManagementPhysical Standby Real-Time Query

Oracle 11g - Real Innovations

<Insert Picture Here>

Oracle Database Scalability and Performance

Oracle Partitioning10 years of innovation

Core functionalityOracle8 Range partitions, global range index

Oracle8i Hash and composite range-hash partitioning

Oracle9i List partitioning

Oracle9i R2 Composite range-list partitioningOracle 10g Global hash indexes

Oracle 10g R2 1M partitions per tableReference PartitioningVirtual column partitioningAutomatic interval partitioningNew composite partitioning:

range-range, list-range,list-list, list-hash

Benefits of Partitioning

Large TableDifficult to Manage

PartitionDivide and ConquerEasier to ManageImprove Performance

Composite PartitionHigher PerformanceMore flexibility to match business needs

ORDERS ORDERS

Jan Feb

ORDERS

Europe

Jan Feb

USA

New in Oracle Database 11gAutomated Partitioning: Interval

ORDERS

Jan Feb

ORDERS

Jan Feb Mar

New in Oracle Database 11gAutomated Partitioning: Reference

OrdersInventory

Back Orders

LineItems

PickLists

Orders

Orders

Orders

Jan

Feb

Mar

New in Oracle Database 11gBusiness Driven Partitioning: New Composite

Orders

Jan Feb

Range-Range• Date by order value

>5000

1000-5000

Orders

List-Range• Region by order value

List-List• Region by type

Gold

Silver

USA EUR

>5000

1000-5000

Orders

USA EUR

Virtual Columns & Partitioning

• ANSI syntax• Look just like regular columns from SQL perspective• Support for indexes, constraints, statistics,

histograms• Used by expression evaluation when applicable• 11g can partition on virtual columns

Create table t1 (c1 number, c2 number,c3 as (c1+c2) virtual)

New in Oracle Database 11gPartition Advisor

ORDERS ORDERS

Jan Feb

ORDERS

Europe

Jan Feb

USA

Well-tunedSQL & Schema

• Considers entire query workload to improve query performance

• Advises on partitioning methods • Range (equal-interval),

range key and interval• Hash, hash key

• Integrated, non-conflicting advice with Indexes, MVs

Partitioning Advisor

SQL Workload

PackagedApps

Custom Apps

SQL Advisor

SQL PlanTuning

SQLStructureAnalysis

AccessAnalysis

SQLProfile

SQLAdvice

Indexes& MVs

PartitionAnalysis

Partition Advice

New!

New in Oracle Database 11g Advanced Compression

• Compress Large Application Tables• Transaction processing, data warehousing

• Compress All Data Types• Structured and unstructured data types

• Typical Compression of 2-3 X• Cascade storage savings throughout data center

• Oracle 9i compresses table data only during bulk load • Data warehousing, ILM

• Table compression is now viable for all applications• Compress during random updates

• Typical compression ratio of 2x to 3x• Database directly reads compressed data

bypassing decompression overhead• Strategy - Compress 10 largest tables in a

database• Reduce table data by half, increase CPU usage 5%

• Savings cascades into test, dev, standby, mirrors, archiving, backup, etc.

Compression for Mainstream

Growing Data Volumes

Source: 2005 TopTen Program, November 2005 © Winter Corporation, Waltham, MA, USA

0

20

40

60

80

100

1998 1999 2000 2001 2002 2003 2004 2005

DatabaseSize(TB)

Size of the largest data warehouse in TopTenPrograms

245% Increase just from 2003 to 2005

So how do we control storage costs?Lets take example of 13.5 terabytes…

$0$500,000

$1,000,000$1,500,000$2,000,000$2,500,000$3,000,000

'03 .5

tb'05

1.5tb

'07 4.

5tb'09

13.5t

b'11

40.5t

b

If 1gb storage = $72

Traditional Storage ApproachAll data resides on single storage tier

High Performance Storage Tier = $72 per Gb

All data on active = $972,000

ActiveActive

Information Lifecycle ManagementPartition data onto appropriate storage tier

Active Less Active Historical

High Performance Storage Tier = $72 per Gb

Low cost Storage Tier= $14 per Gb

Read only Storage Tier= $7 per Gb

Information Lifecycle ManagementReduce storage costs accordingly

5% Active 35% Less Active 60% Historical

High Performance Storage Tier = $72 per Gb

Low cost Storage Tier= $14 per Gb

Read only Storage Tier= $7 per Gb

$49,800 $67,700 $58,000

Benefit of PartitioningSignificantly reduces storage costs…

$0$200,000$400,000$600,000$800,000

$1,000,000

Before

ILM

With

ILM

Cost of Storage

Advanced CompressionReduces storage requirements across all tiers…

5% Active 35% Less Active 60% Historical

$16,600 $22,600 $19,400

Lets use compression factor of 3$49,800 $67,700 $58,000

Benefit of Data CompressionCompression further reduces storage costs…

$0$200,000$400,000$600,000$800,000

$1,000,000

Before

ILM

With

ILM

Cost of Storage

Oracle Database 11g Storage BenefitsManaging data growth

Application independentApplication specific

Low costHigh cost

Automated process Manual process

Multi tier storageSingle tier storage

Online archiveOffline archive

$972,000

$58,600

Server Results Cache

• Caches results of queries, query blocks, or pl/sql function calls• Read consistency is enforced

• DML/DDL against dependent database objects invalidates cache• Bind variables parameterize cached result with variable values

Table 1

Table 2 Table 3

join

join

Group by

query 1executes

Table 1

Table 2 Table 3

join

join

Group bycachedresult

result iscached

Table 5 Table 5

join

Table 4

join

Group by

joinquery 2 uses cachedresult transparently

OCI Consistent Client Cachelike cache fusion between server and client

• Caches query results on client• Improves performance for read-mostly tables

• Faster response time - eliminates network round trips• Saves server CPU

• Consistent with server• Cache proactively refreshed when result set changes• Maximum age of consistency info can be set

Application Server

Database

Consistent Caching

OCI Client Result Cache

• Unified interface with Server result cache• Per process cache shared across multiple

sessions/threads• Works with all 11g OCI-based clients

• Including ODP.Net, JDBC Type 2, PHP, ODBC

• DBA just sets size of client cache to activate• Client side parameter to overwrite client cache size

alter table DEPT cache results

“Native” PL/SQL and JAVA Compilation

• 100+% faster for pure PL/SQL or Java code• 10% – 30% faster for typical transactions with SQL

• PL/SQL• Just one parameter - On / Off

• No need for C compiler• No file system DLLs

• Java• Just one parameter – On / Off• JIT “on the fly” compilation

• Transparent to user (asynchronous, in background)• Code stored to avoid recompilations

Server Side Session Connection Pooling

• Allows multiple Oracle clients to share a server-side pool of sessions

• Clients can connect and disconnect at will without the cost of creating a new server session• Note that Shared Server removes the process creation cost

• But not the session creation cost• Similar to Web Server connection pooling model• Big speedup for PHP applications

• Other networking features:• Network Fast Path for simple SQL performance• High throughput support for Bulk Data Transfers• IPv6 addressing support

Faster Performance

Java Just-In-TimeCompiler

Up to11 x Faster

Database ResidentConnection Pool

Up to 20 x connections

RAC PerformanceEnhancements

Up to70% Faster

Query ResultCaching

Up to25% Faster

Client SideCaching

Up to22% Faster

Oracle SecureBackup

Up to25% Faster

Oracle StreamsEnhancements

Up to 2 x Faster

Optimizer StatsCollection

Up to 10 x Faster

0 %

5 0 0 %

1 0 0 0 %

1 5 0 0 %

2 0 0 0 %

N b r C o n n e c t i o n s0

2

4

6

8

1 0

1 2

Sp e e d

0 %

2 0 %

4 0 %

6 0 %

8 0 %

1 0 0 %

1 2 0 %

1 4 0 %

1 6 0 %

1 8 0 %

Q u e r y I n t e n s i v e

0

2 0

4 0

6 0

8 0

1 0 0

1 2 0

1 4 0

Q u e r i e s

0%

20%

40%

60%

80%

100%

120%

140%

Improvement

0

2 0

4 0

6 0

8 0

1 0 0

1 2 0

1 4 0

B a c k u p

0

5 0

1 0 0

1 5 0

2 0 0

R e p l i c a t i o n

0

200

400

600

800

1000

Stats Collection

<Insert Picture Here>

Oracle Database Reliability and High Availability

Examples of Sustained Innovation -Enterprise Grid Computing

Grids oflow cost

hardware andstorage

RACClusters

forAvailability

SMPDominance

11g Grid Directions

• Simplicity - Make the grid as easy as a single system• Expert system for cross-cluster performance diagnostics• Zero-configuration node management

• Quality of service management• Seamlessly manage resources across middle-tier, database,

and storage• Policy-based performance and workload management

RAC Optimized Cache Fusion

• Improved performance for read-intensive workloads• improves any read from disk (not cache) whether

short random reads or large table scans • Throughput improved up to 70% for internal

read-only benchmark

Other RAC Enhancements

• Seamless integration with XA and Microsoft Transaction Server

• Fine tune performance, scaling, failover, management

• Faster and more robust handling of instance crashes and hangs• Most of this also in 10.2.0.3

• Runtime Connection Load Balancing works with OCI Session Pools

Database

Storage

ASM Fast Mirror Resync

Disk again accessible:Only need to resync modified extents

2

Failure time < DISK_REPAIR_TIME

1 • Fraction of time to establish redundancy

• Only changed blocks are resync’ed

• Benefits:• Fast recovery from transient

failures• Enables pro-active

maintenance

ASM Preferred Mirror Read

Site BSite A

P S

• Allow local mirror read operations• Eliminate network latencies in extended clusters

Extended Cluster

ASM_PREFERRED_READ_FAILURE_GROUPS=DATA.SITEA

ASM_PREFERRED_READ_FAILURE_GROUPS=DATA.SITEB

SELECT preferred_read FROM v$asm_disk;SELECT * FROM v$asm_disk_iostat;

ASM Rolling Upgrades and Patches

• Maximizes database availability in a cluster• How it works:

• Place cluster in ‘Rolling Migration’ mode• Bring down ASM on a cluster node• Upgrade or patch software• Re-start ASM

• Stop ‘Rolling Migration’ mode after upgrading all nodes

Self Managing Database

Stor

age

Bac

kup

Mem

ory

App

s/SQ

L

Sche

ma

RA

C

Rec

over

y

Rep

licat

ion

Auto-TuningTuning

Advisory

Instrumentation

Self Managing Database

Stor

age

Bac

kup

Mem

ory

App

s/SQ

L

Sche

ma

RA

C

Rec

over

y

Rep

licat

ion

Auto-TuningTuning

Advisory

Instrumentation

Automatic Memory Tuning

• Automatically adapts to workload changes

• Unifies shared (SGA) and process (PGA) memory management

• Single dynamic parameter for all database memory

• Maximizes memory utilization• Helps eliminate out- of-memory

errors• Gets and releases memory from

OS: Linux, Windows and Solaris, HPUX, AIX

• Built in safety-nets to work under runaway workloads

• Pace needy components• Not shrink below minimum

O/S MemoryO/S Memory

PGA

SGA

PGA

SGA

ADDM for RAC

• Performance expert in a box• Now RAC specialist too!

• Identifies the most “Globally Significant” performance issues for the entire RAC database

• Database-wide and instance-level analysis

• Database-wide analysis of:• Global cache interconnect issues• Lock manager congestion issues • Global resource contention, e.g. IO

bandwidth, hot blocks• Globally high-load SQL• Skew in instance response times

• Allows drill down to instances• Runs proactively every hour

(default)• Directives to filter results

Self-Diagnostic Engine

Database-Level ADDM

Instance-Level ADDMs

Node 1 Node 2 Node 3

Management Scalability

Manage Highly Complex Integrated Applications• ADDM for RAC• Partitioning Advisor• Fully Automatic SQL tuning• Streams Performance Advisor• Capture/Replay of high load SQL• Capture/Replay for Database Workloads

Oracle Data Guard -Unlocking the Value of Standby DBs

Standbyfor OnlineUpgrade,

Auto Failover

Standbyfor Testing,ReadablePhysical

Standbyfor DR

and Backup

Logical Standby

for RealtimeQuery

Physical Standby with Real-Time Query

Physical Standby Database

Primary Database

Real-time Queries

Continuous Redo Shipment and Apply

Concurrent Real-Time

Query

• Read-only queries on physical standby concurrent with redo apply• Supports RAC on primary / standby• Queries see transactionally consistent results

• Immediate appeal to the many users of physical standby• DR with real time query is unique in the industry – no idle resources• Handles all data types, but not as flexible as logical standby

Oracle Data Guard 11gOffload production reporting to standby

• Simultaneously available in read and recovery mode

Real-time Queries

Standby Database

ProductionDatabase

Oracle Data Guard 11gOffload database backups to standby

• Complete database and fast incremental backups

Real-time Queries

Standby Database

ProductionDatabase

Oracle Data Guard 11gRolling upgrades and changes

• Switch to ‘snapshot’ standby for testing purposes

Real-time Queries

Standby Database

ProductionDatabase

Oracle Data Guard 11gTest upgrade or changes

• Test on standby and ‘roll’ to production

Real-time Queries

Standby Database

ProductionDatabase

Oracle Data Guard 11gSwitchover to new standby system

• Changed standby becomes production

Real-time Queries

ProductionDatabase

StandbyDatabase

SQL Apply and Streams Improvements

• Support XMLType data type (CLOB)• Support Transparent Data Encryption (TDE)• Apply performance improved up to 50%

• SQL Apply additional PL/SQL Package support • Support Fine Grained Auditing• Support DBMS_RLS (Virtual Private Database)

Why Oracle Data Guard?Invest in Disaster and Performance Protection

Simultaneous read & recovery

High ROI

Automated

Disaster & performance protection

Use in production & testing

Recovery mode only

Low ROI

Manual intensive

Disaster protection only

Rarely used

Flashback for Rapid Recovery from Human Error

FlashbackDatabase

FlashbackData Archive

FlashbackTables

FlashbackQuery

Flashback Data Archive

• Long term retention - years• Automatically stores all

changes to selected tables in Flashback Data Archive• Archive cannot be modified• Old data purged per retention

policy• View table contents as of any

time using Flashback SQL• Uses

• Change Tracking• Long term history• Compliance• Auditing• ILM

ORDERS

User Tablespaces

Flashback Data Archive

ArchiveTables

Oracle Database

Changes

Total Recall

Select * from ordersAS OF

‘Midnight 31-Dec-2004’

Oracle Recovery Manager Protect Against Data Loss

New in Oracle Database 11g…Data Recovery Advisor

Automatic Storage Management Protect Against Disk Loss

New in Oracle Database 11g…Fast Mirror ResyncPreferred Mirror Read

Real Application Clusters Protect Against Server Loss

New in Oracle Database 11g…XA Transactions spanning multiple serversImproved runtime connection load balancing

Flashback Protect Against Human Error

New in Oracle Database 11g…Total RecallFlashback Transaction

Oracle Data Guard Protect Against Site Failure

New in Oracle Database 11g…Snapshot StandbyReadable Physical

<Insert Picture Here>

Oracle Database Information Management and Data Security

Complete Information Management

MultimediaMultimediaAudio, Image and VideoAudio, Image and Video

Location & SpatialLocation & SpatialLocation Enabled DatabasesLocation Enabled Databases

Secure Enterprise SearchSecure Enterprise SearchEnterprise Wide SearchEnterprise Wide Search

XMLXMLIntegrated Native XML DatabaseIntegrated Native XML Database

TextTextText Indexing and ClassificationText Indexing and Classification

RelationalRelationalCharacters, Numbers, Dates, LOBsCharacters, Numbers, Dates, LOBs

Content DB and Records DBContent DB and Records DBContent Management in the DatabaseContent Management in the Database

Complete Information Management

MultimediaMultimediaMedical Image SupportMedical Image Support

Location & SpatialLocation & Spatial3D Support3D Support

XMLXMLBinary XML SupportBinary XML Support

TextTextRDF and OWL SupportRDF and OWL Support

RelationalRelationalNew New SecureFilesSecureFiles LOB StorageLOB Storage

Secure Enterprise SearchSecure Enterprise SearchComplete Set of ConnectorsComplete Set of Connectors

Content DB and Records DBContent DB and Records DBUniversal Content & Records ManagementUniversal Content & Records Management

New in Oracle Database 11gCritical New Data Types

RFID Data Types

DICOMMedical Images

3D SpatialImages

Oracle SecureFilesConsolidated Secure Management of Data

• SecureFiles is a new database feature designed to break the performance barrier keeping file data out of databases

• Similar to LOBs but much faster, and with more capabilities• Transparent encryption, compression, deduplication, etc.• Preserves the security, reliability, and scalability of database• Superset of LOB interfaces allows easy migration from LOBs

• Enables consolidation of file data with associated relational data• Single security model• Single view of data• Single management of data• File system access still

Database and File System Interfaces

• SecureFiles can be accessed by both database clients and file system clients

• Database clients use extended LOB interfaces• JDBC, ODBC, OCI, .NET, PL/SQL• 11g has a highly optimized streaming protocol for SecureFiles

• File system clients use the file system protocols implemented inthe XML DB repository• FTP access• WebDav Access• Mountable NFS V4 file system (preview only)

020406080

100120

0.1 1 10 100

LOBs

Linux Files

SecureFiles

• Innovative technology for high performance large object data•Smart buffering, write gathering, intelligent locking

•Fast bulk data transfers, LOB prefetch

• Much faster than LOBs with more capabilities

• File system-like performancewith database functionality!

File Size (MB)

File Read Performance(MB/second)

SecureFiles in the Database -Breaking the Performance Barrier

Integrated BI in the Database - OLAP

SQL Star Queries

Cubes but noSQL access

SQLViews over

Cubes

TransparentSQL Rewrite

to Cubes

Materialized ViewsSales

by RegionSales

by Date

Sales by Product

Sales by Channel

QueryRewrite

Materialized Views Typical Architecture Today

Region Date

Product Channel

SQL Query

RelationalStar Schema

New in Oracle Database 11gCube Organized Materialized Views

Materialized Views

Region Date

Product Channel

SQL Query

QueryRewrite

AutomaticRefresh

OLAP Cube

Database Security and Compliance

DatabaseDatabaseVaultVault

MultiMulti--factorfactorDBA ControlsDBA Controls

AdvancedAdvancedSecuritySecurity

EncryptedEncryptedDataData

LabelLabelSecuritySecurity

DataDataClassificationClassification

SecureSecureBackupBackup

EncryptedEncryptedData on TapeData on Tape

ConfigurationConfigurationMgmt PackMgmt Pack

SecureSecureDeploymentsDeployments

AuditAuditVaultVault

Monitor, Alert,Monitor, Alert,ConsolidateConsolidate

Security and ComplianceDeploy Certified Configurations

Oracle Configuration Management Pack

Security and ComplianceStrongly Authenticate and Authorize End Users

Advanced Security

New in Oracle Database 11g…Kerberos authentication

Strong passwords

Security and ComplianceEncrypt Data in Database

Transparent Data Encryption

New in Oracle Database 11g…Tablespace level encryption

Hardware based masterkey protection

Security and ComplianceAdd Multi-factor DBA Controls

Database Vault

Security and ComplianceConsolidate and Monitor Audit Information

Audit Vault

Security and ComplianceEncrypt Backups

Oracle Secure Backup

New in Oracle Database 11g…Backup compression

So … What is the perennial customer challenge ?

Lifecycle of Change Management New Change Assurance Capabilities

Capture andReplay Workload

Set Up TestEnvironments

Detect and TunePerformance Changes

Package Incidentsfor Support

Online ‘Hot’ Patching

Configure and Maintain Production System

Provision - Upgrade or Clone

Set up Test Environments using Snapshot Standbys

• Convert Physical Standby to Snapshot Standby and open for writes and application testing

• ALTER DATABASE CONVERT TO SNAPSHOT STANDBY;

• Can Replay Workload against the Snapshot Standby

• Discard testing writes and catch-up to primary by applying logs

• ALTER DATABASE CONVERT TO PHYSICAL STANDBY;

• Accumulates logs at the Standby site• Preserves zero data loss

Physical Standby Apply Logs

Snapshot Standby Perform Testing

Open Database

Back out Changes

Database ReplayRealistic Testing

• Recreate actual production database workload• Capture production workload incl. concurrency • Replay workload in test with production timing• Analyze & fix issues before production

Middle Tier

Capture DB Workload

Storage

OracleDB servers Replay DB

Workload

ProductionEnvironment

Standby/TestEnvironment`

SQL Performance Analyzer

CaptureSQL

Storage

OracleDB servers

ExecuteSQL

Queries

ProductionEnvironment

Standby/TestEnvironment

Realistic Testing• Test impact of change on SQL performance• Capture SQL including statistics & bind vars• Re-execute SQL in test environment• Use SQL Tuning Advisor to seed SQL plans

Test Database

Production Database Redo

Shipment and Apply

Works with Snapshot Standby

CAPTURERec REPLAY

Standby Database

Support for Online Hot Patching

• Oracle already supports rolling patches between nodes in a cluster

• 11g adds online patching of a running Oracle executable (single instance or cluster) with no downtime• Integrated with OPatch• Many one-off patches can be hot

patched• Great for diagnostic patches

……

ClientClient

…Client

Capture DB Workload

Make Change Safe -Realistic Testing with Database Replay

• Recreate actual production database workload in test environment• No test development required• Replay workload in test with production timing• Analyze & fix issues before production

Middle Tier

Storage

Oracle DB

Replay DB Workload

Production Test

Test migration to RAC

Make Change Safe –Find Regressed SQL with SQL Performance Analyzer

Oracle Real Application TestingInnovate Change Faster

149 Days

Complete workflowsPartial workflows

Low riskHigh risk

AutomatedManual intensive

Days of developmentMonths of development

Production workloadsArtificial workloads

149 Days 11 Days

Q U E S T I O N SQ U E S T I O N SA N S W E R SA N S W E R S

<Insert Picture Here>

What’s New in Oracle Database 11gGlenn MillerSales Consulting ManagerOracle Public Sector