Upload
hoangkhanh
View
217
Download
0
Embed Size (px)
Citation preview
<Insert Picture Here>
What’s New in Oracle Database 11gGlenn MillerSales Consulting ManagerOracle Public Sector
Continuous Innovation
Audit VaultAudit VaultDatabase VaultDatabase Vault
Grid ComputingGrid ComputingAutomatic Storage Mgmt Automatic Storage Mgmt
Self Managing Database Self Managing Database XML DatabaseXML Database
Oracle Data GuardOracle Data GuardReal Application ClustersReal Application Clusters
Flashback QueryFlashback QueryVirtual Private DatabaseVirtual Private Database
Built in Java VMBuilt in Java VMPaPartitioning Supportrtitioning Support
Built iBuilt in Messagingn MessagingObject RelationalObject Relational SupportSupport
Multimedia SupportMultimedia SupportData Warehousing OptimizationsData Warehousing Optimizations
Parallel OperationsParallel OperationsDistributed SQL & Transaction Distributed SQL & Transaction SupportSupport
Cluster and MPP SupportCluster and MPP SupportMultiMulti--version Read Consistencyversion Read Consistency
Client/Server SupportClient/Server SupportPlatform PortabilityPlatform Portability
Commercial SQL ImplementationCommercial SQL Implementation
Oracle 2Oracle 9i
Oracle 5
Oracle 6
Oracle 7
Oracle 8
Oracle 8i
Oracle 10g
Oracle Database 11g Highest Quality R&D
• Over 1500 developers and testers spread across eight development labs around the world
• 479 Development Projects• Over 235,000 functional tests run daily on a grid of
over 2000 processors• Triple the number of cross-functional tests run
versus Oracle Database 10g• Over 15,000,000 hours of testing• Exhaustive battery of security tests
SecureFilesAdvanced CompressionOnline Upgrades and PatchingOLAP-based Materialized ViewsWorkload Capture and ReplayReal Application TestingTotal RecallReal Application ClustersPerformance ManagementPhysical Standby Real-Time Query
Oracle 11g - Real Innovations
Oracle Partitioning10 years of innovation
Core functionalityOracle8 Range partitions, global range index
Oracle8i Hash and composite range-hash partitioning
Oracle9i List partitioning
Oracle9i R2 Composite range-list partitioningOracle 10g Global hash indexes
Oracle 10g R2 1M partitions per tableReference PartitioningVirtual column partitioningAutomatic interval partitioningNew composite partitioning:
range-range, list-range,list-list, list-hash
Benefits of Partitioning
Large TableDifficult to Manage
PartitionDivide and ConquerEasier to ManageImprove Performance
Composite PartitionHigher PerformanceMore flexibility to match business needs
ORDERS ORDERS
Jan Feb
ORDERS
Europe
Jan Feb
USA
New in Oracle Database 11gAutomated Partitioning: Reference
OrdersInventory
Back Orders
LineItems
PickLists
Orders
Orders
Orders
Jan
Feb
Mar
New in Oracle Database 11gBusiness Driven Partitioning: New Composite
Orders
Jan Feb
Range-Range• Date by order value
>5000
1000-5000
Orders
List-Range• Region by order value
List-List• Region by type
Gold
Silver
USA EUR
>5000
1000-5000
Orders
USA EUR
Virtual Columns & Partitioning
• ANSI syntax• Look just like regular columns from SQL perspective• Support for indexes, constraints, statistics,
histograms• Used by expression evaluation when applicable• 11g can partition on virtual columns
Create table t1 (c1 number, c2 number,c3 as (c1+c2) virtual)
Well-tunedSQL & Schema
• Considers entire query workload to improve query performance
• Advises on partitioning methods • Range (equal-interval),
range key and interval• Hash, hash key
• Integrated, non-conflicting advice with Indexes, MVs
Partitioning Advisor
SQL Workload
PackagedApps
Custom Apps
SQL Advisor
SQL PlanTuning
SQLStructureAnalysis
AccessAnalysis
SQLProfile
SQLAdvice
Indexes& MVs
PartitionAnalysis
Partition Advice
New!
New in Oracle Database 11g Advanced Compression
• Compress Large Application Tables• Transaction processing, data warehousing
• Compress All Data Types• Structured and unstructured data types
• Typical Compression of 2-3 X• Cascade storage savings throughout data center
• Oracle 9i compresses table data only during bulk load • Data warehousing, ILM
• Table compression is now viable for all applications• Compress during random updates
• Typical compression ratio of 2x to 3x• Database directly reads compressed data
bypassing decompression overhead• Strategy - Compress 10 largest tables in a
database• Reduce table data by half, increase CPU usage 5%
• Savings cascades into test, dev, standby, mirrors, archiving, backup, etc.
Compression for Mainstream
Growing Data Volumes
Source: 2005 TopTen Program, November 2005 © Winter Corporation, Waltham, MA, USA
0
20
40
60
80
100
1998 1999 2000 2001 2002 2003 2004 2005
DatabaseSize(TB)
Size of the largest data warehouse in TopTenPrograms
245% Increase just from 2003 to 2005
So how do we control storage costs?Lets take example of 13.5 terabytes…
$0$500,000
$1,000,000$1,500,000$2,000,000$2,500,000$3,000,000
'03 .5
tb'05
1.5tb
'07 4.
5tb'09
13.5t
b'11
40.5t
b
If 1gb storage = $72
Traditional Storage ApproachAll data resides on single storage tier
High Performance Storage Tier = $72 per Gb
All data on active = $972,000
ActiveActive
Information Lifecycle ManagementPartition data onto appropriate storage tier
Active Less Active Historical
High Performance Storage Tier = $72 per Gb
Low cost Storage Tier= $14 per Gb
Read only Storage Tier= $7 per Gb
Information Lifecycle ManagementReduce storage costs accordingly
5% Active 35% Less Active 60% Historical
High Performance Storage Tier = $72 per Gb
Low cost Storage Tier= $14 per Gb
Read only Storage Tier= $7 per Gb
$49,800 $67,700 $58,000
Benefit of PartitioningSignificantly reduces storage costs…
$0$200,000$400,000$600,000$800,000
$1,000,000
Before
ILM
With
ILM
Cost of Storage
Advanced CompressionReduces storage requirements across all tiers…
5% Active 35% Less Active 60% Historical
$16,600 $22,600 $19,400
Lets use compression factor of 3$49,800 $67,700 $58,000
Benefit of Data CompressionCompression further reduces storage costs…
$0$200,000$400,000$600,000$800,000
$1,000,000
Before
ILM
With
ILM
Cost of Storage
Oracle Database 11g Storage BenefitsManaging data growth
Application independentApplication specific
Low costHigh cost
Automated process Manual process
Multi tier storageSingle tier storage
Online archiveOffline archive
$972,000
$58,600
Server Results Cache
• Caches results of queries, query blocks, or pl/sql function calls• Read consistency is enforced
• DML/DDL against dependent database objects invalidates cache• Bind variables parameterize cached result with variable values
Table 1
Table 2 Table 3
join
join
Group by
query 1executes
Table 1
Table 2 Table 3
join
join
Group bycachedresult
result iscached
Table 5 Table 5
join
Table 4
join
Group by
joinquery 2 uses cachedresult transparently
OCI Consistent Client Cachelike cache fusion between server and client
• Caches query results on client• Improves performance for read-mostly tables
• Faster response time - eliminates network round trips• Saves server CPU
• Consistent with server• Cache proactively refreshed when result set changes• Maximum age of consistency info can be set
Application Server
Database
Consistent Caching
OCI Client Result Cache
• Unified interface with Server result cache• Per process cache shared across multiple
sessions/threads• Works with all 11g OCI-based clients
• Including ODP.Net, JDBC Type 2, PHP, ODBC
• DBA just sets size of client cache to activate• Client side parameter to overwrite client cache size
alter table DEPT cache results
“Native” PL/SQL and JAVA Compilation
• 100+% faster for pure PL/SQL or Java code• 10% – 30% faster for typical transactions with SQL
• PL/SQL• Just one parameter - On / Off
• No need for C compiler• No file system DLLs
• Java• Just one parameter – On / Off• JIT “on the fly” compilation
• Transparent to user (asynchronous, in background)• Code stored to avoid recompilations
Server Side Session Connection Pooling
• Allows multiple Oracle clients to share a server-side pool of sessions
• Clients can connect and disconnect at will without the cost of creating a new server session• Note that Shared Server removes the process creation cost
• But not the session creation cost• Similar to Web Server connection pooling model• Big speedup for PHP applications
• Other networking features:• Network Fast Path for simple SQL performance• High throughput support for Bulk Data Transfers• IPv6 addressing support
Faster Performance
Java Just-In-TimeCompiler
Up to11 x Faster
Database ResidentConnection Pool
Up to 20 x connections
RAC PerformanceEnhancements
Up to70% Faster
Query ResultCaching
Up to25% Faster
Client SideCaching
Up to22% Faster
Oracle SecureBackup
Up to25% Faster
Oracle StreamsEnhancements
Up to 2 x Faster
Optimizer StatsCollection
Up to 10 x Faster
0 %
5 0 0 %
1 0 0 0 %
1 5 0 0 %
2 0 0 0 %
N b r C o n n e c t i o n s0
2
4
6
8
1 0
1 2
Sp e e d
0 %
2 0 %
4 0 %
6 0 %
8 0 %
1 0 0 %
1 2 0 %
1 4 0 %
1 6 0 %
1 8 0 %
Q u e r y I n t e n s i v e
0
2 0
4 0
6 0
8 0
1 0 0
1 2 0
1 4 0
Q u e r i e s
0%
20%
40%
60%
80%
100%
120%
140%
Improvement
0
2 0
4 0
6 0
8 0
1 0 0
1 2 0
1 4 0
B a c k u p
0
5 0
1 0 0
1 5 0
2 0 0
R e p l i c a t i o n
0
200
400
600
800
1000
Stats Collection
Examples of Sustained Innovation -Enterprise Grid Computing
Grids oflow cost
hardware andstorage
RACClusters
forAvailability
SMPDominance
11g Grid Directions
• Simplicity - Make the grid as easy as a single system• Expert system for cross-cluster performance diagnostics• Zero-configuration node management
• Quality of service management• Seamlessly manage resources across middle-tier, database,
and storage• Policy-based performance and workload management
RAC Optimized Cache Fusion
• Improved performance for read-intensive workloads• improves any read from disk (not cache) whether
short random reads or large table scans • Throughput improved up to 70% for internal
read-only benchmark
Other RAC Enhancements
• Seamless integration with XA and Microsoft Transaction Server
• Fine tune performance, scaling, failover, management
• Faster and more robust handling of instance crashes and hangs• Most of this also in 10.2.0.3
• Runtime Connection Load Balancing works with OCI Session Pools
Database
Storage
ASM Fast Mirror Resync
Disk again accessible:Only need to resync modified extents
2
Failure time < DISK_REPAIR_TIME
1 • Fraction of time to establish redundancy
• Only changed blocks are resync’ed
• Benefits:• Fast recovery from transient
failures• Enables pro-active
maintenance
ASM Preferred Mirror Read
Site BSite A
P S
• Allow local mirror read operations• Eliminate network latencies in extended clusters
Extended Cluster
ASM_PREFERRED_READ_FAILURE_GROUPS=DATA.SITEA
ASM_PREFERRED_READ_FAILURE_GROUPS=DATA.SITEB
SELECT preferred_read FROM v$asm_disk;SELECT * FROM v$asm_disk_iostat;
ASM Rolling Upgrades and Patches
• Maximizes database availability in a cluster• How it works:
• Place cluster in ‘Rolling Migration’ mode• Bring down ASM on a cluster node• Upgrade or patch software• Re-start ASM
• Stop ‘Rolling Migration’ mode after upgrading all nodes
Self Managing Database
Stor
age
Bac
kup
Mem
ory
App
s/SQ
L
Sche
ma
RA
C
Rec
over
y
Rep
licat
ion
Auto-TuningTuning
Advisory
Instrumentation
Self Managing Database
Stor
age
Bac
kup
Mem
ory
App
s/SQ
L
Sche
ma
RA
C
Rec
over
y
Rep
licat
ion
Auto-TuningTuning
Advisory
Instrumentation
Automatic Memory Tuning
• Automatically adapts to workload changes
• Unifies shared (SGA) and process (PGA) memory management
• Single dynamic parameter for all database memory
• Maximizes memory utilization• Helps eliminate out- of-memory
errors• Gets and releases memory from
OS: Linux, Windows and Solaris, HPUX, AIX
• Built in safety-nets to work under runaway workloads
• Pace needy components• Not shrink below minimum
O/S MemoryO/S Memory
PGA
SGA
PGA
SGA
ADDM for RAC
• Performance expert in a box• Now RAC specialist too!
• Identifies the most “Globally Significant” performance issues for the entire RAC database
• Database-wide and instance-level analysis
• Database-wide analysis of:• Global cache interconnect issues• Lock manager congestion issues • Global resource contention, e.g. IO
bandwidth, hot blocks• Globally high-load SQL• Skew in instance response times
• Allows drill down to instances• Runs proactively every hour
(default)• Directives to filter results
Self-Diagnostic Engine
Database-Level ADDM
Instance-Level ADDMs
Node 1 Node 2 Node 3
Management Scalability
Manage Highly Complex Integrated Applications• ADDM for RAC• Partitioning Advisor• Fully Automatic SQL tuning• Streams Performance Advisor• Capture/Replay of high load SQL• Capture/Replay for Database Workloads
Oracle Data Guard -Unlocking the Value of Standby DBs
Standbyfor OnlineUpgrade,
Auto Failover
Standbyfor Testing,ReadablePhysical
Standbyfor DR
and Backup
Logical Standby
for RealtimeQuery
Physical Standby with Real-Time Query
Physical Standby Database
Primary Database
Real-time Queries
Continuous Redo Shipment and Apply
Concurrent Real-Time
Query
• Read-only queries on physical standby concurrent with redo apply• Supports RAC on primary / standby• Queries see transactionally consistent results
• Immediate appeal to the many users of physical standby• DR with real time query is unique in the industry – no idle resources• Handles all data types, but not as flexible as logical standby
Oracle Data Guard 11gOffload production reporting to standby
• Simultaneously available in read and recovery mode
Real-time Queries
Standby Database
ProductionDatabase
Oracle Data Guard 11gOffload database backups to standby
• Complete database and fast incremental backups
Real-time Queries
Standby Database
ProductionDatabase
Oracle Data Guard 11gRolling upgrades and changes
• Switch to ‘snapshot’ standby for testing purposes
Real-time Queries
Standby Database
ProductionDatabase
Oracle Data Guard 11gTest upgrade or changes
• Test on standby and ‘roll’ to production
Real-time Queries
Standby Database
ProductionDatabase
Oracle Data Guard 11gSwitchover to new standby system
• Changed standby becomes production
Real-time Queries
ProductionDatabase
StandbyDatabase
SQL Apply and Streams Improvements
• Support XMLType data type (CLOB)• Support Transparent Data Encryption (TDE)• Apply performance improved up to 50%
• SQL Apply additional PL/SQL Package support • Support Fine Grained Auditing• Support DBMS_RLS (Virtual Private Database)
Why Oracle Data Guard?Invest in Disaster and Performance Protection
Simultaneous read & recovery
High ROI
Automated
Disaster & performance protection
Use in production & testing
Recovery mode only
Low ROI
Manual intensive
Disaster protection only
Rarely used
Flashback for Rapid Recovery from Human Error
FlashbackDatabase
FlashbackData Archive
FlashbackTables
FlashbackQuery
Flashback Data Archive
• Long term retention - years• Automatically stores all
changes to selected tables in Flashback Data Archive• Archive cannot be modified• Old data purged per retention
policy• View table contents as of any
time using Flashback SQL• Uses
• Change Tracking• Long term history• Compliance• Auditing• ILM
ORDERS
User Tablespaces
Flashback Data Archive
ArchiveTables
Oracle Database
Changes
Total Recall
Select * from ordersAS OF
‘Midnight 31-Dec-2004’
Automatic Storage Management Protect Against Disk Loss
New in Oracle Database 11g…Fast Mirror ResyncPreferred Mirror Read
Real Application Clusters Protect Against Server Loss
New in Oracle Database 11g…XA Transactions spanning multiple serversImproved runtime connection load balancing
Oracle Data Guard Protect Against Site Failure
New in Oracle Database 11g…Snapshot StandbyReadable Physical
Complete Information Management
MultimediaMultimediaAudio, Image and VideoAudio, Image and Video
Location & SpatialLocation & SpatialLocation Enabled DatabasesLocation Enabled Databases
Secure Enterprise SearchSecure Enterprise SearchEnterprise Wide SearchEnterprise Wide Search
XMLXMLIntegrated Native XML DatabaseIntegrated Native XML Database
TextTextText Indexing and ClassificationText Indexing and Classification
RelationalRelationalCharacters, Numbers, Dates, LOBsCharacters, Numbers, Dates, LOBs
Content DB and Records DBContent DB and Records DBContent Management in the DatabaseContent Management in the Database
Complete Information Management
MultimediaMultimediaMedical Image SupportMedical Image Support
Location & SpatialLocation & Spatial3D Support3D Support
XMLXMLBinary XML SupportBinary XML Support
TextTextRDF and OWL SupportRDF and OWL Support
RelationalRelationalNew New SecureFilesSecureFiles LOB StorageLOB Storage
Secure Enterprise SearchSecure Enterprise SearchComplete Set of ConnectorsComplete Set of Connectors
Content DB and Records DBContent DB and Records DBUniversal Content & Records ManagementUniversal Content & Records Management
New in Oracle Database 11gCritical New Data Types
RFID Data Types
DICOMMedical Images
3D SpatialImages
Oracle SecureFilesConsolidated Secure Management of Data
• SecureFiles is a new database feature designed to break the performance barrier keeping file data out of databases
• Similar to LOBs but much faster, and with more capabilities• Transparent encryption, compression, deduplication, etc.• Preserves the security, reliability, and scalability of database• Superset of LOB interfaces allows easy migration from LOBs
• Enables consolidation of file data with associated relational data• Single security model• Single view of data• Single management of data• File system access still
Database and File System Interfaces
• SecureFiles can be accessed by both database clients and file system clients
• Database clients use extended LOB interfaces• JDBC, ODBC, OCI, .NET, PL/SQL• 11g has a highly optimized streaming protocol for SecureFiles
• File system clients use the file system protocols implemented inthe XML DB repository• FTP access• WebDav Access• Mountable NFS V4 file system (preview only)
020406080
100120
0.1 1 10 100
LOBs
Linux Files
SecureFiles
• Innovative technology for high performance large object data•Smart buffering, write gathering, intelligent locking
•Fast bulk data transfers, LOB prefetch
• Much faster than LOBs with more capabilities
• File system-like performancewith database functionality!
File Size (MB)
File Read Performance(MB/second)
SecureFiles in the Database -Breaking the Performance Barrier
Integrated BI in the Database - OLAP
SQL Star Queries
Cubes but noSQL access
SQLViews over
Cubes
TransparentSQL Rewrite
to Cubes
Materialized ViewsSales
by RegionSales
by Date
Sales by Product
Sales by Channel
QueryRewrite
Materialized Views Typical Architecture Today
Region Date
Product Channel
SQL Query
RelationalStar Schema
New in Oracle Database 11gCube Organized Materialized Views
Materialized Views
Region Date
Product Channel
SQL Query
QueryRewrite
AutomaticRefresh
OLAP Cube
Database Security and Compliance
DatabaseDatabaseVaultVault
MultiMulti--factorfactorDBA ControlsDBA Controls
AdvancedAdvancedSecuritySecurity
EncryptedEncryptedDataData
LabelLabelSecuritySecurity
DataDataClassificationClassification
SecureSecureBackupBackup
EncryptedEncryptedData on TapeData on Tape
ConfigurationConfigurationMgmt PackMgmt Pack
SecureSecureDeploymentsDeployments
AuditAuditVaultVault
Monitor, Alert,Monitor, Alert,ConsolidateConsolidate
Security and ComplianceStrongly Authenticate and Authorize End Users
Advanced Security
New in Oracle Database 11g…Kerberos authentication
Strong passwords
Security and ComplianceEncrypt Data in Database
Transparent Data Encryption
New in Oracle Database 11g…Tablespace level encryption
Hardware based masterkey protection
Security and ComplianceEncrypt Backups
Oracle Secure Backup
New in Oracle Database 11g…Backup compression
Lifecycle of Change Management New Change Assurance Capabilities
Capture andReplay Workload
Set Up TestEnvironments
Detect and TunePerformance Changes
Package Incidentsfor Support
Online ‘Hot’ Patching
Configure and Maintain Production System
Provision - Upgrade or Clone
Set up Test Environments using Snapshot Standbys
• Convert Physical Standby to Snapshot Standby and open for writes and application testing
• ALTER DATABASE CONVERT TO SNAPSHOT STANDBY;
• Can Replay Workload against the Snapshot Standby
• Discard testing writes and catch-up to primary by applying logs
• ALTER DATABASE CONVERT TO PHYSICAL STANDBY;
• Accumulates logs at the Standby site• Preserves zero data loss
Physical Standby Apply Logs
Snapshot Standby Perform Testing
Open Database
Back out Changes
Database ReplayRealistic Testing
• Recreate actual production database workload• Capture production workload incl. concurrency • Replay workload in test with production timing• Analyze & fix issues before production
Middle Tier
Capture DB Workload
Storage
OracleDB servers Replay DB
Workload
ProductionEnvironment
Standby/TestEnvironment`
SQL Performance Analyzer
CaptureSQL
Storage
OracleDB servers
ExecuteSQL
Queries
ProductionEnvironment
Standby/TestEnvironment
Realistic Testing• Test impact of change on SQL performance• Capture SQL including statistics & bind vars• Re-execute SQL in test environment• Use SQL Tuning Advisor to seed SQL plans
Test Database
Production Database Redo
Shipment and Apply
Works with Snapshot Standby
CAPTURERec REPLAY
Standby Database
Support for Online Hot Patching
• Oracle already supports rolling patches between nodes in a cluster
• 11g adds online patching of a running Oracle executable (single instance or cluster) with no downtime• Integrated with OPatch• Many one-off patches can be hot
patched• Great for diagnostic patches
……
ClientClient
…Client
Capture DB Workload
Make Change Safe -Realistic Testing with Database Replay
• Recreate actual production database workload in test environment• No test development required• Replay workload in test with production timing• Analyze & fix issues before production
Middle Tier
Storage
Oracle DB
Replay DB Workload
Production Test
Test migration to RAC
Oracle Real Application TestingInnovate Change Faster
149 Days
Complete workflowsPartial workflows
Low riskHigh risk
AutomatedManual intensive
Days of developmentMonths of development
Production workloadsArtificial workloads
149 Days 11 Days