7/23/2019 Pachot Hueber OracleDatabaseAppliance
1/41
Oracle Database Appliance
Infrastructure at your Service.
Oracle Database Appliance
7/23/2019 Pachot Hueber OracleDatabaseAppliance
2/41
Oracle Database Appliance
Franck Pachot
Senior Consultant
Oracle Technology Leader
David Hueber
Senior Consultant
COO
www.dbi-services.com
Page 2
About us
Infrastructure at your Service.
13.05.2014
http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/7/23/2019 Pachot Hueber OracleDatabaseAppliance
3/41
Oracle Database Appliance
Experts At Your Service> 35 specialists in IT infrastructure
> Certified, experienced, passionate
Based In Switzerland
> 100% self-financed Swiss company
> Over CHF 4 mio. turnover
Leading In Infrastructure Services
> More than 100 customers in CH, D, & F
> Over 30 SLAs dbi FlexService contracted
dbi servicesWho we are
Page 313.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
4/41
Oracle Database Appliance
1. ODA Overview & Architecture2. Operating ODA
3. ODA Advanced Get full power
4. ODA Performances
5. Pricing & Licensing
Page 4
Agenda
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
5/41
Oracle Database Appliance Page 5
What? How?ODA overview and architecture
> Principle> Hardware architecture
> Storage capacity & redundancy
> Bare Metal vs Virtualized
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
6/41
Oracle Database Appliance
Part of Oracle Engineered SystemFull stack integrated solution
Simplify
> Deployment> Maintenance
> Support
Principle
Page 6
ODA overview and architecture
Simple
ReliableAvailable
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
7/41
Oracle Database Appliance
2 x 1 RU x86 Server> 2 x 8-cores Intel Xeon E5-2690 / 2 x 12-cores Intel Xeon E5-2697v2
> 256 GB RAM (16 x 16GB)
> 2 x 600GB Boot Disks
> Mirrored
> 1 x Internal SAS HBA> 2 x External SAS HBA
> 10GbE Interconnect
> Redundant
> 4 x External 1/10GbE
1 x 2 RU Storage
> 4 x 2.5 200GB SSD (Redo)
> 20 x 2.5 900GB HDD (Data)
Hardware Architecture ODA X3-2 / ODA X4-2
Page 7
ODA overview and architecture
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
8/41
Oracle Database Appliance
Hardware Architecture ODA X3-2 / ODA X4-2
Page 8
ODA overview and architecture
Redundant Power Supply
Redundant Power Supply Redundant Power Supply
Node 1
Node 0
Storage
Shelf
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
9/41
Oracle Database Appliance
Hardware Architecture ODA X3-2 / ODA X4-2
Page 9
ODA overview and architecture
Management InterfaceILOM
Node 1
Node 0
Storage
Shelf
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
10/41
Oracle Database Appliance
Hardware Architecture ODA X3-2 / ODA X4-2
Page 10
ODA overview and architecture
Cluster Interconnect10Gb
Node 1
Node 0
Storage
Shelf
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
11/41
Oracle Database Appliance
Hardware Architecture ODA X3-2 / ODA X4-2
Page 11
ODA overview and architecture
100 / 10 GbE external Networkbond0 & bond1
Node 1
Node 0
Storage
Shelf
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
12/41
Oracle Database Appliance
Hardware Architecture ODA X3-2 / ODA X4-2
Page 12
ODA overview and architecture
SAS-2 Storage connectors
SAS-2 I/O modules
Node 1
Node 0
Storage
Shelf
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
13/41
Oracle Database Appliance
Depends on ASM redundancy> Double mirrored: 9TB
> Triple mirrored: 6 TB
Depends on backups location
> Local or External> Impacts +DATA and +RECO DiskGroups
Storage capacity & redundancy
Page 13
ODA overview and architecture
Backup Mode + DATA (TB) +RECO (TB) +REDO (GB)
Normal Redundancy
Local 3.6 4.5 248
External 7.2 0.98 248
High Redundancy
Local 2.4 3 248
External 4.8 0.65 248
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
14/41
Oracle Database Appliance
Storage capacity & redundancy
Page 14
ODA overview and architecture
Controller 1 Controller 2
PCIe2 PCIe3 PCIe2 PCIe3
Expander 1 Expender 2
SSD - 20
SAS - 16
SAS - 8
SAS - 4
SAS - 12
SAS 0
SSD - 21
SAS - 17
SAS - 9
SAS - 5
SAS - 13
SAS - 1
SSD - 22
SAS - 18
SAS - 10
SAS - 6
SAS - 14
SAS - 2
SSD - 23
SAS - 19
SAS - 11
SAS - 7
SAS - 15
SAS - 3
Storage Shelf backplane
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
15/41
Oracle Database Appliance
Storage capacity & redundancy
Page 15
ODA overview and architecture
Controller 1 Controller 2
PCIe2 PCIe3 PCIe2 PCIe3
Expander 1 Expander 2
SSD - 20
SAS - 16
SAS - 8
SAS - 4
SAS - 12
SAS 0
SSD - 21
SAS - 17
SAS - 9
SAS - 5
SAS - 13
SAS - 1
SSD - 22
SAS - 18
SAS - 10
SAS - 6
SAS - 14
SAS - 2
SSD - 23
SAS - 19
SAS - 11
SAS - 7
SAS - 15
SAS - 3
Storage Shelf backplane ASMRedundancy
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
16/41
Oracle Database Appliance
Bare Metal vs Virtualized
Page 16
ODA overview and architecture
Bare Metal
> Dedicated to databases
> Latest Patch Bundle ODA 2.10 (May 2014)
Oracle Linux
Appliance Manager
Oracle Database
Oracle Clusterware
Oracle Linux 5.9Kernel 2.6.39-400
Appliance Manager 2.10
Oracle Database 11.2.0.4.2
Grid Infrastructure 11.2.0.4.2
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
17/41
Oracle Database Appliance
Bare Metal vs Virtualized
Page 17
ODA overview and architecture
Virtualized Platform
> Consolidate databases and applications on a single platform
> Based on Oracle VM
Oracle Linux
Appliance Manager
Oracle VM
Oracle Weblogic
Applications Oracle Database
Oracle Clusterware
ODA Base
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
18/41
Oracle Database Appliance Page 18
Database in a single click?ODA Management
> OAKCLI overview
> Hardware monitoring
> Managing databases
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
19/41
Oracle Database Appliance
Hardware
Oracle Linux
OVM
Cross layer solution
> Hardware
> List
> Diagnose & validate
> Operating System
> Install End User Bunddle> Upgrade
> Apply patches
> Database & Cluster
> Create environments
> Delete environments
Used for VMs management
OAKCLI overview
Page 19
Operating ODA
Appliance Manager
Oracle Clusterware
Oracle Database
Always run as root user
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
20/41
Oracle Database Appliance
OAKCLI overview
Page 20
Operating ODA
[root@dbi-oda1 ~]# oakcli -h
Usage: oakcli show - show disk, diskgroup, expander, controller,
server, processor, memory, power, cooling, network, storage, version,
dbhomes, databases, db_config_params, core_config_key, env_hw
oakcli apply - applies the core_config_keyoakcli locate - locates a disk
oakcli deploy - deploys the Database Appliance
oakcli update - updates the Database Appliance
oakcli validate - validates the Database Applianceoakcli manage - manages the oak repository, diagcollect e.t.c
oakcli unpack - unpack the given package to oak repository
oakcli copy - copies the deployment config file
oakcli upgrade - upgrades databaseoakcli stordiag - run storage diagnostic tool on both node
oakcli test - test asroakcli odachk - performs configuration settings check on ODAoakcli configure - configures the network or asroakcli create - create database, dbhome, db_config_params fileoakcli delete - deletes database, dbhome, db_config_params file
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
21/41
Oracle Database Appliance
Hardware monitoring
Page 21
Operating ODA
Checking state and settings OAKCLI show
> Checking disks
> Get storage hardware details
[root@dbi-oda1 ~]# oakcli show disk
NAME PATH TYPE STATE STATE_DETAILS
e0_pd_00 /dev/sda HDD ONLINE Good
e0_pd_01 /dev/sdb HDD ONLINE Goode0_pd_02 /dev/sdaa HDD FAILED DiskRemovede0_pd_03 /dev/sdab HDD ONLINE Good
e0_pd_04 /dev/sdac HDD ONLINE Good
[root@dbi-oda1 ~]# oakcli show storage -hUsage:
oakcli show storage [-errors]
where:
storage -shows the controllers, expanders, disks
storage -errors -shows the storage errors
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
22/41
Oracle Database Appliance
Managing databases
Page 22
Operating ODA
Database creation through a mask
> Based on size level templates
> Defines
> CPU_COUNT
> SGA / PGA
> Redo Log Size> Maximum number of databases
> IOPS in single storage shelf
> IOPS in extended storage shelf
6 Databases classes> Very small (XS) to Extra Extra Large (XXL)
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
23/41
Oracle Database Appliance
Managing databases
Page 23
Operating ODA
Components XS S M L XL XXL
CPU_COUNT 2 4 8 12 24 32
SGA (MB) 4096 8192 16384 24576 49152 65536
PGA (MB) 2048 4096 8192 12288 24576 32768
Processes 200 400 800 1200 2400 3200
Log files size (GB) 1 1 2 4 4 4
Nb Databases* 16 8 4 2 1 1
IOPS** 206.25 412.5 825 1650 3300 3300
*Recommended limit per node** Guaranteed values by Oracle if above recommendations are respected
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
24/41
Oracle Database Appliance
Create a new database oakcli create database
> Done using oakcli as root user
> Creates a new ORACLE_HOME by default
> Use option oh to reuse existing ORACLE_HOME
> Option version available in case of multi-home environments
> Static parameter defined in a configuration file> Default available
> Additional configuration can be created
> Triggers DBCA in background
Managing databasesOperating ODA
Page 24
[root@dbi-oda1 ~]# oakcli create database -hUsage:
oakcli create database -db [[-oh ] | [-version]] [-params ]
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
25/41
Oracle Database Appliance
Managing databasesOperating ODA
Deleting databases oakcli delete database
> Does not delete the corresponding ORACLE_HOME
Page 25
[root@dbi-oda1 DBITEST6]# oakcli delete database -h
Usage:
oakcli delete database -db
where:db_name - name of the database to be deleted
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
26/41
Oracle Database Appliance Page 26
More than plug & play?ODA Advanced Get full power
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
27/41
Oracle Database Appliance
Memory ManagementODA Advanced Get full power
All databases created and configured with
> ASMM Automatic Shared Memory Management
> sga_target
> sga_max_size
> pga_target
Page 27
SQL> show parameter sga
NAME TYPE VALUE
--------------------- ------------ --------------
sga_max_size big integer 16G
sga_target big integer 16G
SQL> show parameter pga
NAME TYPE VALUE
--------------------- ------------ ---------------
pga_aggregate_target big integer 8G
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
28/41
Oracle Database Appliance
Memory ManagementODA Advanced Get full power
All databases created and configured with
> SGA allocation in huge pages
> Configured on OS level
> 2MB pages
> 128GB configured by default
By default databases cant used more than 50% of ODAs RAM
Page 28
[root@dbi-oda1 ~]# grep -i huge /proc/meminfo
HugePages_Total: 64000HugePages_Free: 56200
HugePages_Rsvd: 393
HugePages_Surp: 0
Hugepagesize: 2048 kB
13.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
29/41
Oracle Database Appliance
Database ManagementODA Advanced Get full power
Some additional work for DBAs
> No file multiplexing by default
> Control Files
> Redo Logs
> Tablespace policy management to be defined> Tablespace are auto-extensible with UNLIMITED maximum size
> Application dependent
> Parameters adjustment
> Max processes and / or sessions> SGA fine tuning
> Default parameters taken from the databases class templates
Page 2913.05.2014
7/23/2019 Pachot Hueber OracleDatabaseAppliance
30/41
Oracle Database Appliance Page 30
Lighting-fast?ODA Performances
> Disks stress> Load increase
> Controller loss impact
> CPU stress
13.05.2014
O f
7/23/2019 Pachot Hueber OracleDatabaseAppliance
31/41
Oracle Database Appliance
Bare metal X3-2
OVM X4-2
> I/O performance is similar, no overhead from virtualization:
> Its the same disks, and still direct access through ASM
Disk stress using IO_calibrate
Page 31
ODA Performances
MAX_IOPS MAX_MBPS MAX_PMBPS LATENCY NUM_PHYSICAL_DISKS---------- ---------- ---------- ---------- ------------------
18040 4860 709 10 20
dbms_resource_manager.calibrate_io(20,10,:max_iops,:max_mbps,:actual_latency);
MAX_IOPS MAX_MBPS MAX_PMBPS LATENCY NUM_PHYSICAL_DISKS---------- ---------- ---------- ---------- ------------------
12030 4247 702 8 20
Similar I/O performance
13.05.2014
ODA P f
7/23/2019 Pachot Hueber OracleDatabaseAppliance
32/41
Oracle Database Appliance
Swingbench
> Free load generator for Oracle databases
> Available on
> http://dominicgiles.com/swingbench.html
Test 1 OLTP simulation> 10 to 80 simultaneous users
> ODA seems scalable
Load increase using Swingbench
Page 32
ODA Performances
13.05.2014
ODA P f
http://dominicgiles.com/swingbench.htmlhttp://dominicgiles.com/swingbench.htmlhttp://dominicgiles.com/swingbench.html7/23/2019 Pachot Hueber OracleDatabaseAppliance
33/41
Oracle Database Appliance
Load increase using Swingbench
Page 33
ODA Performances
13.05.2014
Test 2 DBWn & LGWn performances
ODA P f
7/23/2019 Pachot Hueber OracleDatabaseAppliance
34/41
Oracle Database Appliance
Test 3 Storage saturation
> Data access saturated (more than 50% i/o > 32ms ) queuing
> Minimal contention on log Writer
> All redo writes less than milliseconds
Load increase using Swingbench
Page 34
ODA Performances
% of Waits
Event
Total Waits
7/23/2019 Pachot Hueber OracleDatabaseAppliance
35/41
Oracle Database Appliance
Test 4 Simulate controller loss impact
> Still 2 nodes available
> Disk redundancy is still guaranteed using remaining controller
Controller loss impact
Page 35
ODA Performances
13.05.2014
ODA P f
7/23/2019 Pachot Hueber OracleDatabaseAppliance
36/41
Oracle Database Appliance
ODA X3-2
ODA X4-2
CPU stress using swingbench
Page 36
ODA Performances
Faster CPUs
13.05.2014
P i i & Li i
7/23/2019 Pachot Hueber OracleDatabaseAppliance
37/41
Oracle Database AppliancePage 37
Keep the costs under controlPricing & Licensing
> Software Licensing
> Hardware Pricing
13.05.2014
P i i & Li i
7/23/2019 Pachot Hueber OracleDatabaseAppliance
38/41
Oracle Database Appliance
Software LicensingPricing & Licensing
Supports only Enterprise Edition
Pay as your Grow
Bare Metal environment
> Minimum 4 cores per node 8 per ODA
> Cores enabled per increment of 4 per node
> CPU limitation done through oakcli and activation key
Virtualized environment
> Minimum of 2 cores per node 4 per ODA
> Cores enabled per increment of 2 per node> All remaining cores available for applications domains
> Weblogic
> Java applications or any others
Page 38
13.05.2014
P i i & Li i
7/23/2019 Pachot Hueber OracleDatabaseAppliance
39/41
Oracle Database Appliance
Hardware Pricing ODA vs HP DL380 Gen 8Pricing & Licensing
Catalog Prices
> No potential discounts or other advantages taken into account
ODA X3-2
> E5-2690 256 GB RAM 22 x 600GB SAS 10k 4 x 200GB SSD
> ~60000$ CHF 54000
HP DL380 Gen8
> E5-2690 256 GB RAM 2 x 600GB SAS 10k 2 x P420 Smart Array
> MSA 2040 20 x 600GB SAS 10k 4 x 200GB SSD 2 controllers
> ~ CHF 56000 CHF 60000 (depending on controllers model)
> All cores must be licensed
Page 39
13.05.2014
References
7/23/2019 Pachot Hueber OracleDatabaseAppliance
40/41
Oracle Database Appliance
Useful linksReferences
ODA Information Center
> 1417713.2
OAKCLI Reference Guide
> 1417879.1
Supported Versions & Known Issues
> 888888.1
ODA documentation
> http://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htm
Page 40
13.05.2014
I f S i
http://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htmhttp://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htmhttp://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htm7/23/2019 Pachot Hueber OracleDatabaseAppliance
41/41
Page 41
Any questions? Please do ask.
Infrastructure at your Service.
We look forward to working with you!
Franck Pachot
Senior Consultant
Oracle Technology Leader
David Hueber
Senior Consultant
COO
www.dbi-services.com
http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/