Pachot Hueber OracleDatabaseAppliance

7/23/2019 Pachot Hueber OracleDatabaseAppliance

1/41

Oracle Database Appliance

Infrastructure at your Service.



2/41


Franck Pachot

Senior Consultant

Oracle Technology Leader

David Hueber

Senior Consultant

COO

www.dbi-services.com

Page 2

About us


13.05.2014
http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/


3/41


Experts At Your Service> 35 specialists in IT infrastructure

> Certified, experienced, passionate

Based In Switzerland

> 100% self-financed Swiss company

> Over CHF 4 mio. turnover

Leading In Infrastructure Services

> More than 100 customers in CH, D, & F

> Over 30 SLAs dbi FlexService contracted

dbi servicesWho we are

Page 313.05.2014


4/41


1. ODA Overview & Architecture2. Operating ODA

3. ODA Advanced Get full power

4. ODA Performances

5. Pricing & Licensing

Page 4

Agenda

13.05.2014


5/41

Oracle Database Appliance Page 5

What? How?ODA overview and architecture

> Principle> Hardware architecture

> Storage capacity & redundancy

> Bare Metal vs Virtualized

13.05.2014


6/41


Part of Oracle Engineered SystemFull stack integrated solution

Simplify

> Deployment> Maintenance

> Support

Principle

Page 6

ODA overview and architecture

Simple

ReliableAvailable

13.05.2014


7/41


2 x 1 RU x86 Server> 2 x 8-cores Intel Xeon E5-2690 / 2 x 12-cores Intel Xeon E5-2697v2

> 256 GB RAM (16 x 16GB)

> 2 x 600GB Boot Disks

> Mirrored

> 1 x Internal SAS HBA> 2 x External SAS HBA

> 10GbE Interconnect

> Redundant

> 4 x External 1/10GbE

1 x 2 RU Storage

> 4 x 2.5 200GB SSD (Redo)

> 20 x 2.5 900GB HDD (Data)

Hardware Architecture ODA X3-2 / ODA X4-2

Page 7


13.05.2014


8/41



Page 8


Redundant Power Supply

Redundant Power Supply Redundant Power Supply

Node 1

Node 0

Storage

Shelf

13.05.2014


9/41



Page 9


Management InterfaceILOM

Node 1

Node 0

Storage

Shelf

13.05.2014


10/41



Page 10


Cluster Interconnect10Gb

Node 1

Node 0

Storage

Shelf

13.05.2014


11/41



Page 11


100 / 10 GbE external Networkbond0 & bond1

Node 1

Node 0

Storage

Shelf

13.05.2014


12/41



Page 12


SAS-2 Storage connectors

SAS-2 I/O modules

Node 1

Node 0

Storage

Shelf

13.05.2014


13/41


Depends on ASM redundancy> Double mirrored: 9TB

> Triple mirrored: 6 TB

Depends on backups location

> Local or External> Impacts +DATA and +RECO DiskGroups

Storage capacity & redundancy

Page 13


Backup Mode + DATA (TB) +RECO (TB) +REDO (GB)

Normal Redundancy

Local 3.6 4.5 248

External 7.2 0.98 248

High Redundancy

Local 2.4 3 248

External 4.8 0.65 248

13.05.2014


14/41



Page 14


Controller 1 Controller 2

PCIe2 PCIe3 PCIe2 PCIe3

Expander 1 Expender 2

SSD - 20

SAS - 16

SAS - 8

SAS - 4

SAS - 12

SAS 0

SSD - 21

SAS - 17

SAS - 9

SAS - 5

SAS - 13

SAS - 1

SSD - 22

SAS - 18

SAS - 10

SAS - 6

SAS - 14

SAS - 2

SSD - 23

SAS - 19

SAS - 11

SAS - 7

SAS - 15

SAS - 3

Storage Shelf backplane

13.05.2014


15/41



Page 15


Controller 1 Controller 2

PCIe2 PCIe3 PCIe2 PCIe3

Expander 1 Expander 2

SSD - 20

SAS - 16

SAS - 8

SAS - 4

SAS - 12

SAS 0

SSD - 21

SAS - 17

SAS - 9

SAS - 5

SAS - 13

SAS - 1

SSD - 22

SAS - 18

SAS - 10

SAS - 6

SAS - 14

SAS - 2

SSD - 23

SAS - 19

SAS - 11

SAS - 7

SAS - 15

SAS - 3

Storage Shelf backplane ASMRedundancy

13.05.2014


16/41


Bare Metal vs Virtualized

Page 16


Bare Metal

> Dedicated to databases

> Latest Patch Bundle ODA 2.10 (May 2014)

Oracle Linux

Appliance Manager

Oracle Database

Oracle Clusterware

Oracle Linux 5.9Kernel 2.6.39-400

Appliance Manager 2.10

Oracle Database 11.2.0.4.2

Grid Infrastructure 11.2.0.4.2

13.05.2014


17/41


Bare Metal vs Virtualized

Page 17


Virtualized Platform

> Consolidate databases and applications on a single platform

> Based on Oracle VM

Oracle Linux

Appliance Manager

Oracle VM

Oracle Weblogic

Applications Oracle Database

Oracle Clusterware

ODA Base

13.05.2014


18/41


Database in a single click?ODA Management

> OAKCLI overview

> Hardware monitoring

> Managing databases

13.05.2014


19/41


Hardware

Oracle Linux

OVM

Cross layer solution

> Hardware

> List

> Diagnose & validate

> Operating System

> Install End User Bunddle> Upgrade

> Apply patches

> Database & Cluster

> Create environments

> Delete environments

Used for VMs management

OAKCLI overview

Page 19

Operating ODA

Appliance Manager

Oracle Clusterware

Oracle Database

Always run as root user

13.05.2014


20/41


OAKCLI overview

Page 20

Operating ODA

[root@dbi-oda1 ~]# oakcli -h

Usage: oakcli show - show disk, diskgroup, expander, controller,

server, processor, memory, power, cooling, network, storage, version,

dbhomes, databases, db_config_params, core_config_key, env_hw

oakcli apply - applies the core_config_keyoakcli locate - locates a disk

oakcli deploy - deploys the Database Appliance

oakcli update - updates the Database Appliance

oakcli validate - validates the Database Applianceoakcli manage - manages the oak repository, diagcollect e.t.c

oakcli unpack - unpack the given package to oak repository

oakcli copy - copies the deployment config file

oakcli upgrade - upgrades databaseoakcli stordiag - run storage diagnostic tool on both node

oakcli test - test asroakcli odachk - performs configuration settings check on ODAoakcli configure - configures the network or asroakcli create - create database, dbhome, db_config_params fileoakcli delete - deletes database, dbhome, db_config_params file

13.05.2014


21/41


Hardware monitoring

Page 21

Operating ODA

Checking state and settings OAKCLI show

> Checking disks

> Get storage hardware details

[root@dbi-oda1 ~]# oakcli show disk

NAME PATH TYPE STATE STATE_DETAILS

e0_pd_00 /dev/sda HDD ONLINE Good

e0_pd_01 /dev/sdb HDD ONLINE Goode0_pd_02 /dev/sdaa HDD FAILED DiskRemovede0_pd_03 /dev/sdab HDD ONLINE Good

e0_pd_04 /dev/sdac HDD ONLINE Good

[root@dbi-oda1 ~]# oakcli show storage -hUsage:

oakcli show storage [-errors]

where:

storage -shows the controllers, expanders, disks

storage -errors -shows the storage errors

13.05.2014


22/41


Managing databases

Page 22

Operating ODA

Database creation through a mask

> Based on size level templates

> Defines

> CPU_COUNT

> SGA / PGA

> Redo Log Size> Maximum number of databases

> IOPS in single storage shelf

> IOPS in extended storage shelf

6 Databases classes> Very small (XS) to Extra Extra Large (XXL)

13.05.2014


23/41


Managing databases

Page 23

Operating ODA

Components XS S M L XL XXL

CPU_COUNT 2 4 8 12 24 32

SGA (MB) 4096 8192 16384 24576 49152 65536

PGA (MB) 2048 4096 8192 12288 24576 32768

Processes 200 400 800 1200 2400 3200

Log files size (GB) 1 1 2 4 4 4

Nb Databases* 16 8 4 2 1 1

IOPS** 206.25 412.5 825 1650 3300 3300

*Recommended limit per node** Guaranteed values by Oracle if above recommendations are respected

13.05.2014


24/41


Create a new database oakcli create database

> Done using oakcli as root user

> Creates a new ORACLE_HOME by default

> Use option oh to reuse existing ORACLE_HOME

> Option version available in case of multi-home environments

> Static parameter defined in a configuration file> Default available

> Additional configuration can be created

> Triggers DBCA in background

Managing databasesOperating ODA

Page 24

[root@dbi-oda1 ~]# oakcli create database -hUsage:

oakcli create database -db [[-oh ] | [-version]] [-params ]

13.05.2014


25/41


Managing databasesOperating ODA

Deleting databases oakcli delete database

> Does not delete the corresponding ORACLE_HOME

Page 25

[root@dbi-oda1 DBITEST6]# oakcli delete database -h

Usage:

oakcli delete database -db

where:db_name - name of the database to be deleted

13.05.2014


26/41


More than plug & play?ODA Advanced Get full power

13.05.2014


27/41


Memory ManagementODA Advanced Get full power

All databases created and configured with

> ASMM Automatic Shared Memory Management

> sga_target

> sga_max_size

> pga_target

Page 27

SQL> show parameter sga

NAME TYPE VALUE

--------------------- ------------ --------------

sga_max_size big integer 16G

sga_target big integer 16G

SQL> show parameter pga

NAME TYPE VALUE

--------------------- ------------ ---------------

pga_aggregate_target big integer 8G

13.05.2014


28/41


Memory ManagementODA Advanced Get full power

All databases created and configured with

> SGA allocation in huge pages

> Configured on OS level

> 2MB pages

> 128GB configured by default

By default databases cant used more than 50% of ODAs RAM

Page 28

[root@dbi-oda1 ~]# grep -i huge /proc/meminfo

HugePages_Total: 64000HugePages_Free: 56200

HugePages_Rsvd: 393

HugePages_Surp: 0

Hugepagesize: 2048 kB

13.05.2014


29/41


Database ManagementODA Advanced Get full power

Some additional work for DBAs

> No file multiplexing by default

> Control Files

> Redo Logs

> Tablespace policy management to be defined> Tablespace are auto-extensible with UNLIMITED maximum size

> Application dependent

> Parameters adjustment

> Max processes and / or sessions> SGA fine tuning

> Default parameters taken from the databases class templates

Page 2913.05.2014


30/41


Lighting-fast?ODA Performances

> Disks stress> Load increase

> Controller loss impact

> CPU stress

13.05.2014

O f


31/41


Bare metal X3-2

OVM X4-2

> I/O performance is similar, no overhead from virtualization:

> Its the same disks, and still direct access through ASM

Disk stress using IO_calibrate

Page 31

ODA Performances

MAX_IOPS MAX_MBPS MAX_PMBPS LATENCY NUM_PHYSICAL_DISKS---------- ---------- ---------- ---------- ------------------

18040 4860 709 10 20

dbms_resource_manager.calibrate_io(20,10,:max_iops,:max_mbps,:actual_latency);

MAX_IOPS MAX_MBPS MAX_PMBPS LATENCY NUM_PHYSICAL_DISKS---------- ---------- ---------- ---------- ------------------

12030 4247 702 8 20

Similar I/O performance

13.05.2014

ODA P f


32/41


Swingbench

> Free load generator for Oracle databases

> Available on

> http://dominicgiles.com/swingbench.html

Test 1 OLTP simulation> 10 to 80 simultaneous users

> ODA seems scalable

Load increase using Swingbench

Page 32

ODA Performances

13.05.2014

ODA P f
http://dominicgiles.com/swingbench.htmlhttp://dominicgiles.com/swingbench.htmlhttp://dominicgiles.com/swingbench.html


33/41



Page 33

ODA Performances

13.05.2014

Test 2 DBWn & LGWn performances

ODA P f


34/41


Test 3 Storage saturation

> Data access saturated (more than 50% i/o > 32ms ) queuing

> Minimal contention on log Writer

> All redo writes less than milliseconds


Page 34

ODA Performances

% of Waits

Event

Total Waits


35/41


Test 4 Simulate controller loss impact

> Still 2 nodes available

> Disk redundancy is still guaranteed using remaining controller

Controller loss impact

Page 35

ODA Performances

13.05.2014

ODA P f


36/41


ODA X3-2

ODA X4-2

CPU stress using swingbench

Page 36

ODA Performances

Faster CPUs

13.05.2014

P i i & Li i


37/41

Oracle Database AppliancePage 37

Keep the costs under controlPricing & Licensing

> Software Licensing

> Hardware Pricing

13.05.2014

P i i & Li i


38/41


Software LicensingPricing & Licensing

Supports only Enterprise Edition

Pay as your Grow

Bare Metal environment

> Minimum 4 cores per node 8 per ODA

> Cores enabled per increment of 4 per node

> CPU limitation done through oakcli and activation key

Virtualized environment

> Minimum of 2 cores per node 4 per ODA

> Cores enabled per increment of 2 per node> All remaining cores available for applications domains

> Weblogic

> Java applications or any others

Page 38

13.05.2014

P i i & Li i


39/41


Hardware Pricing ODA vs HP DL380 Gen 8Pricing & Licensing

Catalog Prices

> No potential discounts or other advantages taken into account

ODA X3-2

> E5-2690 256 GB RAM 22 x 600GB SAS 10k 4 x 200GB SSD

> ~60000$ CHF 54000

HP DL380 Gen8

> E5-2690 256 GB RAM 2 x 600GB SAS 10k 2 x P420 Smart Array

> MSA 2040 20 x 600GB SAS 10k 4 x 200GB SSD 2 controllers

> ~ CHF 56000 CHF 60000 (depending on controllers model)

> All cores must be licensed

Page 39

13.05.2014

References


40/41


Useful linksReferences

ODA Information Center

> 1417713.2

OAKCLI Reference Guide

> 1417879.1

Supported Versions & Known Issues

> 888888.1

ODA documentation

> http://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htm

Page 40

13.05.2014

I f S i
http://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htmhttp://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htmhttp://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htm


41/41

Page 41

Any questions? Please do ask.


We look forward to working with you!

Franck Pachot

Senior Consultant

Oracle Technology Leader

David Hueber

Senior Consultant

COO

www.dbi-services.com
http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/http://www.dbi-services.com/

Documents

Pachot Hueber OracleDatabaseAppliance