Flex Your Database on 12c's Flex ASM and Flex Cluster

Embed Size (px)

DESCRIPTION

My presentation at RMOUG Training Days 2014 on Flex ASM and Flex Clusters.

Text of Flex Your Database on 12c's Flex ASM and Flex Cluster

  • 1.IOUG Presentation 1 With Flex Clusters and Flex ASM Flex your Database (12c)

2. Maaz Anjum Marietta, Georgia Solutions Architect at BIAS Corporation EM12c Golden Gate Engineered Systems Member of IOUG, GOUG, RMOUG RAC SIG, EM SIG, BIG DATA SIG Using Oracle products since 2001 Blog: maazanjum.com Email: maazanjum@gmail.com Twitter: @maaz_anjum About Me 2 3. ! Flex Cluster Flex ASM Your Database on a Flex Architecture Conclusion Agenda 3 4. Standard Cluster 4 What is an Oracle Cluster today? Set of hosts that have direct access to storage All (typically) run Grid Infrastructure ASM Listener(s) Database(s) 5. What is a Flex Cluster? Is Oracle Grid Infrastructure installed in an Oracle Flex Cluster configuration Scalable Dynamic Robust network of node Offers a platform for a variety of applications including Real Application Clusters, with large number of nodes Flex Cluster 5 6. All nodes in an Oracle Flex Cluster belong to a single Oracle Grid Infrastructure cluster. ! This architecture was designed to centralize Policy decisions for deployment of resources based on application needs Account for various service levels, loads, failure responses, and recovery 6 Flex Cluster 7. Arranged in a Hub and Spoke Architecture The hub-and-spoke model is most frequently compared to the point-to-point transit model. Flex Cluster 7 A D B F E C For a network of n' nodes only n - 1 routes are necessary to connect all nodes the upper bound is n - 1 and the complexity is O(n). A D B F E C 8. This compares favorably to the routes, or O(n2), that would be required to connect each node to every other node in a point-to-point network. ! An airline example: in a system with 10 destinations, the spoke-hub system requires only 9 routes to connect all destinations, while a true point-to-point system would require 45 routes. Flex Cluster 8 Point-to-Point Hub-Spoke 9. Contains two types of nodes Hub Hub Nodes are similar to Oracle Grid Infrastructure nodes in an Oracle Clusterware standard Cluster configuration. Leaf Leaf Nodes are different from standard Oracle Grid Infrastructure nodes, in that they do not require direct access to shared storage, but instead request data through Hub Nodes. Flex Cluster 9 10. Flex Cluster 10 11. Will be the basis for more uses cases in future releases (for resource management) ! If a Leaf-node has access to shared storage, it can perform a role change to a HUB-node ! A Standard Cluster can be converted to a Flex Cluster at any time after the installation ! Once a cluster is configured as a Flex Cluster this configuration is irreversible without a re-configuration of the cluster. Flex Cluster 11 12. An Example Setup Flex Cluster 12 Host: flex1 Role: Hub Storage Host: flex2 Role: Hub RACAttack.org/12c 13. Setup Either configured during installation Flex Cluster 13 14. Setup Can be configured (converted) from crsctl First you need GNS Setup ! #cluvfystageprecrsinstnnodelist #srvctladdgns-domaindomain_name-vipvip_name #srvctlstartgns #cluvfycompgns-precrsinst-domaindomain-vipgns_vip #srvctlmodifynetwork-nettypeMIXED #srvctlupdatescan_listener #srvctlupdatelistener #srvctlupdatedatabase-dbdb_unique_name SQL>alterdatabasesetremote_listener=["scan_name:scan_port"]; #cluvfystage-postcrsinst-nall #srvctlmodifynetwork-nettypeDHCP #srvctlupdatedatabase-dbdb_unique_name #srvctlupdatescan_listener #srvctlupdatelistener #srvctlmodifyscan-scannamescan_name Flex Cluster 14 See RACAttacks Lab on Flex Cluster and Flex ASM Conversion! 15. Setup Can be configured (converted) from crsctl Flex ASM must be enabled ! [root@flex2~]#crsctlsetclustermodeflex Clusterisconfiguredforflex"mode ! [root@flex2~]#crsctlstopcrs ! [root@flex2~]#crsctlstartcrs-wait ! [root@flex2~]#crsctlsetclustermodeflex Clusterisalreadyconfiguredin"flex"mode 15 Flex Cluster 16. Node Roles Resources Prior to role change 16 oracle@flex2:~ (+ASM2) $ crsctl stat res -t -n flex2 -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ACFS.SHARED.advm ONLINE OFFLINE flex2 Unable to connect to ASM,STABLE ora.ACFS.dg ONLINE OFFLINE flex2 STABLE ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE flex2 STABLE ora.DATA.dg ONLINE OFFLINE flex2 STABLE ora.FRA.dg ONLINE OFFLINE flex2 STABLE ora.LISTENER.lsnr ONLINE ONLINE flex2 STABLE ora.acfs.shared.acfs ONLINE OFFLINE flex2 (2) volume /shared o ffline,STABLE ora.net1.network ONLINE ONLINE flex2 STABLE ora.ons ONLINE ONLINE flex2 STABLE ora.proxy_advm ONLINE OFFLINE flex2 STABLE -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE flex2 STABLE ora.asm 1 ONLINE INTERMEDIATE flex2 STABLE ora.flex2.vip 1 ONLINE ONLINE flex2 STABLE ora.house.db 1 ONLINE ONLINE flex2 Open,STABLE ora.scan1.vip 1 ONLINE ONLINE flex2 STABLE -------------------------------------------------------------------------------- Flex Cluster 17. Node Roles Change Role ! [root@flex2~]#./crsctlgetnoderoleconfig Node'flex2'configuredroleis'hub ! [root@flex2~]#./crsctlsetnoderoleleaf CRS-4408:Node'flex2'configuredrolesuccessfullychanged;restartOracleHighAvailabilityServicesfornewrole totakeeffect. ! [root@flex2~]#./crsctlstopcrs ! [root@flex2~]#./crsctlstartcrs-wait 17 Flex Cluster 18. Node Roles Resources after role change Listener Once the node is converted to a leaf node, it has a local listener. ora.LISTENER_LEAF.lsnr OFFLINEOFFLINEflex2STABLE # of ASM Instances also reduces ora.asm 1ONLINEONLINEflex1STABLE 2ONLINEOFFLINESTABLE 3ONLINEOFFLINESTABLE VIP Fails over to available node ora.flex2.vip 1ONLINEINTERMEDIATEflex1FAILEDOVER,STABLE 18 Flex Cluster 19. Bits and Pieces ASM Network By default, it will share the interconnect NIC Can be changed during install, or later Grid Naming Services (GNS) If you didnt like it before, youd better start liking it now. You can install GI in Standard Mode and reconfigure it with GNS prior to conversion to Flex Mode. Optionally, prompted to install Cluster Health Monitor (CHM) Database -MGMTDB The Cluster Health Monitor (CHM) detects and analyzes operating system and cluster resource-related degradation and failures. Initially allocates and uses approximately 4GB 19 Flex Cluster 20. Cluster Health Monitor (CHM) Consists of three services System Monitor Service (osysmond) Cluster Logger Service (OLOGGERD) GI Management Repository (MGMTDB) Another Database resource? Stores Real-Time Operating System Metrics collected by CHM It will only run on a single node in the cluster Communicates with other Services via the Private Network Data files are on the same disk group as the OCR and Voting files. Cluster Troubleshooting OCLUMON Query the CHM repository to display node-specific metrics for a specified time period Leverage CHM to produce reports [root@flex1tmp]#/u01/app/12.1.0.1/grid/bin/diagcollection.plcollect [root@flex1tmp]#/u01/app/12.1.0.1/grid/bin/oclumondumpnodeview-nflex1flex2last"12:00:00 Manage [root@flex1tmp]#oclumonmanage-getalllogger-details Logger=flex1 Nodes=flex1,flex2 20 Flex Cluster 21. Adding a new node is no different than with previous releases Specify the kernel parameters Configure block devices for Oracle Clusterware devices Ensure that you have set the block device permissions correctly Use short, nondomain-qualified names for all of the names in the /etc/hosts file Test whether the interconnect interfaces are reachable using the ping command Verify that the VIP addresses are not active at the start of the cloning process by using the ping command Run CVU to verify your hardware and operating system environment Flex Cluster 21 22. Consider Oracles strive towards consolidation ! Experienced technology sprawl from acquisitions ! Attempting to enable ease of resource management ! Flex Clusters encompass not only databases, but applications as well Flex Cluster 22 23. ! Flex Cluster Flex ASM Your Database on a Flex Architecture Conclusion Agenda 23 24. The Next generation Automatic Storage Management (ASM) has a new name. ! Traditionally, we know ASM as another type of instance in a RAC/Single Instance configuration. ! One ASM instance per node in a cluster Flex ASM 24 25. Flex ASM is Your ASM configured to run on fewer nodes in a cluster Allows for seamless client connection failover 25 Flex ASM 26. Network Public Network Private Network Storage FC/ISCI ASM Network 26 Flex ASM 27. With Oracle Flex ASM you can Consolidate all the storage requirements into a single set of disk groups. ! All these disk groups are mounted by and managed by a small set of Oracle ASM instances running in a single cluster. ! You can specify the number of Oracle ASM instances with a cardinality setting. The default is three instances. ! When using Oracle Flex ASM, you can configure Oracle ASM clients with direct access to storage or the I/Os can be sent through a pool of I/O servers. 27 Flex ASM 28. Configurations Oracle Flex ASM enables Oracle ASM instances to run on a separate physical server from the database servers. An Oracle ASM instance can operate in several configurations in Oracle Flex ASM Flex ASM 28 29. Configurations 1. Local Oracle ASM clients with direct access to Oracle ASM disks 2. Oracle Flex ASM clients with direct access to Oracle ASM disks 3. Oracle ACFS access through the Oracle ASM proxy instance An Oracle ASM proxy instance is an Oracle instance running on a Hub node with a direct Oracle ASM client. Oracle Automatic Storage Management Cluster File System (Oracle ACFS) and Oracle ASM Dynamic Volume Manager (Oracle ADVM) are supported