What's New in Oracle BI for Developers

What’s New in Oracle BI for Developers

B I WA C o n f e r e n c e – J a n u a r y 2 0 1 7

2/5/2017 2www.datavail.com

The latest versions of OBIEE have been released for on-premise implementation, through SaaS via Oracle BI Cloud Service, and on the desktop with Data Visualization. This session gives OBIEE Architects and Developers exposure and direction on where to best spend their time on investigating new features and enhancements with the newest releases, and how they may apply those to their real-world business use cases. Participants will get a heads-up on upgrades, migrations, regression testing, new features, and lifecycle management. At the end of this session, attendees will have a fresh set of insights on new features for OBIEE developers that they can immediately take advantage of through new releases of OBIEE.

Abstract

• DatavailChristian Screen – VP, Oracle Analytics Practice Director

• Innovator in analytics and data warehousing design, best practices, and delivery

• More than 15 years of technology implementation, project management, decision support and Data Warehouse experience to Art of BI.

• Co-author of the first book on Oracle Business Intelligence 11g• Managed, been engaged in, and successfully delivered several

of the most complex implementations of Oracle BI, Oracle BI Analytics Applications (OBIA), Hyperion Planning, and Hyperion Essbase, anywhere in the world.

Presenter

@artofbi

• Introductions• Discuss Legacy Development Options for Oracle BI• Discuss the Average Oracle BI Administrator and Developer• Becoming an OBIEE Developer - (Redefining the OBIEE Developer)• Top 5 OBIEE Developer Items• Oracle BI 11g tools for Developers• Oracle BI 12c tools for Developers• Q & A

Agenda

Introductions

Datavail Company Overview

• All major platforms: SQL, Oracle, DB2, MySQL, Mongo

• Comprehensive development & operational services

• 24x7 in-office delivery• US & Global models• Reactive and proactive

services

Database Operations

• Microsoft SSRS, SSIS, SSAS• PowerBI• Oracle OBIEE, BICS, Golden

Gate• Informatica• Oracle Data Integrator• ETL development and

operational run

• EBS / PeopleSoft• Hyperion• SharePoint• ServiceNow• Custom development

– Microsoft .NET– Oracle APEX

We are data specialists: databases, analytics, and application data

integration13+ Years delivering data services

300+ customers with average client retention of 7 years

Managed services, projects, and staffing 1 2 3

Analytics, Visualization &

IntegrationApplication

Management

Datavail BI & Analytics Overview

Datavail is the largest provider of data and database administration (DBA) services in North America with more than 600 technology professionals (analysts, DBAs, developers and consultants).

We offer 24×7 managed services and project consulting in database administration, Hyperion, BI/Analytics, Data Warehousing, and Enterprise Performance Management.

Our expert consulting team specializes in integrations, implementations, and upgrades for applications across the Oracle stack, including:

OBIEE Legacy Development Options

Has the Oracle BI Administration Tool always been enough?

Oracle BI Tools of the Past

Don’t be Average with OBIEE

Use Tools Per Your Technology Role

• Administrator• Report Developer• Metdata Modeler• ETL Developer

Becoming and OBIEE Developer

Developer as an Umbrella Term

• Can a Weblogic administrator stand alone in an OBIEE and Hyperion world?

• Does a report developer need more tools than provided?• What place does a Java developer have in Oracle BI?• What about DevOps?

(also, being referred to as AppOps)

Remember the OBIEE 11g Developer Tools

What OBI Tools Do You Use? And Why?

• OBIEE 10g had very few externalized tools to make use of for programmatically working with the OBIEE system

• OBIEE 11g increased functionality exposing .EXE (Windows OS) only tools for use in attempting to programmatically integrate third-party systems or administer the OBIEE system

Holy Grail: RPD Automation & Patching

• Patching each environment to have only the OBIEE RPD Changes is integral to storing only the deltas between builds

• Using output as an XML file that will also be stored in the OBIEE Git SCM

• Commands from OBIEE Client/Server Tools• comparerpd• patchrpd• validaterpd• biserverxmlexec• nqscmd

Ex: XML SCM to RPD Binary Automation

• Scripting and Automation• There are many different scenarios for complex

situations or many developers.• Basics are taking the MDS XML and convert back to

binary so a CI Server can “Validate”. Patch as needed thereafter.

MDS XML FoldersOBIEE Git Repository

OBIEE Dev ServerOBIEE Test Server

failReturn Response of Failure and Issue

OBIEE RPD to Temp Snapshot

OBIEE RPD + Artifacts Snapshot

Compared to MicroStrategy Holy Grail LCM

• Scripting and Automation through System Manager• One tool w/ multiple components and code interfaces

Top 6 OBIEE 12c Developer Tools & Changes

Top Developer Tools for Oracle BI 12c

1. Command Scripts Centralized Across OS’s2. OBI Web Services3. High Availability Configuration Toolset4. BI Cloud Service – SQL Developer & Data Sync Tool (REST)

5. DVT - Validation Tool6. BAR File

Top Developer Challenges for Oracle BI xx

1. No depth of understanding for OBIEE2. Lack of programming skills3. Lack of caring (or too busy)4. No architecture leadership5. No standards6. Lack of OBIEE API/Programmatic

Extensibility

OS Specific OBIEE Command Scripts

Centralizing Command Scripts Across OS’s

• OBIEE 12c is a game-changer for automation development

• New script locations• C:\Oracle\OBIEE12cHome\

user_projects\domains\bi\bitools\bin

• Centralized regardless of OS

OBI Server Tools Compared to the OBI Client Tools

• Still only Windows OS specific with the OBI 12c client tools

• OBI 12c full server allows for the same logic but across OS’s

Lifecycle Management Centralized

• Starting and Stopping the OBI System and Server no longer a challenge

• WebLogic start and other WLST script still reside in similar location, C:\Oracle\OBIEE12cHome\user_projects\domains\bi

Patching XML Should be Executed Mainly Via CLI

• Compare RPDs• Capture environment specific

deltas such as connection pool passwords

• Use biserverxmlexec to create a patch XML file

• Use patchrpd to merge the patch XML file to next target environment

"%BI_HOME%/biserverxmlexec" -P Admin123 -I %PATCH_XML% -B %SOURCE_RPD% -O %OUTPUT_RPD%

OBIEE Web Services

Web Services for Developers

• Don’t confuse OBI Web Services with the OBI Metadata Services• New Metadata Service allows RPD metadata data changes such as

Patching on the fly.

“For example, a developer who wants to update the server repository with new metadata, doesn't have to open Administration Tool or restart the server with a modified repository. The developer can use a stored procedure to directly apply the patch XML created from two different versions of the repository.”

Metadata Services for Developers

• Don’t confuse OBI Web Services with the OBI Metadata Web Services

• New Metadata Service allows RPD metadata data changes such as RPD patching on the fly.

• Use JDBC in Java apps

OBIEE Web Services for Developers

• For active connectivity for read and write of web catalog mainly• Different service types allow for different integrations• Updated per each version to reflect new features or enhancements

• AnalysisExportViews Service• ConditionService Service• HtmlViewService Service• iBotService Service• JobManagementService Service• KPIAssessmentService Service• MetadataService Service• ReportEditingService Service

• SAWSessionService Service• SchedulerService Service• ScorecardAssessmentService Service• ScorecardMetadataService Service• SecurityService Service• UserPersonalizationService Service• WebCatalogService Service• XMLViewService Service

OBIEE12c High-Availability

High Availability Re-Configured

• OBI 12c gives OBI administrators and network admins more control and ease of deployment

High Availability Re-Configured

• Copy over main configuration files to secondary node• Set up clustering• Execute pack (source server), copy to target, and unpack on target server• Start the server.

• Done!

OBIEE Developers – Reach for the Clouds

Cloud is on the move for OBIEE Developers

• Cloud interface uses REST protocol with authentication key

• Retrieves or pushes data/metdata via JSON• Make use of standard applications such as SQL

Developer to assist connectivity with developer GUI integration

• Potentially connect to a CI system to run SQL for validation of result, or boundary exceptions to approve code version before moving to production server

• CURL, anyone?

• [ Larry Video on Virtual PC / Cloud ]

CURL – A great place to start for REST

• CURLing your way to OBIEE REST API interactions

More OBIEE Developer Tools

• SQL Developer Cloud Connection

• Data Sync Tool

Developer Tools

• Syncing to Oracle Database Cloud Service • After lift and shift• Use SQLDeveloper CLI• REST API

• APEX is an option here

OBIEE Baseline Validation Tool (BVT)

Regression Testing to the Rescue!

• OBI 12c release giving anytime validation of data, web catalog, logical sql, and visualizations of reports and dashboards

• Compare two compatible OBIEE versions (11g to 12c, 12c to 12c)

• Provides confidence in migrations or upgrades of OBI

Baseline Verification Steps

1. Install or run the JAR file2. Define the “Baseline”• Single report or set of reports or whole catalog• A standard set is for litmus tests is usually good

3. Edit the config file4. Generate a baseline result and target result5. Update thresholds6. Execute BVT for comparisons baseline to target7. Review

Warning: Can take a long time depending on content depth

Baseline Verification Results

• Results depends on what you are comparing• Data, Logical Query, etc.

• Comparison output in HTML reports style for easy review

BI Application Archive(BAR)

What is the BAR?

• OBI 12c and Oracle BI Cloud Service container for all BI artifacts required for a consistent deployment between two environments

• .BAR file extension

Moving the BAR

• Export all content to a .bar extension file• Import .bar to target environment• Excellent for Dev-to-Test and Test-to-Production

migration scenarios

Demonstration

• Review new Oracle BI tools• Review on-premise to cloud integration tools• Major strategy for OBIEE Developers going forward

OBIEE 12c Lifecycle Management(LCM)

OBIEE 12c Movement After Upgrading

• Caveats After Upgrade• Web Catalog may be warped/corrupted• Security Issues• Application Roles don’t sync to RPD any longer, so create new ones in both places if

needed for security, etc.• New upload, download, refresh, storage, and migration processes

Life Cycle Management(LCM)

OBIEE 12c LCM

• BAR• Uses WLST in offline mode to accept commands

• ExportServiceInstance• ImportServiceInstance

• All command line interface right now. WLST can be used remotely in online mode

OBIEE 12c LCM

• BAR

• ExportServiceInstance

• exportServiceInstance('/u01/Oracle/Middleware/Oracle_Home/user_projects/domains/bi', 'ssi', '/u01/workDir', '/u01/exportDir', applicationName=None, applicationDesc=None, applicationVersion=None, includeCatalogRuntimeInfo=false, includeCredentials=None)

OBIEE 12c LCM

• BAR• ImportServiceInstance• importServiceInstance('/scratch/mydir/oraclehome/user_projects/

domains/bi', 'demosvc1', '/scratch/mydir/orahome/bi/bifoundation/samples/sampleapplite/test/SampleAppLite1.bar', importRPD=true, importJazn=false, importWebcat=false, includeCredentials=‘Test123’)

• Keep in mind the reset needed to empty.bar or SampleAppLite.bar files

http://docs.oracle.com/middleware/1221/biee/BIESG/configrepos.htm#BIESG9320

OBIEE 12c LCM

• BAR

• ResetServiceInstance

• resetServiceInstance('/oraclehome/user_projects/domains/bi', 'ssi')

Beware!

OBIEE 12c LCM

• Upload and Download RPD• data-model-cmd.sh uploadrpd -I repository.rpd -SI bi -U weblogic -S

server1.example.com -N 7777 -SSL• data-model-cmd.sh downloadrpd -I repository.rpd -SI bi -U weblogic -

S server1.example.com -N 7777 -SSL

datamodel.sh instead of data-model-cmd.sh since Oracle BI 12c version 12.2.1.2

Summary & Questions

Summary

• Summary of what you just heard/saw is to move to using programmatic features to enable easier management of your Oracle BI work.

• Start using Oracle BI 12c LCM• Begin having your developers become “developers” using OBIEE tools to

the fullest for maximum efficiency• Optimize the LCM Process for your organization – save time and reduce

errors/issues

• Ask questions now or raise one later

Questions?

http://biteamwork.comhttp://datavail.com

What's New in Oracle BI for Developers

Data & Analytics

SAP BusinessObjects BI 4.1 What's New L1.pdf

What's New for Microsoft Silverlight and Microsoft Windows Presentation Foundation (WPF) Developers in Microsoft Visual Studio 2010

What's new in Windows Phone Mango for Developers

Bi what's new

Developers, developers, developers, developers

Tuga IT - Power BI for Developers

Omaha 2006 Oracle BI and Oracle OLAP--What's All This About

BI Platform BI 4.2 SP06 - What's NEW Platform BI 4.2 SP06... · Top new features in BIP 4.2 SP06 Release Security Enhancements: •Enhancements around SAML 2.0 support: •Email support

What's New for Developers in Visio 2010

SAP BusinessObjects BI 4.1 What's New L1

Power BI for Developers @ SQLSaturday #420 (Paris)

MDX - What BI Developers Need To Know

What's New for the BI workload in SharePoint 2016 and SQL Server 2016

What's new for Developers in SharePoint 2013

Oracle Solaris 11: What's New for Application …...Oracle Solaris 11: What’s New for Application Developers 3 Oracle Solaris Studio Oracle Solaris Studio provides developers with

SP2013 What's New for Developers : SPSSTL

Power BI for Developers @ SQLSaturday #369

Breaking Free of Big BI: What's Possible in Embedded Reporting

SAP Crystal Reports - What's New in BI 4.1

What's New in Visual Studio & Blend for XAML Developers