Download pptx - What's New in Oracle BI for Developers

What’s New in Oracle BI for Developers

B I WA C o n f e r e n c e – J a n u a r y 2 0 1 7

2/5/2017 2www.datavail.com

The latest versions of OBIEE have been released for on-premise implementation, through SaaS via Oracle BI Cloud Service, and on the desktop with Data Visualization. This session gives OBIEE Architects and Developers exposure and direction on where to best spend their time on investigating new features and enhancements with the newest releases, and how they may apply those to their real-world business use cases. Participants will get a heads-up on upgrades, migrations, regression testing, new features, and lifecycle management. At the end of this session, attendees will have a fresh set of insights on new features for OBIEE developers that they can immediately take advantage of through new releases of OBIEE.

Abstract


• DatavailChristian Screen – VP, Oracle Analytics Practice Director

• Innovator in analytics and data warehousing design, best practices, and delivery

• More than 15 years of technology implementation, project management, decision support and Data Warehouse experience to Art of BI.

• Co-author of the first book on Oracle Business Intelligence 11g• Managed, been engaged in, and successfully delivered several

of the most complex implementations of Oracle BI, Oracle BI Analytics Applications (OBIA), Hyperion Planning, and Hyperion Essbase, anywhere in the world.

Presenter

@artofbi


• Introductions• Discuss Legacy Development Options for Oracle BI• Discuss the Average Oracle BI Administrator and Developer• Becoming an OBIEE Developer - (Redefining the OBIEE Developer)• Top 5 OBIEE Developer Items• Oracle BI 11g tools for Developers• Oracle BI 12c tools for Developers• Q & A

Agenda

Introductions


Datavail Company Overview

• All major platforms: SQL, Oracle, DB2, MySQL, Mongo

• Comprehensive development & operational services

• 24x7 in-office delivery• US & Global models• Reactive and proactive

services

Database Operations

• Microsoft SSRS, SSIS, SSAS• PowerBI• Oracle OBIEE, BICS, Golden

Gate• Informatica• Oracle Data Integrator• ETL development and

operational run

• EBS / PeopleSoft• Hyperion• SharePoint• ServiceNow• Custom development

– Microsoft .NET– Oracle APEX

We are data specialists: databases, analytics, and application data

integration13+ Years delivering data services

300+ customers with average client retention of 7 years

Managed services, projects, and staffing 1 2 3

Analytics, Visualization &

IntegrationApplication

Management


Datavail BI & Analytics Overview

Datavail is the largest provider of data and database administration (DBA) services in North America with more than 600 technology professionals (analysts, DBAs, developers and consultants).

We offer 24×7 managed services and project consulting in database administration, Hyperion, BI/Analytics, Data Warehousing, and Enterprise Performance Management.

Our expert consulting team specializes in integrations, implementations, and upgrades for applications across the Oracle stack, including:

OBIEE Legacy Development Options


Has the Oracle BI Administration Tool always been enough?

Oracle BI Tools of the Past

Don’t be Average with OBIEE


Use Tools Per Your Technology Role

• Administrator• Report Developer• Metdata Modeler• ETL Developer

Becoming and OBIEE Developer


Developer as an Umbrella Term

• Can a Weblogic administrator stand alone in an OBIEE and Hyperion world?

• Does a report developer need more tools than provided?• What place does a Java developer have in Oracle BI?• What about DevOps?

(also, being referred to as AppOps)

Remember the OBIEE 11g Developer Tools


What OBI Tools Do You Use? And Why?

• OBIEE 10g had very few externalized tools to make use of for programmatically working with the OBIEE system

• OBIEE 11g increased functionality exposing .EXE (Windows OS) only tools for use in attempting to programmatically integrate third-party systems or administer the OBIEE system


Holy Grail: RPD Automation & Patching

• Patching each environment to have only the OBIEE RPD Changes is integral to storing only the deltas between builds

• Using output as an XML file that will also be stored in the OBIEE Git SCM

• Commands from OBIEE Client/Server Tools• comparerpd• patchrpd• validaterpd• biserverxmlexec• nqscmd


Ex: XML SCM to RPD Binary Automation

• Scripting and Automation• There are many different scenarios for complex

situations or many developers.• Basics are taking the MDS XML and convert back to

binary so a CI Server can “Validate”. Patch as needed thereafter.

MDS XML FoldersOBIEE Git Repository

OBIEE Dev ServerOBIEE Test Server

failReturn Response of Failure and Issue

pass

OBIEE RPD to Temp Snapshot

OBIEE RPD + Artifacts Snapshot


Compared to MicroStrategy Holy Grail LCM

• Scripting and Automation through System Manager• One tool w/ multiple components and code interfaces

Top 6 OBIEE 12c Developer Tools & Changes


Top Developer Tools for Oracle BI 12c

1. Command Scripts Centralized Across OS’s2. OBI Web Services3. High Availability Configuration Toolset4. BI Cloud Service – SQL Developer & Data Sync Tool (REST)

5. DVT - Validation Tool6. BAR File


Top Developer Challenges for Oracle BI xx

1. No depth of understanding for OBIEE2. Lack of programming skills3. Lack of caring (or too busy)4. No architecture leadership5. No standards6. Lack of OBIEE API/Programmatic

Extensibility

OS Specific OBIEE Command Scripts


Centralizing Command Scripts Across OS’s

• OBIEE 12c is a game-changer for automation development

• New script locations• C:\Oracle\OBIEE12cHome\

user_projects\domains\bi\bitools\bin

• Centralized regardless of OS


OBI Server Tools Compared to the OBI Client Tools

• Still only Windows OS specific with the OBI 12c client tools

• OBI 12c full server allows for the same logic but across OS’s


Lifecycle Management Centralized

• Starting and Stopping the OBI System and Server no longer a challenge

• WebLogic start and other WLST script still reside in similar location, C:\Oracle\OBIEE12cHome\user_projects\domains\bi


Patching XML Should be Executed Mainly Via CLI

• Compare RPDs• Capture environment specific

deltas such as connection pool passwords

• Use biserverxmlexec to create a patch XML file

• Use patchrpd to merge the patch XML file to next target environment

"%BI_HOME%/biserverxmlexec" -P Admin123 -I %PATCH_XML% -B %SOURCE_RPD% -O %OUTPUT_RPD%

OBIEE Web Services


Web Services for Developers

• Don’t confuse OBI Web Services with the OBI Metadata Services• New Metadata Service allows RPD metadata data changes such as

Patching on the fly.

“For example, a developer who wants to update the server repository with new metadata, doesn't have to open Administration Tool or restart the server with a modified repository. The developer can use a stored procedure to directly apply the patch XML created from two different versions of the repository.”


Metadata Services for Developers

• Don’t confuse OBI Web Services with the OBI Metadata Web Services

• New Metadata Service allows RPD metadata data changes such as RPD patching on the fly.

• Use JDBC in Java apps

https://docs.oracle.com/middleware/1221/biee/BIEIT/structures.htm#BIEIT144

https://docs.oracle.com/middleware/1221/biee/BIEIT/bi_server_web_services.htm#BIEIT3257


OBIEE Web Services for Developers

• For active connectivity for read and write of web catalog mainly• Different service types allow for different integrations• Updated per each version to reflect new features or enhancements

• AnalysisExportViews Service• ConditionService Service• HtmlViewService Service• iBotService Service• JobManagementService Service• KPIAssessmentService Service• MetadataService Service• ReportEditingService Service

• SAWSessionService Service• SchedulerService Service• ScorecardAssessmentService Service• ScorecardMetadataService Service• SecurityService Service• UserPersonalizationService Service• WebCatalogService Service• XMLViewService Service

OBIEE12c High-Availability


High Availability Re-Configured

• OBI 12c gives OBI administrators and network admins more control and ease of deployment


High Availability Re-Configured

• Copy over main configuration files to secondary node• Set up clustering• Execute pack (source server), copy to target, and unpack on target server• Start the server.

• Done!

OBIEE Developers – Reach for the Clouds


Cloud is on the move for OBIEE Developers

• Cloud interface uses REST protocol with authentication key

• Retrieves or pushes data/metdata via JSON• Make use of standard applications such as SQL

Developer to assist connectivity with developer GUI integration

• Potentially connect to a CI system to run SQL for validation of result, or boundary exceptions to approve code version before moving to production server

• CURL, anyone?

• [ Larry Video on Virtual PC / Cloud ]


CURL – A great place to start for REST

• CURLing your way to OBIEE REST API interactions


More OBIEE Developer Tools

• SQL Developer Cloud Connection

• Data Sync Tool

http://www.oracle.com/technetwork/middleware/bicloud/downloads/index.html


Developer Tools

• Syncing to Oracle Database Cloud Service • After lift and shift• Use SQLDeveloper CLI• REST API

• APEX is an option here

OBIEE Baseline Validation Tool (BVT)


Regression Testing to the Rescue!

• OBI 12c release giving anytime validation of data, web catalog, logical sql, and visualizations of reports and dashboards

• Compare two compatible OBIEE versions (11g to 12c, 12c to 12c)

• Provides confidence in migrations or upgrades of OBI


Baseline Verification Steps

1. Install or run the JAR file2. Define the “Baseline”• Single report or set of reports or whole catalog• A standard set is for litmus tests is usually good

3. Edit the config file4. Generate a baseline result and target result5. Update thresholds6. Execute BVT for comparisons baseline to target7. Review

Warning: Can take a long time depending on content depth


Baseline Verification Results

• Results depends on what you are comparing• Data, Logical Query, etc.

• Comparison output in HTML reports style for easy review

BI Application Archive(BAR)


What is the BAR?

• OBI 12c and Oracle BI Cloud Service container for all BI artifacts required for a consistent deployment between two environments

• .BAR file extension


Moving the BAR

• Export all content to a .bar extension file• Import .bar to target environment• Excellent for Dev-to-Test and Test-to-Production

migration scenarios


Demonstration

• Review new Oracle BI tools• Review on-premise to cloud integration tools• Major strategy for OBIEE Developers going forward

OBIEE 12c Lifecycle Management(LCM)


OBIEE 12c Movement After Upgrading

• Caveats After Upgrade• Web Catalog may be warped/corrupted• Security Issues• Application Roles don’t sync to RPD any longer, so create new ones in both places if

needed for security, etc.• New upload, download, refresh, storage, and migration processes

Life Cycle Management(LCM)


OBIEE 12c LCM

• BAR• Uses WLST in offline mode to accept commands

• ExportServiceInstance• ImportServiceInstance

• All command line interface right now. WLST can be used remotely in online mode


OBIEE 12c LCM

• BAR

• ExportServiceInstance

• exportServiceInstance('/u01/Oracle/Middleware/Oracle_Home/user_projects/domains/bi', 'ssi', '/u01/workDir', '/u01/exportDir', applicationName=None, applicationDesc=None, applicationVersion=None, includeCatalogRuntimeInfo=false, includeCredentials=None)


OBIEE 12c LCM

• BAR• ImportServiceInstance• importServiceInstance('/scratch/mydir/oraclehome/user_projects/

domains/bi', 'demosvc1', '/scratch/mydir/orahome/bi/bifoundation/samples/sampleapplite/test/SampleAppLite1.bar', importRPD=true, importJazn=false, importWebcat=false, includeCredentials=‘Test123’)

• Keep in mind the reset needed to empty.bar or SampleAppLite.bar files

http://docs.oracle.com/middleware/1221/biee/BIESG/configrepos.htm#BIESG9320


OBIEE 12c LCM

• BAR

• ResetServiceInstance

• resetServiceInstance('/oraclehome/user_projects/domains/bi', 'ssi')


Beware!


OBIEE 12c LCM

• Upload and Download RPD• data-model-cmd.sh uploadrpd -I repository.rpd -SI bi -U weblogic -S

server1.example.com -N 7777 -SSL• data-model-cmd.sh downloadrpd -I repository.rpd -SI bi -U weblogic -

S server1.example.com -N 7777 -SSL


datamodel.sh instead of data-model-cmd.sh since Oracle BI 12c version 12.2.1.2

Summary & Questions


Summary

• Summary of what you just heard/saw is to move to using programmatic features to enable easier management of your Oracle BI work.

• Start using Oracle BI 12c LCM• Begin having your developers become “developers” using OBIEE tools to

the fullest for maximum efficiency• Optimize the LCM Process for your organization – save time and reduce

errors/issues


• Ask questions now or raise one later

Questions?


http://biteamwork.comhttp://datavail.com

http://www.biteamwork.com/

http://artofbi.com/

http://artofbi.com/
