Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
The door to data clarity
About interRel
Our goal is to build strong, collaborative connections with our clients
to help them glean meaningful insights from their data analytics
that ultimately drives improved business performance.
OUR MISSION:
To leave the world a smarter place than we found it.
Oracle Analytics Partner of the Year
Upcoming Webcasts
3-6
3-13
2-26
3-4
3-11
3-18
3-25
STICKING WITH HYPERION PLANNING?
HOW TO SUSTAIN, EVOLVE AND GROW IN 2020
ESSBASE IS NOT DEAD:EXCITING FEATURES FOR ON-PREM ESSBASE
IN VERSION 19C
DEEP DIVE: UNDERSTANDING FINANCIAL
CONSOLIDATION, CLOSE APPLICATION AND DIMENSION DESIGN
ESSBASE CUBE BUILDER: GO FROM SPREADSHEET TO ESSBASE TO
DATA VISUALIZATION IN 5 MINUTES OR LESS
FREE FORM PLANNING 101: HOW TO BUILD ESSBASE CUBES IN
FREE FORM PLANNING
Register Today.Use Discount Code IRC20 to get $100 off!
Videos to expand what you’ve learned here
• Product Introductions
• New Features in Oracle Analytics
• Cutting-Edge Cloud updates
• Expert-level videos for BI gurus
• Technical Reference in video form
• To experience the education revolution first-hand, join our community at epm.bi/videos
Play It Forward
Best Selling Hyperion Technical Book Series
Want to learn more about interRel Consulting, Assessment, Training and
Support services?
Contact us at epm.bi/LearnMore
Defining Your Data Integration Strategy for 2020: Which Tool
Should I Use?
Questions to Determine the Best DI Strategy
• What are the Oracle EPM and BI solutions utilized?
• What are the sources of data?
• What are the targets of data?
• On Prem? Cloud? Both?
• How often should data be refreshed?
• Is drill through required?
• Are any mappings or transformations required?
• How many integrations (both data and dimensions)?
• What is the experience level of administration /build team?
Agenda
• There are lots of ways to integrate data with EPM Cloud and Analytics
• Today – we are focusing on all the ways to import / export / share data in:• EPM Cloud
• Essbase 19c
• We’ll touch on drill through for each of these solutions
• In reality, you will likely use more than one in your solutions
Data Integration Options for EPM Cloud
Data Integration – EPM Cloud
How will data be loaded into EPM and BI Cloud? How data gets into the apps has significant
impact on the close, planning, and reporting processes. Choosing the right option(s) improve
performance. Automating the load process is the ultimate goal.
EPMSUI Import/Export
Data Management
(DM)
FDMEE
OneCloud Smart View
Data Maps
Groovy
XREF/XWRITE
Primary Methods of Loading Data to EPM Cloud
o Simplified User Interface – Simple file
import/export; specific layout required
o Data Management (DM) – Integrated ETL tool
for ERP integrations & flat files can be extended
with on-prem agent
o FDMEE – Traditional ETL tool for direct
connections to some ERP systems. Supports
Event scripts. Can also be used to load flat files.
Separate Oracle purchase and requires
infrastructure
o OneCloud – Third party integration and
automation solution
o Smart View is generally used for ad-hoc
reporting but can also be utilized for data
submission.
Import Data with Web Interface – “SUI Format”
• Load data with native Essbase format: Free-form data loading is a simple process
Data file can be loaded as-is
• No explicit description of its contents
• No load rule
• Data MUST be in the natural order for Essbase
Natural Order for Essbase:
• Essbase must encounter a member from every dimension before a data value
• Any valid dimension / member / alias name combination is acceptable
• Data is read according to the member names Essbase finds
Import Data with Web Interface – “SUI Format”
• Native Planning imports require a specific formatting: First column
• Dimension members marked for “row”; there will be one member per row
Second column (and sometimes following columns) • Dimension members marked for “column”; there will be multiple columns, one per member;
data will exist in this column
Next to final column (POV)• The remaining dimension members (one per POV combination) where data should be loaded
Final column (plan type)• Name of the cube being loaded
Import Data with Web Interface – “SUI Format”
• Sample exported data file Use as a template for import Displayed in a text editor File is of type .txt Notepad ++ or other text editor is great to use when working with these files
Data Management
• Data integration tool that provides a single, systematic process for loading data from disparate systems into target analytical applications
• FDMEE “Lite” (Financial Data Quality Management Enterprise Edition)
• ETL for the business user – both data and metadata
• Dimensions and data
• Provides visibility, traceability, integrity, and verification processes
• Mapping capabilities by end users
• Cloud Targets and sources / Flat files
• Drill through to sources
• Fully automated with EPM Automate
• Comes with your EPM Cloud subscription
• Direct connect with Cloud ERPs
• EPM Integration Agent for on-prem relational sources
EPM Cloud
EPM SQL Integration Agent within Data Management
• Extract, load, and translate data from on-prem sources to EPM Cloud
• Uses custom or seeded SQLs to access data
• Scripting available to access additional sources (pre/post scripting)
• Light weight on prem foot print with minimal config
• Centralized management of data source definition, filters, and queries
• Drill through to source system
• Synchronous, Asynchronous
• Supported Sources: EBS GL PS GL Custom on-prem relational sources Non-relational sources (e.g. Big Data,Third party APIs, Jython, Groovy, and Java-accessible systems)
How to Use the EPM Data Integration Agent
• Download and install agent
• Create a template file with header row for fields returned by a query or script
• In DM, create a source for the agent using the template as the source definition
• Create the Data Integration
• Start the agent and run the integration
Financial Data Quality Management Enterprise Edition (FDMEE)
• Data integration tool that provides a single, systematic process for loading data from disparate systems into target analytical applications
• ETL for the business user
• Provides visibility, traceability, integrity
and verification of processes
• Mapping capabilities by end users
• Targets and sources• ERPs• Data Warehouses• EPM Solutions (on-prem and Cloud)• DRM• Flat files
• Custom scripting supported
• Direct connect to on-prem ERP
• Questionable “future”
EPM Cloud,
On-prem EPM /
Essbase, On-prem
ERPs
Introduction to OneCloud
• Cloud platform to connect and automate EPM and BI applications (E/PBCS + Essbase19c)
• Connects Oracle to non-Oracle data sources (including Anaplan, Workday, and Tableau)
• Point and click UI to build integrations and automations
• Application specific functionality / intelligence
• Self service, scheduling, notifications
How does OneCloud work?
• Native and bi-directional integration
• Application specific functionality
• Business aware
• No custom code
• Multi-level approval
• Metadata and Data in EPM Cloud applications
• Schedule scripts and integrations
• Secure
Data Maps
• Data Maps Map data across plan types within your
Planning application
• Dimension to dimension
• Smart List to dimension
Can be attached to data forms and run by the end user via smart push feature
Allows users to copy data from one plan type to another without other data sharing alternatives: @XWRITE, @XREF, or partitioning
• Navigate to by going to Application >> Data Exchange >> Data Maps
Data Maps
• If you are pushing data to an ASO database Should only map level zero members in the target ASO database
• The Smart List to Dimension mapping feature Allows Smart List data to be pushed to a reporting cube where that Smart List
exists as a dimension
Users can slice and dice and report subtotals by the Smart List
Export Data Using a Business Rule
• DATAEXPORT business rule command
One method to export data using business rules
Allows you to extract data to a text file or relational table
Use of FIX statements and IF statements allows you to isolate the desired data to be pulled
Load the extracted data to a source cube
Full process can be automated with the Job Scheduler and scheduled to run as needed
Export Data Using a Business Rule
• Use SET DataExportOptions { }, with the options listed below (not all options are required)
• Data Export Options – to define information for the export: DataExportDecimal “n";
DataExportLevel “ALL” or “LEVEL” or “INPUT”;
DataExportColFormat ON or OFF;
DataExportColHeader “Dimension Name“;
DataExportDynamicCalc ON or OFF;
DataExportOverwriteFile ON or OFF;
DataExportDimHeader ON or OFF;
• Use the above in conjunction with DATAEXPORT command and export type, delimiter, and location
Export Data Using a Business Rule
• Once the rule has been run, view the Inbox/Outbox Explorer to locate the exported ZIP data file
@XREF
Enables a database calculation to incorporate values from another Essbase
database.
@XWRITE
Enables a database calculation to write values to another Essbase database, or
within the same database.
@XREF vs. @XWRITE
XREF:
• Pulls data from the source cube into the target cube.
• Business Rule / Calc Script will be based in the TARGET cube.
XWRITE:• Pushes data from the source
cube to the target cube.• Business Rule / Calc Script
will be based in the SOURCEcube.
• @XWRITE does not impose member and dimension mapping restrictions, which means the SOURCE and TARGET outlines can be different
What is Groovy?
• According to Wikipedia:• “Groovy is a Java-syntax-compatible object-oriented programming language
for the Java platform.”
• From Oracle:• “Groovy is an agile, dynamic language for the Java platform that combines
smooth Java integration with the benefits of Java performance. Many features of Groovy are inspired by languages like Python, Ruby, and Smalltalk, making them available to Java developers using a Java-like syntax.”
• What is Object-oriented programming?• (OOP) is a programming paradigm based on the concept of "objects", which
can contain data, in the form of fields (often known as attributes or properties), and code, in the form of procedures (often known as methods).
• Planning CLoud uses a Java API for Groovy
Uses of Groovy in EPBCS
• Pushing Data between cubes or to/from Strategic Modeling
• Copying data from dynamic parents to level 0 in hybrid databases
• Create complex scripts in ASO
• Creating dynamic scripts that only act on data that has been changed
• Reusable code for different forms based on members on the form
• Create dynamic FIX statements in calc scripts
• Interact with API’s (e-mail from script, real time error messages, etc.)
• Creation of metadata or change member properties
• Communicate with external resources (ex. Make http: call to anything)
Comparing Integration Options within EPM Cloud that come with your Subscription
Integration Option Integration Where Use Case Valid Sources
Data Management
Import, Export, and Map Data
Drill through
Data ManagementMapping and / or drill through required
Usually used for repetitive monthly loads
Flat File, EPM Cloud, HCM Cloud, Financials
Cloud, *new EPM Integration agent
SUI formatImport / Export data
Very specific formatSimplified UI
Use for import/export data, free form text, and Smart List data
Prototyping, historical data loads not requiring mapping
Great for backups of data sets and quick loads
Flat File only
Data MapsPush data between cubes within app (*coming soon for cross pod)
Simplified UISync data between plan types within an
applicationCube to Cube within App
Native Essbase formatImport / Export Data
Very specific formatSimplified UI
Source file can be provided in the specific / required format; Good for moving data across
Essbase cubesFlat File only
Business Rule with DATAEXPORT function
Export Data Calculation Manager Export data to load to other systems Flat File only
XWRITE / XREF Cube to Cube Data Push/Pull Calc Manager Create rule to push / pull data to Cube to Cube within App
GroovyPush data between cubes within app; interactions with users and
dataCalc Manager – Groovy Rules
Push data between cubes within app; interactions with users and data
Cubes, Flat Files, Other
Comparing OneCloud with other EPM Cloud integration options
Integration Option Custom Code Data Management FDMEE OneCloud
Enterprise Data Management (EDMCS)
EPM Automate
REST APIn/a REST API Native
Planning (PBCS, EPBCS, PCMCS)
EPM Automate
SUI format Native Native Native
Consolidation and Close(FCCS, ARCS)
EPM Automate
SUI formatNative Native except for ARCS Native
Data Integration Options for OAC Essbase and Essbase 19c
Data Integration – Essbase 19c
How will data be loaded into Essbase 19c?
EssbaseEssbase load rules
Data Sync
OneCloudData
Visualization
Smart View Cube
Designer/ Excel
Partitioning
Primary Methods of Loading Data to newer
versions of Essbase
o Essbase load rules – Tried and true Essbase
load rules with new UI and new connection
options
o Data Sync – Client tool that has capabilities to
connect many sources to Essbase cubes and
load data using load rules
o OneCloud – Third party integration and
automation solution
o Data Visualization – Essbase cubes can be
built and loaded using DV flows
o Smart View is generally used for ad-hoc
reporting but can also be utilized for data
submission.
Essbase Load Rules
• Used to load the data into the cube by Essbase cube dimensions
• Used to build the hierarchies into the cubes
• Can be used to:• Add new dimensions and members
• Remove or change existing dimensions or members
• Modify attributes automatically
• Essbase Cloud automatically builds rules files based on the information defined in the Application Workbook
• Load data from files or other supported connections
Essbase Connections and Data Sources
• Essbase out of the box connections enable you to connect to external sources
• This enables you to connect to on-prem sources in 19c• Oracle Database
• Essbase
• Spark
• File
• DB2
• SQL Server
• MySQL
Essbase Connections and Data Sources
• Connections and Data Sources are ways to connect to external data from Essbase 19c
• Data Sources and Connections can be shared amongst Essbase applications
• Data Sources can be used to feed Essbase cubes with Metadata and Data
• Currently there are out-of-the-box Connections to seven technologies
Application Workbooks
• Application workbooks are one of the main vehicles to creating and maintaining Essbase Cloud cubes
• The Application Workbook contains several worksheets that are important to the Essbase cube build process
Cube Settings
Dimensions
Data
Dim.DimensionName Worksheet
• The Dim.DimensionName worksheet defines: The hierarchy and members for the DimensionName
Essbase Cloud creates one worksheet for each dimension
Data.CubeName Worksheet
• The Data.CubeName worksheet contains: The data that should be loaded to the cube
The settings that control the data load (File Name), data load Rule Name, Data Load Option, Delimiter, and Header Rows to Skip
An application workbook can contain more than one data sheet
Load Data From an Unstructured Spreadsheet to Essbase
• Build an Essbase cube with the click of a button
• Can be used as the initial setup of a cube, then edited later
• Templates provided
Data Visualization
• Self service data exploration and analytics in visual, modern BI interface
• Connect to Essbase cubes as well as well as many other data sources for data exploration, analyses, and dashboards
• Click and drag UI to create visualizations
• Create multiple canvases / insights
• Presentation and story telling mode
• Use Data Flows to Wrangle and Mashup Data
to create new Datasets
• Load and build Essbase cubes
• Ever expanding library of visualizations
• Any user / no tech skills required
• Machine Learning
• Artificial intelligence
• Natural language
• Custom visualization plug-ins available
from Oracle’s online library
Not Just Visualizations – You can Model with Data Flows
• You can use data flows to produce curated (combined, organized, and integrated) data sets
• Data Flows are available in the DV UI
• Build data sets from a predefined sequence
• Refresh your data regularly on a schedule
• Load data into an Essbase cube
• Load to relational table
• Data flow results are available in BI & Published Reporting
OAC Data Sync
• Supplemental client tool to help integrate data in OAC Import / export, load data to Essbase cubes, SQL
• You can use Data Sync to upload, and manage data in OAC You can load data from files (CSV and XLSX), various relational sources
(tables, views, SQL statements), OTBI, JDBC data sources, and Oracle Service Cloud
You can load to relational tables or data sets
• You can create connections/queries directly in Essbase cubes
Integration Options within Essbase
Integration Option Integration Use Case Valid Sources/Targets
Native Essbase format Import / Export DataSource file can be provided in the specific /
required format; Good for moving data across Essbase cubes
Flat File only
Load Rule Import Data Use to load data from other sourcesFlat File / Supported
Connection
Data Sync Import / Export DataData Sync can execute load rule; data sync
provides connectors/SQL optionsFlat File / Supported
Connection
Application Workbooks Import / Export DataLoad or export data from app workbook; non-
automated load processesExcel
Cube Designer in Smart View Export DataImport data from Excel using CD ribbon / export using MDX; non-automated export
processesExcel
MDX Export DataMove data across environments (test to
prod); Backup of dataFlat File only in Native
Essbase format
Calc Script with DATAEXPORT function
Export Data from BSO/Hybrid Export data to load to other systems Flat File only
Partitioning Cube to Cube Push / pull data from other cube Cube to Cube
OneCloud Import / Export DataUse across EPM and BI; common tool with
graphical interfaceAlmost any source/target
Drill Through
• Many different options (each requires its own setup, dependent on whether EPM or Essbase)
Drill Through in EPM and BI
Drill Through Option Product User Interface to
Drill
Drill Through Source: Target Notes
Action Links OAC DV DV Project Any DV source to DV source (e.g.
Essbase, relational database, cloud or on prem)
Action Links OAC BI BI Dashboard /
Analysis
Any source BI Analysis source to
any BI analysis source (e.g. Essbase, relational database, cloud or on prem)
Essbase Drill Through Essbase Smart View Excel Essbase cube to Essbase source
(which could be other Essbase cube, relational source, OTBI, OAC BI)
Replaces
Essbase Studio
Data Management EPM Cloud (Planning,
FCC, PCM)
Forms, Smart View
Excel, Financial Reports
Drill back to Data Management
staging table, EPM cloud
FDMEE On Premise Hyperion,
EPM Cloud
Forms, Smart View
Excel, Financial Reports
Drill back to staging table and/or
drill back to ERP if connected
Drill Through in Smart View with Essbase 19c
Creating Essbase Drill Through Report
OAC BI Drill Using Action Links
• Guided dashboard with hyperlink to another analysis/dashboard with detail
• Pass parameters from one to the other
• Creates a drill experience for users
OAC BI Drill Using Action Links – Transaction Detail Example
Drill with Data Management
• https://www.youtube.com/watch?v=pfQQYjvrUvM&app=desktop
Automation
EPM Automate for EPM Cloud
• Command line interface that uses scripting to remotely execute common administrative tasks. There is also a scheduler feature to launch a specified task at a designated time.
• EPM Automate can be scripted to perform the following tasks (sampling of functionality):
— Import and export metadata, data, artifact and application snapshots, templates, and Data Management mappings
— Upload files into environments, list files, and delete files from the service
— Download snapshots, reports, and metadata and data files from the service
— Run business rules on data, and refresh the application
— Run a Data Management batch rule
— Generate Data Management reports, provisioning report, and user audit report
— Copy profiles to a period to initiate the reconciliation process
— Replay Oracle Smart View for Office load on an environment to enable performance testing under heavy load
— Import supplemental data from a file into Oracle Financial Consolidation and Close Cloud
Essbase Job Console
• Essbase Cloud has a built-in jobs console• This can be useful to Administrators who want to set up jobs for
common administration tasks and then schedule them, like setting up data loads to run on a weekly basis
• The jobs console is where jobs can be set up initially and run on demand.
• From the job console an administrator can • Run an existing job on demand
• Deactivate an existing job
• View job status and details for all
jobs (non-administrators only see the
jobs they ran)
MaxL for Essbase
• MaxL our old friend is in Essbase 19c• Only a Service Administrator can invoke and run MaxL commands.
• No learning curve if you’ve used MaxL on-prem
• Works on-prem and cloud
• Common functions performed by MaxL— Loading data to a cube
— Building a dimension
— Running calculation scripts
— Viewing cube statistics
• Used to automate tasks
• There is a new MaxL utility that connects to OAC over http/https
• Support to run MaxL via Command Line Interface (CLI) is deprecated
Command Line Interface (CLI) for Essbase
• Command Line Interface (CLI) can be used to migrate the LCM .zip file to Essbase Cloud• The CLI can be executed from a command line or can be called from
a .bat or .sh file• In order to execute commands from the interface, a download from
Cloud is required
• Used to migrate the LCM.zip file to OAC Essbase
• Made up of other commands similar to MaxL, but not as robust
• Available commands— Calc - executes a calc script:
• calc -application appname -db cubename -script scriptfilename
— Clear - clears data and the outline: • clear -application appname -db cubename -option ALL_DATA
Did I tell you about OneCloud?
Core BizApps for General Purpose
● Email automation● File Operations● Advanced Transformation
● Handlebars● Script Runner● FTP / SFTP / FTPS
● HTTP (GET, POST, PUT, DELETE)● JSON → Tabular● XML → Tabular
● Log Filtering● Amazon S3● Box
● Google Drive● OneDrive/Sharepoint - GA Pending● Dell Boomi Cloud Dispatcher
● Informatica Cloud Dispatcher● PagerDuty● Slack
● SnapLogic Cloud Dispatcher● MuleSoft Cloud Dispatcher (Pending GA)
Self-Service via OneCloud UI
OneCloudScheduler
OneCloudActionLink with
Parameters (URL)
OneCloud File Triggers
OneCloud API
OneCloud Chain Invocation Methods
Managing Dimensions and Hierarchies
Enterprise Data Management Cloud Service (EDM)
• Allows business users to manage master data (dimensions, hierarchies, etc.)
• Provides audit controls and accountability
• Allows synchronization of master data across all systems
• System validations and verifications to control hierarchies
• Compare and easily update shared hierarchies and dimensions
• Subscriptions & node type converters to manage master data across source and targets
• Approvals
• Comes with Enterprise subscription
EDM: Central Place to Manage Dimensions, Hierarchies, Attributes
Enterprise Data Management Cloud
(EDM)
Manage common dimensions, hierarchies,
attributes, & mappings
Business user driven tool
Archived hierarchy versions
Audit trail
Essbase Cubes
Financial ConsolClose Cloud
Planning Cloud
ERPFinancials Cloud
Key EDM Cloud Features
• Manage dimensions, hierarchies, properties, attributes by business users
• Next generation DRM; new data model design
• Business user tool / Modern graphical user interface
• Request driven batch of related changes
• Compare, rationalize, and conform structural changes
• Visualize and analyze impact of changes before committing
• Drag and drop hierarchy management with subscriptions and node type converters
• Granular change audit
• Granular security by application, dimension, node type, or hierarchy set.
• Push hierarchies into EPM Cloud apps directly and to other custom apps via exports
• Push mappings into Data Management
Conclusion
Comparison of Pre-Cloud vs Cloud Oracle Products
DATAINTEGRATIONPre-Cloud Product
Cloud Product Extension of on-prem? Migrate?
FDM / FDMEE FDMEE Yes Yes
---Data Management (comes with EPM Cloud subscriptions)
Yes, “Lite” version of FDMEE No
DRM EDM No – completely re-architected No
ODIFDMEE / Data Management / OAC Data Sync – OAC Load Rules, Data Integration CS
No No
One Data Integration Solution?
Planning Cloud
FCC Cloud Profitability Cloud
Essbase HP HFM
DM Flat fileDirect connect EPM Cloud
Direct connect ERP Cloud – Financials, HCMDirect connect EBS, SQL
Not available
FDMEE*Additional licensing
Direct connect on-prem, EPM Cloud, ERP Cloud, SQL, custom scripting
Custom Script Solution
Not available
SUI Loads Flat file SUI formatFlat file / SQL SUI
format
OneCloud*Third party solution
Connectors, SUI, and DM Supported Supported Supported Supported
Essbase Load Rule
Not available Supported
Data Visualization
Not availableAlmost any source
/ Supported DV source
Data SyncNot available
Flat File, SQL, Essbase, OTBI (ERP Cloud)
Key Takeaways
• EPM• Data Management, new EPM Integration Agent for most DI
requirements
• Lots of options for cube to cube integrations in EPM Cloud— Is Groovy is the future for cube to cube integrations?
• Future of FDMEE?
• Essbase 19c• Connections, data sources, and rules files
• Overall• Not just one tool
• Where do users want to “drill”? — Right now there is not just one setup and build?
Questions to Determine the Best DI Strategy
• What are the Oracle EPM and BI solutions utilized?
• What are the sources of data?
• What are the targets of data?
• On Prem? Cloud? Both?
• How often should data be refreshed?
• Is drill through required?
• Are any mappings or transformations required?
• How many integrations (both data and dimensions)?
• What is the experience level of administration /build team?
Want to learn more about interRel Consulting, Assessment, Training and
Support services?
Contact us at epm.bi/LearnMore