39
Pentaho BI Platform Suresh Narayanappa Principal Architect May 2012

Download presentation file: Pentaho BI Platform

Embed Size (px)

Citation preview

Pentaho BI Platform

Suresh Narayanappa Principal Architect

May 2012

About Pentaho

• Recognized leader in business analytics & data integration

• Subscription-based business model

• Achieved critical mass:

• Over 1,200 commercial customers

• Over 10,000 production deployments

• Over 185 countries

• Stewardship of most important open source analytics projects

2

INDUSTRY RECOGNITION OVER 160 PARTNERS GLOBALLY

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

Why Customer Love Pentaho

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 3

Innovation & Scalability

Superior Customer

Service

Total Value

8 weeks time to market

2 weeks time to market

€350K+ cost saving 75% lower acquisition costs

Music files from 20,000 sources

Operational reports at all 1000 retail stores

Less than 1 month ROI

Analyzing buying patterns of 5 million

members Analytics on 500,000

patients records

“… better functionality and more support”

“… top-notch professional support”

“Pentaho support is as good as its software”

“… a great partner through every phase of

our project”

“…ROI was almost immediate.”

Fully rolled out in budget in 4 months

Marketing dashboard in less than 1 day

Speed of Deployment

Analyst Quote 2011 Q4

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 4

“Pentaho has expanded beyond the

traditional BI market into the

business analytics market”

Powerful Analytics Made Easy

Business analytics makes extensive use of data, statistical and quantitative analysis, explanatory an predictive modeling, and fact-based management to drive decision making. Analytics may be used as input for human decisions or may drive fully automated decisions. Business intelligence is querying, reporting, OLAP, and "alerts". http://en.wikipedia.org/wiki/Business_analytics

High Level Feature/Functions

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 5

Advanced Power Users

& Viewers Data Mining

Information Consumers Dashboards

Knowledge Workers/

Business Users

Analysis

Business Users Reporting

Power Users, Developers &

DBAs

Data

Advanced Predictive Analysis

Self-service Interactive KPI & Metrics and

Visualization

Self-service Interactive and Ad Hoc Analysis

Ad hoc and Operational

Reports

High Performance Data Integration, BIG DATA, Cleansing

and Presentation

Dashboards

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 6

Dashboards

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 7

Dashboards

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 8

Reports – Interactive, Static, Distributed

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 9

Reports – Reporting Pack & House Styles

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 10

Analyzer

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 11

Analyzer

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 12

High Level Feature/Functions

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 13

Advanced Power Users

& Viewers Data Mining

Information Consumers Dashboards

Knowledge Workers/

Business Users

Analysis

Business Users Reporting

Power Users, Developers &

DBAs

Data

Advanced Predictive Analysis

Self-service Interactive KPI & Metrics and

Visualization

Self-service Interactive and Ad Hoc Analysis

Ad hoc and Operational

Reports

High Performance Data Integration, BIG DATA, Cleansing

and Presentation

Scenario 1

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 14

Operational Database Dashboard

Report

Scenario 2

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 15

Data Mart(s) / Warehouse

Metadata

Dashboard

Report

Analyzer

Scenario 3

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 16

Unstructured Data

Data Mart(s) / Warehouse

Structured Data

BIG DATA Technology and/or

Staging Area & Data Vault

Pentaho Data Integration

Source data acquisition

Initial consolidation as required

Pentaho Data Integration

Cleansing

Transformation

Change Data Capture

Data Warehouse Management

PDI PDI Metadata

Dashboard

Report

Analyzer

Variations on a Theme

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 17

Unstructured Data

Ad-hoc Data

Data Mart(s) / Warehouse

Structured Data

Alerting SMS, eMail & attachments

Pentaho Data Integration

Source data acquisition

Initial consolidation as required

Pentaho Data Integration

Cleansing

Transformation

Change Data Capture

Data Warehouse Management

PDI PDI Metadata

Dashboard

Report

Analyzer

BIG DATA Technology and/or

Staging Area & Data Vault

OLTP Database Structure

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 18

Star Schema

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 19

Customer Country Partner Article

Type Status Created

Delivered Qty Amt

Customer Zip Gender

Country Currency

Partner

Article Group etc

Type Status

PDI Components

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

• Spoon – Graphical environment for modeling – Transformations are metadata models

describing the flow of data – Jobs are workflow-like models for

coordinating resources, execution and dependencies of ETL activities

• Pan – Command line tool for executing

transformations modeled in Spoon

• Kitchen – Command line tool for executing

jobs modeled in Spoon

• … and of course Kettle – The Engine itself

KDE ETTL Environment

20

Spoon Interface – Designing a Transformation

Job Example

PDI Components

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

• Enterprise Edition Data Integration Server – Execution and remote monitoring

– Integrated scheduling

– Enterprise Security options

– Enhanced content management including revision history and locking

– Remote distributed cluster based processing

21

Pentaho Data Integration

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

Step based processing engine with instant visualisation of results

22

Pentaho Data Integration

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

Integrated Metadata Creation

23

Metadata – Schema Workbench

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

Complex calculations and multi-cube requirements may need more modeling

24

High Level Feature/Functions

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 25

Advanced Power Users

& Viewers Data Mining

Information Consumers Dashboards

Knowledge Workers/

Business Users

Analysis

Business Users Reporting

Power Users, Developers &

DBAs

Data

Advanced Predictive Analysis

Self-service Interactive KPI & Metrics and

Visualization

Self-service Interactive and Ad Hoc Analysis

Ad hoc and Operational

Reports

High Performance Data Integration, BIG DATA, Cleansing

and Presentation

Cloud Friendly

External Data Sources Information Delivery Pentaho Platform

“Traditional” Database Support

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 26

DATA INTEGRATION DATA ANALYSIS

Big Data

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 27

NonStop

SQL/MX

DATA INTEGRATION DATA ANALYSIS

Big Data Architecture

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 28

Data Lake(s)

Data Mart(s)

Data Source

Data Warehouse Ad-Hoc

Other Information

Pentaho Business Analytics

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

• Extreme scale in-memory data analysis – Predictable high-performance

– Increased scalability

• In-memory aggregation – Faster performance

– Reduced load on the database

• Leverage “new” Analytic Databases

29

High Level Feature/Functions

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 30

Advanced Power Users

& Viewers Data Mining

Information Consumers Dashboards

Knowledge Workers/

Business Users

Analysis

Business Users Reporting

Power Users, Developers &

DBAs

Data

Advanced Predictive Analysis

Self-service Interactive KPI & Metrics and

Visualization

Self-service Interactive and Ad Hoc Analysis

Ad hoc and Operational

Reports

High Performance Data Integration, BIG DATA, Cleansing

and Presentation

Tell me something new

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 31

Tell me something new

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 32

High Level Feature/Functions

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 33

Advanced Power Users

& Viewers Data Mining

Information Consumers Dashboards

Knowledge Workers/

Business Users

Analysis

Business Users Reporting

Power Users, Developers &

DBAs

Data

Advanced Predictive Analysis

Self-service Interactive KPI & Metrics and

Visualization

Self-service Interactive and Ad Hoc Analysis

Ad hoc and Operational

Reports

High Performance Data Integration, BIG DATA, Cleansing

and Presentation

Co

mp

on

en

ts a

re in

de

pe

nd

en

t

Integration

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 34

Pentaho BI Server

Other Application

Pentaho

Custom Stuff

My Application

Pentaho Components

Integration

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 35

Bundled Mashup Extended Embedded

Value Fastest Way to Get Analytics that Have

Your Look & Feel

An Integrated Experience for Yours

End User

Customizing Pentaho for Your

Experience

Ultimate Integration and Customization

What it Takes?

• Pentaho is a separate app, branded with Partner’s logo, look & feel • Optional: Partner app may include links to Pentaho reports, analysis and dashboards (popping new window) • Optional: Single sign-on creates a seamless experience

• Pentaho & Partner app have the same UI • Pentaho User Console, or individual reports, analysis or dashboards are included in partner app • Single sign-on creates a seamless experience

• Pentaho’s core functionality is extended through plug-ins. Examples: - Connecting to custom data sources - Adding new visualizations - Customizing security - Replacing Pentaho rules engine

• Integrate with Partner’s App Server • Directly embedding Pentaho into your app • Calling Pentaho Java APIs from your App

Skill Level • Limited HTML skills • HTML skills • HTML skills • Java skills

• HTML skills • Java skills • Knowledge of Pentaho architecture

Why Customers Love Pentaho

36

€350K+ cost saving

Music files from 20,000 sources

Operational reports at all 1000 retail stores

“… top-notch professional support”

“… a great partner through every phase of

our project”

Fully rolled out in budget in 4 months

8 weeks time to market “…excited how quickly we could implement a model”

“…a brilliant product”

Over 600,000 reports a year

Supporting 400 social workers in 13 countries

“…consulting helped us become self-

sufficient” “…proven experience and

professional reliability”

“…A similar experience to Oracle at significant price

advantage.”

“..dramatically reduce the amount of manual work.”

“..discovered valuable insights affecting production.”

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

Innovation & Scalability

Superior Customer

Service

Total Value

Speed of Deployment

Platform slide

CENTRAL ADMINISTRATION, AUDITING & MONITORING

DELIVER When & Where Users Need It

STREAMLINE Information Delivery

VISUALIZE & Report Information In Any Style

ACCESS All Enterprise Data Sources

ISV & Packaged Applications

SaaS / Cloud Applications

EMBEDDED

Web

Mobile

Print

E-Mail

STANDALONE

‣ Advanced &

Predictive Analytics

DATA MINING

‣ Interactive

‣ Operational

‣ Enterprise

REPORTING

‣ Ad hoc Exploration

‣ Multi-Dimensional

ANALYSIS

‣ Interactive Metrics

‣ Rich Visualizations

DASHBOARDS

ERP / CRM /

Enterprise Apps (e.g. SAP, Oracle)

Hadoop & NoSQL Data

Unstructured &

semi-structured (XML, Excel, Files, etc.)

Relational Data Sources

Cloud (e.g. Salesforce,

Amazon, Dell)

‣ Direct Access

‣Data Integration

‣ Hadoop Clustering

‣ Graphical ETL Designer

‣ Enterprise Scalability

INTEGRATE, CLEANSE, & ENRICH DATA

‣ In Memory Caching

‣ High Performance

‣ Relational OLAP Cubes

METADATA LAYER

Architectural Components

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666 38

Thank You

© 2012, GrayMatter. All Rights Reserved. Graymatter.co.in. Worldwide +91 (80) 4284 6666

http://www.graymatter.co.in [email protected]