Open Source Business Intelligence Tools

7/29/2019 Open Source Business Intelligence Tools

1/33

Open Source Business IntelligenceTools

Alex MeadowsTriLUG, January 2012


2/33

Agenda

Business Intelligence Overview

Review of OSBI Tools

Data Warehousing

Data Integration

Reporting/OLAP

Visualization

Statistical Analysis/Predictive Analytics


3/33

What Is Business Intelligence?

Utilizing technology to identifyand analyze trends in data to make

better business decisions.


4/33

Source: Back In Business, Klimberg, Miori (www.informs.org)

Overlapping Fields


5/33

Source: Competing on Analytics; Thomas Davenport, Jeanne Harris

Competing On Analytics


6/33

Phases of Growth


7/33

The Three Types of Questions

What happened?

How was performance last week?

What is currently happening?

How is performance right now?

What will happen?

What can I do to reach our goals?


8/33

Data Warehousing

Store data outside of application/normalbusiness environment (i.e. ERP systems)

Specific for reporting/analytics

Modeling Styles

3NF (normal database modeling)

Data Marts (aka star schemas)

Data Vault (hybrid 3NF/Data Mart) Anchor Modeling (6NF)


9/33

Data Warehousing

Databases

MySQL, Postgres, etc

Columnar Data Stores

Infobright*, LucidDB, InfiniDB*, etc.

Hybrid Data Warehouse Databases

Greenplum* (both RDBMS and Columnar)

NoSQL

Hadoop, CouchDB, MongoDB, etc.

*Hardware and/or Software limitations in community editions


10/33

RDBMS vs Columnar

Source: http://www.calpont.com/column-oriented-database-bi


11/33

NoSQL?

Not Only SQL

Unstructured/semi-structured data

Huge (multi-terrabyte to petabyte+ data sets)

Source: http://www.information-management.com/specialreports/20040622/1005301-1.html


12/33

Data Integration

Syncing data across systems

Includes:

ETL (Extract, Transform, Load)

MDM (Master Data Management)

EAI (Enterprise Application Integration)

EII (Enterprise Information Integration)


13/33

Talend

Data Management Tool Suite

ETL

MDM

Data Profiling

Data Quality

Code generator

Eclipse based Extensible plugin architecture


14/33


15/33

Pentaho K.E.T.T.L.E.

Kettle Extraction, Transport, Transformation,and Loading Environment

Focus on ETL

Extensible plugin architecture

Engine based


16/33


17/33

Reporting

Focus: Historical Analysis


18/33

Reporting Options

*Flat Files, NoSQL, etc.

MDX PivotTable

Charting SQL Other Sources*

DrillThrough

Parameterized

BIRT

Pentaho

JasperReports

SQL PowerWabit

Saiku


19/33

BIRT Example


20/33


21/33


22/33

Visualization

Focus: Trending and Present


23/33


24/33


25/33


26/33

Pentaho CDE/CDF

Dashboard framework and editor built intoPentaho BI Server

Community developed uses open web

languages (Javascript, HTML, etc).


27/33


28/33


29/33

Statistics/Predictive Analytics

Focus: All relevent data used to predictoutcomes


30/33

Statistics/Predictive Analytics

R stats oriented

Weka machine learning oriented

RapidMiner mixed

Originally YALE

Weka and R Plugins

Like SAS Enterprise Miner


31/33

BI From Reporting to Statistical


32/33

BI From Reporting to StatisticalAnalysis

* Utilizes Talend ETL**Utilizes Weka Data Mining

***All use Mondrian for OLAP, with different front ends

ETL Metadata Reporting Dashboards OLAP*** Statistics AutomatedDecisions

Jaspersoft *

Pentaho **

SpagoBI * * **


33/33

Shameless Plug

RTP Pentaho User Group On LinkedIn (soon to be also on Meetup)

Meets quarterly

Documents

Open Source Business Intelligence Tools