Embed Size (px)
DESCRIPTION
This presentation supported the speech delivered by Monica Franceschini, SpagoBI Architect, during the BI/Big Data track at Solutions Linux 2013 (Paris, 28th-29th May 2013). The presentation focuses on Big Data and on the approach adopted by SpagoBI to extract maximum value from Big Data through a new information exploration paradigm.
Citation preview
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Extracting value from Big Data through a new information exploration paradigm
Monica Franceschini - SpagoBI Architect
SpagoBI Competency Center - Engineering Group
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data dimensions
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
3 scenarios
BYTES STREAM
SEMANTIC
BIG DATASETS
Analytics
SpagoBI for Big Data
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data storages
Data Source
Data Set
Visualization
In-MemoryIn-MemoryPersistencyPersistency
HiveQL
HBQL
CQL
SchedulationSchedulation
….
Impala
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
real-time
Data Streaming
In-MemoryIn-Memory
Event Dispatcher
VisualizationVisualization
SpagoBI Adapter
● Web Service
● Java API
● Queue
● ...
Event Handlers
● Dataset
● Alerts
● SMS
PersistencyPersistency
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
semantic approach
Semantic database
Explorative AnalysisExplorative AnalysisNetwork Analysis as Network Analysis as DRIVERDRIVER
Network Analysis Engine
MQL,Cypher, MQL,Cypher, SPARQLSPARQL......
Freebase,Freebase,Orient DB, Orient DB, Neo4J...Neo4J...
Classify and Categorize unstructured and heterogeneous data through semantic annotations, using domain ontologies.
FILTERFILTER
VisualizationVisualization
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
use casesTelecommunication companies: need to extract value from mobile data traffic information to improve services and advance new solutions
Public administration: need to extract value from information gathered from different sources (consumption, highway traffic, voice traffic) in order to improve the supply of tourist, environmental, social services
VALUE
BIG DATA
OPEN DATA
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
big data platform
RDBMSRDBMS DWHDWH Open Open DataData
NoSQLNoSQL
Local Local ServicesServices
AP
I OR
CH
ES
TR
AT
ION
AP
I OR
CH
ES
TR
AT
ION
Data Data MarketplaceMarketplace
Pro
cess
/P
roce
ss/
Ser
vice
s d
esig
ner
Ser
vice
s d
esig
ner
Cloud Cloud servicesservices
Dataset SpagoBI
SpagoBISpagoBI ......
API
Data Data MarketplaceMarketplaceSpagoBISpagoBI
......
Cleaning & IntegrationCleaning & Integration
Analysis & VisualizationAnalysis & Visualization
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
data “measures”
Data
Does size matter?Does size matter?Big Data are different Big Data are different types...Big Data are types...Big Data are something more!!!something more!!!
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
dashboardsUse cockpits to:
Aggregate analysis to Aggregate analysis to get information at a get information at a
glanceglance
Filter data using Filter data using specific documents specific documents
Make different kinds of Make different kinds of documents interact documents interact
with each otherwith each other
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
self-serviceUse Free Enquiry
engine to:
Define your own queries Define your own queries over datasetsover datasets
Create new datasets in a Create new datasets in a graphical and smart waygraphical and smart way
Refine your analysisRefine your analysis
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
ad-hoc reportingUse
Worksheet to:
Provide an instant Provide an instant graphical meaning to graphical meaning to
your datasetsyour datasetsCreate a prototype for Create a prototype for your projectyour project
Interact with Qbe to Interact with Qbe to refresh your datarefresh your data
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
agile developmentQuery
Create charts
Refine the query
Persist
New query
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
what comes next?Unstructured &
heterogeneous data
Statistical computing
Text mining
Sentiment analysis
...and more...
NEW VISUALIZATION
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
open-source as a resource
Big-data through Open Source tools:– Technologically feasible– No product costs– Experimental proposals on well-known
domains– Exploration of new domains– Investment skills (data scientist)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
contacts
http://www.caribbean-tour.com/Contact-Us.html
Find out all information (demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:www.spagobi.orgwww.spagobi.org
Contact [email protected]@eng.it
