97. SAP HANA como plataforma de desarrollo, combinando el mundo OLTP + OLAP

SAP HANA Platform SAP Platform Solution Group

Septiembre 2014

© 2013 SAP AG. All rights reserved. 2

Agenda

• Introduction SAP HANA

• SAP HANA Components

• SAP HANA Platform – Development

• References and Links


Assuntos de interesse

Have you heard about SAP HANA?


CPU

Next-generation Software & Hardware Architecture Removing data processing bottlenecks using latest innovations in computing

STORAGE

MEMORY

Compression Partitioning OLTP+OLAP

in column Store Insert Only on Delta

No Aggregate tables (Dynamic Aggregation)

Solid State Flash HDD

64bit address space 1 TB in current servers

Dramatic decline in price/performance

L3 Cache

L3 Cache

L3 Cache

L3 Cache

L3 Cache

L3 Cache

L3 Cache

L3 Cache

Multi-Core Architecture 8 CPU x 10 Cores per blade

Massive parallel scaling with many blades

Logging and Backup


One in-memory atomic copy of data for Transactions + Analysis

Eliminate unnecessary complexity and latency Less hardware to manage Accelerate through innovation and simplification

3 copies of data in different data models Inherent data latency Poor innovation leading to wastage

Separated Transactions + Analysis + Acceleration processes

SAP HANA (DRAM)

Transact

ETL

Analyze

ETL

Re-think Data Management with in-memory computing Need to eliminate redundant data copies, materialization and models

A Common Database Approach for OLTP and OLAP Using an In-Memory Columnar Database Hasso Plattner

VS Accelerate

Cache


• Database & data processing engines

• Application Server

• Integration Services

• Development, Deployment and Administration

Breakthrough Data & Application Processing Enabling real-time computing design patterns across entire software architecture

OLTP + OLAP in Columnar database

SIMPLIFIED Application Processing

OPTIMIZED End-to-end

Data Processing

CONVERGED

Text Image

Spatial/GIS Transactions Sensors

Prescriptive Predictive

Sentiment Intelligence

Machine Learning

Operational Analytics

SAP HANA (Main Memory)



Application Layer

In-Memory Database layer

Libraries

Which HANA use cases you see for your company?


Multi-channel Unified User Experience

SAP Business Suite HANA Live

New SAP Apps

Partner Apps

SAP HANA PLATFORM

Application Services

Database Services

Integration & Synchronization Services

SAP HANA Platform Real time business Platform

SAP NetWeaver

BW

Text Search (InA)

Search Engine

Planning Engine Rules Engine Application &

UI Services

Business Function Library

Predictive Analysis Library

Geo Spatial Stored

Procedure & Data Models

Data Services

Real-time Replication

Services

Hadoop Integration

Flexible Deployment Model (On Premise, Hybrid & Cloud)

SQL, MDX, R, Odata

Data Virtualization

(SDA)


Easily migrate your applications. Deploy App without Re-Write

• Process any Data within same query with ONE SQLScript

Build new web applications with any open source HTML5 / JS libraries, server-side Java script

SAP HANA supports 3rd party customized application as well as native HANA application.

Any Apps On Any App Server

Any SAP Applications on SAP App Server

JSON R Open

Connectivity MDX SQL

Native HANA Applications on SAP HANA App Server

SAP HANA

DB Server DB-oriented Logic

Text Mining

Predictive

SQL Scripts

R Integration

Decision Tables

Extended App Services (Web Server) Procedural App Logic

OData Java Script

Unstructured Application Library

Structured data

Click stream

Social network

Customer Data

Point of Sale

RFID

Machine Data

Connected Vehicles

Text Data

Geospatial Data

Smart Meter

Mobile

Application Platform Services Migrate Existing or Build New Application to Process Any Data


SAP HANA – XS (Extended Services) Engine


SAPUI5 - SAP User Interface for HTML 5

Visit the UI development toolkit for HTML5

https://sapui5.hana.ondemand.com/sdk/

Is a collection of libraries

that developers can use

to build desktop and

mobile applications that

run in a browser.

Develop in JavaScript


SAP HANA XS Engine – Native Apps runing on HANA

• XS Engine is part of SAP HANA Platform

• XS Engine allows apps run on HANA

• XS Apps are accesed via Mobile devices or Browser

• XS Apps are develop using standard technologies (HTML5, JS, OData)

Please visit the SAP HANA Marketplace: http://marketplace.saphana.com/

Strategic Workforce Planning SAP Fraud Management

http://marketplace.saphana.com/

http://www.sap.com/solutions/business-suite/erp/hcm/strategic-workforce-planning.epx





http://marketplace.saphana.com/Industries/Banking/SAP-Fraud-Management/p/3528





C4.5 decision tree

Weighted score tables

Regression

ABC classification

Spatial, Machine,

Real-time data

Hadoop/ Sybase IQ,

Sybase ASE, Teradata

Unstructured

PAL

R-scripts

SQL Script Optimized Query Plan

Main Memory

Virtual Tables

Spatial Data

R-Engine

KNN classification

K-means

Associate analysis:

market basket

Text Analysis

SAP HANA

HANA Studio/AFM,

Apps & Tools

Predictive Analytics & Machine Learning Transforming the Future with Insight Today

Accelerate predictive analysis and scoring with in-database algorithms

delivered out-of-the-box. Adapt the models frequently

Execute R commands as part of overall query plan by transferring

intermediate DB tables directly to R as vector-oriented data structures

Predictive analytics across multiple data types and sources.

(e.g.: Unstructured Text, Geospatial, Hadoop)


Embedding Predictive Analytics into SAP HANA Applications

R Library Predicative Analysis Library

SAP Predictive Analysis

SAP HANA Platform Calculation Traditional

Calculation SAP HANA

Application Layer

Database Layer

Smart Meter Analytics

K-Means

What if pricing simulations for electricity plans

Customer Value

Intelligence

ABC Classification

Churn probability and white space

revenue analysis

• Embed within business applications

• Access to 3,500+ open-source algorithms via R integration

• In-database processing for powerful and fast results

• Rich visualization and analytics tools

Audience Discovery & Targeting

Log Regressions

Identify customer clusters for

precision targeting

Fraud Management

C4.5 Decision Tree

Reduce false positive fraud

signals


Planned innovations Future direction Solution today

Overview of SAP Predictive Analysis & Overview of R

SAP HANA Platform


(PAL)

R Integration for SAP HANA

R

SAP Predictive Analysis

SAP LoB & Industry

Applications

Custom Applications

What is the R language? An open source software language and environment for statistical computing and graphics with over 3000 add-on packages.

http://www.r-project.org/ The packages cover wide range topics - Cluster Analysis & Finite Mixture Models Probability Distributions Computational Econometrics Empirical Finance Statistical Genetics Graphic Displays, Dynamic Graphics, Graphic

Devices & Visualisation Machine Learning & Statistical Learning Medical Image Analysis Multivariate Statistics Natural Language Processing Statistics for the Social Sciences Time Series Analysis

http://www.r-project.org/


The Predictive Analysis Library in SAP HANA Functional Overview

The Predictive Analysis Library (PAL) is a built-in C++ library to perform in-database data mining and statistical calculations, designed to provide excellent performance on large data sets.

Embedded in SAP HANA via the Application Function Library Data Preparation

Sampling Binning Scaling Convert Categorical to Binary

Outlier Detection Inter-Quartile Range Test (Tukey’s Test) Variance Test Anomaly Detection

Cluster Analysis ABC Classification DBSCAN K-Means Kohonen Self Organized Maps

Time Series Analysis Single Exponential Smoothing Double Exponential Smoothing Triple Exponential Smoothing

Link Prediction Common Neighbours; Jaccard’s

Coefficient; Adamic/Adar; Katzβ

Other Weighted Scores Table

Classification Analysis C4.5 Decision Tree Analysis CHAID Decision Tree Analysis K Nearest Neighbour Multiple Linear Regression Polynomial Regression Exponential Regression Bi-Variate Geometric Regression Bi-Variate Logarithmic Regression Logistic Regression Naïve Bayes

Association Analysis Apriori Apriori Lite

Y

X Z

Status: SAP HANA SPS6.


Application Function Modeler

Application Function Modeler A graphical editor to facilitate a faster and easier design-time process of creating the

wrapper-procedures AFL Models are stored as repository objects and can easily be re-used as part of

development workflow.

Library Selection

Function List and Search

Parameters and specifications for table types

Model Editor Drag‘n drop of functions Template for table types Data source selection and

automatic mappings to table types

Sample SQL for procedure consumption


The Predictive Analysis Library in SAP HANA Application Function Library (AFL) Architecture

Application Functions (C++)

SQLScript

HANA Clients (App Server, Analytics Technology, etc)

SAP HANA

Business Function Library


AFL Framework

…

AFL Technology includes Application Functions Written in C++ and delivered as AFL content by SAP Predictive Analysis and Business Function Library have

been released in SPS05 as AFL content

AFL Framework On demand library loading framework for registered and supported libraries AFL are consumed for use from SqlScript via so-called

wrapper-procedures. Consumption can be controlled via permissions.

Beyond the initial script-based approach, the Application Function Modeler is released with SPS06 as a graphical editor to facilitate the design-time process of creating the wrapper-procedures and can easily be re-used as part of development workflow.

Parameter Table

AFM


SAP HANA (DRAM)

Operational ad-hoc analytics and monitoring Real-time insight into the in-the-moment business situations

Accelerate business decisions Provide vision across entire business process

Empower front-line employees Provide POS data analysis as interactive session with drill-down information

Implement real-time fraud detection, risk management and monitoring

Pricing Accounting

Customers Forecasting Planning

Channel Inventory

Products Suppliers

Customer Service

Finance and Operations

Account Administration

• OLTP + OLAP Processing • SAP HANA Live

• SAP smart data access – data virtualization

• Real-time data integration (Replication, Streaming) • Unified data modeling

• Single-query access to data

Deployed as Datamart


Big Data Warehousing and Big Data Apps drive big business Deeper insights into customer needs and wants

Extract value from big data Bring together the power of in-memory, Hadoop, predictive, text mining and spatial analytics

Dramatically improved performance for decision making from variety and volumes of structured and unstructured data

Create a logical data warehouse to respond to changing business environment

• Hadoop/R Integration • Text Search, Analytics, NLP

• Geospatial Processing

• SAP HANA smart data access • BW & SAP Sybase IQ

• In-DB Predictive Analytics

Brand Sentiment

:-) Predictive Maintenance

Network Optimization

Insider Threats

Risk Mitigation, Real-time

Asset Tracking

360O

Customer View

Propensity to Churn

Personalized Care

Product Recommendation

Real-time Demand/ Supply Forecast

Fraud Detection

SAP HANA PLATFORM


File Filtering Unlock text from binary documents Ability to extract and process

unstructured text data from various file formats (txt, html, xml, pdf, doc, ppt, xls, rtf, msg)

Load binary, flat, and other documents directly into HANA for native text search and analysis

Native Text Analysis Give structure to unstructured textual

content Expose linguistic markup for text

mining uses Classify entities (people,

companies, things, etc.) Identify domain facts (sentiments,

topics, requests, etc.) Supports up to 31 languages for

linguistic mark-up and extraction dictionary and 11 languages for predefined core extractions

SAP HANA Text Search & Analysis Extract information from documents. Perform text analysis on unstructured data

SAP HANA Text Analysis


SAP HANA Full-Text Search Architecture

SAP HANA

HANA Search UI Search UI

configured with the Info Access (InA) toolkit for HTML5

running natively on SAP HANA

Apps on HANA Applications on

any platform using SQL via

ODBC/JDBC

Store

Tables

Engines

Search Engine

Analytic Engine

Extended Application Services

SQL, MDX

HANA App built with SAP UI5 Application

running natively on / against SAP

HANA

Preprocessor

Linguistic Processing

Entity, Fact Extraction

Metadata

Model

SAP HANA Studio

Modeler, Dev.

Workbench

Info Access (InA)

Service

server-side JS, OData

HANA App Custom

application leveraging SAP HANA search

capabilities

Full-Text Indexing, Text Analysis

Modeling, Search Rule Sets

Full-Text search via SQL

SAP HANA Info Access (InA) toolkit, SInA API for JavaScript


SAP HANA Spatial Processing Develop and deploy spatially-enabled analytics and applications

Transaction Data Unstructured Data Location Data Machine Data

SAP HANA

Analytics Applications Visualization GIS SAP Info Access

(HTML 5) Mobility

REAL-TIME DATA

SPATIAL DATA

BUSINESS DATA

OLTP Analytics Planning Predictive Text Spatial

Geo-Services

Geo-Content

Columnar Spatial

Processing

Calc Model / Views

Spatial Functions

Spatial Data Types

Real-time high-performance spatial processing

Store, process, manipulate, retrieve

and share spatial data Unified modeling

platform Combine spatial

with business data Geo-content and services


Capabilities: SAP HANA spatial application development

components include: Location Services (on-premises or cloud), Geo-Content, Application Interfaces, Services Allows for visualization, interaction, and

exploration of spatial data in SAP HANA via maps Supports HTML5 deployments for browser or iPad Consumes SAP HANA models NOT a general purpose BI or GIS tool! Benefits: Quick development and deployment time Low TCO & TCD and fast response times with 2-

tier architecture Components, content, and services included

with SAP HANA; can also use other map svcs

SAP HANA Spatial Application Development

Quickly develop and deploy SAP HANA based spatial applications with provided geo-content and map services via the native XS engine

SAP HANA XS

iPad/ Browser

SAP HANA

HTML5 Application

Location Services Maps

Geo- coding Services

Spatial Engine

Geo- content


Referencias SAP HANA

SAP HANA on AWS Cloud • Amazon Web Services – SAP HANA (http://aws.amazon.com/sap/saphana/) Documentación • Manuales, información técnica, guías, información de desarrollo de applicaciones.

(http://help.sap.com/hana_platform/) • Informacion general, SAP HANA Marketplace, foro, demos. (http://www.saphana.com/) Comunidades • SCN - SAP HANA and In-Memory Computing (http://scn.sap.com/community/hana-in-

memory) • SCN - SAP HANA Developer Center (http://scn.sap.com/community/developer-

center/hana) Capacitación y cursos • openSAP – Introduction to SAP HANA Software Development

(https://open.sap.com/course/hana1)

http://aws.amazon.com/sap/saphana/

http://help.sap.com/hana_platform/

http://www.saphana.com/

http://scn.sap.com/community/hana-in-memory

http://scn.sap.com/community/hana-in-memory

http://scn.sap.com/community/developer-center/hana

http://scn.sap.com/community/developer-center/hana

Gracias !

Flavio Corradini HANA Center of Excellence Leader Latin America [email protected]

mailto:[email protected]