Embed Size (px)
Citation preview
SAP Data Warehousing NEXT-GENERATION DATA WAREHOUSE
2016. 4. 5
2
전통적 DW 시스템
ü Staging, Enterprise DW, Data Mart Layer 별 모델링
ü 각 Layer 간 데이터 가공작업, 데이터 중복 관리
ü 분석 ~ 구현까지 상당한 시간, 인력 투자
ü 시스템 운영 복잡도 증가
3
전통적 DW 시스템의 Pain points
데이터 폭증으로 인한 시스템 성능
빅 데이터와 연계 분석 요구
다양한 시스템과 인터페이스 DW
4
차세대 Data Warehouse
5
차세대 DW 시스템의 필요 조건
Forrester
“Next-Generation EDW Technology Focuses On Real-Time, Automation, and Integration”
• Real-time in-memory architecture and self-service analytics • Integration with Hadoop to lower TCO and support structured/semi-structured/unstructured data • Data virtualization and simpler data warehouse modeling • In-database complex analytics processing
6
차세대 DW 시스템의 특징
2 1 3
Simplify Innovate Accelerate
간결한 분석 시스템 체계 데이터 기반 의사결정 Agile 개발 방법론
7
차세대 DW 시스템의 Scope
ü Agile Data Mart
ü Modern DW
ü Data Lake
다양한 데이터에 대한 Real-Time Analytics
Enterprise 데이터의 Single source of truth
Big 데이터 Analytics, Hadoop integration
1 Simplify
2 Innovate
3 Accelerate
8
차세대 SAP DW Solution
ü In-memory DBMS
ü 고급 분석 기능 내장
ü Appliance 모델
ü Data Integration 포함
ü 다양한 Data Tiering
ü 표준 개발 방법 지원
9
In-memory architecture D
isk
to M
emor
y
Hard Disk: 10,000,000ns* / SSD: 200,000ns* Disk Storage
Log M
emor
y
CPU Memory to CPU Cache
CPU L1 Cache
L2 Cache
L3 Cache
1.5ns*
4ns*
15ns*
Core 1 Core N
Memory
60ns*
10,000,000 ns 60 ns
1 Simplify
10
Logical Data Warehouse
SAP HANA platform
SAP HANA PLATFORM
Predictive Spatial
Text Graph
Streams SQL Search OLAP
Planning Rules App server Language
HANA Live Business functions
Co
gn
itive
Q
ue
ry
Ap
plic
atio
n
Mo
de
ls
Enterprise Data Warehouse
Operational
Data Marts
기존�System Big Data System
1 Simplify
11
Smart Data Access 1 Simplify
HANA Table
Virtual Table
Query Optimizer
Remote Table
Result Query Optimizer
DB Adaptor Join
Remote Data Source
ü Oracle, Teradata, Hadoop 등 다양한 Data Source 지원
ü HANA SQL로 개발
ü Smart Query Processing
ü Read & Write 지원
ü Adaptor 개발 SDK
12
Dynamic Tiering
Database Catalog
HANA Database
Warm Store Data
Hot Store
Table Definition
Data
Table Definition
In-memory table
Extended table
Application Development tools
SAP Data Warehouse Foundation
Data Lifecycle Manager
1 Simplify
13
In-Database Analytics 2 Innovate
Predictive Text Spatial Built-in Mining Library
100 + 알고리즘
No Language, Just Call
Full-Text Search
Text Analysis
Text Mining(Semantic)
Geo Data Support
Geo Function
ARC-GIS Support
14
Analytic Process Innovation 2 Innovate
대상추출
프로그램개발
결과해석
결과적재
CALL SYS.AFLLANG_WRAPPER_PROCEDURE_DROP('DM_PAL', 'PAL_ENET_LOGISTICR_PROC'); CALL SYS.AFLLANG_WRAPPER_PROCEDURE_CREATE('AFLPAL','LOGISTICREGRESSION', 'DM_PAL', 'PAL_ENET_LOGISTICR_PROC',PAL_ENET_LOGISTICR_PDATA_TBL); CALL DM_PAL.PAL_ENET_LOGISTICR_PROC(PAL_ENET_LOGISTICR_DATA_TBL, "#PAL_CONTROL_TBL", PAL_ENET_LOGISTICR_RESULTS_TBL, PAL_ENET_LOGISTICR_STAT_TBL, PAL_ENET_LOGISTICR_PMMLMODEL_TBL) WITH OVERVIEW;
One Step Processing
Hadoop Integration 2
Innovate
Application
vUDF (User-defined)
External Table (Virtual)
Hadoop System
SAP Data Services (ETL)
Smart Data Access (DB Link)
Column store (In-memory)
Native Integration
HANA-Spark Adapter for improved performance between distributed systems
Compiled queries enable applications & data analysis to work more efficiently across nodes
Familiar OLAP experience on Hadoop to derive business insights from big data such as drill-down into HDFS data
HANA VORA 2
Innovate
YARN
HDFS
Other Apps
Files Files Files
Compiled Queries Spark
Adapter Drill Downs
Vora Spark
Vora Spark
In-Memory Store
Application Services
Database Services
Integration Services
Processing Services
SAP HANA Platform
Vora Spark HANA-Spark
Adaptor
17
SAP Data Warehouse 3 Accelerate
SAP Data Warehouse Foundation SAP HANA Application Lifecycle Management
SAP Data Services SAP Replication Server & SAP SLT SAP HANA Smart data integration
SAP Power Designer SAP Information Steward
SAP Power Designer SAP Information Steward
SAP HANA Modeler
SAP HANA Application Lifecycle Management
SAP Information Steward SAP HANA Smart data quality
SAP Agile Data Preparation
18
HANA Cloud Readiness
SAP HANA ENTERPRISE CLOUD
SAP Applications powered by SAP HANA
SAP Business Warehouse
SAP Business Suite
SAP HANA CLOUD PLATFORM
Developer Tools and Services
Analytics and Social
SAP HANA DB and Infrastructure
UX Integration
Managed Cloud as-a-Service Platform as-a-Service
SAP Business Suite
SAP Business Warehouse
SAP HANA Datamart Build
Applications Run
Applications Extend
Applications
3 Accelerate
19
Data Cafe
“HANA allows us to analyze the performance of East Coast stores on Black Friday and make pricing adjustments for stores on the West Coast before they open.”
250 billions
3 years
POS Data
2 Seconds
Query
ALL Data
20
Real-Time Analytics
“SAP HANA is giving us new insight into production processes from perspectives we did not have before due to performance restraints.”
21
Big Data Analytics
22
Big Data Analytics
3 billions
1 Human DNA pairs
400,000 X
Faster Processing
with Hadoop
23
Peta-Byte Scale
“As Intel runs through the manufacturing and test cycle, Intel generates nearly a trillion test records. We have a petabyte of data to analyze and improve our manufacturing process”
24
SAP Digital Boardroom
Enterprise Data Warehouse
In-Memory Store
© 2016 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
