18
Adolf Pleyer Development Manager Strategic Customer Engagement Trading Operations in O&G Business on-the-fly SAP HANA COUNCIL 31 октября 2014 г., Москва

Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

Embed Size (px)

Citation preview

Page 1: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

Adolf Pleyer

Development Manager – Strategic Customer Engagement

Trading Operations in O&G Business –

on-the-fly

SAP HANA COUNCIL 31 октября 2014 г., Москва

Page 2: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

INTRODUCTION

ENGAGING THE CUSTOMER

DESIGN THINKING

PROOF OF CONCENPT

CASE STUDIES

PEOPLE

BUSINESS TECHNOLOGY

Multidisciplinary Team

Dynamic Approach

Divergence & Convergence

Creative Environment

STRATEGIC CUSTOMER ENGAGEMENT TEAM

”Customer Co-innovation at SAP”

Page 3: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

WHAT are we solving

STRATEGIC CUSTOMER ENGAGEMENT TEAM

INTRODUCTION

ENGAGING THE CUSTOMER

DESIGN THINKING

PROOF OF CONCEPT

CASE STUDIES

Business Technology

Provide real-time insights and advanced

customer profile

Create unique digital shopping experience

for customers

Revenue loss due to the inability to sell the

product to larger customers

Inability to identify the source of exposure

variances

Fragmented data from multiple sources with

multiple gateways and firewalls

Massive data volume

Real time performance on multiple BI analytical

tools (SAP and others)

Migrating traditional ABAP processes to HANA

with vast performance improvement

Page 4: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

INTRODUCTION

ENGAGING THE CUSTOMER

DESIGN THINKING

PROOF of CONCEPT

CASE STUDIES

STRATEGIC CUSTOMER ENGAGEMENT TEAM

Page 5: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

Execution

Plan

Data

Conversion /

Load

Sprint

Planning /

Review

Hana

Modeling

Testing

UI

Development

Data

Services

Sprints of 1-2

weeks

STRATEGIC CUSTOMER ENGAGEMENT TEAM

8-12 Weeks

total POC

INTRODUCTION

ENGAGING THE CUSTOMER

DESIGN THINKING

PROOF of CONCEPT

CASE STUDIES

Page 6: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

POC Solutions

Burberry Real-time customer

360 View

Kingfisher Consolidated and

real-time access

across multiple

systems in multiple

regions

STRATEGIC CUSTOMER ENGAGEMENT TEAM

Page 7: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

STRATEGIC CUSTOMER ENGAGEMENT TEAM

8 weeks implementation

Data Access Near real-time with longer sales history available for forecast model

Increased Capability for better trading strategy and more transparency for risk management

Business Challenges

Rapid growth in oil trading volume generating massive data volume and complexity

Customers Oil Data Warehouse (ODW) can no longer support the needs of expected business growth

Support burden and delivery time high for new reports (months) due to the performance trade-offs and tuning required

Technical Challenges

With additional businesses and expected data growth, current architecture is unsustainable

Massive data volume from specialized oil & gas system

Real time performance on multiple BI analytical tools (SAP and others, e.g. TIBCO Spotfire)

Business Value

New capability to analyze and simulate trading scenarios (from 2 days to over 80 days)

Increased transparency for risk management

Reduced architecture complexity and lower IT costs

Company Oil & Gas exploration, production, refining, distribution & trading Headquarters Europe Industry Oil & Gas Products Petroleum, natural gas, and other petrochemicals Employees 87,000 (2013)

Oil & Gas Example - Real-time Trading Platform

Page 8: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

Adolf Pleyer

Development Manager – Strategic Customer Engagement

Trading Operations in O&G Business –

on-the-fly

SAP HANA COUNCIL 31 октября 2014 г., Москва

Page 9: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 9

Analytics and Big data in O&G Trading

Keys to success O&G trading

Ability to manage risk and exposure

Ability to simulate and forecast changing market condition

Insight into past (history) and future (what-if)

Calculate bonus and traders profitability

Better and faster information better trading decisions

Growth and agility requirements

Additional businesses

More transactions

Data volume is increasing

Data load and reporting times are increasing

Delivery time for new reports is critical, e.g. to adapt trading strategies

Page 10: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 10

Customer’s Pain Points – Business POV

Rapid growth of data due to

Addition of international crude - geographical expansion

Addition of product businesses - gasoline, jet fuel, …

Growth of business - selling more

Volume expansion due to financial contracts

Hitting the wall

Existing reports run too long

making quick reaction to market events difficult

Reports run even longer with growing data volume

No growth potential

Adding new businesses adds data and reporting requirements

Adding new reports takes long because of necessary optimizations

0

20

40

60

80

100

120

140

2011 2012 2013 2014 2015 2016 2017

DataVolumeinTB

Total

HotData

Page 11: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 11

Architecture before PoC

ODW

STG1

ODW ODS

BO Universe BO

Reports

MVWs

ODW

DW

Excel / VB

Saved

Reports

1 2 3

Trading Platform Operational Data Warehouse

Multiple Source Systems,

Significant Proprietary

Tranformations Move (0.75 hrs) Move, Some

Transform (2.5 hrs)

Move, Transform to

Star Schema (2.5 hrs)

Refresh

Move, Flatten (2 Hours)

4 6

5

Data transported to and processed in ODW contains all relevant trading data:

trading parties, trading contracts, deals, commitments, profiles, fees, …

Page 12: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 12

ODW Current Challenges in Detail

Nightly load processing times – frequently not meeting window

High volumes of transactional and simulation every day

Too many layers to move the data, including DW layer and two reporting refresh layers

Forced persistence of transactional data to support “time sensitive” transactions & simulations

Use of a Star Schema in ODW for majority of ODW reporting (operational)

Performance of Excel-Based Operational Reporting

Memory Crashes (Too Much Data for Some Portfolios)

Length of Time to Pull Data into Excel Pivots

Page 13: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 13

Architecture Transformation (ODW)

ODW

STG1

ODW ODS

BO Universe BO

Reports

MVWs

ODW

DW

Excel / VB

Saved

Reports

1 2 3

Trading Platform Operational Data Warehouse

Multiple Source Systems,

Significant Proprietary

Tranformations Move (0.75 hrs) Move, Some

Transform (2.5 hrs)

Move, Transform to

Star Schema (2.5 hrs)

Refresh

Move, Flatten (2 Hours)

HANA DB

(Includes all

Base tables

from Trading

Platform)

Operational Data Warehouse Trading Platform

Multiple Source Systems,

Significant Proprietary

Tranformations

Attribute Views

Analytical Views

Calculation Views

Analytical Models

HANA

STUDIO

BO

Universe

Spotfire

Server

BO

Reports

Excel

Spotfire

Reports Operational Reporting

SAP HANA Reporting

ETL

4 6

5

Data Services

Page 14: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 14

PoC Details

PoC Deliverables:

View 6 days of data which is not possible today in Futures & Forwards Crude business unit

Prove HANA’s ability to provide pivot & drill down capability

Conduct PoC at SAP location

PoC Success Criteria:

Reporting performance ( < 10 mins, currently takes 2 hrs)

Reporting experience – reproduce current functionality

Provide end-user with Profit & Loss report for FF Crude business unit –

for 1 day, 2 days, 6 days (6 days = 18M rows, not possible today)

Demonstrate “step change” capability

– Industry standard drill-down response time speed

(7 sec or less for less than 20 days)

– Ability to aggregate and compare across 6 days in one query result

– Aggregate and compare 20 days of data

Data in PoC Scope:

82 days of PNL tables

(all data since Go-Live)

20 tables

2.3 billion records

1 TB data

* Above lists are not complete

Page 15: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

STRATEGIC CUSTOMER ENGAGEMENT TEAM

8 weeks implementation

Data Access Near real-time with longer sales history available for forecast model

Increased Capability for better trading strategy and more transparency for risk management

Business Challenges

Rapid growth in oil trading volume generating massive data volume and complexity

Customers Oil Data Warehouse (ODW) can no longer support the needs of expected business growth

Support burden and delivery time high for new reports (months) due to the performance trade-offs and tuning required

Technical Challenges

With additional businesses and expected data growth, current architecture is unsustainable

Massive data volume from specialized oil & gas system

Real time performance on multiple BI analytical tools (SAP and others, e.g. TIBCO Spotfire)

Business Value

New capability to analyze and simulate trading scenarios (from 2 days to over 80 days)

Increased transparency for risk management

Reduced architecture complexity and lower IT costs

Company Oil & Gas exploration, production, refining, distribution & trading Headquarters Europe Industry Oil & Gas Products Petroleum, natural gas, and other petrochemicals Employees 87,000 (2013)

Oil & Gas Example - Real-time Trading Platform

Page 16: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

POC Solutions Across Industries

Burberry Real-time customer

360 View

Kingfisher Consolidated and

real-time access

across multiple

systems in multiple

regions

STRATEGIC CUSTOMER ENGAGEMENT TEAM

Your

Company Your Competitive

Innovative Use

Case

Page 17: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

Спасибо за внимание!

Page 18: Trading Operations in O&G Business on-the-fly · 87,000 (2013) Oil & Gas Example ... STUDIO BO Universe Spotfire Server BO Reports Excel Spotfire ... (SAP and others, e.g. TIBCO Spotfire)

© SAP AG или аффилированная компания SAP, 2014 г. Все права защищены. 18

© SAP AG или аффилированная компания SAP, 2014 г. Все

права защищены.

Любая часть данной публикации может быть воспроизведена или передана в какой-либо форме и с какой-либо целью только после получения разрешения SAP

AG или аффилированной компании SAP.

SAP и другие упомянутые здесь продукты и сервисы SAP, а также их логотипы являются торговыми марками или зарегистрированными торговыми марками SAP

AG (или аффилированной компании SAP) в Германии и других странах. Ознакомьтесь с информацией по адресу http://global12.sap.com/corporate-

en/legal/copyright/index.epx для получения дополнительной информации о торговых марках и других замечаний.

Некоторые решения, предлагаемые SAP AG и ее дистрибуторами, включают компоненты запатентованного программного обеспечения других поставщиков

программного обеспечения.

Национальные спецификации продуктов могут отличаться.

Эти материалы предоставлены SAP AG и аффилированными компаниями SAP исключительно в информационных целях, без заявлений и каких-либо гарантий,

и SAP AG и аффилированные компании SAP не несут ответственности за ошибки или пропуски в этих материалах. Единственными гарантиями на продукты и

услуги SAP AG и аффилированных компаний SAP являются гарантии, изложенные в договорных гарантийных документах (если имеются) к таким продуктам или

услугам Ни одно из положений настоящего документа не может рассматриваться как дополнительные гарантийные обязательства.

В частности, SAP AG и аффилированные компании SAP не принимают на себя обязательств заниматься любым видом деятельности, указанным в данном

документе, а также разрабатывать и выпускать на рынок продукты с указанными функциональными возможностями. Настоящий документ, любая связанная с

ним презентация и стратегия SAP AG и аффилированных компаний SAP, а также возможные в будущем разработки, продукция и (или) платформы, направления

и функциональность могут в любой момент времени быть изменены компанией SAP по любой причине без дополнительного уведомления. Информация,

содержащаяся в данном документе, не является договорной обязанностью или правовым обязательством поставить какие-либо материалы, код или

функциональные возможности. На все прогнозные заявления могут влиять риски и неопределенности, которые могут привести к существенному отличию

фактических результатов от ожидаемых. Рекомендуется не полагаться на эти прогнозные заявления полностью: они справедливы лишь на тот момент, когда они

были сделаны, и на них не следует опираться при принятии решений о покупке.