UFF Tech 2013 - Big Data - Rafael Borges EMC

Copyright © 2013 EMC Corporation. All Rights Reserved.

Big Data

Rafael Borges

EMC Centro de P&[email protected]


Agregando valor à informação através de mudanças de TI

EMC Expertise

Otimização de infraestrutura através

de virtualização

Transformando negócios com o uso de ferramentas

analíticas

CLOUD BIG DATACyber security, compliance e

gerência de risco

Security

Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved.

Atuação

ENTERPRISE APPLICATIONS BIG DATA APPLICATIONS

IonixVPLEX

Data Domain, Avamar, NetWorker

VNXVNXe

VMAXVMAXe Isilon Atmos

Pivotal

http://en.wikipedia.org/wiki/File:Tux.svg


P&D

Estratégia de Inovação

Aquisição de Tecnologias

12%Investment

10%Investment


EMC’s Big Data R&D Center in Brazil

Applied Research Center at the heart of the Technology Park in Rio Purpose built facility located with the

University Campus / Technology Park Complex

Industry Leading Technology Ecosystem: Schlumberger, Halliburton, BG, Siemens, GE, Petrobras, and others

50+ EMC Big Data Scientists Collaborating with 50+ others on Campus Joint projects with leading technology and

O&G companies Solution Development and Certification

World Class Executive Briefing Center


O que é Big Data, afinal


Big Data Refers To…• All Data that comes at high Volume

• All Data that comes at high Velocity

• All Data that comes from a Variety of Sources

• All Data that brings Complexity

• All Data that challenges existing Information Infrastructure Capabilities

• All Data that makes us “Think Different” Today


IN 2010 THE DIGITAL UNIVERSE WAS

1.2 ZETTABYTES1,200,000,000,000,000,000,000

Zetta Exa Peta Tera Giga Mega Kilo Byte

Source: 2010 IDC Digital Universe Study


Avalanche desta década

20090.8 Zettabytes

CRESCIMENTODA INFORMAÇÃO

2020

44X

MAIOR35.2 ZB

fONTE: IDC Digital Universe Study, patrocinado pela EMC, 2011

O NÚMERO DE PROFISSIONAIS DE TI NO MUNDO VAI CRESCER

MENOS QUE 50%


Ondas de evolução

Computação em nuvem

Minicomputador

Mainframe

PC/ Microprocessador

Redes/Computação distribuída


Com a “Nuvem”, agora estamos prontos para a era da conectividade


O que está causando essa avalanche de dados?

Exploração Geofísica

Imagens médicas

Vídeos de vigilânciaSensores móveis

Renderização de Vídeos

Sequenciamento de gens

Smart Grids

Redes sociais

LER MEDIDORES A CADA 15 MIN GERA 3,000X MAIS DADOS

O CUSTO DE SEQUENCIAR UM GENOMA CAIUDE $100M EM 2001 PARA $10K EM 2011

FACEBOOK CRESCE COM APUBLICAÇÃO DE250 MILHÕESDE FOTOS/DIA


Big Data é um conceito relativo

O que é grande hoje…Pode não ser tão grande amanhã….


Fontes de Dados Crescem Sem Parar


CRESCER 50X

Nos próximo 10 anos

Informações nas empresas irá



90%DO MUNDO DIGITAL É

NÃO ESTRUTURADO


Então… Tudo que preciso é gerenciar Big Data, certo?


Errado!


Big Data Is About


Big Data Is AboutPredictive Analytics


E quem fará essa revolução?


E quem é o Cientista de Dados?

BI foca no gerenciamento e reporte de dados existentes para monitorar e gerenciar questões tangentes ao empreendimento.

Data Science aplica avançadas ferramentas e algorítimos de análise para criar novas informações e inovações que são um desdobramento direto dos dados originais


Alto

FuturoPassado TEMPO

VALORDO

NEGÓCIO

Data Science

Business Intelligen

ce

Baixo

Data Science

• Análises Preditivas

• E se…?

Business Intelligence

• Relatórios

• O que aconteceu?

Qual a diferença?


Perfil de um Cientista de Dados

Técnico

Quantitativo

Curiosidade&

Creatividade

Comunicativo&

Colaborativo

Cético


EMC Oil And Gas Strategy

ADVANCE existing EMC oil and gas

solutions

LEVERAGE a robust partner

ecosystem

RESEARCH inventing the next

generation of applied technologies


Volume

• Seismic– SEGD, Pre-Stack, Post-Stack

• Navigation

Variety

• Recently Acquired and Historical – Log curves– Production data– Drilling and test – Micro seismic

– Tops– Lithology– Cultural– Cores

Velocity

• Real Time– LWD– MWD– Mud logging– Rate of Penetration

– Flow– Pressure

Exploration DevelopmentEngineering

and Production

– Seismic acquisition

– Seismic processing

– Seismic interpretation

– Geological interpretation

– Drilling & Test– Reservoir Modeling

– Reservoir Simulation

– Facilities & Reservoir Engineering

– Drilling program

– Production Development and Optimization

– Production

Big Data Definition: Upstream

http://www.google.com/imgres?imgurl=http://www.oilandgaslawyerblog.com/2D%20seismic.JPG&imgrefurl=http://www.oilandgaslawyerblog.com/seismic-surveys/2009/04/&usg=__kXoM5OdNkr49g5XrTZG7ghG2hoc=&h=374&w=649&sz=104&hl=en&start=28&sig2=hxGuKWnQ0TrzlsmwUE5utQ&um=1&itbs=1&tbnid=gqt9m5eWz4umLM:&tbnh=79&tbnw=137&prev=/images?q=seismic&start=18&um=1&hl=en&sa=N&rlz=1T4GGLL_enUS321US321&ndsp=18&tbs=isch:1&ei=lVgiTJLbNYP98AaM2oWxBQ

http://www.google.com/imgres?imgurl=http://www.terralog.com/images/Oildiagr.jpg&imgrefurl=http://www.terralog.com/drill_cuttings_management.asp&usg=__hQfTtc36aRRJynGAyEEMpBqcwjE=&h=308&w=240&sz=45&hl=en&start=9&sig2=hfCh4purCKG-LQ0a_oChZQ&um=1&itbs=1&tbnid=btcwGLs83Yk5eM:&tbnh=117&tbnw=91&prev=/images?q=reservoir+engineering&um=1&hl=en&rlz=1T4GGLL_enUS321US321&tbs=isch:1&ei=vlgiTMiADMKAlAfw7JD0BA


Data Acquisition

Seismic Processing

Interpretation

Drilling

Production

Data Lifecycle Management

Data Dependent Compression

Integrating Wireless Sensors & Analytics

Visualization and Collaboration over Distance

Optimized I/O Platforms for Processing

Analytics for Risers Integrity Management

Plug-in Development


Data Acquisition

Seismic Processing

Interpretation

Drilling

Production


Scientific Workflow Optimization

Complex Data Pattern Recognition

Time Series Data Uncertainty Analysis

Remote User Data Protection Plug-ins

Optimized RTM ; FWI Processing Platforms

Mega-survey Mobility and Distribution

Edge Data Mobility and Transport

Condition Based Maintenance Analytics

Logistics Optimization / Incident Management Analytics


Data Acquisition

Seismic Processing

Interpretation

Drilling

Production


Partition Tolerant Storage Architectures

3D Application Cloud Virtualization Architecture

Topside Plant and Process Analytics

Production Optimization Analytics

HPC Checkpoint Optimization

In-memory HPC architectures

Analytics for Drilling Intervention / EHS

Copyright © 2013 EMC Corporation. All Rights Reserved.Copyright © 2011 EMC Corporation. All Rights Reserved. 29

OBRIGADO!

Documents

UFF Tech 2013 - Big Data - Rafael Borges EMC