Big data meetup_10_9_2013

Click to edit Master title style

This presentation, and the information contained therein, is the proprietary and confidential property of ComLinkData, powered by

Comniscient Technologies LLC, and may only be viewed by the individual to which it was initially provided by ComLinkData. By viewing this

presentation, you agree that you will not copy, reproduce or distribute the presentation in whole or in part, without the prior written consent

of ComLinkData. You agree not to forward this presentation (by email or otherwise) to anyone inside or outside your organization, and you will

not save this presentation on a network to which anyone other than you has access (except for information technology professionals who are

subject to confidentiality provisions, in the ordinary course of their responsibilities). You agree to maintain the confidentiality of all of the

information and data in the presentation that is not already in the public domain. You further agree to use the presentation only for the

purpose of evaluating the services offered by ComLinkData, and will not use any of the confidential information in the presentation for any

other purpose, including for the purpose of analyzing aspects of the telecommunications market.

Turning Big Data into Business Applications: An introduction to R Shiny@tanyacash21, @JoshuaWalker_

10/9/2013

Your viewing this presentation is subject the confidentiality and other terms provided on the first page of the presentation.

The Opportunity: Real-time Telecom Insights

50,000 transactions a day18MM+ a year

2.2 Terabytes Disk Space3 years of data and growing

Demographics

Advertising spend

Events

Social Media

Distribution

Device

Real-time Telecom Switching Data

Data Flow and Architecture

The Front End Framework

Web Application (Front End)

jQuery

AngularJS

Twitter Bootstrap

Font Awesome

Javascript, HTML5, CSS3 Java Servlets API(Service Layer)

1. Parse queries2. Fetch data

3. Construct JSON

SQL Server / Amazon Redshift

R is Gaining Major Visibility

http://r4stats.com/2013/03/19/r-2012-growth-exceeds-sas-all-time-total/

Testable, Reproducible, Scalable

• Testable – RUnit package

• Reproducible – Commented scripts / multiple ways to ingest data (flat files, Excel files, ODBC/JDBC, Rcurl)

• Scalable – doSNOW, doMPI, doMC, foreach packages

Developers and Data Geeks Tend to Have Mutually Exclusive Sets of Skills

Web Developers / Designers / Engineers

Data Scientists / Analysts / Researchers

Solution: Shiny!

Shiny Features

• Easy to use – readily available widgets, no HTML/Javascript or jQuery knowledge required

• Fast bidirectional communication using websockets

• Uses Twitter Bootstrap

• Reactive Programming Model

Reactivity

Inputs on a web page Plots / Tables

rCharts

Generates d3.js code

googleVis

Define HTML UI Instead of ui.R for Even More Flexibility

index.html

ui.R:<application-dir>|-- www |-- index.html|-- server.R

Interactive Shiny Workshop

Start up R!

Demo of Full Shiny Applications

New Method of Collaboration and Product Development in Data-Centric Companies

References

1. http://rcharts.io/2. http://rcharts.io/gallery/3. http://cran.r-project.org/web/packages/googleVis/index.html4. http://cran.r-project.org/web/packages/websockets/index.html5. http://rstudio.github.io/shiny/tutorial/#welcome6. https://groups.google.com/forum/#!forum/shiny-discuss7. http://r4stats.com/2013/03/19/r-2012-growth-exceeds-sas-all-time-total/8. http://www.businessinsider.com/excel-partly-to-blame-for-trading-loss-2013-2

Big data meetup_10_9_2013

Technology

Oracle Big Data Science Oracle OpenWorld 2016vlamiscdn.com/papers/Oracle Big Data Science.pdf · Oracle Portfolio of Big Data Science Products Big Data Discovery Big Data SQL Oracle

Big Data ในภาครัฐ - library2.parliament.go.th · Big Data))' 2' 2559) (Big Data)" Big Data Big Data 2559) -

MSA220/MVE440 Statistical Learning for Big Data - Lecture 1 · 2018. 3. 19. · Statistical Learning for Big Data Big Data BIG DATA: can’t t on a HD Big Data: 10Gb+1Tb big data:

Big Data, Big Risks – Simplify Big Data Security & Management | Vormetric

Big Data ในภาครัฐ - National Assembly of ...library2.parliament.go.th/ejournal/content_af/2559/dec2559-4.pdf · Big Data))' 2' 2559) (Big Data)" Big Data Big Data

Big Data, Big Commerce, Big Challenge

Big Vulnerabilities + Big Data = Big Intelligence

Caterpillar Big Data Infrastructure Big Data, Data Analytics, and … · Caterpillar Big Data Infrastructure Big Data, Data Analytics, and Machine Learning. Caterpillar is the world’s

Informatica Big Data Management - Meetup › 16208282 › Big Data Management... · 2016-04-15 · Big Data = Big Opportunity Sources: Informatica Big Data Survey, March 2012 Cisco,

ความย้อนแย้งเรื่อง Big Data (Big Data Paradoxes)

BIG DATA, SMART DATA AND BIG ANALYSIS

การประยุกต์ใช้ Big Data · การประยุกต์ใช้ Big Data ในการบริหารจัดการฐานข้อมูลทางด้าน

Big data solutions - Big data technology

Big Data Meets Big Data Analytics

The BIG Future of BIG Data · 2017-03-08 · The BIG Future of BIG Data. Big Data Data Governance Data Warehousing Data Reporting Data Infrastructure. Become a PREDICTIVEEnterprise

Big Data and Hadoop - How Big is this Big Data?

Big Data meets Big Data

Introduction to Big Data, Big Data Processing, and Big ...eecs.csuohio.edu/~sschung/CIS660/Lecture1_IntroBig... · What’s Big Data? From Wikipedia: • Big data is the term for

Real Time Big data Applications: file · Web viewUNIT I. INTRODUCTION TO BIG DATA. Big Data – Definition, Characteristic Features – Big Data Applications - Big Data vs. Traditional

BIG DATA, BIG INNOVATIONS - Data Storage, … · BIG DATA, BIG INNOVATIONS ... before possible with traditional business intelligence and data warehouse ... desired data sets needed