Big data and beyond

Sastry PenumarthyJune 12, 2016

Agenda•You and big data, closer than you think!•What is it? The 4 V’s•How did we get here? Evolution•What are the components?•Who are the leaders?•Trends?

You and Big Data, closer than you think! Tool usage/ Sites & Apps Activities on these Time spent doing them Data created (Volume and context)

▫Work Email / IM Collateral / Artefact creation Meetings Other

▫Non-work Social Mobile – Chat, Video Other (Gadgets etc.,)

• What do you see?

4 V’s of Big Data

Data

Variety

Volume

Velocity

Veracity

Evolution•Computing Technologies -

▫Storage (Punch cards, Floppies, Disks, SSD …)▫Processor speed (Moore’s law ++)▫Network (Wired / wireless / Mobile)▫Data Center, Cloud (Private / Public / Hybrid)

•Software▫Custom written▫Packages▫Web-based▫Apps

•Social / Local / Mobile Phenomenon!

Components

Data storage and management• Storage and Resiliency• Process management• Processing

• Map / Reduce, Spark

Data processing and intelligence• Data science• Analytics

• R, Python, Scala

Data visualization• Presentation

• Tableau, Google, HTML

Leaders (FANG+) -

Facebook Amazon

Netflix Google

Trends•Hadoop is going mainstream in

enterprises•Cloud-based applications are growing

phenomenally (PaaS, SaaS, XaaS)•IOT + Cloud + Big data – coming together

Q & A

My email - sastry.penumarthy@gmail.com

During the time you spent here …What Happened? How much (Approx)?

New Mobile Web users added 20+ K

New posts on Facebook 40+ M

Searches on Google 240+ M

Video Hours loaded to Youtube 18+ K Hours

Downloads from App Store 4+ MMoney spent online (Shopping) in USD 22+ M $

Number of tweets on Twitter 21+ M

Total data volume added per day (2012) – 2.5 Quintillion Bytes (2.3 Trillion Gigabytes!)

Backup Slides

What’s cooking…•Augmented Reality / Virtual reality

▫MagicLeap, HoloLens, Oculus Rift•Artificial Intelligence and Robotics•Deep Learning•Internet Of Things•Drones•3D Printing•Wearables, Implants, Exoskeletons

What does it take?Persistence

Real time processing

Enable the right insights

Simple UI / UX

Secure and reliable