Big data analytics as an on demand service by Kevin Crosbie

RavenPack International

RavenPack News AnalyticsBig Data Analytics as an On Demand ServiceKevin Crosbie, May 20, 2016

ravenpack.com | [email protected] | AMERICAS Tel: (646) 277-7339 | EMEA-APAC Tel: +44 (0) 782 783 8282


The value in Big Data

The Role of Data Analytics in Decision Making

PWC Study:Only 29% use Data

The Role of Data Analytics in Decision Making

Key Obstacles

● Lack of

skill/expertise

● Quality/

completeness

● Timeliness of data


● Our approach to Big Data● Key Client Applications● Unifying Big Data● Self-Service Data

Presentation Outline

RavenPack at a GlanceRavenPack is the leading provider of real-time news and sentiment analytics in financial markets

Company Facts:• Founded in 2003• 50 Full time employees• Offices in NY, London, & Marbella

The RavenPack Name?In Norse mythology, the most knowledgeable of all gods, Odin, had two ravens scouring the world for information and returning with it every night.

The name RavenPack is derived from Odin’s ravens, a “pack” scouring the world for information and making sense of it all.

Our Vision:

Make unstructured content actionable for financial professionals

What we do

Convert unstructured data into structured data

Why we do it

Unexploited value in unstructured data

Economy

Environment

Societyand

Politics

What is unstructured data?

Business

Structured data from News and Social Media

Type of Analytic Shire Plc AbbVie Inc. Explanation - 5 out of 46 data fields

Relevance Score 100 100 Calculate the relevance of any entity in the story

Event Detection Acquisition Failed Classification of potential market moving event

Entity & Role Detection Acquiree Acquirer Identify entity and its potential role in the story

Novelty Score 100 (most novel event) Answers if the news is new or “novel” over time

Sentiment Score 21 41 Calculate sentiment using various techniques

UnstructuredContent

• Newswires• Social Media• Press Releases• Reg. Filings• Web content

Shire plc: AbbVie Terminates Offer for Shire DUBLIN, Oct. 20, 2014 PRNewswireIn light of the AbbVie Board's decision to change its recommendation and to advise its shareholders to vote against its offer, Shire believes that there is now no realistic prospect of AbbVie completing its Offer…

Sample Story

Sample Analysis

Daily FTP Updates

Downloadable Historical Archive

APIReal-time

Key Features:

• Real-time data delivery• 16+ yrs of historical data• 41k stocks, 200 countries, all

major FX and commodities • Event-level, story-level and

sentiment-level analyticsClient Proprietary Trading & Risk Models


Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring

Temporal Information

Media Buzz

Relationships

Opinions

Sentiment Indicators


Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions



Entity Recognition

Event Detection

Relevance Scoring

Novelty Scoring

Sentiment Scoring


Media Buzz

Relationships

Opinions


Processing Big Data

Huge quantities of data

Processing Big Data

Need for Parallel Processing

Processing Big Data

Real-time Streaming

Processing Big Data

Low Latency

Data for Investing and Financial Decision-making

Who uses it?



Quantitative & Algorithmic Trading• Enhanced algorithmic trading execution

Discretionary Trading Applications• Front office decision making tools

Portfolio Selection• Find stocks in the media spotlight

Event based trading• Buy on the rumor, sell on the fact





















Risk Management• Control for headline or event risk

Market Surveillance/Compliance• Investigate insider trading

Competitor Analysis• Stay on top of competitor activity

Supply-chain Analysis• Monitor companies in the supply chain



















Self-service Data AnalyticsGartner’s Magic Quadrant for Business Intelligence and Analytics Platforms

● Access to self-service tools● End-to-end analytical platforms● Next-generation data discovery● Natural-language generation

Complete view for decision making?

Third Party Content

Organization

Press Releases

Corporate Website

Competitor Activity

Social Media Presence

Proprietary Data

Sales Data

Shipping/Satellite Info

Internet Traffic

CRM

Crowd Sourced Data

Public Information

Anonymized Data

Online Purchases

An Organization’s Big Data

Credit and Valuations

Insight from Big Data

Brand Tracking

Competitor Insight

Supply Chain Tracking

Customer Churn

Trading

Organization Data

Mapping/Transformation

Relationships

RavenPack Data Enrichme

nt

RavenPack’s Self-Service Platform

Query Visualize

Connect Upload

Big Data Platform

Query

EntitiesNews Analytics

Transaction and

Payments

Satellite Tracking

Data

Internet Traffic Data

Big Data Platform

Event Taxonomy

Visualize

Big Data Platform

Connect

DataPlatform

HistoricalAPI (Pull)

Real-time API (Push)

Matlab/R etc.

Integration

Qlik/Tableau Integration

Direct Queries

Big Data Platform

Upload

DataServer

* Process* Map* Deliver

* Research* Email* Transcripts* Sales Data* Marketing* CRM* Competitors

Public API

Private Cloud

Business Data

DataPlatform

Unify data across the enterprise

Big Data Platform


Summary


● 80% of Big Data is unstructured● There is value in unstructured data● Big Data is used for 29% of decisions● Data democratization needs data

unification


Questions


Kevin Crosbie: [email protected]

We’re Hiring! Web Designers, Java, Python, [email protected]

Software

Big data analytics as an on demand service by Kevin Crosbie