18
©2013 Primal Fusion Inc. Data Synthesis The Big Problem with Small Data

Data Synthesis—Addressing Small Data Problems Faced by Big Data

  • Upload
    primal

  • View
    563

  • Download
    2

Embed Size (px)

DESCRIPTION

Big data technologies are plagued with small data problems. Their performance suffers in markets that aggregate a large number of unique interests. Some of the largest markets share these small data characteristics, including local e-commerce, personalized media, and interest networking. New approaches are needed that are far less sensitive to the cost and complexity of the data. In this talk, Primal demonstrates how its semantic synthesis technology can overcome these small data problems. We draw on real-world experience in application areas such as personalized information services, recommendation engines, and expertise search.

Citation preview

Page 1: Data Synthesis—Addressing Small Data Problems Faced by Big Data

©2013 Primal Fusion Inc.

Data Synthesis

The Big Problem with Small Data

Page 2: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Treat your customers as individuals.

MASS MARKETS OF INDIVIDUALS

• Media and advertising• Healthcare and medicine

• Education• Ecommerce and marketing

• Etc.

Page 3: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Implicit SemanticsStatistical Approaches

Explicit SemanticsOntological Approaches

The Long Tail of Big Data

EXPRESSIVENESS

DATA

COMPLEX SCHEMASIMPLE SCHEMA

SMALL

BIG

Cost-Performance Barrier

MASS MARKETS OF INDIVIDUALSStatistical methods lose significance

Ontological methods prohibitively expensiveHybrid

Approaches

Page 4: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Example: Expertise Search

Source: James Cridland

Page 5: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Statistical Approaches

Page 6: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Manual Approaches

Page 7: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 8: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 9: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 10: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Primal’s approach:Modeling knowledge generation, not modeling knowledge

Natural Language Primal Semantics

Words+

Grammatical rules=

Statements and queries

Atomic semantics+

Constructive rules=

Semantic representations

Page 11: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 12: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 13: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 14: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 15: Data Synthesis—Addressing Small Data Problems Faced by Big Data
Page 16: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Treat your customers as individuals.

Massive opportunities in truly individualized services, but...

…huge challenges in the long tail of big data.

The cost-performance barrier requires solutions with fundamentally different cost structures.

Primal’s semantic synthesis technology is one such solution.

Page 17: Data Synthesis—Addressing Small Data Problems Faced by Big Data

About PrimalPrimal powers the rapid development of personalized and intelligent systems.

Cloud-based data service (DaaS). Software and IP licensing opportunities are available for larger companies.

Professional services available, with expertise in knowledge representation, statistical computing, information retrieval and extraction, database, and cloud computing.

More info: primal.com

Page 18: Data Synthesis—Addressing Small Data Problems Faced by Big Data

Contact Info

Peter Sweeney,Founder & President

[email protected]@petersweeney

Further reading: blog.primal.com