28
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1

Building a personalized web scale application - tht11005 - v1.1

Embed Size (px)

DESCRIPTION

A close look from the Oracle NoSQL Database product management group at the challenges associated with web scale personalization type workloads. How NoSQL technology is enabling this class of application and how the inability to meet the demands of these emerging workloads can impact the business financially.

Citation preview

Page 1: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

Page 2: Building a personalized web scale application - tht11005 - v1.1

Building a Personalized Web-Scale Application – THT11005Dave SegleauDir. Product Management

Page 3: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 4: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4

Agenda

What is Personalization?

Why does it matter?

Personalization Requirements

Managing Personalization using Oracle NoSQL Database

Q&A

Page 5: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5

What is Personalization?

“Personalization technology enables the dynamic insertion, customization or suggestion of content in any format that is relevant to the individual user, based on the user’s implicit behavior and preferences, and explicitly given details.”

Wikipedia, “Personalization”

1. Any content: New & Existing content2. Any format: Includes Web Services, Email, Applications, Kiosks, Cell Phones, etc. 3. Any preferences: Implicit & Explicit

Page 6: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6

• A customer enters the store• They pick what they want• They pay• They walk out the door

Shopping Used To Be Easy

Page 7: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7

The Store...

• Unless the customer asked an assistant for help

... Didn’t have to do anything until the customer checked out

• Unless the cashier recognized the customer

... Didn’t really know who the customer was

• Unless somebody remembered talking to the customer and took notes

... Didn’t really know what the customer liked or disliked

Page 8: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8

THEWEBCHANGESEVERYTHING

Page 9: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9

Many Small Transactions & InteractionsCould be 100’s per purchase

UpdateCart

MaintainLists

PackagingInstructions

CaptureComments

ShippingAddress

TrackRatings

Page 10: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10

Add a chat agent

“Hello, Amy”, Can I help you?

We think you might beinterested in theseitems.

Web Applications Personalize the Experience

Here are the orders that you placed recently

When I go online, I can’t easily find what I need. It’s too complicated to find what’s best for me.

AmyAmy Grant

Can’t their sales reps remember my web order? The Acme rep always knows all my orders.

Joeuser

25

I have a hard time locating the accessories after I buy the main item. I wish they arranged these better!

Sam

79

I remember I saw it the last time I was on the website, can’t seem to locate it anymore!!

JoseJose Ramirez

I wish they won’t make me give my address and credit card info every time!

Darlene

58Save their preferences

“This is your currentshipping address andpayment information.”

Display their recentlybrowsed items.

“Here’s what you beenlooking at recently”

Page 11: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11

Customer IDCustomer ID

Customer IDCustomer ID

Customer IDCustomer ID

• Flexibility

• Consistency

• Scalability

• Distribution

• Latency

The Online Profile Management Challenge

Amazon: 10ms delay 1% loss of revenue

Page 12: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12

More Than Shopping

Other web applications

• Gambling, online games, travel sites, advertising, social, career, product online catalog processing, profile management

Network-based infrastructure

• Phones, smart grid, medical monitoring, factory automation, quality of service, oil & gas exploration, geo-location tracking, financial fraud detection

Page 13: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13

Implementing a Personalized Web-Scale App

Identify Key Interactions– Data capture

– Personalized data delivery

Application Drives Data Structure Optimize Data Access

– De-normalize, aggregate, last action

Find New Interactions– Incorporate new data, Integrate downstream

Best Practices

Page 14: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14

The Challenge

Transactions and Personalization are Complex

Doing it at scale is Hard

Doing it in real-time is Harder Still

Page 15: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15

Low LatencyTransactions, Lookups

FlexibleIntegrate withEnterprise Systems

00:02

$$$

Requirements

15Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Page 16: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16

Highly flexible key/value data model

Supports simple transactions and configurable consistency

Enables web-scale transaction processing and personalization

Page 17: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17

Choose the RIGHT tool for the job

Hadoop Distributed File System (HDFS)

Oracle NoSQL Database Oracle Database

File System Key Value Store Relational Database

No inherent structure Simple data structure Complex data structures, rich SQL

High volume writesHigh volume random or range

based reads and writesHigh volume OLTP with 2-PC

Limited functionality, roll-your-own applications

Simple get/put high speed storage, flex configuration

Security, Backup/Restore, Data life cycle mgmt, XML, etc.

Batch OrientedReal-Time, web-scale specialized

applicationsGeneral purpose SQL platform,

multiple applications, ODBC, JDBC

Page 18: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18

Key-value, JSON & RDF data Large Object API BASE & ACID transactions Highly Available Simple administration Data Center Support Online Rolling Upgrade Online Cluster Management Commercial grade support

Features

Oracle NoSQL Database Scalable, Highly Available, Key-Value Database

Application

Storage NodesDatacenter B

Storage NodesDatacenter A

Application

NoSQL DB Driver

Application

NoSQL DB Driver

Application

Page 19: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19

AtomicConsistentIsolatedDurable

Transaction Code Belongs In The DatabaseNot in Your Application

Page 20: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20

Linear increase in throughput

Predictable latency

Predictable Latency at Scale

Page 21: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21

Oracle NoSQL DatabaseIntegrated for the Enterprise

Real Time Access External Tables

MapReduce, OLH, ODC, ODI

NoSQL DB Driver

Application

GRAPH

Page 22: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22

Engineered System (Big Data Appliance)

Commodity Cluster

Deployment Options

Page 23: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23

Oracle NoSQL DB at OOW

Focus on NoSQL Database: http://tinyurl.com/NoSQLOOW13– Sessions on JSON, Application Development, Data Centers, etc.

Hands on Lab: Application Development and Schema Design with Oracle NoSQL Database - HOL10085. Wednesday, 3:30 – 4:30 PM. Marriott Marquis - Salon 3/4

Demogrounds (Moscone South, Exhibition Hall left hand side, Booth SL-059)

Page 24: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24

Oracle NoSQL DB at OOW

– 10:00AM – 11:00 AM NoSQL Office Hours• Buca de Beppo - 855 Howard St  San Francisco

• Bring your questions about the product, competitors, etc. to an informal meeting before the Community Lunch and Demo. Meet and discuss with product development.

– 11:00 AM – 1:00 PM NoSQL Community Lunch and Demo• Buca de Beppo - 855 Howard St  San Francisco

• Join special guests Andrew Mendelsohn and Mike Olson as we relax over beers with fellow architects and developers. What's more, customers will be able to check out the latest Oracle NoSQL Database solutions from Oracle partners. 

Special Customer Event – Tuesday, Sept 24th

Page 25: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25

Oracle NoSQL DB Resources

Oracle Big Data Handbook (Amazon, Barnes & Noble, Oracle Press) NoSQL DB Use Cases, White Papers, Data Sheets, Benchmarks

http://www.oracle.com/technetwork/products/nosqldb/overview/index.html

NoSQL DB Documentation

http://www.oracle.com/technetwork/products/nosqldb/documentation/index.html

NoSQL DB Downloadshttp://www.oracle.com/technetwork/products/nosqldb/downloads/index.html

NoSQL DB OTN Forumhttp://forums.oracle.com/forums/forum.jspa?forumID=1388

OU Training Classeshttp://bit.ly/V5qbmY

Page 26: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26

Q&A

Page 27: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27

Graphic Section Divider

Page 28: Building a personalized web scale application - tht11005 - v1.1

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28