Keynote: from publisher to platform, How The Guardian Embraced the Internet using Content, Search,...

From publisher to platform: How the Guardian embraced the internet using content, search, and Open Source

Stephen Dunn, Guardian News and Mediastephen.dunn@guardian.co.uk, 25th May, 2011

Twitter: @cuica, @openplatform

Thursday, 26 May 2011

From publisher to platformHow the Guardian embraced the Internet using content, search, and Open SourceStephen Dunn, Guardian News and Media

The publishing era

We started a long time ago:

Swine flu

Keyword page

Twitter updates

Content partnerships

Video Open platform API

Live blogs

Comment

Mobile siteApps

Newspapers

To secure the financial and editorial independence of the Guardian in perpetuity. To promote freedom in the press and liberal journalism globally.

To become the world's leading liberal voice.

To secure the financial and editorial independence of the Guardian in perpetuity

To promote freedom in the press and liberal journalism globally

Open Web Principles

• “A cool URI is one that does not change” Tim Berners-Lee 1998• 1.5 million resources redirected to new scheme

1. Permanent

http://www.flickr.com/photos/fstorr/

2. Addressable★ Resources are “about” something - ready for the

social web.

★ We live in “the age of point-at-things” (Coates 2005)

★ Multiple routes to content

★ Tagging drives discovery

3. Discoverable

4. Open

/technology/internet

/technology/all

/environment/climatechange

Example: The Hackable Guardian

http://www.guardian.co.uk/....

+business/globaleconomy/rss

Results...

3,750,000

7,500,000

11,250,000

15,000,000

18,750,000

22,500,000

26,250,000

30,000,000

Sep 2005 Oct 2006 Nov 2007 Dec 2008

rs Pre - project

First release

Final ReleaseSite traffic growthUnique Users

However...

1 Billion+Internet Users!

...“How I stopped worrying about my website and learned to love the whole internet.”

Matt McAlister

The Open Strategy

OPEN IN

Bring in data and apps from the Internet

OPEN OUT

Enable partners to build applications using Guardian content and services for other platforms

"Our most interesting experiments lie in combining what we know with the experience, opinions and expertise of the people who want to participate rather than passively receive.”

“The Guardian alongside Al Jazeera was the one news source that everybody on the streets in Tahrir - not just in Cairo but in surrounding cities and major centers of revolutionary activity - that people were talking about.”

Jack Shenker

The Open Strategy

OPEN IN

OPEN OUT

The Open Platform

The suite of services enabling partners to build applications with

the Guardian

OPEN IN

OPEN OUT

CONTENT APIA service for selecting and

collecting content from the Guardian

for re-use

DATA STOREA directory of

useful data curated by Guardian editors

POLITICS APIOpen database of candidates, voting records, constituencies, election results,

live data on election day

Mutualised news!

DATA STOREA directory of

useful data curated by Guardian

editors

POLITICS APIOpen database of candidates, voting

records, constituencies, election results, live data on election day

POLITICS APIOpen database of candidates, voting

records, constituencies, election results, live data on election day

Open for Business

3 Tiers of access3 Revenue models

Keyless: Take our headlines. You keep associated revenues.

Approved: Take our full article content, but with an advert. Guardian keeps ad revenue, you keep rest-of-page revenue.

Bespoke: Take, reformat, augment our content Revenue model to be negotiated. Combination of Media, Fees, Downloads.

What this means

Open Out: Developers can now access full content APIs on demand with keys post-approved

Platform is positioned as a place to do business

So rapid scalability, reliability and performance are now core requirements

OPEN INBring in data and

apps from the internet

OPEN OUTAllow partners to build applications using Guardian

content and services for other

platforms

A framework for integrating 3rd party

applications into guardian.co.uk

MICROAPPS Simple REST/HTTP framework allows lightweight development

Applications proxied for performance

Apps generally hosted in the cloud, allows hot deployment into production

A framework for integrating 3rd party

applications into guardian.co.uk

MICROAPPS

• What could I cook?

Bringing it together

App showcase

From publisher to platform

Seeking massive growth, but no longer only broadcasting content on the website

User/partner engagement & contribution onJournalismdatasoftwareapplicationsrevenue and ads

Support developers and partners with data and APIs,need scalability, reliability, speed

Evolving the architecture

App server App server App server

Web server Web server Web server

Oracle

Memcached (added later)

App server App server App server

Web server Web server Web server

Oracle

Memcached

Why RDBMS?

5 years ago, fewer alternatives

Understand operations procedures

Can easily recruit DBAs / devs

Developer/ops tools

Business critical system: a safe choice

3,750,000

7,500,000

11,250,000

15,000,000

18,750,000

22,500,000

26,250,000

30,000,000

Sep 2005 Sep 2006 Sep 2007 Sep 2008

Scaling trafficUnique Users

We chose Solr/Lucene

Can perform complex queries, including full-text search

We can change the schema with no downtime

Most queries are of similar cost

Scales very well horizontally

“Just worked” in the cloud

No strange control processes/engines

Developers just loved working with it!

App server

Web servers

Memcached

Cloud, EC2

OPEN IN

OPEN OUT

What about Open In?

App server

Web servers

Memcached

external hostingapp engine etc

App server

Web servers

Memcached

Cloud, EC2

external hostingapp engine etc

Keynote: from publisher to platform, How The Guardian Embraced the Internet using Content, Search,...

Technology

From Publisher To Platform: How The Guardian Embraced the Internet using Content , Search, and Open Source

Embraced. Empowered. Engaged. - Aetna · Embraced. Empowered. Engaged. 2 Table of contents Executive Messages 4 Embraced 6 Empowered 14 Engaged 18 Demographics 23. At Aetna, diversity

Dunn and Dunn Model

GUARDIAN-LITE STANDARD GUARDIAN GUARDIAN PREMIER

Learning Style and Academic Achievement€¦ · was developed to describe adult learning. The Dunn and Dunn Learning Style Model Dunn and Dunn (Dunn, 1994, 1997-1998, 1999-2000, 2003;

ADUNA BEACH VILLA: Embraced by Nature :)

Winston dunn

How AngularJS Embraced Traditional Design Patterns

Bigthinker dunn

Gaya Dunn and Dunn

Edu 5701 7 Dunn & Dunn Learning Styles Model[1]

6 Behaviors Embraced by Effective Leaders

How The Guardian Embraced the Internet using Content, Search, and Open Source

How The Guardian Embraced the Internet using Content , Search, and Open Source

D S Dunn CVitae Unabridged - Moravian Collegehome.moravian.edu/public/psych/dunn/D S Dunn CVitae... · 2011-01-24 · Dunn 2 Fellow of the American Psychological Association (APA

Dunn presentation

The Dunn and Dunn Learning Style Model on Instruction

Introduction to DUNN Capital Management, LLC · DUNN Capital Management, LLC Founded in 1974 by Dr. William A. Dunn, a pioneer in managed futures, DUNN Capital Management, LLC (DUNN)

Non-Muslim Scientists Embraced Islam Af

Dunn Transcript