23
Plone.org an overview of the plone infrastructure

Wichert Akkerman Plone Deployment Practices The Plone.Org Setup

  • Upload
    wooda

  • View
    2.806

  • Download
    2

Embed Size (px)

DESCRIPTION

The plone.org and plone.net websites are the first confrontation with Plone for most users. It is important that they perform well and are stable. With almost 4 million page views per day and thousands of LDAP users plone.org and plone.net are examples of a complex deployment setup requiring LDAP, caching and load balancing - all on a single machine. I will describe how the Plone websites are build and how those practices can be applied to other sites, making it possible to scale upwards to bigger sites or make smaller sites more efficient.

Citation preview

Page 1: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Plone.organ overview of the plone infrastructure

Page 2: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Who ?

• Former lifetime: Debian

• Plone developer

• Plone 3 release manager

• Plone infrastructure team lead

• Simplon

Page 3: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

What ?

• Issue trackers

• Mailing lists

• Source control systems

• Web sites

Page 4: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

How?

• 90% existing software

• 2% custom changes

• 2% custom software

• 6% cursing and frustration

• equals 100% love (we hope)

Page 5: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

For who?

• 681 commiters

• over 1 million downloads

• over 200 Plone companies

• the whole world uses Plone!

Page 6: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

24 hours per day

0

1,000

2,000

3,000

4,000

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23

Plone Collective

Page 7: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

7 days per week

0

2,250

4,500

6,750

9,000

Monda

y

Tues

day

Wed

nesd

ay

Thursd

ayFr

iday

Satu

rday

Sund

ay

Plone Collective

Page 8: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Internet

Web server

proxy cache

Load Balancer

Zopeinstance

Zopeinstance

ZEOserver

LDAP

Zopeinstance

ZEOserver

Zope hosting

Page 9: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Debian GNU/Linux

Page 10: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

PloneHelpCenter

Page 11: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

PloneSoftwareCenter

Page 12: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Poi

Page 13: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

PloneOrg

Page 14: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Bluffing

• ~ 150k page views per day

• Plone is not nearly fast enough

• Fake it!

Page 15: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Varnish vs Squid

• Squid help enormously

• Varnish helped even more

• ~80% cache hit rate

• CacheSetup makes it possible

Page 16: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Source Control

• Subversion

• Synchronised to svn-mirror.plone.org

• Access control via LDAP

• Reporting to CIA and mailing lists

Page 17: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Who are you ?

• Authentication required for services

• Duplication is evil

• Single account database

Page 18: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

LDAPserver

LDAPserver

plone.org

plone.net

dev.plone.org

svn.plone.org

LDAPrepllication

svn commitmails

LDAP everywhere

Page 19: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

LDAP Statistics

• 28971 accounts

• ~ 1000 new accounts per month

0

7,500

15,000

22,500

30,000

Dec

embe

r 20

05

Febr

uary

200

6

Apr

il 20

06

June

200

6

Aug

ust

2006

Oct

ober

200

6

Dec

embe

r 20

06

Febr

uary

200

7

Apr

il 20

07

June

200

7

Aug

ust

2007

LDAP accounts

Page 20: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

LDAP setup

• OpenLDAP everywhere

• PloneLDAP is your friend

• Apache is your fiend

Page 21: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

No Worries Mate

• Spam on dev.plone.org

• Spam on lists.plone.org

• Spam on paste.plone.org

• Postgres and Varnish stability

• Robots are coming to get us

Page 22: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Pain pill

Page 23: Wichert Akkerman   Plone Deployment Practices   The Plone.Org Setup

Dreams ...

• Plone 3.0 for plone.org and plone.net

• Redundancy

• Single sign-on