PRT375SharePoint Products & Technologies: Performance and Capacity Planning, Best Practices, and Lessons Learned

Joel Oleson

Technologist

Microsoft Corporation

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

TokyoTokyo

DublinDublin

SingaporeSingapore

RedmondRedmond

3M+ e-mail messages per 3M+ e-mail messages per day internallyday internally

99.99% availability99.99% availability

89,000 end users89,000 end users

83 countries83 countries

300,000+ PCs and devices300,000+ PCs and devicesSingle Instance Single Instance SAP (1.9Tb Db)SAP (1.9Tb Db)

Microsoft IT Environment

403 403 buildingsbuildings

9.5M+ remote 9.5M+ remote connections/monthconnections/month

100,000+ SharePoint Site Collections100,000+ SharePoint Site Collections

IT SharePoint StrategyIndividual to Enterprise Consistent Collaboration Platform

IndividualIndividual

EnterpriseEnterprise

DivisionDivisionRegionRegionGroupGroup

TeamTeamProjectProjectPartnerPartner

The Microsoft Site Hierarchy

MSWebMSWeb

Divisional PortalsDivisional Portals

Group PortalsGroup PortalsTeam SitesTeam Sites

Personal SitesPersonal Sites

Global SharePoint Deployment

Tokyo

Dublin

Singapore

Redmond

Aggregated enterprise search● Portals● Team Sites● Personal Sites● Partner collaboration

Regional search● Portals● Team Sites● Personal Sites● Partner collaboration

Regional search● Portals● Team Sites● Personal Sites

Regional search● Portals● Team Sites● Personal Sites● Partner Collaboration

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

Top 10 - IT Capacity GuidelinesMetric Preferred IT Max Cap Guideline*

Site Collections /DB 250 5,000 50,000

Database Size/DB 25-50GB 100 GB

Databases/SQL Instance 100 300

Database Size/SQL Instance 2TB 3TB

Child Portals/Farm 10 100 100

Full Portals/Farm 1 15 15

App Pools/Server 2-4 10

Worker Processes/App Pool 4 8

Site Collection Max Quota 5GB 20GB

File Upload Size 50MB 100MB 2GB

* Based on Microsoft SharePoint Products & Technologies Capacity Planning

All other numbers are based on Microsoft IT experience on SharePoint Products & Technologies including SP1

Site & Database Management

Capacity Planning

Establish User Site & File Profile

Microsoft Profile:

Personal Site = 20MB

Team Site = 60MB

MS 3 yr Target: 6-10 Million Docs ~10TB

Data Strategy

Min Network Performance Levels

Namespace Strategy

Farm & System Sizing

Small Farm

Availability not a concern

Cost restrictive

1-3,000 Users

Medium Farm Benefits

High Availability 99.9%

Offloaded Indexing

1000-30,000 Users

Large Farm Benefits

Search Offloaded

Indexing Offloaded

Millions of documents

1,000-30,000 Users

Adding Front Ends

1 per additional 25,000 users

Hardware Decisions - What Matters!

Web – Memory, NIC

Search – NIC

Index – CPU, NIC

SQL – Memory, CPU, NIC, Backup Strategy

Americas Intranet Hardware

4+1 WFE

2 Search

3 IndexMSWeb & Shared Services

2 WFE

1-100 Portals

2 WFE

101-200 Portals

SQL (A/P)Portal SQL

Cluster

32-bit SQL (A/P)Portal SQL

Cluster

x64 SQL (A/P)Portal SQL

Cluster

SharePoint Portal Server 2003SharePoint Portal Server 2003

20 WFEVarious

Dedicated

Americas Intranet Hardware

2 WFE 2 WFEUpgraded

Farm

SQL (A/P)

Team SQLCluster

SQL (A/P)

Team SQLCluster

2 WFETeam Farm Host Header

Windows SharePoint ServicesWindows SharePoint Services

Sites, Databases & Virtual Servers(May 05)

DB Space Used (GB)

DB Space Total

(GB)

WSS VServers &

Portals

Site Collections

Webs/

SubsitesDatabases

Extranet .6 .7 9 5,709 14,409 33

Asia .4 .6 37 7,885 17,484 115

South Pacific .1 .1 32 1,320 3,621 89

EMEA 1.3 1.5 131 18,515 49,531 409

Americas 4.0 4.7 269 63,870 173,927 699

Totals 6.5TB 7.5TB 494 97,299 258,972 1345

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

SharePoint Growth and Scale

SQL Server Report Pack for Office SharePoint Portal Server 2003

http://www.microsoft.com/downloads/details.aspx?FamilyId=49159368-544B-4B09-8EED-4844B4E33D3D&displaylang=en

Sample Report – Search Terms

Usage Statistics on “Team”

“Team” IIS Logs (Jan 2-8, 2005)

Total Hits 24 M

Total Sessions 375 K

Unique Visitors 80 K

Page Requests 21 M

Bandwidth Out 1 TB

Out bits/sec 14 Mb

Bandwidth In 77 GB

In bits/sec 1 Mb

Web CPU vs. Connections

MSWeb Quick Stats

6 Million Files Indexed

SharePoint

MS CMS

Public Folders

Web Sites

File Shares

37 GB in Indexes

Largest Index 15 GB, 2.2M files

195 Content Sources

Manageability with MOM 2005

Microsoft Operations Manager Packs

Microsoft Windows SharePoint Services

Microsoft SharePoint Portal Server 2003

Microsoft SQL Server 2000

Microsoft Internet Information Server 6

Microsoft Cluster Service

Microsoft Windows 2003 Server

Web Site Monitoring

Web Sites and Services MP

Web Sites & Services Report (Example)

Metric SLA MAY APR MAR FEB

Uptime: DIP1 (Team) 99.90% 99.97% 99.76% 99.97% 99.99%

Uptime: DIP2 (Team) 99.90% 100.00% 99.88% 100.00% 100.00%

Uptime: VIP (Team) 99.90% 99.98% 99.77% 99.97% 99.99%

Perf (ms): DIP1 (Team) 1,000 124 123 122 136

Perf (ms): DIP2 (Team) 1,000 128 144 128 151

Perf (ms): VIP (Team) 1,000 126 141 119 125

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

Perf Counters to KnowCPU, Memory, NIC, Connections

Performance Tuning IIS

Planning* Plan Namespace - Use few virtual servers

Tune Sptimer subscription frequency

Disable auto-rapid failure

Use web garden for max performance

MaintenanceLimit WP memory consumed: 500 - 800 MB max

Consolidate app pools, divide for poor performing

Use worker process logs & diagnostics

Application Pool Worker Processes Properties

Performance Tuning SQL

Maintenance Plan

Regular Defrag DBs/Disks (Monthly/Quarterly)

Regular DBCCs (Consistency Checks)

Cleanup/Offline

Resource Planning

FTS vs. SPS Search (MSSearch.exe)

SQL Instances

Disk Optimization (RAID & Partitioning)

SAN vs. DAS

Performance Tuning Memory

Web front-end server memory

Use 4 GB RAM, add /3GB to boot.ini

SQL

Use 4 GB RAM, add /3GB to boot.ini

Add –g512 to SQL Startup Parameters for extra MTL (Mem To Leave)

Use AWE and /PAE for 8GB+ Servers (High End)

Performance Tuning BackupsPlanning

Site Backups don’t scale and cause SQL blocking

SharePoint Database Explorer for file restore (Reskit)

SPSBackup for Index only

Recycle bin to avoid DB recovery

Optimization

Third-party compressed database backup

Use Private Network or Fiber attached tape

Disk Pivoting - Utilize Passive Node

Performance Tuning Network

Network Optimizations

Get backup off the NIC

Consider Network Upgrade 10MB->100 100->1GB

Client Network Perf Improvements

Utilization on slow Links

Bandwidth on slow links

Performance Tuning Index

Planning

Use Site Directory as content source

Scope with source groups

Use fewer indexes

Ad hoc content in larger index

Important content in smaller index

Maintenance

Avoid/Remove single-threaded I-filters

Avoid indexing content twice

Remove – index portal every 10 min

Limit number of crawl threads

Development Considerations

Caching, Caching, Caching

Closed Web Parts do impact performance

Personalization & Audience Targeting

Front Page vs. Site Definition Changes

Ghosting

# of Data Sources

# WebParts, # of zones

Performance Other Considerations…

Auth - Kerberos vs. NTLM vs. Basichttp://support.microsoft.com/?id=832769

IIS 6 Dynamic & Static Compression – Level 9

Third Party – Offline, Replication, Acceleration

Anti-Virus Impact

TCP/IP vs. Named Pipes

Apply WSS & SPS SP1

SPS Search vs. FTS (Extending SPS Search)http://msdn.microsoft.com/library/en-us/spptsdk/html/ExtendingSearchforSPS_SV01159259.asp

WSS Hot fix (Post SP1)KB: 889385 SharePoint Usage & Site Backup

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

IT FY06 Plans64-bit hardware and software

Windows 2003 SP1 Rollout

SQL 2005

Continue to scale up and out

Smart tools/WebParts

Admin Recycle BinEnhanced Search

My Site Off boarding

Site Lifecycle Notification & Archive

SharePoint Utility (DB Analysis/Split Tool)

Search/Index optimization and ranking

Agenda

Microsoft IT Best Practices & Lessons Learned

Microsoft IT Solution

Capacity Planning

Scalability & Manageability

Performance Tuning

FY06

References

Q&A

Microsoft IT Performance White Paper:http://www.microsoft.com/downloads/details.aspx?familyid

=8acf3b81-2DB5-4079-b904-589d2d49bedd&displaylang=en

Microsoft IT SharePoint Deployment Web Cast:http://msevents.microsoft.com/CUI/EventDetail.aspx?EventID=1032241971&Culture=en-US

SharePoint Resource Kit:http://www.microsoft.com/technet/prodtechnol/sppt/reskit/default.mspx

Capacity Planning for Microsoft Office SharePoint Portal Server 2003:http://www.microsoft.com/technet/prodtechnol/office/sps2003/plan/cappisps.mspx

Microsoft SharePoint & ISA Extranet Whitepaper:http://www.microsoft.com/downloads/details.aspx?FamilyId

=4C5BF9DD-3EFB-451D-B213-98ED039190BF&displaylang=en

Resources

Session Summary

Establish profile – Plan for DB capacity

Namespace strategy

Plan enterprise search strategy

Plan Solid Scalable Backup Strategy/Recovery

Monitor performance for bottlenecks

Ask The ExpertsGet Your Questions Answered

You can find me at the Microsoft Ask the Experts area, located in the Exhibition Hall:

Thursday 7 July 13:15 – 15:00

For more information…IT Showcase | How Microsoft Does IT

Visit Microsoft IT at station 18 in the ATE area.

On the Web

Content on TechNethttp://www.microsoft.com/technet/itshowcase/

Content on Microsoft Serviceshttp://www.microsoft.com/itshowcase/

Webcasts on TechNethttp://www.microsoft.com/technet/itsolutions/msit/webcasts.mspx

On CD

The latest IT Showcase CD will be distributed at the ‘Ask The Experts’ booth – please feel free to ask for a copy.

Microsoft Learning Resources:

Click here to access free Microsoft Learning Assessments http://www.microsoft.com/learning/assessment/ind/default.asp

To access free Microsoft Learning E-Learning visit http://www.microsoft.com/learning/access and reference the promotional code 9185-TECHED-6650.

Special offers on Microsoft Certificationfrom Microsoft Learning

Click here to take advantage of these special offers: http://www.microsoft.com/learning/mcp/

Get ready for Microsoft Visual Studio 2005 and Microsoft SQL Server 2005 with free Assessments and E-Learning, and a chance to win a laptop, GPS, and more

Community ResourcesMicrosoft Community Resourceshttp://www.microsoft.com/communities/default.mspx

Non-Microsoft Community Resourceshttp://www.microsoft.com/communities/related/default.mspx

NewsgroupsConverse online with Microsoft Newsgroups, including Worldwidehttp://www.microsoft.com/communities/newsgroups/default.mspx

User GroupsMeet and learn with your peershttp://www.microsoft.com/communities/usergroups/default.mspx

Attend a free chathttp://www.microsoft.com/communities/chats/default.mspx

Attend a free web casthttp://www.microsoft.com/usa/webcasts/default.asp

Most Valuable Professional (MVP)http://mvp.support.microsoft.com/

© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.