HTTPD Performance Scaling Up

8/11/2019 HTTPD Performance Scaling Up

http://slidepdf.com/reader/full/httpd-performance-scaling-up 1/39

Apache Performance Tuning

Part 1: Scaling Up

Sander Temme <sander@temme.net>

“Apache is a general webserver, which is designed to be correct

first, and fast second. Even so, its performance is quitesatisfactory. Most sites have less than 10Mbits of outgoing

bandwidth, which Apache can fill using only a low end Pentium-

based webserver.”

http://httpd.apache.org/docs/1.3/misc/perf-tuning.html says:

Performance Tuning: Goals

• Serve as Many Requests as Possible

• Graceful Degradation

– (Don’t crash the box)

Monitoring Your Server

Purposes of Monitoring

• Observation

• Extrapolation

• Signals/Alerts

• Testing

Monitoring Apache

Monitoring Solaris: SE

Toolkit• Lightweight• Programmable

• Alive

http://www.sunfreeware.com/setoolkit.html

Other Monitoring Tools

• vmstat

• iostat

• top

• free

Web Server Logs

• ErrorLog – LogLevel: debug, info, notice, warn,

error, crit

• Access Log : TransferLog orCustomLog

– Common Log Format

Common Log Format172.16.2.91 - - [16/Nov/2003:15:23:27 -0800] "GET /~sctemme/ HTTP/1.1" 200 1446

172.16.2.91 - - [16/Nov/2003:15:23:28 -0800] "GET /~sctemme/css/doc.css HTTP/1.1" 200 167

172.16.2.91 - - [16/Nov/2003:15:23:28 -0800] "GET /~sctemme/css/menu.css HTTP/1.1" 200 623

172.16.2.91 - - [16/Nov/2003:15:23:29 -0800] "GET /favicon.ico HTTP/1.1" 404 283

172.16.2.91 - - [16/Nov/2003:15:23:34 -0800] "GET /~sctemme/index.html HTTP/1.1" 200 1446

Client IP 172.16.2.91

RFC 1413 ident -

username -

timestamp [16/Nov/2003:15:23:29 -0800]

Request "GET /favicon.ico HTTP/1.1"

Status Code 404

Content Bytes 283

Configuring for Performance

• Configuring Apache• Tuning the Operating System

Apache Configuration

• Process/Thread Management• DNS Lookups

• Avoid .htaccess Files

• Disable unused modules

• Tune your App Tier

DNS Lookups

• HostnameLookups• Access Control

– Bad: Deny from example.com

– Good: Deny from 172.160.234.5

.htaccess Files

• Per-directory configuration files• Accessed for every request

• Best performance: AllowOverride

GET /dir1/dir2/restricted.html HTTP/1.0

MaxClients

• Configuration file directive• Maximum number of workers

• Apache 1.3, 2.0 Prefork: processes

• Apache 2.0 Worker: threads *

processes

• Limit according to resources

(memory)

Server-side Includes

• We Love Them! – Easy to implement

– Easy to manage

• We Hate Them! – They break sendfile()

– They break cacheability

SSI on www.apache.orgSSI Enabled

Sizing MaxClients

• Take total RAM• Subtract OS allowance

– look at free value without Apache, etc.

• Subtract external program allowance – JVM, cgi programs, MySQL?

• Divide by httpd process size

– Read process size from top

Selecting Your MPM

• Apache 2.0 only!• Processes and Threads

• Differences between platforms

• Thread-safety issues

Processes and Threads

• Process: – Own copy of data structures

– Shares: program code, shared memory

– Context switches expensive• Thread:

– Runs within process

– Shares process environment

– No context switch

Platforms and Threading

• Context switches expensive on Solaris, AIX• Context switches cheaper on Linux

• Solaris uses M:N threading

• Linux uses 1 process per thread• LinuxThreads implementation is old

– Replaced by Native Posix Thread Library

(NPTL) in 2.6

– NTPL already in RH 9, RHAS 3

Thread-safety

• Third-party modules and libraries – mod_perl: experimental threading in Perl

5.6; more mature in Perl 5.8

– PHP: uses many third-party libraries• FreeBSD: threading not reliable until

– Apache 2.2 Worker MPM runs onFreeBSD

Tune your App Tier

• Tomcat – Edit server.xml, tune minProcessors,

maxProcessors

– Use APR -> Persistent connections

– Tune JVM (Heap, Garbage Collection)• MySQL

– Ships with various scenarios in support-files:• my-{small,medium,large,huge}.conf

– PHP & prefork: every child makes a connection – Tune max_connections variable in my.cnf

System Tuning Tips

• RAM and swap space• ulimit: files and processes

• Turn off unused services and

modules

RAM and Swap

• Swap is disk-based Extension of RAM• Excessive swapping kills performance

• Tune MaxClients

• Never have more memory than swap

– Upgrade RAM -> add more swap space

ulimit

• Per-process resource limits• Built-in command of sh, bash

• Important limits: – processes (-u)

– open files (-n)

• Set in invoking shell

• Code in Apache 2.0 startup script– ulimit -S -n `ulimit -H -n`

• Linux: /etc/security/limits.conf

Caching Content

• Dynamic Content is Expensive• Static Content Relatively Cheap

• Several Approaches:

– Dynamic caching

– Pre-rendering popular pages

(index.rss…)

mod_cache Configuration

CacheRoot /raid1/cacheroot

CacheEnable disk /

# A page modified 100 min. ago will expire in 10 min.CacheLastModifiedFactor .1

# Always check again after 6 hours

CacheMaxExpire 21600

</IfModule>

Make Popular Pages Static

• RSS Feeds• Popular catalog queries

• … (Check your access log)

Static Page Substitution

Options +Indexes

Order allow,deny

Allow from all

RewriteEngine on

RewriteCond %{REQUEST_FILENAME} !-f

RewriteCond %{REQUEST_FILENAME} !-d

RewriteRule ^(.*)$ /cgi-bin/blosxom.cgi/$1 [L,QSA]

</Directory>

• Observe Before You Act• Act on Monitoring Results

• Don’t Overload Your System

Conference Roadmap

• TH9: Building a Fast and Rich Web App withPHP 5

• TH10: Troubleshooting Apache configurations

• TH19: mod_perl for Speed Freaks!

• TH22: Garbage collection tuning for java serverprocesses

• FR12: Getting everything out of Apache Derbydatabase

• FR1: Scaling httpd 2.x to 50,000 Concurrent

Downloads• FR5: Apache Performance Tuning Part 2:

Scaling Out

• FR24: PHP and MySQL Best Practices 2.0

Current Version

http://people.apache.org/~sctemme/ApconEU2006/FR4/

Thank You

HTTPD Performance Scaling Up

Documents

Performance Tuning, Sizing, and Scaling Guide

Vertical Scaling & Performance Tuning

Tomcat and apache httpd training

High Performance Php My Sql Scaling Techniques

Ruby on Rails - Brian McCallisterkasparov.skife.org/ac-us-04-ror.pdf · Conrad Barski ... Rails Rails Apache HTTPD PostgreSQL Cache Cache. Apache HTTPD 1.3 mod_fcgi Apache HTTPD 2.0

Specialized Architectures: Enabling Performance Scaling in

Section 2 - dctpublic.s3.amazonaws.com · LESSON: Instance user data #!/bin/bash yum update -y yum install httpd -y systemctlstart httpd systemctlenable httpd cd /var/www/html echo

Django + httpd - Schedschd.ws/hosted_files/apachecon2016/d9/Django + httpd - Jeff Trawick...Django + httpd Je Trawick ... Django app can run inside or outside of httpd processes

「Apache httpd 2.4」「PHP7.3」「MariaDB」のインストー …Webサーバ Apache httpd 2.4 を CentOS 7 に yum でインストールする手順 # yum -y install httpd

Scaling Confluence: From Performance to People

Scaling Apache* Web Server Performance on Intel®-Based Platforms€¦ · of processing power, dual-socket web servers can support a larger number of simultaneous httpd server processes

Rc169 010d-apache httpd-1

Scaling and High Performance Storage System: LeoFS

Drupal Performance and Scaling

Real World MySQL Performance Tuning - Develooper · Real World MySQL Performance Tuning ... that’s running in Apache HTTPD)? ... • Front end cache (mod_cache, squid, Varnish*

Scaling Across the Supercomputer Performance Spectrum - Cray · Scaling Across the Supercomputer Performance Spectrum Cray’s XC series leverages the combined advantages of the high-performance

Scaling Workgroup Performance With Switching & Fast Ethernet

Apache Performance Tuning: Scaling Up

WRF Performance and Scaling Assessment

Apache Performance Tuning: Scaling Out