23
Scaleability Scale Up and Scale Out SMP SMP Super Server Super Server Departmental Departmental Server Server Personal Personal System System Grow Up with SMP Grow Up with SMP 4xP6 is now standard 4xP6 is now standard Grow Out with Cluster Grow Out with Cluster Cluster has inexpensive parts Cluster has inexpensive parts Cluster of PCs

Scaleability Scale Up and Scale Out

Embed Size (px)

DESCRIPTION

Scaleability Scale Up and Scale Out. SMP. Super Server. Departmental. Server. Personal. System. Grow Up with SMP 4xP6 is now standard Grow Out with Cluster Cluster has inexpensive parts. Cluster of PCs. Thesis Many little beat few big. 3. 1 MM. 10 nano-second ram. - PowerPoint PPT Presentation

Citation preview

  • NT Scalability EffortsJim Gray (Microsoft Research)My 7 standard slidesData Gravity: Smart devicesClusters: Packs and CrowdsSome cluster projects I am doing

  • ScaleabilityScale Up and Scale OutGrow Up with SMP4xP6 is now standard

    Grow Out with Cluster

    Cluster has inexpensive parts

    Clusterof PCs

  • There'll be Billions Trillions Of ClientsEvery device will be intelligentDoors, rooms, carsComputing will be ubiquitous

  • Billions Of ClientsNeed Millions Of ServersMobile clientsFixed clients ServerSuperserverClientsServersAll clients networked to serversMay be nomadic or on-demandFast clients want faster serversServers provide Shared DataControlCoordinationCommunicationTrillionsBillions

  • ThesisMany little beat few bigSmoking, hairy golf ballHow to connect the many little parts?How to program the many little parts?Fault tolerance & Management?$1 million$100 K$10 KMainframeMiniMicroNano14"9"5.25"3.5"2.5"1.8"1 M SPECmarks, 1TFLOP

    106 clocks to bulk ram

    Event-horizon on chip

    VM reincarnated

    Multi-program cache,On-Chip SMPPico Processor10 pico-second ram100 TB1 TB10 GB1 MB100 MB

  • 4 B PCs (1 Bips, .1GB dram, 10 GB disk 1 Gbps Net, B=G) The Bricks of CyberspaceCost 1,000 $Come with NTDBMSHigh speed NetSystem managementGUI / OOUI ToolsCompatible with everyone elseCyberBricks

  • Super Server: 4T MachineArray of 1,000 4B machines1 b ips processors1 B B DRAM 10 B B disks 1 Bbps comm lines1 TB tape robotA few megabucksChallenge:ManageabilityProgrammabilitySecurityAvailabilityScaleabilityAffordabilityAs easy as a single systemFuture servers are CLUSTERSof processors, discs

    Distributed database techniquesmake clusters workCyber Bricka 4B machine

  • Cluster VisionBuying Computers by the SliceRack & StackMail-order componentsPlug them into the clusterModular growth without limitsGrow by adding small modulesFault tolerance: Spare modules mask failuresParallel execution & data searchUse multiple processors and disksClients and servers made from the same stuffInexpensive: built with commodity CyberBricks

  • Computers shrink to a pointDisks 100x in 10 years 2 TB 3.5 driveShrink to 1 is 200GBDisk is super computer!

    This is already true of printers and terminalsKiloMegaGigaTeraPetaExaZettaYotta

  • Data Gravity Processing Moves to TransducersMove Processing to data sourcesMove to where the power (and sheet metal) is Processor inModemDisplayMicrophones (speech recognition) & cameras (vision)Storage: Data storage and analysisSystem is distributed (a cluster/mob)

  • Disk = Nodehas magnetic storage (100 GB?)has processor & DRAMhas SAN attachment has execution environment OS KernelSAN driverDisk driverFile System RPC, ...ServicesDBMS Applications

  • Microsoft.com: ~150x4 nodes: a crowd(3)

  • HotMail: ~400 Computers Crowd

  • DB Clusters (crowds)16-node Cluster64 cpus2 TB of diskDecision support45-node Cluster140 cpus14 GB DRAM4 TB RAID diskOLTP (Debit Credit)1 B tpd (14 k tps)

  • Windows NT Versus UNIXBest Results on an SMP: SemiLog plot shows 3x (2 year) lead by UNIX Does not show Oracle/Alpha Cluster at 100,000 tpmCAll these numbers are off-scale huge (20,000 active users?)

    Chart5

    2454.97485.88

    3066.072660.03

    3641.179414.06

    551711456.13

    684313646.17

    7128.214176.61

    7521.1314285.87

    807018438.7

    911623143.65

    10665.5331147.04

    10665.5331147.04

    11055.739469.47

    11327.4751871.62

    13089.352117.8

    12030.4757053.8

    10854.2489500

    14501

    13391.13

    13391.13

    16101.27

    14144.27

    16216.1

    16257.2

    27383.4

    18127.4

    17700.43

    18154

    18322.67

    17715.9

    18893.43

    18528.97

    19241.66

    20563

    h

    Unix

    NT

    tpmC

    tpmC vs Time

    Scaleup vs time graphs

    NEW RESULTS OR PRICE CHANGES

    SUBMITTED JULY 21-25, 1997

    Date(tpmC)Company(tpmC)$/tpmCTotal .Cost ($)DBOScpusDate

    Mar-95486IBM486$654317,781SybaseAIX134770

    May-952,660Bull2,660$5301,409,965InformixAIX8May-95

    May-951,563Bull1,563$549858,266InformixAIX4May-95

    May-952,660Bull2,660$5601,490,086InformixAIX8May-95

    May-951,563Bull1,563$584912,331InformixAIX4May-95

    Jun-951,470IBM1,470$666979,231DB2AIX1Jun-95

    Jun-951,438IBM1,438$492707,470DB2AIX4Jun-95

    Jun-951,438IBM1,438$510733,487DB2AIX4Jun-95

    Jul-95874SNI874$364318,441InformixSNI Unix1Jul-95

    Aug-951,416DG1,416$656928,744InformixDG/UX8Aug-95

    Oct-952,455Compaq2,455$242593,216MS SQLNT4Oct-95

    Oct-95735IBM735$378278,029SybaseAIX1Oct-95

    Oct-959,414Digital9,414$3162,972,726OracleDigitalUNIX8Oct-95

    Nov-956,314Tandem6,314$4933,115,351InformixIRIX16Nov-95

    Nov-953,921SNI3,921$4951,939,674InformixSNI Unix8Nov-95

    Nov-952,023Unisys2,023$463937,366InformixSVR45Nov-95

    Dec-953,406DG3,406$240816,031OracleDG/UX7Dec-95

    Dec-9511,456Digital11,456$2863,274,110OracleDigitalUNIX8Dec-95

    Dec-953,516Compaq3,516$186651,647OracleSCO4Dec-95

    Dec-953,226Compaq3,226$207665,806OracleSolaris4Dec-95

    Dec-9511,014Sybase11,014$2222,445,319SybaseDigitalUNIX10Dec-95

    Jan-966,270SNI6,270$4732,963,608InformixSNI Unix16Jan-96

    Jan-963,066Compaq3,066$198606,539OracleNT4Jan-96

    Jan-961,333Sun1,333$208276,559SybaseSolaris1Jan-96

    Jan-963,849Compaq3,849$161619,445OracleSCO4Jan-96

    Jan-963,513Bull3,513$270946,649OracleAIX8Jan-96

    Feb-964,939HP4,939$2321,144,200OracleHPUX4Feb-96

    Feb-964,886HP4,886$2601,272,020OracleHPUX4Feb-96

    Mar-961,084Compaq1,084$197212,920MS SQLNT1Mar-96

    Mar-963,631IBM3,631$2891,049,656OracleAIX8Mar-96

    Mar-963,631IBM3,631$2961,075,443OracleAIX8Mar-96

    Mar-961,880IBM1,880$168315,490DB2NT4Mar-96

    Mar-9613,646Digital13,646$2773,778,989InformixDigitalUNIX10Mar-96

    Mar-963,112Compaq3,112$152470,198SybaseNT4Mar-96

    Apr-963,641Compaq3,641$148537,508MS SQLNT4Apr-96

    Apr-9611,466Sun11,466$1902,174,979SybaseSolaris12Apr-96

    Apr-9611,466Sun11,466$1882,152,254SybaseSolaris12Apr-96

    Apr-963,513Motorola3,513$274960,792OracleAIX8Apr-96

    Jun-964,925Bull4,925$2311,134,364OracleAIX8Jun-96

    Jun-963,119IBM3,119$237740,627DB2AIX8Jun-96

    Jun-963,119IBM3,119$242756,018DB2AIX8Jun-96

    Jun-965,517Digital5,517$122669,344MS SQLNT4Jun-96

    Jun-966,185Compaq6,185$111683,514SybaseSCO4Jun-96

    Jun-963,810DG3,810$129490,181SybaseDG/UX2Jun-96

    Jul-9614,177Digital14,177$1992,812,287SybaseDigitalUNIX10Jul-96

    Jul-965,740Digital5,740$117671,204MS SQLNT4Jul-96

    Jul-966,253Unisys6,253$3041,899,743OracleUnixWare10Jul-96

    Jul-961,691Digital1,691$159267,586SybaseDigitalUNIX1Jul-96

    Aug-966,662Sun6,662$1521,013,031DB2Solaris6Aug-96

    Sep-961,676Intergraph1,676$103171,496MS SQLNT1Sep-96

    Sep-967,561SNI7,561$3722,810,223InformixSNI Unix18Sep-96

    Sep-965,822HP5,822$148857,852SybaseHPUX2Sep-96

    Sep-965,774IBM5,774$1981,143,858SybaseAIX8Sep-96

    Sep-965,774IBM5,774$2031,169,995SybaseAIX8Sep-96

    Oct-968,311Compaq8,311$96792,738SybaseSCO4Oct-96

    Oct-966,843Compaq6,843$100681,754InformixNT4Oct-96

    Nov-966,713Digital6,713$66437,418MS SQLNT4Nov-96

    Nov-967,304Bull7,304$1961,429,252SybaseAIX8Nov-96

    Nov-961,333Sun1,333$164218,545SybaseSolaris1Nov-96

    Nov-963,107Sun3,107$116360,488DB2Solaris2Nov-96

    Dec-9614,286IBM14,286$2263,225,073OracleAIX8Dec-96

    Dec-9614,286IBM14,286$2293,270,909OracleAIX8Dec-96

    Dec-963904.00HP3904.00$110430,835MS SQLNT2Dec-96

    Dec-967,128Compaq7,128$80568,730MS SQLNT4Dec-96

    Dec-964,248Fujitsu4,248$81343,313MS SQLNT2Dec-96

    Dec-966,393Compaq6,393$109694,417OracleNT4Dec-96

    Dec-969,524SNI9,524$2972,833,151InformixSNI Unix22Dec-96

    Dec-966,680IBM6,680$88587,986OracleSolaris4Dec-96

    Jan-9718,439Sun18,439$1402,566,159SybaseSolaris20Jan-97

    Jan-9714,286Bull14,286$2363,357,571OracleAIX8Jan-97

    Jan-977,352HP7,352$80584,286MS SQLNT4Jan-97

    Feb-9714,227Digital14,227$2533,586,486OracleVMS8Feb-97

    Feb-9715,462Sun15,462$1352,077,487InformixSolaris14Feb-97

    Feb-974,040Compaq4,040$69278,513MS SQLNT2Feb-97

    Feb-973,961Intergraph3,961$64250,927MS SQLNT2Feb-97

    Feb-972,300Intergraph2,300$67152,748MS SQLNT1Feb-97

    Feb-977,063SNI7,063$69484,578MS SQLNT4Feb-97

    Feb-972,301SNI2,301$181417,575OracleSNI Unix1Feb-97

    Feb-976,768Digital6,768$119804,063SybaseDigitalUNIX2Feb-97

    Feb-977,521Compaq7,521$78584,205MS SQLNT4Feb-97

    Feb-972,503Compaq2,503$72179,396MS SQLNT1Feb-97

    Feb-9714,739HP14,739$1331,949,237SybaseHPUX4Feb-97

    Mar-977,693Dell7,693$43327,234MS SQLNT4Mar-97

    Mar-9723,144Sun23,144$1192,734,009OracleSolaris16Mar-97

    Mar-977,650Compaq7,650$83629,668SybaseNT4Mar-97

    Mar-977,407Unisys7,407$63464,052MS SQLNT4Mar-97

    Mar-977,573Amdahl7,573$79593,988MS SQLNT4Mar-97

    Apr-978,028HP8,028$73581,896MS SQLNT4Apr-97

    Apr-978,070Compaq8,070$58465,382MS SQLNT4Apr-97

    Apr-977,368NCR7,368$77560,276MS SQLNT4Apr-97

    Apr-976,044NCR6,044$81484,582MS SQLNT4Apr-97

    Apr-977,407ALR7,407$58427,949MS SQLNT4Apr-97

    Apr-977,308IBM7,308$100725,823SybaseAIX4Apr-97

    Apr-973,265Digital3,265$61198,873MS SQLNT1Apr-97

    Apr-9725,309SGI25,309$1403,519,012InformixIRIX28Apr-97

    Apr-974,865Compaq4,865$63304,046MS SQLNT2Apr-97

    Apr-979,029Compaq9,029$79705,818SybaseSCO4Apr-97

    May-979,165IBM9,165$98895,035SybaseAIX8May-97

    May-979,165IBM9,165$99905,767SybaseAIX8May-97

    May-978,142IBM8,142$95765,626SybaseAIX4May-97

    May-9710,350Digital10,350$1251,288,102SybaseDigitalUNIX4May-97

    May-975,008Compaq5,008$87432,736OracleNT2May-97

    Jun-979,116NCR9,116$86778,970MS SQLNT4Jun-97

    Jun-978,146Digital8,146$49396,521MS SQLNT4Jun-97

    Jun-972,605Compaq2,605$94244,154OracleNT1Jun-97

    Jun-9731,147Sun31,147$1093,391,878OracleSolaris24Jun-97

    Jul-9710,666Unisys10,666$54569,844MS SQLNT6Jul-97

    Jul-979,198HP9,198$50456,389MS SQLNT4Jul-97

    Jul-9710,666ALR10,666$49513,001MS SQLNT6Jul-97

    Jul-9711,503SNI11,503$1681,934,106InformixSNI Unix8Jul-97

    Jul-979,223Unisys9,223$53485,057MS SQLNT4Jul-97

    Trend linesBest

    Date(tpmC)OSDate(tpmC)OS

    Mar-95486AIXMar-95486AIXMar-99Mar-99

    May-952,660AIXMay-952,660AIXMay-99May-99

    May-951,563AIXOct-959,414DigitalUNIXMay-99Oct-99

    May-952,660AIXDec-9511,456DigitalUNIXMay-99Dec-99

    May-951,563AIXMar-9613,646DigitalUNIXMay-99Mar-00

    Jun-951,470AIXJul-9614,177DigitalUNIXJun-99Jul-00

    Jun-951,438AIXDec-9614,286AIXJun-99Dec-00

    Jun-951,438AIXJan-9718,439SolarisJun-99Jan-01

    Jul-95874SNI UnixMar-9723,144SolarisJul-99Mar-01

    Aug-951,416DG/UXJun-9731,147SolarisAug-99Jun-01

    6/23/9731,147

    9/15/9739,469

    10/3/9751,872

    2/13/9852,118

    2/18/9857,054

    Nov-9889,500

    Oct-952,455

    Jan-963,066

    Apr-963,641

    Jun-965,517

    Aug-966,843

    Dec-967,128

    Feb-977,521

    Apr-978,070

    Jun-979,116

    Oct-95735AIXJul-9710,666NTOct-99Oct-99

    Oct-959,414DigitalUNIX7/7/9710,666NTOct-99Jan-00

    Nov-956,314IRIX10/13/9711,056NTNov-99Apr-00

    Nov-953,921SNI Unix10/22/9711,327NTNov-99Jun-00

    Nov-952,023SVR411/6/9713,089NTNov-99Aug-00

    Dec-953,406DG/UX11/21/9712,030NTDec-99Dec-00

    Dec-9511,456DigitalUNIX12/1/9710,854NTDec-99Feb-01

    Dec-953,516SCO12/1/9714,501NTDec-99Mar-01

    Dec-953,226Solaris2/5/9813,391NTDec-99May-01

    Dec-9511,014DigitalUNIX2/5/9813,391NTDec-99Jul-01

    Jan-966,270SNI Unix3/2/9816,101

    Jan-961,333Solaris3/18/9814,144

    Jan-963,849SCO3/18/9816,216

    Jan-963,513AIX3/30/9816,257

    Feb-964,939HPUX4/9/9827,383

    Feb-964,886HPUX6/26/9818,127

    Mar-963,631AIX6/29/9817,700

    Mar-963,631AIX7/16/9818,154

    Mar-9613,646DigitalUNIX8/5/9818,323

    Apr-9611,466Solaris9/11/9817,716

    Apr-9611,466Solaris9/14/9818,893

    Apr-963,513AIX9/28/9818,529

    Jun-964,925AIX10/13/9819,242

    Jun-963,119AIX11/6/9820,563

    Jun-963,119AIX

    Jun-966,185SCO

    Jun-963,810DG/UX

    Jul-9614,177DigitalUNIX

    Jul-966,253UnixWare

    Jul-961,691DigitalUNIX

    Aug-966,662Solaris

    Sep-967,561SNI Unix

    Sep-965,822HPUX

    Sep-965,774AIX

    Sep-965,774AIX

    Oct-968,311SCO

    Nov-967,304AIX

    Nov-961,333Solaris

    Nov-963,107Solaris

    Dec-9614,286AIX

    Dec-9614,286AIX

    Dec-969,524SNI Unix

    Dec-966,680Solaris

    Jan-9718,439Solaris

    Jan-9714,286AIX

    Feb-9715,462Solaris

    Feb-972,301SNI Unix

    Feb-976,768DigitalUNIX

    Feb-9714,739HPUX

    Mar-9723,144Solaris

    Apr-977,308AIX

    Apr-9725,309IRIX

    Apr-979,029SCO

    May-979,165AIX

    May-979,165AIX

    May-978,142AIX

    May-9710,350DigitalUNIX

    Jun-9731,147Solaris

    Jul-9711,503SNI Unix

    Oct-952,455NT

    Jan-963,066NT

    Mar-961,084NT

    Mar-961,880NT

    Mar-963,112NT

    Apr-963,641NT

    Jun-965,517NT

    Jul-965,740NT

    Sep-961,676NT

    Oct-966,843NT

    Nov-966,713NT

    Dec-963904.00NT

    Dec-967,128NT

    Dec-964,248NT

    Dec-966,393NT

    Jan-977,352NT

    Feb-974,040NT

    Feb-973,961NT

    Feb-972,300NT

    Feb-977,063NT

    Feb-977,521NT

    Feb-972,503NT

    Mar-977,693NT

    Mar-977,650NT

    Mar-977,407NT

    Mar-977,573NT

    Apr-978,028NT

    Apr-978,070NT

    Apr-977,368NT

    Apr-976,044NT

    Apr-977,407NT

    Apr-973,265NT

    Apr-974,865NT

    May-975,008NT

    Jun-979,116NT

    Jun-978,146NT

    Jun-972,605NT

    Jul-9710,666NT

    Jul-979,198NT

    Jul-9710,666NT

    Jul-979,223NT

    &CTPC RESULTS AS OF JULY 25, 1997

    Scaleup vs time graphs

    485.88

    2660.03

    1562.93

    2660.03

    1562.93

    1470.06

    1438.04

    1438.04

    874.13

    1416.33

    2454.97

    735.27

    9414.06

    6313.78

    3921.17

    2023.23

    3406.21

    11456.13

    3516.27

    3225.5

    11014.1

    6269.67

    3066.07

    1332.5

    3849.17

    3512.97

    4939.11

    4886.07

    1083.9

    3631.47

    3631.47

    1879.8

    13646.17

    3112.43

    3641.17

    11465.93

    11465.93

    3512.97

    4925.02

    3119.16

    3119.16

    5517

    6184.9

    3809.7

    14176.61

    5740

    6253.32

    1691.04

    6662.47

    1675.53

    7560.93

    5822.33

    5774.07

    5774.07

    8311.43

    6842.7

    6712.53

    7303.67

    1332.5

    3107.17

    14285.87

    14285.87

    0

    7128.2

    4247.6

    6393.2

    9524.47

    6679.5

    18438.7

    14285.87

    7351.5

    14227.25

    15461.87

    4039.83

    3961

    2300.03

    7063.07

    2301.38

    6767.8

    7521.13

    2502.5

    14739.03

    7693.03

    23143.65

    7650.37

    7407.05

    7573

    8028

    8070

    7368

    6043.93

    7407.05

    7308.1

    3264.86

    25309.2

    4864.97

    9028.67

    9165.13

    9165.13

    8142.4

    10350.16

    5008.47

    9116

    8145.6

    2604.77

    31147.04

    10665.53

    9198.37

    10665.53

    11503.03

    9223.43

    tpmC

    tpmC vs Time

    485.882454.97

    2660.033066.07

    1562.931083.9

    2660.031879.8

    1562.933112.43

    1470.063641.17

    1438.045517

    1438.045740

    874.131675.53

    1416.336842.7

    735.276712.53

    9414.060

    6313.787128.2

    3921.174247.6

    2023.236393.2

    3406.217351.5

    11456.134039.83

    3516.273961

    3225.52300.03

    11014.17063.07

    6269.677521.13

    1332.52502.5

    3849.177693.03

    3512.977650.37

    4939.117407.05

    4886.077573

    3631.478028

    3631.478070

    13646.177368

    11465.936043.93

    11465.937407.05

    3512.973264.86

    4925.024864.97

    3119.165008.47

    3119.169116

    6184.98145.6

    3809.72604.77

    14176.6110665.53

    6253.329198.37

    1691.0410665.53

    6662.479223.43

    7560.93

    5822.33

    5774.07

    5774.07

    8311.43

    7303.67

    1332.5

    3107.17

    14285.87

    14285.87

    9524.47

    6679.5

    18438.7

    14285.87

    15461.87

    2301.38

    6767.8

    14739.03

    23143.65

    7308.1

    25309.2

    9028.67

    9165.13

    9165.13

    8142.4

    10350.16

    31147.04

    11503.03

    h

    h

    Unix

    NT

    tpmC

    tpmC vs Time

    485.882454.97485.882454.97

    2660.033066.072660.033066.07

    1562.931083.99414.063641.17

    2660.031879.811456.135517

    1562.933112.4313646.176843

    1470.063641.1714176.617128.2

    1438.04551714285.877521.13

    1438.04574018438.78070

    874.131675.5323143.659116

    1416.336842.731147.0410665.53

    735.276712.53

    9414.060

    6313.787128.2

    3921.174247.6

    2023.236393.2

    3406.217351.5

    11456.134039.83

    3516.273961

    3225.52300.03

    11014.17063.07

    6269.677521.13

    1332.52502.5

    3849.177693.03

    3512.977650.37

    4939.117407.05

    4886.077573

    3631.478028

    3631.478070

    13646.177368

    11465.936043.93

    11465.937407.05

    3512.973264.86

    4925.024864.97

    3119.165008.47

    3119.169116

    6184.98145.6

    3809.72604.77

    14176.6110665.53

    6253.329198.37

    1691.0410665.53

    6662.479223.43

    7560.93

    5822.33

    5774.07

    5774.07

    8311.43

    7303.67

    1332.5

    3107.17

    14285.87

    14285.87

    9524.47

    6679.5

    18438.7

    14285.87

    15461.87

    2301.38

    6767.8

    14739.03

    23143.65

    7308.1

    25309.2

    9028.67

    9165.13

    9165.13

    8142.4

    10350.16

    31147.04

    11503.03

    h

    Unix

    NT

    tpmC

    tpmC vs Time

    Chart5

    2454.97485.88

    3066.072660.03

    3641.179414.06

    551711456.13

    684313646.17

    7128.214176.61

    7521.1314285.87

    807018438.7

    911623143.65

    10665.5331147.04

    10665.5331147.04

    11055.739469.47

    11327.4751871.62

    13089.352117.8

    12030.4757053.8

    10854.2489000

    14501

    13391.13

    13391.13

    16101.27

    14144.27

    16216.1

    16257.2

    27383.4

    18127.4

    17700.43

    18154

    18322.67

    17715.9

    18893.43

    18528.97

    19241.66

    20500

    h

    Unix

    NT

    tpmC

    tpmC vs Time

    Scaleup vs time graphs

    NEW RESULTS OR PRICE CHANGES

    SUBMITTED JULY 21-25, 1997

    Date(tpmC)Company(tpmC)$/tpmCTotal .Cost ($)DBOScpusDate

    Mar-95486IBM486$654317,781SybaseAIX134770

    May-952,660Bull2,660$5301,409,965InformixAIX8May-95

    May-951,563Bull1,563$549858,266InformixAIX4May-95

    May-952,660Bull2,660$5601,490,086InformixAIX8May-95

    May-951,563Bull1,563$584912,331InformixAIX4May-95

    Jun-951,470IBM1,470$666979,231DB2AIX1Jun-95

    Jun-951,438IBM1,438$492707,470DB2AIX4Jun-95

    Jun-951,438IBM1,438$510733,487DB2AIX4Jun-95

    Jul-95874SNI874$364318,441InformixSNI Unix1Jul-95

    Aug-951,416DG1,416$656928,744InformixDG/UX8Aug-95

    Oct-952,455Compaq2,455$242593,216MS SQLNT4Oct-95

    Oct-95735IBM735$378278,029SybaseAIX1Oct-95

    Oct-959,414Digital9,414$3162,972,726OracleDigitalUNIX8Oct-95

    Nov-956,314Tandem6,314$4933,115,351InformixIRIX16Nov-95

    Nov-953,921SNI3,921$4951,939,674InformixSNI Unix8Nov-95

    Nov-952,023Unisys2,023$463937,366InformixSVR45Nov-95

    Dec-953,406DG3,406$240816,031OracleDG/UX7Dec-95

    Dec-9511,456Digital11,456$2863,274,110OracleDigitalUNIX8Dec-95

    Dec-953,516Compaq3,516$186651,647OracleSCO4Dec-95

    Dec-953,226Compaq3,226$207665,806OracleSolaris4Dec-95

    Dec-9511,014Sybase11,014$2222,445,319SybaseDigitalUNIX10Dec-95

    Jan-966,270SNI6,270$4732,963,608InformixSNI Unix16Jan-96

    Jan-963,066Compaq3,066$198606,539OracleNT4Jan-96

    Jan-961,333Sun1,333$208276,559SybaseSolaris1Jan-96

    Jan-963,849Compaq3,849$161619,445OracleSCO4Jan-96

    Jan-963,513Bull3,513$270946,649OracleAIX8Jan-96

    Feb-964,939HP4,939$2321,144,200OracleHPUX4Feb-96

    Feb-964,886HP4,886$2601,272,020OracleHPUX4Feb-96

    Mar-961,084Compaq1,084$197212,920MS SQLNT1Mar-96

    Mar-963,631IBM3,631$2891,049,656OracleAIX8Mar-96

    Mar-963,631IBM3,631$2961,075,443OracleAIX8Mar-96

    Mar-961,880IBM1,880$168315,490DB2NT4Mar-96

    Mar-9613,646Digital13,646$2773,778,989InformixDigitalUNIX10Mar-96

    Mar-963,112Compaq3,112$152470,198SybaseNT4Mar-96

    Apr-963,641Compaq3,641$148537,508MS SQLNT4Apr-96

    Apr-9611,466Sun11,466$1902,174,979SybaseSolaris12Apr-96

    Apr-9611,466Sun11,466$1882,152,254SybaseSolaris12Apr-96

    Apr-963,513Motorola3,513$274960,792OracleAIX8Apr-96

    Jun-964,925Bull4,925$2311,134,364OracleAIX8Jun-96

    Jun-963,119IBM3,119$237740,627DB2AIX8Jun-96

    Jun-963,119IBM3,119$242756,018DB2AIX8Jun-96

    Jun-965,517Digital5,517$122669,344MS SQLNT4Jun-96

    Jun-966,185Compaq6,185$111683,514SybaseSCO4Jun-96

    Jun-963,810DG3,810$129490,181SybaseDG/UX2Jun-96

    Jul-9614,177Digital14,177$1992,812,287SybaseDigitalUNIX10Jul-96

    Jul-965,740Digital5,740$117671,204MS SQLNT4Jul-96

    Jul-966,253Unisys6,253$3041,899,743OracleUnixWare10Jul-96

    Jul-961,691Digital1,691$159267,586SybaseDigitalUNIX1Jul-96

    Aug-966,662Sun6,662$1521,013,031DB2Solaris6Aug-96

    Sep-961,676Intergraph1,676$103171,496MS SQLNT1Sep-96

    Sep-967,561SNI7,561$3722,810,223InformixSNI Unix18Sep-96

    Sep-965,822HP5,822$148857,852SybaseHPUX2Sep-96

    Sep-965,774IBM5,774$1981,143,858SybaseAIX8Sep-96

    Sep-965,774IBM5,774$2031,169,995SybaseAIX8Sep-96

    Oct-968,311Compaq8,311$96792,738SybaseSCO4Oct-96

    Oct-966,843Compaq6,843$100681,754InformixNT4Oct-96

    Nov-966,713Digital6,713$66437,418MS SQLNT4Nov-96

    Nov-967,304Bull7,304$1961,429,252SybaseAIX8Nov-96

    Nov-961,333Sun1,333$164218,545SybaseSolaris1Nov-96

    Nov-963,107Sun3,107$116360,488DB2Solaris2Nov-96

    Dec-9614,286IBM14,286$2263,225,073OracleAIX8Dec-96

    Dec-9614,286IBM14,286$2293,270,909OracleAIX8Dec-96

    Dec-963904.00HP3904.00$110430,835MS SQLNT2Dec-96

    Dec-967,128Compaq7,128$80568,730MS SQLNT4Dec-96

    Dec-964,248Fujitsu4,248$81343,313MS SQLNT2Dec-96

    Dec-966,393Compaq6,393$109694,417OracleNT4Dec-96

    Dec-969,524SNI9,524$2972,833,151InformixSNI Unix22Dec-96

    Dec-966,680IBM6,680$88587,986OracleSolaris4Dec-96

    Jan-9718,439Sun18,439$1402,566,159SybaseSolaris20Jan-97

    Jan-9714,286Bull14,286$2363,357,571OracleAIX8Jan-97

    Jan-977,352HP7,352$80584,286MS SQLNT4Jan-97

    Feb-9714,227Digital14,227$2533,586,486OracleVMS8Feb-97

    Feb-9715,462Sun15,462$1352,077,487InformixSolaris14Feb-97

    Feb-974,040Compaq4,040$69278,513MS SQLNT2Feb-97

    Feb-973,961Intergraph3,961$64250,927MS SQLNT2Feb-97

    Feb-972,300Intergraph2,300$67152,748MS SQLNT1Feb-97

    Feb-977,063SNI7,063$69484,578MS SQLNT4Feb-97

    Feb-972,301SNI2,301$181417,575OracleSNI Unix1Feb-97

    Feb-976,768Digital6,768$119804,063SybaseDigitalUNIX2Feb-97

    Feb-977,521Compaq7,521$78584,205MS SQLNT4Feb-97

    Feb-972,503Compaq2,503$72179,396MS SQLNT1Feb-97

    Feb-9714,739HP14,739$1331,949,237SybaseHPUX4Feb-97

    Mar-977,693Dell7,693$43327,234MS SQLNT4Mar-97

    Mar-9723,144Sun23,144$1192,734,009OracleSolaris16Mar-97

    Mar-977,650Compaq7,650$83629,668SybaseNT4Mar-97

    Mar-977,407Unisys7,407$63464,052MS SQLNT4Mar-97

    Mar-977,573Amdahl7,573$79593,988MS SQLNT4Mar-97

    Apr-978,028HP8,028$73581,896MS SQLNT4Apr-97

    Apr-978,070Compaq8,070$58465,382MS SQLNT4Apr-97

    Apr-977,368NCR7,368$77560,276MS SQLNT4Apr-97

    Apr-976,044NCR6,044$81484,582MS SQLNT4Apr-97

    Apr-977,407ALR7,407$58427,949MS SQLNT4Apr-97

    Apr-977,308IBM7,308$100725,823SybaseAIX4Apr-97

    Apr-973,265Digital3,265$61198,873MS SQLNT1Apr-97

    Apr-9725,309SGI25,309$1403,519,012InformixIRIX28Apr-97

    Apr-974,865Compaq4,865$63304,046MS SQLNT2Apr-97

    Apr-979,029Compaq9,029$79705,818SybaseSCO4Apr-97

    May-979,165IBM9,165$98895,035SybaseAIX8May-97

    May-979,165IBM9,165$99905,767SybaseAIX8May-97

    May-978,142IBM8,142$95765,626SybaseAIX4May-97

    May-9710,350Digital10,350$1251,288,102SybaseDigitalUNIX4May-97

    May-975,008Compaq5,008$87432,736OracleNT2May-97

    Jun-979,116NCR9,116$86778,970MS SQLNT4Jun-97

    Jun-978,146Digital8,146$49396,521MS SQLNT4Jun-97

    Jun-972,605Compaq2,605$94244,154OracleNT1Jun-97

    Jun-9731,147Sun31,147$1093,391,878OracleSolaris24Jun-97

    Jul-9710,666Unisys10,666$54569,844MS SQLNT6Jul-97

    Jul-979,198HP9,198$50456,389MS SQLNT4Jul-97

    Jul-9710,666ALR10,666$49513,001MS SQLNT6Jul-97

    Jul-9711,503SNI11,503$1681,934,106InformixSNI Unix8Jul-97

    Jul-979,223Unisys9,223$53485,057MS SQLNT4Jul-97

    Trend linesBest

    Date(tpmC)OSDate(tpmC)OS

    Mar-95486AIXMar-95486AIXMar-99Mar-99

    May-952,660AIXMay-952,660AIXMay-99May-99

    May-951,563AIXOct-959,414DigitalUNIXMay-99Oct-99

    May-952,660AIXDec-9511,456DigitalUNIXMay-99Dec-99

    May-951,563AIXMar-9613,646DigitalUNIXMay-99Mar-00

    Jun-951,470AIXJul-9614,177DigitalUNIXJun-99Jul-00

    Jun-951,438AIXDec-9614,286AIXJun-99Dec-00

    Jun-951,438AIXJan-9718,439SolarisJun-99Jan-01

    Jul-95874SNI UnixMar-9723,144SolarisJul-99Mar-01

    Aug-951,416DG/UXJun-9731,147SolarisAug-99Jun-01

    6/23/9731,147

    9/15/9739,469

    10/3/9751,872

    2/13/9852,118

    2/18/9857,054

    Nov-9889,000

    Oct-952,455

    Jan-963,066

    Apr-963,641

    Jun-965,517

    Aug-966,843

    Dec-967,128

    Feb-977,521

    Apr-978,070

    Jun-979,116

    Oct-95735AIXJul-9710,666NTOct-99Oct-99

    Oct-959,414DigitalUNIX7/7/9710,666NTOct-99Jan-00

    Nov-956,314IRIX10/13/9711,056NTNov-99Apr-00

    Nov-953,921SNI Unix10/22/9711,327NTNov-99Jun-00

    Nov-952,023SVR411/6/9713,089NTNov-99Aug-00

    Dec-953,406DG/UX11/21/9712,030NTDec-99Dec-00

    Dec-9511,456DigitalUNIX12/1/9710,854NTDec-99Feb-01

    Dec-953,516SCO12/1/9714,501NTDec-99Mar-01

    Dec-953,226Solaris2/5/9813,391NTDec-99May-01

    Dec-9511,014DigitalUNIX2/5/9813,391NTDec-99Jul-01

    Jan-966,270SNI Unix3/2/9816,101

    Jan-961,333Solaris3/18/9814,144

    Jan-963,849SCO3/18/9816,216

    Jan-963,513AIX3/30/9816,257

    Feb-964,939HPUX4/9/9827,383

    Feb-964,886HPUX6/26/9818,127

    Mar-963,631AIX6/29/9817,700

    Mar-963,631AIX7/16/9818,154

    Mar-9613,646DigitalUNIX8/5/9818,323

    Apr-9611,466Solaris9/11/9817,716

    Apr-9611,466Solaris9/14/9818,893

    Apr-963,513AIX9/28/9818,529

    Jun-964,925AIX10/13/9819,242

    Jun-963,119AIX11/6/9820,500

    Jun-963,119AIX

    Jun-966,185SCO

    Jun-963,810DG/UX

    Jul-9614,177DigitalUNIX

    Jul-966,253UnixWare

    Jul-961,691DigitalUNIX

    Aug-966,662Solaris

    Sep-967,561SNI Unix

    Sep-965,822HPUX

    Sep-965,774AIX

    Sep-965,774AIX

    Oct-968,311SCO

    Nov-967,304AIX

    Nov-961,333Solaris

    Nov-963,107Solaris

    Dec-9614,286AIX

    Dec-9614,286AIX

    Dec-969,524SNI Unix

    Dec-966,680Solaris

    Jan-9718,439Solaris

    Jan-9714,286AIX

    Feb-9715,462Solaris

    Feb-972,301SNI Unix

    Feb-976,768DigitalUNIX

    Feb-9714,739HPUX

    Mar-9723,144Solaris

    Apr-977,308AIX

    Apr-9725,309IRIX

    Apr-979,029SCO

    May-979,165AIX

    May-979,165AIX

    May-978,142AIX

    May-9710,350DigitalUNIX

    Jun-9731,147Solaris

    Jul-9711,503SNI Unix

    Oct-952,455NT

    Jan-963,066NT

    Mar-961,084NT

    Mar-961,880NT

    Mar-963,112NT

    Apr-963,641NT

    Jun-965,517NT

    Jul-965,740NT

    Sep-961,676NT

    Oct-966,843NT

    Nov-966,713NT

    Dec-963904.00NT

    Dec-967,128NT

    Dec-964,248NT

    Dec-966,393NT

    Jan-977,352NT

    Feb-974,040NT

    Feb-973,961NT

    Feb-972,300NT

    Feb-977,063NT

    Feb-977,521NT

    Feb-972,503NT

    Mar-977,693NT

    Mar-977,650NT

    Mar-977,407NT

    Mar-977,573NT

    Apr-978,028NT

    Apr-978,070NT

    Apr-977,368NT

    Apr-976,044NT

    Apr-977,407NT

    Apr-973,265NT

    Apr-974,865NT

    May-975,008NT

    Jun-979,116NT

    Jun-978,146NT

    Jun-972,605NT

    Jul-9710,666NT

    Jul-979,198NT

    Jul-9710,666NT

    Jul-979,223NT

    &CTPC RESULTS AS OF JULY 25, 1997

    Scaleup vs time graphs

    485.88

    2660.03

    1562.93

    2660.03

    1562.93

    1470.06

    1438.04

    1438.04

    874.13

    1416.33

    2454.97

    735.27

    9414.06

    6313.78

    3921.17

    2023.23

    3406.21

    11456.13

    3516.27

    3225.5

    11014.1

    6269.67

    3066.07

    1332.5

    3849.17

    3512.97

    4939.11

    4886.07

    1083.9

    3631.47

    3631.47

    1879.8

    13646.17

    3112.43

    3641.17

    11465.93

    11465.93

    3512.97

    4925.02

    3119.16

    3119.16

    5517

    6184.9

    3809.7

    14176.61

    5740

    6253.32

    1691.04

    6662.47

    1675.53

    7560.93

    5822.33

    5774.07

    5774.07

    8311.43

    6842.7

    6712.53

    7303.67

    1332.5

    3107.17

    14285.87

    14285.87

    0

    7128.2

    4247.6

    6393.2

    9524.47

    6679.5

    18438.7

    14285.87

    7351.5

    14227.25

    15461.87

    4039.83

    3961

    2300.03

    7063.07

    2301.38

    6767.8

    7521.13

    2502.5

    14739.03

    7693.03

    23143.65

    7650.37

    7407.05

    7573

    8028

    8070

    7368

    6043.93

    7407.05

    7308.1

    3264.86

    25309.2

    4864.97

    9028.67

    9165.13

    9165.13

    8142.4

    10350.16

    5008.47

    9116

    8145.6

    2604.77

    31147.04

    10665.53

    9198.37

    10665.53

    11503.03

    9223.43

    tpmC

    tpmC vs Time

    485.882454.97

    2660.033066.07

    1562.931083.9

    2660.031879.8

    1562.933112.43

    1470.063641.17

    1438.045517

    1438.045740

    874.131675.53

    1416.336842.7

    735.276712.53

    9414.060

    6313.787128.2

    3921.174247.6

    2023.236393.2

    3406.217351.5

    11456.134039.83

    3516.273961

    3225.52300.03

    11014.17063.07

    6269.677521.13

    1332.52502.5

    3849.177693.03

    3512.977650.37

    4939.117407.05

    4886.077573

    3631.478028

    3631.478070

    13646.177368

    11465.936043.93

    11465.937407.05

    3512.973264.86

    4925.024864.97

    3119.165008.47

    3119.169116

    6184.98145.6

    3809.72604.77

    14176.6110665.53

    6253.329198.37

    1691.0410665.53

    6662.479223.43

    7560.93

    5822.33

    5774.07

    5774.07

    8311.43

    7303.67

    1332.5

    3107.17

    14285.87

    14285.87

    9524.47

    6679.5

    18438.7

    14285.87

    15461.87

    2301.38

    6767.8

    14739.03

    23143.65

    7308.1

    25309.2

    9028.67

    9165.13

    9165.13

    8142.4

    10350.16

    31147.04

    11503.03

    h

    h

    Unix

    NT

    tpmC

    tpmC vs Time

    485.882454.97485.882454.97

    2660.033066.072660.033066.07

    1562.931083.99414.063641.17

    2660.031879.811456.135517

    1562.933112.4313646.176843

    1470.063641.1714176.617128.2

    1438.04551714285.877521.13

    1438.04574018438.78070

    874.131675.5323143.659116

    1416.336842.731147.0410665.53

    735.276712.53

    9414.060

    6313.787128.2

    3921.174247.6

    2023.236393.2

    3406.217351.5

    11456.134039.83

    3516.273961

    3225.52300.03

    11014.17063.07

    6269.677521.13

    1332.52502.5

    3849.177693.03

    3512.977650.37

    4939.117407.05

    4886.077573

    3631.478028

    3631.478070

    13646.177368

    11465.936043.93

    11465.937407.05

    3512.973264.86

    4925.024864.97

    3119.165008.47

    3119.169116

    6184.98145.6

    3809.72604.77

    14176.6110665.53

    6253.329198.37

    1691.0410665.53

    6662.479223.43

    7560.93

    5822.33

    5774.07

    5774.07

    8311.43

    7303.67

    1332.5

    3107.17

    14285.87

    14285.87

    9524.47

    6679.5

    18438.7

    14285.87

    15461.87

    2301.38

    6767.8

    14739.03

    23143.65

    7308.1

    25309.2

    9028.67

    9165.13

    9165.13

    8142.4

    10350.16

    31147.04

    11503.03

    h

    Unix

    NT

    tpmC

    tpmC vs Time

  • Bottleneck AnalysisDrawn to linear scaleTheoreticalBus Bandwidth422MBps = 66 Mhz x 64 bitsMemory Read/Write~150 MBpsMemCopy~50 MBpsDisk R/W~9MBps

  • Bottleneck AnalysisNTFS Read/Write 18 Ultra 3 SCSI on 4 strings (2x4 and 2x5) 3 PCI 64 ~ 155 MBps Unbuffered read (175 raw)~ 95 MBps Unbuffered writeGood, but 10x down from our UNIX brethren (SGI, SUN)

    155 MBps

  • PennySortHardware266 Mhz Intel PPro64 MB SDRAM (10ns)Dual Fujitsu DMA 3.2GB EIDE SoftwareNT workstation 4.3NT 5 sortPerformancesort 15 M 100-byte records (~1.5 GB)Disk to diskelapsed time 820 sec cpu time = 404 sec

    Chart3

    351

    144

    94

    278

    72

    99

    69

    PennySort Machine (1107$ )

    Sheet1

    JamesPTNDeltaPriceWatch

    1System Assembly2590

    1ASUS P2L97 Mother Board145

    1Intel P2-266360495

    164MB SDRAM133

    1CPU FAN764570964

    1Mini Tower Case w/235W Power Supply436017

    1Mitsumi 24X CD ROM DRIVE5773

    2QUANTUM 2160A 2.1GB U/ATA 10ms 128k 5400rpm270290

    1INTEL 8465 Etherexpress PCI Pro/10048557

    1Triton PCI video card23

    1Mouse PS25

    1shipping - UPS Ground - ~$30, Air ~90$90133

    1206

    extras200

    Base price1006real diff88

    1System Assembly w/one Year Warranty9LAB-ASSE-01-0389.9589.9590

    1Barebone (P2L97+P2-266+64MB SDRAM+FAN) - 1 Year WarrantyBARE-PARA-P2-10709.95709.95590

    1ENLIGHT 6552 Mini Tower Case w/200W Power SupplyCASE-ENLI-MI-0259.9559.9560

    1SONY 24X CD ROM DRIVERCDRM-SONY-24-0172.9572.95-

    2QUANTUM 2160A 2.1GB U/ATA 10ms 128k 5400rpmHDEI-QUAN-21-08144.95289.9

    1INTEL 8460 Etherexpress PCI Pro/100 (OEM)NETW-INTE-86-0154.9554.9555

    1shippingFedX 1 day133133

    1410.65

    System I bought1436

    shipping105

    CD72

    Ethernet55

    1204

    1Assembly25

    1Barebone (P2L97+P2-266+FAN) - 1 Year Warranty495

    164MB SDRAM (10ns)94

    1Mini Tower Case w/235W Power Supply & fan47

    1floppy drive18

    2Fujitsu MPS3032UA 3.1 GB U/ATA 10ms 128k 5400rpm278

    1INTEL 8465 Etherexpress PCI Pro/10048

    1Virage 3D w/2MB EDO33

    1NT Workstation69

    1107

    cpu351

    board144

    Memory94

    Disk278

    Cabinet + Assembly72

    Network, Video, floppy99

    Software69

    1107

    days in 3 years1095

    seconds/day86400

    seconds/3 years94608000

    PennySort Machine cost1107

    seconds/penny on Pennysort855

    Sheet1

    PennySort Machine (1107$ )

    Sheet2

  • Sandia/Compaq/ServerNet/NT SortSort 1.1 Terabyte (13 Billion records) in 47 minutes68 nodes (dual 450 Mhz processors) 543 disks, 1.5 M$ 1.2 GBps network rap (2.8 GBps pap)5.2 GBps of disk rap (same as pap)(rap=real application performance, pap= peak advertised performance)

  • Progress on Sorting: NT now leads both price and performanceSpeedup comes from Moores law 40%/yearProcessor/Disk/Network arrays: 60%/year (this is a software speedup).

    Chart1

    166.666666666718292.6829268293

    277.7777777778

    38461.5384615385

    142857.142857143

    3125

    12048.1927710843

    17241.3793103448

    111111.111111111

    285714.285714286

    196078.431372549

    1000000

    1550000

    862068.965517241

    18292.6829268293

    35000000

    Ordinal+SGI

    Sort Records/second vs Time

    Bitton M68000

    Cray YMP

    IBM 3090

    Tandem

    Kitsuregawa Hardware Sorter

    Sequent

    Intel HyperCube

    IBM RS6000

    NOW

    Alpha

    PennyNTsort

    Sandia/Compaq/NT

    Sort Results

    yearMB/secGB/$secboxprice M$cpus

    19850.020.0536000M68000.031

    19860.030.0093600tandem0.33

    19873.850.05226Cray YMP71

    199114.290.5417IBM 30902.51

    19900.310.148320Kitsuregawa0.21

    19931.200.11483Sequent132

    19941.720.16358IPSC/Wisc132

    199411.115.2569Alpha0.21

    199528.572.7033.5SGI/Ordinal116

    199519.6137.1015.1IBM0.051

    1996100.0015.76860NOW0.632

    1997155.007.33260Now 1002100

    199786.216.27458SGI/Ordinal1.314

    19981.83144.220820NTsort0.00121

    1998391.00238.0002814Sandia/CompaqNT Sort1.4968

    seconds in 3 years94608000

    SortSpeedup

    yearrec/secsecboxprice M$Processors$/sGB/sGB/$

    19851.7E+026000M68000.0313.17E-041.7E-055.3E-02

    19862.8E+023600tandem0.333.17E-032.8E-058.8E-03

    19873.8E+0426Cray ymp717.40E-023.8E-035.2E-02

    19911.4E+057IBM 30902.512.64E-021.4E-025.4E-01

    19903.1E+03320Kitsuregawa0.212.11E-033.1E-041.5E-01

    19931.2E+0483Sequent1321.06E-021.2E-031.1E-01

    19941.7E+0458IPSC1321.06E-021.7E-031.6E-01

    19941.1E+059Alpha0.212.11E-031.1E-025.3E+00

    19952.9E+053.5SGI3.0E+061161.06E-022.9E-022.7E+00

    19952.0E+055.1IBM0.051Ramesh Agrawal5.28E-042.0E-023.7E+01

    19961.00E+0660NOW0.6326.34E-031.0E-011.6E+01

    19971.55E+0660Now 10021002.11E-021.6E-017.3E+00

    19979.E+0558Ordinal1.3141.37E-028.6E-026.3E+00

    1998.21.83E+04820NTsort0.001211.27E-051.8E-031.4E+02

    1998.93.50E+072814Sandia/Compaq/NT1.49681.57E-020.3912.5E+011.099Tb /2184 sec 8 byte key, 80 byte recs333MBps

    sec/3 years94608000

    &F

    Page &P

    SortSpeedup

    &F

    Page &P

    Ordinal+SGI

    Sort Records/second vs Time

    Bitton M68000

    Cray YMP

    IBM 3090

    Tandem

    Kitsuregawa Hardware Sorter

    Sequent

    Intel HyperCube

    IBM RS6000

    NOW

    Alpha

    PennyNTsort

    Sandia/Compaq/NT

    BellPrize

    &A

    Page &P

    Records Sorted per SecondDoubles Every Year

    GB Sorted per DollarDoubles Every Year

    Sandia/Compaq/NT

    NT/PennySort

    Speed

    2/87 0.45 800 0.03

    2/88 1.0 1,000 0.05

    2/89 6.0 11,000 0.5

    2/9014153

    1991-1-1

    11/92-2-1-1

    11/9364 507.5(3) 1.8 ($22M)

    11/94140230

    11/9518050

    11/96330(3)144

    Peak Gf/sPrice K$Gf/s/$MGf/s/$M

    1987.160.458000.030.02

    1988.1611,0000.050.03

    1989.16611,0000.50.20

    1990.16141531.30.47

    199130-1.00

    1992.950-1.67

    1993.964507.52.13

    1994.91402302.64.67

    1995.9180503.66.00

    1996.93301446.311.00

    1997.9600401512.00

    1998.913006021.666666666722

    000

    000

    000

    000

    000

    000

    000

    000

    000

    000

    000

    000

    &A

    Page &P

    Peak Gf/s

    Gf/s/$M

    Gf/s/$M

    Chart2

    277.77777777780.0525618292.6829268293

    38461.53846153850.00876

    142857.1428571430.0519824176

    31250.5406171429

    12048.19277108430.147825

    17241.37931034480.1139855422

    111111.1111111110.1631172414

    285714.2857142865.256

    196078.4313725492.7030857143

    100000037.1011764706

    155000015.768

    862068.9655172417.33212

    18292.68292682936.2737400531

    35000000144.2195121951

    1998.924.8266630872

    Records Sorted per SecondDoubles Every Year

    GB Sorted per DollarDoubles Every Year

    Sandia/Compaq/NT

    NT/PennySort

    Speed

    Sort Results

    yearMB/secGB/$secboxprice M$cpus

    19850.020.0536000M68000.031

    19860.030.0093600tandem0.33

    19873.850.05226Cray YMP71

    199114.290.5417IBM 30902.51

    19900.310.148320Kitsuregawa0.21

    19931.200.11483Sequent132

    19941.720.16358IPSC/Wisc132

    199411.115.2569Alpha0.21

    199528.572.7033.5SGI/Ordinal116

    199519.6137.1015.1IBM0.051

    1996100.0015.76860NOW0.632

    1997155.007.33260Now 1002100

    199786.216.27458SGI/Ordinal1.314

    19981.83144.220820NTsort0.00121

    1998391.00238.0002814Sandia/CompaqNT Sort1.4968

    seconds in 3 years94608000

    SortSpeedup

    yearrec/secsecboxprice M$Processors$/sGB/sGB/$

    19851.7E+026000M68000.0313.17E-041.7E-055.3E-02

    19862.8E+023600tandem0.333.17E-032.8E-058.8E-03

    19873.8E+0426Cray ymp717.40E-023.8E-035.2E-02

    19911.4E+057IBM 30902.512.64E-021.4E-025.4E-01

    19903.1E+03320Kitsuregawa0.212.11E-033.1E-041.5E-01

    19931.2E+0483Sequent1321.06E-021.2E-031.1E-01

    19941.7E+0458IPSC1321.06E-021.7E-031.6E-01

    19941.1E+059Alpha0.212.11E-031.1E-025.3E+00

    19952.9E+053.5SGI3.0E+061161.06E-022.9E-022.7E+00

    19952.0E+055.1IBM0.051Ramesh Agrawal5.28E-042.0E-023.7E+01

    19961.00E+0660NOW0.6326.34E-031.0E-011.6E+01

    19971.55E+0660Now 10021002.11E-021.6E-017.3E+00

    19979.E+0558Ordinal1.3141.37E-028.6E-026.3E+00

    1998.21.83E+04820NTsort0.001211.27E-051.8E-031.4E+02

    1998.93.50E+072814Sandia/Compaq/NT1.49681.57E-020.3912.5E+011.099Tb /2184 sec 8 byte key, 80 byte recs333MBps

    sec/3 years94608000

    &F

    Page &P

    SortSpeedup

    &F

    Page &P

    Ordinal+SGI

    Sort Records/second vs Time

    Bitton M68000

    Cray YMP

    IBM 3090

    Tandem

    Kitsuregawa Hardware Sorter

    Sequent

    Intel HyperCube

    IBM RS6000

    NOW

    Alpha

    PennyNTsort

    Sandia/Compaq/NT

    BellPrize

    &A

    Page &P

    Records Sorted per SecondDoubles Every Year

    GB Sorted per DollarDoubles Every Year

    Sandia/Compaq/NT

    NT/PennySort

    Speed

    2/87 0.45 800 0.03

    2/88 1.0 1,000 0.05

    2/89 6.0 11,000 0.5

    2/9014153

    1991-1-1

    11/92-2-1-1

    11/9364 507.5(3) 1.8 ($22M)

    11/94140230

    11/9518050

    11/96330(3)144

    Peak Gf/sPrice K$Gf/s/$MGf/s/$M

    1987.160.458000.030.02

    1988.1611,0000.050.03

    1989.16611,0000.50.20

    1990.16141531.30.47

    199130-1.00

    1992.950-1.67

    1993.964507.52.13

    1994.91402302.64.67

    1995.9180503.66.00

    1996.93301446.311.00

    1997.9600401512.00

    1998.913006021.666666666722

    000

    000

    000

    000

    000

    000

    000

    000

    000

    000

    000

    000

    &A

    Page &P

    Peak Gf/s

    Gf/s/$M

    Gf/s/$M

  • The Microsoft TerraServer HardwareCompaq AlphaServer 84008x400Mhz Alpha cpus10 GB DRAM324 9.2 GB StorageWorks Disks3 TB raw, 2.4 TB of RAID5STK 9710 tape robot (4 TB)WindowsNT 4 EE, SQL Server 7.0

  • TerraServer: Lots of Web HitsA billion web hits!1 TB, largest SQL DB on the Web100 Qps average, 1,000 Qps peak877 M SQL queries so far

  • SQL 7 TerraServer AvailabilityOperating for 4 months: 3,133 hrsUnscheduled outage: 36.5 minutes: 99.98% scheduled upScheduled outage: 60 minutesAvailability: 99.95% overall upNo NT failures (ever)One SQL7 Beta2 bugNo failures in Aug, Oct

    Chart2

    0.02543981480.0416435185130.4842821759

    Up

    Unscheduled

    Scheduled

    up

    TotalTime (Hours)

    Sheet1

    date & timeoff lineon lineeventcause

    6/30/98 18:08startupcrashed in the middle of the night and nobody was thereTotal time

    6/30/98 18:190:11:43onAval

    7/1/98 18:3424:14:39stopset the database to Read-only to get more speed / stability

    7/1/98 18:38startup

    7/1/98 18:380:04:15on

    7/8/98 15:47165:08:40Shutdownre-set DB to Read / write.

    7/8/98 15:47startup

    7/8/98 15:50shutdown

    7/8/98 15:50startup

    7/8/98 15:500:03:05on

    7/30/98 16:55529:04:54terminatingData load Query hung, timeout errors

    7/30/98 17:25startupup3131:37:22

    7/30/98 17:27onUnscheduled0:36:38

    7/30/98 17:270:00:18stopScheduled0:59:58

    7/30/98 17:28on

    7/30/98 17:28startup

    7/30/98 17:280:32:29on

    7/31/98 7:53ShutdownData Load Query hung

    7/31/98 8:3315:04:18stop

    7/31/98 8:340:01:04startup

    7/31/98 8:34Startup

    9/9/98 3:15954:40:41Shutdown for upgrade

    9/9/98 3:590:44:00startup

    11/8/98 8:591445:00:28Still up

    Total Time1:36:363133:13:58

    % up time99.949%

    Unscheduled down0:36:38

    Unscheduled %99.9805%

    Sheet1

    Scheduled

    Un Scheduled

    Unscheduled

    Scheduled

    Down Time (Hours:minutes)

    130.4842821759

    Up

    Unscheduled

    Scheduled

    up

    TotalTime (Hours)

  • Backup / Restore

    Gazetteer

    TerraServer Gazetteer TablesGEO Gazetteer

    CountryNameStateNamePlaceNameAltPlaceGEO_EntityGEO_Name

    0CountryId I4StateId I4PlaceId I4AltNameId I40Lashed_YN bitNameId I4

    1UNCode C4CountryId I4ImgFlag I1AlternateName VC1281GeoId I4GeoId I4

    2CountryName VC128StateName VC128CountryId I4PlaceId I42DefCtxtId I4SortName vc128

    3CountrySGML VC255StateSGML VC255StateId I4ImgFlag I13SourceId I2SGMLName vc200

    WWFeatureId I4TypeId I44GECid I2LocaleId b2

    GazSrcId I4CountryId I45LanguageId b1LanguageId b1

    AltCountryAltStateTypeId I4StateId I46GeoRelevId I1RoleId I1

    0CountryId I4StateId I4Longitude D7.47DescName vc128PublisherId I2

    1ContinentId I4CountryId I4Latitude D7.48PublisherId I2Published SDT

    2WWFeatureId I4WWFeatureId I4Name VC1289Published SDTTimeStamp ts

    3GazSrcId I4GazSrcId I4SGMLName VC20010TimeStamp ts

    4Name VC128Name VC128ZGridId I4GazateerSource

    5AlternateName VC128AlternateName VC128DoqDate DTGazSrcId I40LKP_GeoEntityClassGEO_PointGeometry

    6SGMLName VC200SGMLName VC200SpinDate DTGazDesc VC2551GECidGeoId I4

    DegreeId I42GECParentId I2Lat float

    UGridId I43GeoValid_YN b1Long float

    Population I4DegreePopulation4POIValid_YN b1MOBBGrid I4

    CountryId I45Description vc60GPCid I2

    DegreeId I46Definition vc255PrimSrcId I2

    FeatureTypeWordWheelFeatureGECID_To_FeatureTypeUNCode2 C47Retired_YN bit 1

    0TypeId I4WWFeatureId I4WWFeatureId I4Population I4

    1Name VC255Name VC255TypeId I4Rate D8.4

    2

    Country are GECid =14,16,90,138,140,207

    States are GECid =22, 226

    Don't pick up Lashed_YN = 1

    TerraServer DB Tables

    ImgMetaThemeTileMetaThemeJumpImgNoImageDOQOrigMetaSpinOrigMeta

    0ImgMetaId I4TileMetaId I4ThemeThumbImgImgData imgOrigMetaId I4OrigMetaId I4

    1OrigMetaId I4ImgMetaId I4ThemeBrowseImgSrcId I4SrcId I4

    2SrcId I4OrigMetaId I4ImgMetaId I4MCGridGridX I4GridX I4

    3ImgTypeId I4SrcId I4ZGridId I4XMCGrid I4GridY I4GridY I4

    4XGridId I2ImgTypeId I4UGridId I4YMCGrid I4CutsWide I4CutsWide I4

    5YGridId I2XGridId I2SrcId I4SpinRowCount I4CutsHigh I4CutsHigh I4

    6ZGridId I4YGridId I2ImgTypeId I4SpinImgMb I4ImageWidth I4ImageWidth I4

    7UtmZone I2ZGridId I4EncryptKey I4USGSRowCount I4ImageHeight I4ImageHeight I4

    8XUtmId I2UtmZone I2ImgDate DTUSGSImgMbUpperLongitude D15.10UpperLongitude D15.10

    9YUtmId I2XUtmId I2ZTileGridId I4TotalRowCount I4UpperLatitude D15.10UpperLatitude D15.10

    10UGridId I4YUtmId I2FileName VC255TotaImgMb I4LowerLatitudeD15.10LowerLatitude D15.10

    11ThumbPixWidth I4UGridId I4ImgData ImgLowerLongitude D15.10LowerLongitude D15.10

    12ThumbPixHeight I4ImgStatus I2MSGridUpperGridLong D15.10UpperGridLong

    13BrowsePixWidth I4ImgDate DTThemeTileImg1XMCGrid I4UpperGridLat D15.10UpperGridLat

    14BrowsePixHeight I4CutRow I2TileMetaId I4YMCGrid I4XPixelsPerDegree I4XPixelsPerDegree

    15JumpPixWidth I4XTileGridId I2ZGridId I4SpinRowCount I4YPixelsPerDegree I4YPixelsPerDegree

    16JumpPixHeight I4YTileGridId I2UGridId I4SpinImgMb I4DiscardRowPixels I4DiscardRowPixels

    17ImgStatus I2ZTileGridId I2SrcId I4USGSRowCount I4DiscardColumnPixels I4DiscardColumnPixels

    18ImgDate DTTilePixWidth I4ImgTypeId I4USGSImgMbColorValue I4ColorValue

    19CutRow I2TilePixHeight I4EncryptKey I4TotalRowCount I4ColorPerCent I4ColorPerCent

    20CutCol I2EncryptKey I4ImgDate DTTotaImgMb I4InMetaname VC255InMetaname

    21MidLat D15.10MidLat D15.10TileZGridId I4InFilename VC255InFilename

    22MidLong D15.10MidLong D15.10FileName VC255ThemeJumpHitQuadName C38SunAngle D10.6

    23NWLat D15.10NWLat D15.10ImgData ImgImgMetaId I4Quadrant C2ShootingHeight D15.5

    24NWLong D15.10NWLong D15.10ImageHit I4DataSetName VC255PixelSize D6.4

    25NELat D15.10NELat D15.10SpinFrameMetaDataSetName2 VC255FrameNumber C60

    26NELong D15.10NELong D15.10ImgMetaId I4ThemeThumbHitCountry C10SpinImgDate DT

    27SWLat D15.10SWLat D15.10ZGridId I4ImgMetaId I4States C12SpinGMT C12

    28SWLong D15.10SWLong D15.10ImgStatus I2ImageHit I4Producer C24CameraSystem C24

    29SELat D15.10SELat D15.10ImgDate DTWestLongitude D15.10Copyright C80

    30SELong D15.10SELong D15.10PercentBlank I4ThemeBrowseHitEastLongitude D15.10

    31FrameId c10ImgMetaId I4NorthLatitude D15.10

    32FrameSection C2ImageHit I4SouthLatitude D15.10

    33FrameQuarter C2RasterOrder C24

    34ThemeTileHitNbrLines I4

    35TileMetaId I4NbrSamples I4

    36ImageHit I4BandContent C20

    37BandOrganization C12

    PrimaryHorizontalDatum I2

    CountryNameStateNamePlaceAltPlaceSecondaryHorizontalDatum I2

    0CountryId I4StateId I4PlaceId I4AltNameId I4CoordinateSystem C10

    1UNCode C4CountryId I4ImgFlag I1AlternateName VC128CoordinateZone I4

    2CountryName VC128StateName VC128CountryId I4PlaceId I4HorizontalUnits C20

    3CountrySGML VC200StateSGML VC200StateId I4ImgFlag I1HorizontalResolution D6.4

    WWFeatureId I4TypeId I4BitsPerPixel I2

    GazSrcId I4CountryId I4SW_Xprimary D24.15

    AltCountryAltStateTypeId I4StateIdSW_Yprimary D24.15

    0CountryId I4StateId I4Longitude D7.4NW_Xprimary D24.15

    1ContinentId I4CountryId I4Latitude D7.4NW_Yprimary D24.15

    2WWFeatureId I4WWFeatureId I4Name VC128NE_XPrimary D24.15

    3GazSrcId I4GazSrcId I4SGMLName VC200NE_Yprimary D24.15

    4Name VC128Name VC128ZGridId I4SE_Xprimary D24.15

    5AlternateName VC128AlternateName VC128DoqDate DTSE_Yprimary D24.15

    6SGMLName VC200SGMLName VC200SpinDate DTSW_Xsecondary D24.15

    DegreeId I4SW_Ysecondary D24.15

    GazateerSourceUGridId I4NW_Xsecondary D24.15

    GazSrcId I4Population I4NW_Ysecondary D24.15

    GazDesc VC255DegreePopulationNE_Xsecondary D24.15

    CountryId I4NE_Ysecondary D24.15

    FeatureTypeWordWheelFeatureGECID_To_FeatureTypeDegreeId I4SE_Xsecondary D24.15

    0TypeId I4WWFeatureId I4WWFeatureId I4UNCode2 C4SE_Ysecondary D24.15

    1Name VC255Name VC255TypeId I4Population I4XOriginPrimary D24.15

    2Rate D8.4YOriginPrimary D24.15

    XOriginSecondary D24.15

    GridSysImgSourceImgTypeImgCounterYOriginSecondary D24.15

    0GridSysId I4SrcId I4ImgTypeId I4LastImgMetaId I4RMSE_XY D24.15

    1ImgXVal I2ImgTypeId I4ImgFileExt C3LastOrigMetaId I4ProductionSystem C24

    2ImgYVal I2GridSysId I4ImgFileDesc VC255LastTileMetaId I4ProductionDate DT

    3TileXVal I2SrcName C10MimeStr VC255LastUpdated DTImageSource C24

    4TileYVal I2SrcTblName C10SourcePhotoId C24

    5MinX I2SrcDesc VC255SourcePhotoDate DT

    6MinY I2Compression C20

    7MaxX I2MetaDataDate DT

    8MaxY I2DataFileSize I4

    9GridDesc VC255HeaderByteCount I4

    StandardVersion C10

    Agency C60

    Log tables are not implementedSourceDEMDate DT

    0LogAccessLogCoordLogImgMetaIdLogPlace

    0LogImgCount I4LogCoordCount I4RemoteAddress C16RemoteAddress C16

    1RemoteAddress C16RemoteAddress C16SrcId I1PlaceName VC255

    2SrcId I4SrcId I4ImgSizeId I1PlaceType I4

    3ImgSizeId I1OriginType I1ImgMetaId I4PlaceState VC255

    4OriginType I1Longitude D15.10TileMetaId I4PlaceCountry VC255

    5MetaId I4Latitude D15.10CreateDate DTRowsFound I4

    6Direction I4HitFlag I1InsertTimeStamp DT

    7CreateTimeStamp DT

    8

    0Pick

    0Name VC255

    1Link VC255

    2Description VC255

    3PickDate DT

    4

    5

    0PlaceGridExternalLinkExternalSourceCountryName

    0ZGridId I4ZGridId I4ExternalSrcId I4CountryId I4

    1ZclosestGridId I4ExternalSrcIdDisplayFlag I4UNCode2 C4

    2Xdistance I4GraphicsSrcFile vc255Name VC255Name VC255

    3Ydistance I4GraphicsPixWidth I4BaseRef VC255

    4Direction I4GraphicsPixHeight I4GraphicsSrcFile vc255

    5BestTypeId I4AlternateSrc vc255GraphicsPixWidth I4

    6BestFeatId I4URLTemplate vc255GraphicsPixHeight I4

    7BestCountryId I4AlternateSrc vc255

    8BestStateId I4URLTemplate vc255

    9BestPlaceId I4

    10Float1 D14.3

    11Float2 D14.3

    12BestPlaceName vc255

    13

    14

    15

    &L&A&C&BMicrosoft Confidential&B&RPage &P

    &LTom Barclay&R&D

    Tom Barclay:In Terra-Server V1.0, there were a total of 31 ThemeTileImg tables (62 total). This was to increase the amount of parallel loading. Conceptually we would prefer to collapse this to 1 table. What are the issues if we do this?

    Tom Barclay:In Terra-Server V2.0, we are displaying images by date rather than by type. Therefore, we have one ImgMeta table containing records of all types. Alternatively, we could have another table containing all types pointing to this table.

    Tom Barclay:GraphicsSrcFile, GraphicsPixWidth, GraphicsPixHeight, AlternateSrc, and URLTemplate contain default information to be used if the related ExternalLink row contains null data for the same fields. The logic inside the application SP is:

    Note, this does mean that a vendor could send us a different graphics file for every link but one URLTemplate and vice-versa.

    T2B2 Indices

    TableIndexTypeFields

    ImgTypepkImgTypeUniqClusImgTypeId

    ImgSourcepkImgSourceUniqClusSrcId

    GridSyspkGridSysUniqClusGridSysId

    GazetteerSourcepkGazetteerSourceUniqClusGazSrcId

    AltCountryAkAltCountryUAAlternateName

    AltCountryAkAltCountryUCCountryId

    AltPlaceAkAltPlacePPlaceId

    AltPlaceAkAltPlaceFAIPImgFlagAlternateNameAltNameIdPlaceId

    AltPlaceAkAltPlaceFCAIPImgFlagCountryIdAlternateNameAltNameIdPlaceId

    AltPlaceAkAltPlaceFCSAIPImgFlagCountryIdStateIdAlternateNameAltNameIdPlaceId

    AltPlaceAkAltPlaceFTAIPImgFlagTypeIdAlternateNameAltNameIdPlaceIdPlaceId

    AltPlaceAkAltPlaceFTCAIPImgFlagTypeIdCountryIdAlternateNameAltNameIdPlaceId

    AltPlaceAkAltPlaceFTCSAIPImgFlagTypeIdCountryIdStateIdAlternateNameAltNameIdPlaceId

    AltPlaceAkAltPlaceIAltNameId

    CountryNamePkCountryNameCiClusCountryId

    CountryNameAkCountryNameCnCountryName

    AltStateAkAltStateUSiUniqClusStateId

    AltStateAkAltStateUAnAlternateName

    StateNamePkStateNameSiClusStateId

    StateNameAkStateNameSnStateName

    DegreePopulationpkDegreePopulationUniqClusDegreeIdCountryId

    DoqJumpHitpkDoqJumpHitUniqueImgMetaId

    SpinJumpHitpkSpinJumpHitUniqueImgMetaId

    DoqThumbHitpkDoqThumbHitUniqueImgMetaId

    SpinThumbHitpkSpinThumbHitUniqueImgMetaId

    DoqBrowseHitpkDoqBrowseHitUniqueImgMetaId

    SpinBrowseHitpkSpinBrowseHitUniqueImgMetaId

    DoqTileHitpkDoqTileHitUniqueImgMetaIdTileMetaId

    SpinTileHitpkSpinTileHitUniqueImgMetaIdTileMetaId

    PlaceNamePK__PlaceNameU_16CE6296UniqClusPlaceId

    PlaceNameAkPLaceNameUITCSNPImgFlagTypeIdCountryIdStateIdNamePlaceId

    PlaceNameAkPlaceNameUITCNPImgFlagTypeIdCountryIdNamePlaceId

    PlaceNameAkPlaceNameUICSNPImgFlagCountryIdStateIdNamePlaceId

    PlaceNameAkPlaceNameUICNPImgFlagCountryIdNamePlaceId

    PlaceNameAkPlaceNameZGridIdZGridId

    PlaceNameAkPlaceNameUGridIdImgFlagAlternateNamePlaceIdCountryIdStateIdTypeId

    ImgMetapkImgMetaUniqueImgMetaId

    ImgMetaakImgMeta1ZGridIdSrcIdImgDate

    ImgMetaakImgMeta2UGridIdSrcId

    DoqOrigMetapkDoqOrigMetaUniqueOrigMetaId

    SpinOrigMetapkSpinOrigMetaUniqueOrigMetaId

    DoqTileMetapkDoqTileMetaUniqueTileMetaId

    DoqTileMetaakDoqTileMeta1UGridIdZTileGridId

    SpinTileMetapkSpinTileMetaUniqueTileMetaId

    SpinTileMetaakSpinTileMeta1ZGridIdZTileGridIdImgDate

    DoqJumpImgpkDoqJumpImgUniqueUGridId

    SpinJumpImgpkSpinJumpImgZGridIdImgDate

    DoqThumbImgpkDoqThumbImgUniqueUGridId

    SpinThumbImgpkSpinThumbImgZGridIdImgDate

    DoqBrowseImgpkDoqBrowseImgUniqueUGridId

    SpinBrowseImgpkSpinBrowseImgZGridIdImgDate

    DoqTileImg1pkDoqTileImg1UniqueTileMetaId

    SpinTileImg1pkSpinTileImg1UniqueTileMetaId

    SpinFrameMetaakSpinFrameMetaZIdZGridIdImgMetaId

    SpinFrameMetaakSpinFrameMetaImImgMetaId

    &L&A&C&"Arial,Bold"Microsoft Confidential&RPage &P

    &LTom Barclay&R&D

    SupportContacts

    1stRobert EberlRobert EberlMark Walling

    Pager:(800)603-4206(800)603-4206(888)786-7192

    Home:(425)881-6597(425)881-6597

    E-Mail:robertebroberteba-markwa

    2ndKen MartinKen MartinRobert Eberl

    Pager:(800)592-1831(800)592-1831(800)603-4206

    Home:(425)881-0516(425)881-0516(425)881-6597

    E-Mail:kenmkenmroberteb

    3rdTom BarclayTom BarclayTom Barclay

    Pager:(888)983-9921(888)983-9921(888)983-9921

    Home:(925)736-1266(925)736-1266(925)736-1266

    E-Mail:tbarclaytbarclaytbarclay

    WebServers

    SQL Server Performance

    ProcessorMaxThreads>>56789101112

    Current

    ModelNodeIPCPUProc. Max ThreadTotal Threads

    CompaqCPMSRWBA01207.46.142.29402024283236404448

    CompaqCPMSRWBA02207.46.142.30402024283236404448

    CompaqCPMSRWBA07207.46.142.91402024283236404448

    CompaqCPMSRWBA08207.46.142.88402024283236404448

    CompaqCPMSRWBA09207.46.142.89402024283236404448

    CompaqCPMSRWBA10207.46.142.90402024283236404448

    Maximum Connections24120144168192216240264288

    Launch

    ModelNodeIPCPUProc. Max ThreadTotal Threads

    CompaqCPMSRWBA01207.46.142.29402024283236404448

    CompaqCPMSRWBA02207.46.142.30402024283236404448

    AlphaCPMSRWBA03207.46.142.85201012141618202224

    AlphaCPMSRWBA04207.46.142.126201012141618202224

    AlphaCPMSRWBA05207.46.142.100402024283236404448

    AlphaCPMSRWBA06207.46.142.101301518212427303336

    CompaqCPMSRWBA07207.46.142.91402024283236404448

    CompaqCPMSRWBA08207.46.142.88402024283236404448

    CompaqCPMSRWBA09207.46.142.89402024283236404448

    CompaqCPMSRWBA10207.46.142.90402024283236404448

    Maximum Connections35175210245280315350385420

    6/24 - 6/30SQL7 could only handle 175 simultaneous collections before hitting the performance knee

    7/2/98Removed CPMSRWBA03 and CPMSRWBA04 from DNS

    7/15/98Removed CPMSRWBA05 and CPMSRWBA05 from DNS

    7/27/98Removed CPMSRWBA03 thru CPMSRWBA06 from the IDC

    WebSiteMap

    TerraServer Web Site

    PathSizeDescription

    InetPub

    TerraServer1.00 MBHTM, ASP, .Class, Inc, Fnc, Sub, Txt, and Global.Asa

    CoverageMap9.63 MB.GIF for CoverageMap system

    DigitalBackyard0.10 MBUSGS HTM pages

    Images1.31 MBLogos and main GIF and JPG files

    AlphaServer0.04 MBDEC/Compaq Alpha Server images

    DigitalImages0.76 MBDEC Images

    Graphics0.03 MBMiscellaneous

    Graphs0.29 MBDiagrams and Graphs

    Map0.01 MBGraphics that go around the image

    MS0.00 MBMicrosoft Toolbar

    MsNav0.00 MBMicrosoft Toolbar (Duplicate)

    Placeholder6.50 MBInside TerraServer Images

    ServerImage0.06 MBServer Images

    Subheads0.03 MB[Obsolete Headers]

    Toolbars0.01 MBImage Toolbar (grey buttons)

    Library11.10 MBWhitepaper

    SetPick0.02 MB

    Total Size30.88 MB

    IIS Configuration

    Tasks performed

    Machine Name

    ASP Performance

    Script Engine Cache10001000

    Default Site

    Web SiteIntelAlpha

    Drive Pathe:\c:\

    TCP Port8080

    Limit Connections400400

    Connection TimeOut6060

    LogFilese:\logfilese:\logfiles

    LogFormatMS IISMS IIS

    Operators

    Administrators

    Performance

    Pages per Day> 100,000> 100,000

    Bandwidth(Open)(Open)

    HTTP Keep-Alives Enabled(Checked)(Checked)

    ISAPI Filters

    None

    Directories

    RootE:\C:\

    Access Checked:Read Log IndexRead Log Index

    Permissions CheckedExecute + ScriptExecute + Script

    Library directory PermissionsNoneNone

    Tuning Script(s)

    Run MakeFre15.bat in \Program Files\Common Files\System\Ado

    Web Site Performancec:\Settings\k2tune.cmd

    Registry Settingsc:\Settings\iis4Tune.reg

    Change IIS4 Machine setting for ScriptEngineCache to 1000

    Change Log File format to W3SVC Extended. Add URI, Bytes Sent, Time Taken

    Install Steps

    1Copy tree from CD or WinZip floppy to \InetPub\TerraServer

    2Copy over top of these files new replacements (delta changes)

    3Make sure ImageServer.dll is correct platform (default is Intel, get the Alpha disk)

    4Edit ImgSrv.reg. Make sure paths to noimage path and Log Path are valid and exist

    5Examine global.asa, make sure BaseRef is dns name of server, e.g. http://terraserver.microsoft.com

    6Create ODBC DSNs:

    NameServerProtocolUIDPassword

    0TerraServerTerraServerTCP/IPt2b2_dbo

    0TerraBackupTerraServerTCP/IPt2b2_dbo

    0ImageServerTerraServerTCP/IPt2b2_dbo

    0ImageBackupTerraServerTCP/IPt2b2_dbo

    7Run imgsrv.reg (RegEdit imgsrv.reg)

    8Examine library\wp.exe, make sure its right version

    9Run k2tune.cmd (c:\settings\k2tune)

    10Run iis4tune.reg (regedit iis4tune.reg)

    11Change ScriptEngineCache to 1000

    12Set Web Site, Performance, and Home Directory per the above spec.

    13Run MakeFre15.bat in \Program Files\Common Files\System\Ado

    14Run Perfmon with c:\settings\web.pmc

    15Counters:

    0ASPRequests Executing

    0ASPRequests Wait Time

    0ASPRequest Execution Time

    ASPRequest Rejected

    Web ServiceCurrent Connections

    Web ServiceGet Request/sec

    Web ServiceConnect Attempts / Sec

    Active Server Pages

    Parameters

    Page Name (*.asp)12345678910

    ClickOnCoveragePPDRCDsizeClickAt

    ClickOnMacPPDRCDsizeClickAt

    CoverageListRCDsize

    CoverageSearchPPDRCDsizeClickAt

    GetImageByXYXidYidSrcIdImgDateImgSize

    GetNext10PlaceImgFlagQueryIdNameStateIdCountryIdTypeLastPlacePlaceIdDsize

    GetOrigMetaOrigMetaIdSrcIdWidthHeightImgSizeDSize

    GetPageByCoordLongLatAltMapNameDsize

    GetPageByGridIdGridIdSrcIdImgDateImgSizeDsize

    GetPageByLatLonLongitudeLatitudeAltitudeDsize

    GetPageByPlace

    GetPageByXYXidYidSrcIdImgDateImgSizeDsize

    GetPickPageDSize

    GetSearchByMapLongitudeLatitudeAltitudePanXPanYDSize

    GetSearchByPlaceDsize

    GetTileByClickXidYidSrcIdImgDateImgSizeClickAt

    GetTileListByXYXidYidTileXTileYSrcIdImgDateDsize

    GetTilesByXYXidYidTileXTileYSrcIdImgDateDsize

    GetTileXYXidYidTileXTileYSrcIdImgDate

    SpinOrderViewXidYidSrcIdImgDateImgSizeDsize

    USGSDownloadXidYidTileXTileYSrcIdImgDateDsize

    USGSEntryXidYidTileXTileYSrcIdImgDateDsize

    USGSOrderViewXIdYidSrcIdImgDateImgSizeDSize

    USGSTileViewXidYidTileXTileYSrcIdImgDateDsize

    DisplayImageViewXidYidSrcIdImgDateImgSizeDsizeXY

    DisplayTileViewXidYidTileXTileYSrcIdImgDateImgSizeDsizeXY

    Page Name (*.asp)Calls Support File (*.inc, *.sub, *.txt)

    ClickOnCoverageDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeader

    CoverageSearchLeftNav_searchToolbarOutputErrorMsgHtmlHeaderSponsorsTableFunctions

    GetImageByXYGetConnection

    GetNext10PlacePlaceSearchToolbarOutputErrorMsgGetConnectionHtmlHeader

    GetOrigMetaLeftNav_searchToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsorsTableFunctions

    GetPageByCoordDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors

    GetPageByGridIdDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors

    GetPageByLatLongDisplayImage

    GetPageByPlacePlaceSearchToolbarOutputErrorMsgGetConnectionHtmlHeader

    GetPageByXYDisplayImageToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors

    GetPickPageLeftNav_searchToolbarOutputErrorMsgGetConnectionHtmlHeaderSponsors

    GetSearchByMapLeftNav_searchToolbarOutputErrorMsgMapFunctionsHtmlHeaderSponsorsTableFunctions

    GetSearchByPlaceSponsorsToolbar

    GetTileByClickDisplayTileTableToolbarOutputErrorMsgGetConnectionHtmlHeaderTileFunctionsTableFunctionsDisplayTileApplet

    GetTileListByXYTileFunctions

    GetTilesByXYDisplayTileTableToolbarOutputErrorMsgGetConnectionHtmlHeaderTileFunctionsTableFunctionsDisplayTileApplet

    GetTileXYGetConnection

    SpinOrderView

    USGSDownload

    USGSEntryGetDoqOrigMetaIdToolbarOutputErrorMsgGetConnectionDisplayImgTblMakeSKUTileFunctions

    USGSOrderView

    USGSStoreOutputErrorMsg

    USGSTileViewTileFunctions

    DisplayImageView

    DisplayTileViewTileFunctions

    DisplayImgTableLeftnav_searchHtmlHeaderSponsorsTableFunctions

    PlaceSearchSponsors

    &L&A&C&BMSFT Confidential&B&RPage &P

    &LTom Barclay&R&D

    SQL Stored Procedures

    Parameters

    Method123456789

    spDelLoadSetDatabaseThemeLowImgMetaIdNumImgMetaIdLowTileMetaIdNumTileMetaIdLowOrigMetaIdNumOrigMetaIdPartitionId

    spFindByGridIdGridIdSrcIdImgDate

    spFileGridIdGridIdSrcIdCellsImgDate

    spFindLatestByCoordLongitudeLatitude

    spFindLatestByXYGridIdXGridIdYGridId

    spFindLatestCoordLongitudeLatitudeCells

    spFindLatestGridIdXGridIdYGridIdCells

    spFindStickyCoordLongitudeLatitudeCellsSrcIdImgDate

    spFindPlaceByUGridIdUGridId

    spFindPlaceByZGridIdZGridId

    spFindTileMetaXIdYIdTileXTileYSrcIdImgDate

    spGetDupFieldsXYXIdYIdSrcIdImgDate

    spGetFieldsXYXIdYIdSrcIdszImgDate

    spGetImageIdIdSrcIdImgDateImgSize

    spGetImageXYXIdYIdSrcIdszImgDateImgSize

    spGetImageRectXidYIdSrcIdCellsImgDate

    spGetLastIdLoadedPartitionIdLowIdNumIdTableTypeTableName

    spGetMetaFieldsXYXIdYIdSrcIdszImgDate

    spGetMGridSizesPPDRowColDsize

    spGetTileRectXIdYIdTileXTileYSrcIdCellsImgDate

    spGetTileXYXIdYIdTileXTileYSrcIdImgDate

    spImageExistsXIdYIdSrcIdszImgDate

    spOtherImageXYXidYidSrcIdszImgDate

    spQueryGazetteerImgFlagQueryTypePlaceNamePlaceTypeStateIdCountryIdLastPlaceNameLastPlaceId

    spQueryGazFirstPlaceNamePlaceTypeIdStateNameCountryName

    spQueryGazNextQueryTypeImageFlagLastPlaceIdLastPlaceNamePlaceNameStateNameCountryNamePlaceTypeIdRowCount

    spTargetTileFactorImgDateXGridIdYGridIdXTileIdYTileIdTargetXTargetYTargetTileX

    TargetTileY

    spTileExistsXIdYIdTileXTileYSrcIdImgDate

    spUpdatePlaceDateZidDoqDateSpinDate

    spZTranXIdYId

    Obsolete

    &L&A&C&BMSFT Confidential&B&RPage &P

    &LTom Barclay&R&D

    ASP File Sizes

    Active Server Page File Size

    ASP FilesSupport Files

    FileLinesBlank LinesBytesInclude BytesTotal LinesFileLinesBlank LinesBytes

    ClickOnCoverage.asp16347210BeginTable.inc3632951

    ClickOnMac.asp15947264CoverageTable.inc2292815437

    CoverageList.asp8963060DisplayImage.inc2831014937

    CoverageSearch.asp3162315469DisplayTileApplet.inc2201012311

    GetImageXY.asp3751410DisplayTileTable.inc214412720

    GetNext10Place.asp5112586HtmlHeader.inc182983

    GetOrigMeta.asp2501415549LeftNav_Search.inc3992199

    GetPageByCoord.asp14726444MapFunctions.inc1651910530

    GetPageByGridId.asp14625978PlaceNameTable.inc90565

    GetPageByLatLon.asp14626149PlaceSearch.inc13488328

    GetPageByPlace.asp4212017Sponsors.inc110897

    GetPageByXY.asp14826906TableFunctions.inc2522714222

    GetPickPage.asp7873417DisplayImgTbl.sub6953838

    GetSearchByLatLon.asp7282871GetDOQOrigMetaId.sub15096363

    GetSearchByMap.asp187209797OutputErrorMsg.txt111480

    GetTileByClick.asp15036829TileFunctions.txt3601439

    GetTileListByXY.asp12045990toolbar.txt141205128

    GetTilesByXY.asp13626528

    GetTileXY.asp3951501

    SpinOrderView.asp195512243

    usgsbuydoq.asp12156218

    USGSDownload.asp10855124

    usgsentry.asp119126887

    USGSOrderView.asp19249567

    USGSTileView.asp206210874

    2513766716Average1711996666

    3417148167888Totals2017155113328

    ASP SP Xref

    SQL Stored Procedures

    Active Server PagesandExecutablesspFindGridIdspFindLatestCoordspFindLatestGridIdspFindStickyCoordspGetFieldsXYspFindTileMetaspGetImageRectspGetImageXYspGetLastIdLoadedspGetMetaFieldsXYspGetMGridSizesspGetTileRectspGetTileXYspImageExistsspQueryGazFirstspQueryGazNextspSetupSpinInsertsspSetupUSGSInsertsspGetTargetTilespTileExistsspUpdatePlaceDate

    ClickOnCoverage

    ClickOnMac

    CoverageList

    CoverageSearch

    DisplayImageView.asp

    DisplayImgTable.inc

    DisplayTileApplet.inc

    DisplayTileTable.inc

    DisplayTileView.asp

    GetConnection.inc

    GetImageByXY.asp

    GetNext10Place.asp

    GetOrigMeta.asp

    GetPageByCoord.asp

    GetPageByGridId.asp

    GetPageByLatLon.asp

    GetPageByPlace.asp

    GetPageByXY.asp

    GetPickPage.asp

    GetSearchByMap.asp

    GetSearchByPlace.asp

    GetTileByClick.asp

    GetTileListByXY.asp

    GetTilesByXY.asp

    GetTileXY.asp

    OutputErrorMsg.txt

    PlaceSearch.inc

    SpinOrderView

    Sponsors.inc

    Toolbar.txt

    USGSDownload

    USGSEntry

    USGSOrderView

    USGSStore

    USGSTileView

    GetDOQOrigMetaId.sub

    MakeSKU.fnc

    LoadManager.exe

    TerraLoader.exe

    TerraUpdate.exe

    &L&A&C&BMSFT Confidential&B&RPage &P

    &LTom Barclay&R&D

    Equipment

    TerraServer Equipment Specs

    SystemComponentQtyHeightWidthDepthWeightPowerPlugBTU/Hr

    TerraServer PrimaryDEC Alpha 84001170.0 cm (67.0 in)80.0 cm (31.5 in)87.5 cm (34.4 in)545 kg (1200 lb.)120/208 V50-60 Hz3-Phase star30ANEMA L21-30R15,700 Btu/hr, 4,600 W

    ESA-10000(Disk Cabinets)7170.0 cm (67.0 in)60.0 cm (23.75 in)90.0 cm (35.5 in)295 kg (650 lb.)220-240V 60 Hz 30A Single Phase3 Wire NEMA No. L6-30P6,140 Btu/hr, 1,800 W

    StorageTek 97101184.6 cm (72.0 in)148.2 cm (57.8 in)101.5 cm (39.6 in)450 kg (1000 lb.)6A @ 120 volts,Nema 5-20P1,650 BTU/hour

    TerraServer BackupDEC Alpha 41001170.0 cm (67.0 in)60.0 cm (23.75 in)90.0 cm (35.5 in)350 kg (772 lb.)200-240V50-60 Hz24ASingle PhaseNEMA L6-30P16,382 Btu/hr,

    SW8003170.0 cm (67.0 in)80.0 cm (31 in)87.5 cm (34.5 in)454 kb (1000 lb)120/208 V50-60 Hz3-Phase star24ANEMA L21-309,976 Btu/Hr., 2,923 W

    StorageTek 9714143 in.26 in.36 in.380 lbs (empty)430 lbs (100 tapes)Single Phase 120 VAC 47-63 Hz. 6A Service,Standard 3 Wire520 Btu/Hr, 150 W

    JavaApplets

    Spin View Applet

    A012345678910

    S1iDisplayWidthiDisplayHeightiColumnWidthiPlaceDateHeightiFontSizeiType33RecsszBaseRef

    S33iRow#iCol#iWidthiHeightiEncryptKeyszImageUrliClickActionszClickURL

    S99EOF

    Image View, Image Save, and Rags Records and Fields

    A012345678910

    A1iDisplayWidthiDisplayHeightszBaseRefiColoriType2RecsiType3RecsiType4RecsiType7RecsiType6Recs

    A2iXLocationiYLocationiWidthiHeightiColor

    A3iXlocationiYLocationszImgURLiClickActionszClickURLbDrawPhase

    A4iXlocationiYLocationiClickActionszClickURLszFontiSizeiColoriStyleszTextbDrawPhase

    I5iXlocationiYLocationiWidthiHeightiColor

    I6Row#Col#iWidthiHeightiEncryptKeyszImageUrliClickActionszClickURL

    A7iStartXiStartYiEndXiEndYbLineBooliPixWidthiColorbFilliFillColor

    s8szSuccessURLszSuccessTextszFailureText

    R10iXLocationiYLocationiWidthiHeightiColoriMaxRec11

    R11iXRelLoc10iYRelLoc10iColoriDelaymsiDrawTypeiWidthiHeight

    R12iDelaymsbClearszRagsURL

    99EOF

    Applet Key

    AImage View, Image Save and Rags View

    SSpin View only

    IImage View and Image Save only

    sImage Save only

    RRags only

    FieldNamesDataTypeDescription

    iDisplayWidthintWidth in pixels

    iDisplayHeightintHeight in pixels

    iXLocationintAbsolute pixel address starting from 0,0 in upper left hand corner

    iYLocationintAbsolute pixel address starting from 0,0 in upper left hand corner

    iClickActionint0 = "not clickable", 1 = "click to URL handled by this applet", 2 = "click to external URL"

    szxxxxUrlcharURL to go to

    szBaseRefcharBeginning of URL's that are internal (iClickAction = 1, images)

    iColorint24-bit RGB value

    szFontcharFont name, e.g. "Arial"

    iSizeintFont size in points

    bDrawPhaseint0 = before images, 1 = after images are drawn (control on-top-ness)

    iWidthintWidth in pixels

    iHeightintHeight in pixels

    iStartXintStart position in absolute pixels

    iStartYintStart position in absolute pixels

    iEndXintEnd position in absolute pixels

    iEndYintEnd position in absolute pixels

    bLineBoolint0 = don't draw a line, 1= draw line

    bFillint0 = don't fill, 1 = fill object

    iFillColorint24-bit RGB value

    iMaxRec11intTotal number of record type 11's that may ever be sent to the applet

    iType2RecsintTotal number of record type 2's that may ever be sent to the applet

    iType3RecsintTotal number of record type 3's that may ever be sent to the applet

    iType4RecsintTotal number of record type 4's that may ever be sent to the applet

    iType6RecsintTotal number of record type 6's that may ever be sent to the applet

    iType7RecsintTotal number of record type 7's that may ever be sent to the applet

    iDrawTypeint0 = Pixel, 1 = FillFlag, 2= Rect, 3 = FillRect, 4 = Oval, 5 = Fill Oval

    iXRelLoc10intPixel location relative to start of Record 10

    iYRelLoc10intPixel location relative to start of Record 10

    bClearint0 = Don't clear record 10 array; 1 = re-draw record 10 rectangle.

    TerraServer Admin ASP

    TerraServer Administration System Active Server Pages

    Parameters

    Page Name (*.asp)12345678910

    ShowPickPageDSize

    ChangePickPageNameDsize

    DeletePickEntryNameDsize

    InsertPickEntryDsize

    ModifyPickEntryDsize

    Page Name (*.asp)Calls Support File (*.inc, *.sub, *.txt)

    ChangePickPageToolbarOutputErrorMsgSponsors

    DeletePickEntryToolbarOutputErrorMsgSponsors

    InsertPickEntryToolbarOutputErrorMsgSponsors

    ModifyPickEntryToolbarOutputErrorMsgSponsors

    ShowPickPageToolbarOutputErrorMsgSponsors

    Sheet2

    Java Applet Compatibility

    SpinViewMapViewImageViewImageSave

    NT/98/95 IE4.0OkOkOkOk

    NT/98/95 IE4.0OkOkOkOk

    NT/98/95 IE3.02OkOkOkNot Supported

    NT/98/95 NS3.0Doesn't workDoesn't workOkNot Supported

    Linux NS4.0OkOkMissing File DialogMissing File Dialog

    MacOS8 IE4OkOkOkMissing File Dialog

    MacOS8 IE3.02Doesn't workDoesn't workDoesn't workDoesn't work

    MacOS8 NS4.0OkOkOkDoesn't work

    TerraServer V1.0 DB Tables

    ThemeImgMetaThemeTileMetaThemeThumbImgThemeThumbHitDOQOrigMeta

    0ImgMetaId I4TileMetaId I4ImgMetaId I4ImgMetaId I4OrigMetaId I4

    1OrigMetaId I4ImgMetaId I4ZGridId I4ImgHit I4QuadName C38

    2SrcId I4OrigMetaId I4SrcId I4Quadrant C2

    3ImgTypeId I4SrcId I4ImgTypeId I4Filename VC255

    4XGridId I2ImgTypeId I4FileName VC255Country C4

    5YGridId I2XGridId I2ImgData ImgStates C12

    6ZGridId I4YGridId I2State1County C20

    7ThumbPixWidth I4ZGridId I4ThemeBrowseImgThemeBrowseHitState2County C20

    8ThumbPixHeight I4ImgStatus I2ImgMetaId I4ImgMetaId I4State3County C20

    9BrowsePixWidth I4ImgDate DTZGridId I4ImgHit I4State4County C20

    10BrowsePixHeight I4XTileGridId I2SrcId I4Producer C4

    11ImgStatus I2YTileGridId I2ImgTypeId I4DataOrder I2

    12ImgDate DTZTileGridId I2FileName VC255NbrLines I4

    13MidLat D7.4TilePixWidth I4ImgData ImgNbrSamples I4

    14MidLong D7.4TilePixHeight I4BandTypes I2

    15NWLat D7.4MidLat D7.4ThemeTileImgThemeTileHitElevationType I2

    16NWLong D7.4MidLong D7.4TileMetaId I4TileMetaId I4BandElevation i2

    17NELat D7.4NWLat D7.4ZGridId I4ImageHit I4VerticalDatum I2

    18NELong D7.4NWLong D7.4SrcId I4PrimaryHorizontalDatum I2

    19SWLat D7.4NELat D7.4ImgTypeId I4SecondaryHorizontalDatus I2

    20SWLong D7.4NELong D7.4FileName VC255GroundXYSystem I2

    21SELat D7.4SWLat D7.4ImgData ImgGoundPlanimetricSystem I4

    22SELong D7.4SWLong D7.4GroundPlanimetricUnits I4

    23PlaceName VC255SELat D7.4AngleRotation D24.15

    24SELong D7.4SW_Xprimary D24.15

    25PlaceName VC255SW_Yprimary D24.15

    26NW_Xprimary D24.15

    NW_Yprimary D24.15

    NE_XPrimary D24.15

    NE_Yprimary D24.15

    SE_Xprimary D24.15

    SE_Yprimary D24.15

    A_Primary D24.15

    B_Primary D24.15

    C_Primary D24.15

    D_Primary D24.15

    E_Primary D24.15

    F_Primary D24.15

    CountryStatePlaceGazateerSourceXC_Primary D24.15

    0CountryId I4StateId I4PlaceId I4GazSrcId I4YC_Primary D24.15

    1UNCode C4StateName VC255CountryId I4GazDesc VC255SW_Xsecondary D24.15

    2CountryName VC255StateId I4SW_Ysecondary D24.15

    3WWFeatureId I4NW_Xsecondary D24.15

    4CountrySearchStateSearchGazSrcIdDegreePopulationNW_Ysecondary D24.15

    5CountryId I4StateId I4TypeId I4CountryId I4NE_Xsecondary D24.15

    6ContinentId I4CountryId I4Longitude D7.4DegreeId I4NE_Ysecondary D24.15

    7WWFeatureId I4WWFeatureId I4Latitude D7.4UNCode2 C4SE_Xsecondary D24.15

    8GazSrcId I4GazSrcId I4Name VC255Population I4SE_Ysecondary D24.15

    9Name VC255Name VC255AlternateName VC255Rate D8.4A_secondary D24.15

    10AlternateName VC255AlternateName VC255ZGridId I4B_secondary D24.15

    11DoqDate DTC_secondary D24.15

    12FeatureTypeWordWheelFeatureSpinDate DTD_secondary D24.15

    13TypeId I4WWFeatureId I4DegreeId I4E_secondary D24.15

    14Name VC255Name VC255F_secondary D24.15

    15XC_secondary D24.15

    YC_secondary D24.15

    0GridSysImgSourceImgTypeImgCounterSW_XIntPrimary I4

    1GridSysId I4SrcId I4ImgTypeId I4LastImgMetaId I4SW_YIntPrimary I4

    2ImgXVal I2ImgTypeId I4ImgFileExt C3LastOrigMetaId I4NW_XIntPrimary I4

    3ImgYVal I2GridSysId I4ImgFileDesc VC255LastTileMetaId I4NW_YIntPrimary I4

    4TileXVal I2SrcName C10MimeStr VC255LastUpdated DTNE_XIntPrimary I4

    5TileYVal I2SrcTblName C10NE_YIntPrimary I4

    6MinX I2SrcDesc VC255SE_XIntPrimary I4

    7MinY I2SE_YIntPrimary I4

    8MaxX I2SW_XIntPrimary I4

    9MaxY I2SW_YIntPrimary I4

    10GridDesc VC255SE_XIntPrimary I4

    SE_YIntPrimary I4

    FirstPixelPrimaryX D24.15

    0HTMLPageHTMLPageParamsHtmlStrHtmlFmtStrFirstPixelPrimaryY D24.15

    1PageName C40PageName C40SectionName C40StrName VC255FirstPixelSecondaryX D24.15

    2SectionName C40SectionName C40LineNbr I4FmtStr VC255FirstPixelSecondaryY D24.15

    3SectionOrder I4PageParamNbr I4ParamNbr I4ElevationUnits I2

    4SecParamNbr I4HtmlText VC255MinPhotoElevation D10.3

    5MaxPhotoElevation D10.3

    XPixelResDEM D12.6

    YPixelResDEM D12.6

    0LogAccessLogCoordLogImgMetaIdLogPlaceZPixelResDEM D12.6

    1LogImgCount I4LogCoordCount I4RemoteAddress C16RemoteAddress C16XPixelResDOQ D12.6

    2RemoteAddress C16RemoteAddress C16SrcId I1PlaceName VC255YPixelResDOQ D12.6

    3SrcId I4SrcId I4ImgSizeId I1PlaceType I4ZPixelResDOQ D12.6

    4ImgSizeId I1OriginType I1ImgMetaId I4PlaceState VC255MaxPrimaryContourInterval I4

    5OriginType I1Longitude D7.4CreateDate DTPlaceCountry VC255MaxPrimaryContourUnits I2

    6MetaId I4Latitude D7.4RowsFound I4SuspectCode I2

    7Direction I4HitFlag I1InsertTimeStamp DTHorizontalAccuracy D6.1

    8CreateTimeStamp DTVerticalAccuracy D6.1

    9HorizontalTestPoints I2

    PixelAlgorithm I2

    0PickProductionSystem C24

    1Name VC255ProductionDate DT

    2Link VC255FilmType C24

    3SourcePhotoId C24

    4MosaicCode I2

    5LeafOffFlag C2

    6SourcePhotoDate DT

    CameraFocalLength D8.3

    0PlaceCacheConfigPlaceListCachePlaceRowCacheCountryNameFlyingHeight I4

    1MaxSize I4Ticket I4Ticket I4CountryId I4ScannerType C24

    2SetSize I4DateCreated DTRowNumber I4UNCode2 C4ScannerResolutionX D6.2

    3NextTicket I4SummaryPlaceName VC255Longitude VC10Name VC255ScannerResolutionY D6.2

    4LifeTime I4SummaryState VC255Latitude VC10ScannerSampleResX D6.2

    5SummaryCountry VC255SourceName VC10ScannerSampleResY D6.2

    6PlaceName VC255URLPlaceName VC50RadiometricRes I2

    7PlaceTypeStr VC10PlaceTypeStr VC10ResampledRes D6.2

    8State VC255URLState VC50CompressionFlag C1

    9Country VC255URLCountry VC50CompressedFileSize I4

    10SrcIdStr VC10PlaceName VC255CompressionAlgorithm C20

    11NumResults VC255State VC255CompressionType C1

    12Country VC255CompressionFactor I2

    13DOQOrigMeta_DataTypeZGridId I4

    14DOQOrigMeta_InternalCoordinatesDoqDate DT

    15DOQOrigMeta_LocationSpin2Date DT

    16DOQOrigMeta_PrimaryCoordinates

    DOQOrigMeta_Production

    DOQOrigMeta_Resolution

    DOQOrigMeta_SecondCoordinates

    &L&A&C&BMicrosoft Confidential&B&RPage &P

    &LTom Barclay&CPage &P&R&D

    DBFileSize

    TotalSize1000Restore Speed (MB/Minute)

    FileCountGB/FileMB/Sec54321

    5020.0068.2785.33113.78170.67341.33

    4522.2275.8594.81126.42189.63379.26

    4025.0085.33106.67142.22213.33426.67

    3528.5797.52121.90162.54243.81487.62

    3033.33113.78142.22189.63284.44568.89

    2540.00136.53170.67227.56341.33682.67

    2050.00170.67213.33284.44426.67853.33

    1566.67227.56284.44379.26568.891137.78

    10100.00341.33426.67568.89853.331706.67

    5200.00682.67853.331137.781706.673413.33

    &A

    Page &P

    FieldColumnNames

    ImgMetaId I4OrigMetaId I4SrcId I4ImgTypeId I4XGridId I2YGridId I2ZGridId I4ThumbPixWidth I4ThumbPixHeight I4BrowsePixWidth I4BrowsePixHeight I4JumpPixWidth I4JumpPixHeight I4ImgStatus I2ImgDate DTCutRow I2CutCol I2MidLat D15.10MidLong D15.10NWLong D15.10NELat D15.10NELong D15.10SWLat D15.10SWLong D15.10SELat D15.10SELong D15.100000000

    TileMetaId I4ImgMetaId I4OrigMetaId I4SrcId I4ImgTypeId I4XGridId I2YGridId I2ZGridId I4ImgStatus I2ImgDate DTCutRow I2XTileGridId I2YTileGridId I2ZTileGridId I2TilePixWidth I4TilePixHeight I4EncryptKey I4MidLat D15.10MidLong D15.10NWLat D15.10NELat D15.10NELong D15.10SWLat D15.10SWLong D15.10SELat D15.10SELong D15.100000000

    ImgMetaId I4ZGridId I4UGridId I4SrcId I4ImgTypeId I4EncryptKey I4ImgDate DTFileName VC255ImgData Img

    00UGridId I4000ImgDate DT00

    00UGridId I4000ImgDate DTZGridId I4ImgStatus I2

    TileMetaId I4ZGridId I4UGridId I4SrcId I4ImgTypeId I4EncryptKey I4ImgDate DTFileName VC255ImgData Img

    OrigMetaId I4SrcId I4GridX I4GridY I4CutsWide I4CutsHigh I4ImageWidth I4ImageHeight I4UpperLongitude D15.10UpperLatitude D15.10LowerLatitudeD15.10LowerLongitude D15.10UpperGridLong D15.10UpperGridLat D15.10XPixelsPerDegree I4YPixelsPerDegree I4DiscardRowPixels I4DiscardColumnPixels I4ColorValue I4ColorPerCent I4InMetaname VC255InFilename VC255QuadName C38Quadrant C2DataSetName VC255DataSetName2 VC255Country C10States C12Producer C24WestLongitude D15.10EastLongitude D15.10NorthLatitude D15.10SouthLatitude D15.10RasterOrder C24NbrLines I4NbrSamples I4BandContent C20BandOrganization C12PrimaryHorizontalDatum I2SecondaryHorizontalDatum I2CoordinateSystem C10CoordinateZone I4HorizontalUnits C20HorizontalResolution D6.4BitsPerPixel I2SW_Xprimary D24.15SW_Yprimary D24.15NW_Xprimary D24.15NW_Yprimary D24.15NE_XPrimary D24.15NE_Yprimary D24.15SE_Xprimary D24.15SE_Yprimary D24.15SW_Xsecondary D24.15SW_Ysecondary D24.15NW_Xsecondary D24.15NW_Ysecondary D24.15NE_Xsecondary D24.15NE_Ysecondary D24.15SE_Xsecondary D24.15SE_Ysecondary D24.15XOriginPrimary D24.15YOriginPrimary D24.15XOriginSecondary D24.15YOriginSecondary D24.15RMSE_XY D24.15ProductionSystem C24ProductionDate DTImageSource C24SourcePhotoId C24SourcePhotoDate DTCompression C20MetaDataDate DTDataFileSize I4HeaderByteCount I4StandardVersion C10Agency C60SourceDEMDate DT

    OrigMetaId I4SrcId I4GridX I4GridY I4CutsWide I4CutsHigh I4ImageWidth I4ImageHeight I4UpperLongitude D15.10UpperLatitude D15.10LowerLatitude D15.10LowerLongitude D15.10UpperGridLongUpperGridLatXPixelsPerDegreeYPixelsPerDegreeDiscardRowPixelsDiscardColumnPixelsColorValueColorPerCentInMetanameInFilenameSunAngle D10.6ShootingHeight D15.5PixelSize D6.4FrameNumber C60SpinImgDate DTSpinGMT C12CameraSystem C24Copyright C80

    Use the above rows to format the columns when verifying the meta data .BCP files

    The first row is the ImgMeta table. Second is TileMeta. Third is JumpImg.

    Fourth is ThumbImg. Fifth is BrowseImg. Sixth is Tile Img.

    Seventh is DOQ Original meta. Eigth is Spin Meta

    &A

    Page &P

    Spin-2 Store

    Spin-2 Image Sizes

    1.561.56161672

    KMKMFullFullThumbThumbAverage

    NameWidthHeightPixWidthPixHeightPixWidthPixHeightTable Height x Width

    Small1.51.687596210829410561152

    Medium33.37519232163188211142304

    Large4.254.7827243064266299203168

    Tom Barclay:This value is displayed to the user on the SPIN-2 Page as the width in Km to be purchased.

    Tom Barclay:Height in KM displayed to the user in the SPIN-2 store pages.

    Tom Barclay:Number of wide pixels at full resolution. Depends on pixels per square meter in row 2.

    DownloadTime

    Page Size by Image Type Table600x400500

    800x600700

    Image TypeHTML Text SizeGraphics Size (Total)HTML and Gif SizeJpeg SizeAvg Width1024x768900

    Jump15,0005458269,5821,000561152x8821000

    Thumb12,0005458266,5822,5001131280x10241100

    Browse9,5005458264,08210,000225

    Tile8,5005458263,08210,000225

    Pages Per

    60%Effective Throughput

    100200300400

    Mbits/secMbits/secMbits/secMbits/sec

    Second75150225300

    Hour270,000540,000810,0001,080,000

    Day4,860,0009,720,00014,580,00019,440,000

    DownLoad Time Calculations

    2880028800560005600015000001500000

    Image TypeWindow SizeMax Image WidthTiles Per PageTotal Size (Bytes)Kbps Total Time1st Image TimeKbps Total Time1st Image TimeKbps Total Time1st Image Time

    Jump600x400500647900027.43s24.51s14.11s12.60s0.53s0.47s

    Thumb600x400500165200018.06s23.99s9.29s12.34s0.35s0.46s

    Browse600x40050044950017.19s25.72s8.84s13.23s0.33s0.49s

    Tile600x40050044850016.84s25.38s8.66s13.05s0.32s0.49s

    Average5000017.36s8.93s0.33s

    Jump800x60070014415900055.21s24.51s28.39s12.60s1.06s0.47s

    Thumb800x6007003610200035.42s23.99s18.21s12.34s0.68s0.46s

    Browse800x60070099950034.55s25.72s17.77s13.23s0.66s0.49s

    Tile800x60070099850034.20s25.38s17.59s13.05s0.66s0.49s

    Average10000034.72s17.86s0.67s

    Jump1024x76890025627100094.10s24.51s48.39s12.60s1.81s0.47s

    Thumb1024x7689004913450046.70s23.99s24.02s12.34s0.90s0.46s

    Browse1024x7689001616950058.85s25.72s30.27s13.23s1.13s0.49s

    Tile1024x7689001616850058.51s25.38s30.09s13.05s1.12s0.49s

    Average15750054.69s28.13s1.05s

    Jump1152x8821000289304000105.56s24.51s54.29s12.60s2.03s0.47s

    Thumb1152x88210006417200059.72s23.99s30.71s12.34s1.15s0.46s

    Browse1152x88210001616950058.85s25.72s30.27s13.23s1.13s0.49s

    Tile1152x88210001616850058.51s25.38s30.09s13.05s1.12s0.49s

    Average17000059.03s30.36s1.13s

    Jump1280x10241100361376000130.56s24.51s67.14s12.60s2.51s0.47s

    Thumb1280x102411008121450074.48s23.99s38.30s12.34s1.43s0.46s

    Browse1280x102411001616950058.85s25.72s30.27s13.23s1.13s0.49s

    Tile1280x102411001616850058.51s25.38s30.09s13.05s1.12s0.49s

    Average18416763.95s32.89s1.23s

    OverheadImages/Sec

    100005,000,000.001500

    &LMicrosoft Terra-Server&C&"Arial,Bold"&A&R&D&T

    &LTom Barclay&RPage &P

    GraphicsFileSizes

    Graphics File Sizes

    Graphics FileSize (Bytes)

    alex-logo.gif2424

    anibkoffice.gif15856

    bktomap.gif470

    buyme.gif2281

    database.gif1279

    diglogo.gif480

    east.gif483

    hardware.gif1237

    help.gif1028

    image.gif1107

    imagery.gif1201

    info.gif1005

    Line.gif816

    map.gif1015

    msftlogo.gif358

    name.gif1074

    north.gif471

    northeast.gif442

    northwest.gif446

    nozomap.gif1598

    picks.gif1071

    scalekm.gif1200

    scalemi.gif1200

    search.gif1144

    south.gif471

    southeast.gif453

    southwest.gif462

    spinlogo.gif1913

    storageworks.gif3162

    tslogosm.gif2006

    usgslogo.gif1077

    usgslogo.gif1077

    west.gif472

    year.gif300

    zinomap.gif1576

    zinozomap.gif1927

    Total Size54582

    &A

    Page &P

    MapGridSizeTables

    Database Size Tables

    MCGridIdMSGridId

    XMCGridId i4XMSGridId i4

    YMCGridId i4YMSGridId i4

    SpinRowCount i4SpinRowCount i4

    SpinImgMb