Microsoft Enterprise Solutions For Federal Agencies Jim Gray Senior Researcher Microsoft Corporation

Microsoft Microsoft Enterprise SolutionsEnterprise SolutionsFor Federal AgenciesFor Federal Agencies

Jim GrayJim GraySenior ResearcherSenior ResearcherMicrosoft CorporationMicrosoft Corporation

Competitive Competitive advantageadvantage

Basic Basic operationsoperations

Reacting to Reacting to unplannedunplanned

eventsevents

Executing Executing on plannedon planned

eventsevents

DigitalDigitalNervousNervousSystemSystem

E-mailE-mail

Video conferencingVideo conferencing

InternetInternet

Electronic commerceElectronic commerce

Key Technologies For Key Technologies For Digital Nervous SystemsDigital Nervous Systems

PCsPCs

Digital Nervous SystemDigital Nervous SystemStrengthening DemocracyStrengthening Democracy Unfiltered messages to citizensUnfiltered messages to citizens Learn about candidates, check Learn about candidates, check

judicial records, endorsements judicial records, endorsements Watch debates and speechesWatch debates and speeches In-depth investigation of policies and In-depth investigation of policies and

issues of interestissues of interest How did my representative vote on How did my representative vote on

this issue?this issue? Informed voters, higher participationInformed voters, higher participation

Reinventing GovernmentReinventing Government Provide citizen services through a Provide citizen services through a

single point of contactsingle point of contact Improve responsiveness and accuracyImprove responsiveness and accuracy Improve productivityImprove productivity Use technology to improve educationUse technology to improve education Encourage innovationEncourage innovation

The American AdvantageThe American Advantage

50% of house holds have PCs50% of house holds have PCs

Most computer literate society Most computer literate society

Largest Internet user Largest Internet user

Technically savvy governmentTechnically savvy government

FAA- FAA- Flights Standards Service (AFS)Flights Standards Service (AFS)

Reinventing Information FlowReinventing Information FlowDick GordonDick Gordon AFSAFS

Sets standards, Sets standards, Tests & certifies personnel Tests & certifies personnel Inspects aircraft maintenance Inspects aircraft maintenance

and operationand operation Re-engineered in 1995 to Re-engineered in 1995 to

reduce clerical tasks, reduce clerical tasks, make inspectors more productive make inspectors more productive

ArchitectureArchitecture All MS Word docs stored in SQL ServerAll MS Word docs stored in SQL Server Templates come from HQTemplates come from HQ Inspectors make certificates & reportsInspectors make certificates & reports SQL Server replication SQL Server replication

propagates changes propagates changes

Backup server

HQ server

12 regional servers

Over 100 district servers

USGSUSGSDirect Citizen ContactDirect Citizen ContactInformation at Your FingertipsInformation at Your Fingertips

USGS has vast quantities of data forUSGS has vast quantities of data for BiologyBiology GeologyGeology MappingMapping Water Water

Delivers to citizens via USGS web siteDelivers to citizens via USGS web site K-12 program on the Web K-12 program on the Web http://www.usgs.gov/educationhttp://www.usgs.gov/education

Over 10 million accesses per monthOver 10 million accesses per month from over 230,000 people from over 230,000 people

Estimate over 50% of info service is via web Estimate over 50% of info service is via web

ScientistsScientists ProfessionalsProfessionals CitizensCitizens

for

Barbara RyanBarbara RyanAssociate Director for OperationsAssociate Director for Operations

GatewayGatewayto theto theEarthEarth

USGS MissionUSGS Mission

The U.S. Geological Survey The U.S. Geological Survey

provides the Nation with reliable, provides the Nation with reliable,

impartial information to impartial information to

describe and understand the Earth.describe and understand the Earth.

This information is used This information is used to . . .to . . .

minimize loss of life and minimize loss of life and property from natural property from natural disastersdisasters


manage water, biological, energy, and manage water, biological, energy, and mineral resourcesmineral resources


contribute to wise economic and contribute to wise economic and physical developmentphysical development


enhance and protect the quality enhance and protect the quality of lifeof life

Geographic ResearchGeographic Research

CRADA GoalsCRADA Goals

Build a Build a general publicgeneral public-oriented -oriented browsing and retrieval capability browsing and retrieval capability for for geospatial data geospatial data on the on the InternetInternet..

Increase the public’s access toIncrease the public’s access to and and awareness ofawareness of geospatial geospatial data.data.

USGS DOQ of USGS DOQ of Washington, D.C.Washington, D.C.

DOQ Coverage MapDOQ Coverage Map

USGS DOQ of USGS DOQ of Washington, D.C.Washington, D.C.

Sample TerraServer ImageSample TerraServer Image

Gateway to the EarthGateway to the Earth

Microsoft TerraServer Microsoft TerraServer Demonstration Demonstration

Tom Barclay Tom Barclay

Microsoft ResearchMicrosoft Research

Hedy Rossmeissl Hedy Rossmeissl

Senior Program Advisor, USGSSenior Program Advisor, USGS

Microsoft TerraServer: Microsoft TerraServer: Scaleup to Big DatabasesScaleup to Big Databases Build a 1 TB SQL Server databaseBuild a 1 TB SQL Server database Data must beData must be

1 TB1 TB UnencumberedUnencumbered Interesting to everyone everywhereInteresting to everyone everywhere And And not offensive to anyone anywherenot offensive to anyone anywhere

Loaded Loaded 1.5 M place names from Encarta World Atlas1.5 M place names from Encarta World Atlas 3 M Sq Km from USGS (1 meter resolution)3 M Sq Km from USGS (1 meter resolution) 2 M Sq Km from Russian Space agency (1.5 m)2 M Sq Km from Russian Space agency (1.5 m)

On the web (world’s largest atlas)On the web (world’s largest atlas) Sell images with commerce server.Sell images with commerce server.

Microsoft TerraServer BackgroundMicrosoft TerraServer Background

Earth is 500 Tera-meters squareEarth is 500 Tera-meters square USA is 10 tmUSA is 10 tm22

100 TM100 TM22 land in 70ºN to 70ºS land in 70ºN to 70ºS We have pictures of 6% of itWe have pictures of 6% of it

3 tsm from USGS3 tsm from USGS 2 tsm from Russian Space Agency 2 tsm from Russian Space Agency

Compress 5:1 Compress 5:1 (JPEG)(JPEG) to 1.5 TB. to 1.5 TB. Slice into 10 KB chunksSlice into 10 KB chunks Store chunks in DBStore chunks in DB Navigate withNavigate with

Encarta™ AtlasEncarta™ Atlas globeglobe gazetteergazetteer

StreetsPlus™ in the USAStreetsPlus™ in the USA

40x60 km2 jump image

20x30 km2 browse image

10x15 km2 thumbnail

1.8x1.2 km2 tile

SomedaySomeday multi-spectral multi-spectral

image image of everywhereof everywhere once a day / houronce a day / hour

USGS Digital Ortho Quads USGS Digital Ortho Quads (DOQ)(DOQ) US Geologic SurveyUS Geologic Survey 4 Tera Bytes4 Tera Bytes Most data not yet publishedMost data not yet published Based on a CRADABased on a CRADA

Microsoft TerraServer makes data available.Microsoft TerraServer makes data available.

USGS “DOQ”

1x1 meter4 TBContinentalUSNew DataComing

Russian Space AgencyRussian Space Agency(SovInfomSputnik)(SovInfomSputnik)

SPIN-2 SPIN-2 (Aerial Images is Worldwide Distributor)(Aerial Images is Worldwide Distributor)

1.5 Meter Geo Rectified imagery of (almost) anywhere1.5 Meter Geo Rectified imagery of (almost) anywhere Almost equal-area projectionAlmost equal-area projection De-classified satellite photos (from 200 KM),De-classified satellite photos (from 200 KM), More data coming (1 m)More data coming (1 m) Selling imagery on Internet.Selling imagery on Internet. Putting 2 tmPutting 2 tm22 onto Microsoft TerraServer. onto Microsoft TerraServer.

SPIN-2

http://www.TerraServer.Microsoft.com/

Demo Demo

SPIN-2

Microsoft

BackOffice

http://www.terraserver.microsoft.com/

http://www.terraserver.microsoft.com/

http://t2b2c/terra-server/

Demo Demo navigate by coverage map to White Housenavigate by coverage map to White House Download imageDownload image buy imagery from USGS buy imagery from USGS navigate by name to Venice navigate by name to Venice buy SPIN2 image & Kodak photobuy SPIN2 image & Kodak photo Pop out to Expedia street map of VenicePop out to Expedia street map of Venice Mention that DB will double in next 18 Mention that DB will double in next 18

months (2x USGS, 2X SPIN2)months (2x USGS, 2X SPIN2) Segue back to Jim Gray Segue back to Jim Gray

1TB Database Server AlphaServer 8400 4x400. 10 GB RAM 324 StorageWorks disks 10 drive tape library (STC Timber Wolf DLT7000 )

HardwareHardware

STK9710DLTTapeLibrary

489 GBDrives

AlphaServer8400

Enterprise Storage Array

8 x 440MHzAlpha cpus

10 GB DRAM

489 GBDrives

489 GBDrives

489 GBDrives

489 GBDrives

489 GBDrives

489 GBDrives

100 MbpsEthernet Switch

DS3

SiteServersInternet

MapServer

SPIN-2

Web Servers

The The Microsoft TerraServer HardwareMicrosoft TerraServer Hardware

Compaq AlphaServer 8400Compaq AlphaServer 8400 8x400Mhz Alpha cpus8x400Mhz Alpha cpus 10 GB DRAM10 GB DRAM 324 9.2 GB StorageWorks Disks324 9.2 GB StorageWorks Disks

3 TB raw, 2.4 TB of RAID53 TB raw, 2.4 TB of RAID5

STK 9710 tape robot (4 TB)STK 9710 tape robot (4 TB) WindowsNT 4 EE, SQL Server 7.0WindowsNT 4 EE, SQL Server 7.0

browser

HTMLJava

Viewer

The Internet

Web Client

Microsoft AutomapActiveX Server

Internet InfoServer 4.0

Image DeliveryApplication

SQL Server7

MicrosoftSite Server EE

Internet InformationServer 4.0

Image Provider Site(s)

TerraServer DB Automap Server

Terra-ServerStored Procedures

InternetInformationServer 4.0

ImageServer

Active Server Pages

MTS

TerraServer Web Site

SoftwareSoftware

SQL Server 7

Backup and RecoveryBackup and Recovery STK 9710 Tape robotSTK 9710 Tape robot Legato NetWorker™Legato NetWorker™ SQL Server 7 Backup & RestoreSQL Server 7 Backup & Restore Clocked at 80 MBps (peak)Clocked at 80 MBps (peak)

(~ 200 GB/hr)(~ 200 GB/hr)

SQL Server Enterprise MgrSQL Server Enterprise Mgr DBA MaintenanceDBA Maintenance SQL Performance Monitor SQL Performance Monitor

System System Management & Management & MaintenanceMaintenance

Microsoft TerraServer File Group LayoutMicrosoft TerraServer File Group Layout Convert 324 disks to 28 RAID5 setsConvert 324 disks to 28 RAID5 sets

plus 28 spare drivesplus 28 spare drives

Make 4 WinNT volumes Make 4 WinNT volumes (RAID 50)(RAID 50)

595 GB per volume595 GB per volume

Build 30 20GB files on each volumeBuild 30 20GB files on each volume DB is File Group of 120 filesDB is File Group of 120 files

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

E: F: G: H:

HSZ70 A

HSZ70 B

Image Delivery and LoadImage Delivery and LoadIncremental load of 4 more TB in next 18 monthsIncremental load of 4 more TB in next 18 months

DLTTape “tar”

\Drop’N’ DoJobWait 4Load

LoadMgrDB

100mbitEtherSwitch

108 9.1 GBDrives

Enterprise Storage Array

AlphaServer8400

108 9.1 GBDrives

108 9.1 GBDrives

STKDLTTape

Library

604.3 GBDrives

AlphaServer4100

ESAAlphaServer4100

LoadMgr

DLTTape

NTBackup

ImgCutter

\Drop’N’ \Images

10: ImgCutter20: Partition30: ThumbImg40: BrowseImg45: JumpImg50: TileImg55: Meta Data60: Tile Meta70: Img Meta80: Update Place

...LoadMgr

ScalabilityScalability1 billion 1 billion

transactionstransactions

1.8 million 1.8 million mail messagesmail messages

4 terabytes of 4 terabytes of datadata

100 million100 millionweb hitsweb hits

• Scale up: to large SMP nodesScale up: to large SMP nodes• Scale out: to clusters of SMP nodesScale out: to clusters of SMP nodes

NCSA Super ClusterNCSA Super Cluster

National Center for Supercomputing ApplicationsNational Center for Supercomputing ApplicationsUniversity of Illinois @ UrbanaUniversity of Illinois @ Urbana

512 Pentium 512 Pentium IIII cpus, 2,096 disks, SAN cpus, 2,096 disks, SAN Compaq + HP +Myricom + WindowsNTCompaq + HP +Myricom + WindowsNT A Super Computer for 3M$A Super Computer for 3M$ Classic Fortran/MPI programmingClassic Fortran/MPI programming DCOM programming modelDCOM programming model

http://access.ncsa.uiuc.edu/CoverStories/SuperCluster/super.html

Challenges For GovernmentChallenges For Government

Heterogeneous & legacy systemsHeterogeneous & legacy systems

Year 2000 problemYear 2000 problem

Security and StandardsSecurity and Standards

High AvailabilityHigh Availability

Total Cost Of OwnershipTotal Cost Of Ownership

Microsoft’s RoleMicrosoft’s Role Provide software building blocksProvide software building blocks

For efficient digital nervous systemsFor efficient digital nervous systems For information at your fingertipsFor information at your fingertips For continued industry innovationFor continued industry innovation

Make the PC easier and simplerMake the PC easier and simpler Listen to customersListen to customers Public and private cooperationPublic and private cooperation

Windows NT Enterprise Windows NT Enterprise Solutions for Federal Solutions for Federal

Agencies Agencies

Sean MurphySean MurphySenior Systems EngineerSenior Systems Engineer

MicrosoftMicrosoftKeeping You Mission Critical Keeping You Mission Critical

Applications Running...Applications Running...

Windows NTWindows NT InteroperabilityInteroperability With Everyone With Everyone File & Print Services File & Print Services

MacintoshMacintosh NetWareNetWare UnixUnix

Terminal ServerTerminal Server SNA Server SNA Server Integrated SecurityIntegrated Security Security InteropSecurity Interop

UNIX + NetWareUNIX + NetWare LDAP DirectoryLDAP Directory HTTP, XMLHTTP, XML SNMP, POP3, IMAP4..SNMP, POP3, IMAP4..

BackOffice Client BackOffice Client SupportSupport Macintosh (AppleTalkMacintosh (AppleTalk NetWare 3.x, 4.x (IPX)NetWare 3.x, 4.x (IPX) Banyan VinesBanyan Vines OS/2OS/2 UnixUnix

NetworkingNetworking TCP/IPTCP/IP SNASNA IPX/SPXIPX/SPX AppleTalkAppleTalk VinesVines DECnetDECnet LanManLanMan

Y2KY2KYear 2000 ComplianceYear 2000 Compliance Microsoft customer commitmentMicrosoft customer commitment

www.Microsoft.com/Year2000www.Microsoft.com/Year2000

Y2K certificationY2K certification Win95 / 98Win95 / 98 NT4 / 5NT4 / 5 Office (Word, Excel, Access,…)Office (Word, Excel, Access,…) BackOffice (SQL, Exchange, SNA,..)BackOffice (SQL, Exchange, SNA,..)

Compliance tests complete by Sept 1998Compliance tests complete by Sept 1998 Downloads available from web site.Downloads available from web site.

Security: Security: Federal Standards SupportFederal Standards Support

Windows NT C2 CertificationWindows NT C2 Certification FIPS 140-1 Certification for MS Crypto FIPS 140-1 Certification for MS Crypto

APIAPI Fortezza SupportFortezza Support

Browser, Web Server, EtcBrowser, Web Server, Etc X.509 Certificate Server for PKI (Public X.509 Certificate Server for PKI (Public

Key Infrastructure)Key Infrastructure)

SQL Server 7 C2 CertificationSQL Server 7 C2 Certification

Security: Security: Microsoft Exchange DMSMicrosoft Exchange DMS

High Assurance MessagingHigh Assurance Messaging Total Support From the beginningTotal Support From the beginning FortezzaFortezza MSP4.0 version DMS 2.0bMSP4.0 version DMS 2.0b

Medium Assurance Messaging Medium Assurance Messaging (COTS)(COTS) KMS (Key Management Server)KMS (Key Management Server) X.509 v3 certificates, MS Certificate X.509 v3 certificates, MS Certificate

Server integrationServer integration S/MIMES/MIME

Security: Security: FuturesFutures

For NT 4.0For NT 4.0 Security Configuration EditorSecurity Configuration Editor NTLM / PKI IntegrationNTLM / PKI Integration Services For UNIXServices For UNIX

For NT 5.0For NT 5.0 Kerberos Client AuthenticationKerberos Client Authentication Encrypting File SystemEncrypting File System IPSecIPSec

DOS, MAC, UNIX clientsDOS, MAC, UNIX clients(via Citrix plug-in)(via Citrix plug-in)

Microsoft Microsoft Terminal Terminal ServerServer

Windows-basedWindows-basedterminalterminal

WorkstationWorkstationor Desktop PC or Desktop PC

Net PCNet PC(ICA)(ICA)

(T.S

hare)

(T.S

hare)

(T.Share)(T.Share)

(T.Share)(T.Share)

Thin Client Thin Client SWSWor deviceor device

Microsoft Terminal ServerMicrosoft Terminal ServerThin Client WindowsThin Client Windows

Windows GUI and apps on any platformWindows GUI and apps on any platform Windows-to-Windows solutionWindows-to-Windows solution Lower total cost of ownershipLower total cost of ownership

Microsoft BackOfficeMicrosoft BackOffice

Windows NT ServerWindows NT ServerInternet Information ServerInternet Information ServerInternet Information ServerInternet Information Server

Microsoft Transaction ServerMicrosoft Transaction Server

Microsoft Message QueueMicrosoft Message Queue

Exchange ServerExchange ServerIntegrated Messaging & GroupwareIntegrated Messaging & Groupware

Supports all the popular standardsSupports all the popular standards POP3, IMAP4, LDAP, X400, SNMP, S/MIME,POP3, IMAP4, LDAP, X400, SNMP, S/MIME,….….

Complete Collaboration EnvironmentComplete Collaboration Environment Chat and NetMeetingChat and NetMeeting Web-based CollaborationWeb-based Collaboration Workflow Event Scripting and Routing Wizard Workflow Event Scripting and Routing Wizard Integration with and NT security, Office, and BackOffice.Integration with and NT security, Office, and BackOffice.

Lowest cost: Own, Manage, & AdminLowest cost: Own, Manage, & Admin Single seat admin, Sites, Proactive monitors, Auto re-routingSingle seat admin, Sites, Proactive monitors, Auto re-routing

Most popular Groupware serverMost popular Groupware server Outsells Lotus NotesOutsells Lotus Notes

More details later todayMore details later today

Microsoft SQL ServerMicrosoft SQL ServerThe Most Popular SQL SystemThe Most Popular SQL System

SQL Server 6.5 integrated with NTSQL Server 6.5 integrated with NT GUI admin and toolsGUI admin and tools client / server stored proceduresclient / server stored procedures integrated security, performance monitorintegrated security, performance monitor Replication (publish/distribute/subscribe)Replication (publish/distribute/subscribe)

SQL Server 6.5 Enterprise EditionSQL Server 6.5 Enterprise Edition High Availability: failover.High Availability: failover. English Language QueryEnglish Language Query Large Memory support (3GB)Large Memory support (3GB)

Next: Next: Windows NT5.0 Windows NT5.0 Reduced Total Cost of OwnershipReduced Total Cost of Ownership

Plug & PlayPlug & Play

Remote operations (MMC and scripting)Remote operations (MMC and scripting)

Active DirectoryActive Directory

Intelli-MirroringIntelli-Mirroring

Hierarchical Storage ManagementHierarchical Storage Management

Web Web sitesite

DatabaseDatabase

Web site filesWeb site files

Database filesDatabase files

Server 1Server 1

BrowserBrowser

High Availability Windows NT:High Availability Windows NT:Failover with Microsoft Cluster ServerFailover with Microsoft Cluster Server

Server 1Server 1 Server 2Server 2

Web site filesWeb site files

Database filesDatabase files

Web Web sitesite

DatabaseDatabase

Web Web sitesite

DatabaseDatabase

Business Impact of DowntimeBusiness Impact of Downtime Downtime costs U.S. business $4 Downtime costs U.S. business $4

billion/year*billion/year* On average, one period of downtime costs:On average, one period of downtime costs:

$140,000 in retail industry$140,000 in retail industry$450,000 in securities industry$450,000 in securities industry

Mission-critical application support**Mission-critical application support** 1992, 12% of applications ran 24 hours1992, 12% of applications ran 24 hours 1996, 28% of applications will run 24 hours1996, 28% of applications will run 24 hours

* Strategic Research Division of Find/SVP, 1992* Strategic Research Division of Find/SVP, 1992**Standish Group, 1992**Standish Group, 1992

Windows NT ServerWindows NT ServerA Reliable Server A Reliable Server PlatformPlatform

Protection against application faultsProtection against application faults Preemptive multitasking, protected memoryPreemptive multitasking, protected memory ““Instrumented” monitoring, logging, alertingInstrumented” monitoring, logging, alerting

Protection against loss of dataProtection against loss of data Journalled, recoverable file systemJournalled, recoverable file system Disk mirroring, RAID striping with parityDisk mirroring, RAID striping with parity

Protection against loss of powerProtection against loss of power Uninterruptible Power Supply (UPS) supportUninterruptible Power Supply (UPS) support

Protection against loss of a logon serverProtection against loss of a logon server Replicated Directory & Backup logon serversReplicated Directory & Backup logon servers

Current NT Server High-AvailabilityCurrent NT Server High-Availability& Clustering Solutions& Clustering Solutions

VendorVendor ProductProductAmdahlAmdahl EnVista Central ServerEnVista Central ServerCompaqCompaq Recovery ServerRecovery ServerDigitalDigital Digital Clusters for NT ServerDigital Clusters for NT ServerFujitsu/ICLFujitsu/ICL High-Availability ManagerHigh-Availability ManagerHewlett PackardHewlett Packard MC/ServiceGuardMC/ServiceGuardMarathonMarathon MIALMIAL NCRNCR LifeKeeperLifeKeeperNSINSI Double-TakeDouble-TakeNetframeNetframe ClusterServerClusterServerOctopusOctopus Octopus A.S.O.Octopus A.S.O.StratusStratus RADIORADIOTandemTandem CASCASVeritasVeritas FirstWatchFirstWatchVincaVinca StandBy ServerStandBy Server

High-Availability ClusteringHigh-Availability ClusteringMicrosoft Cluster Server (Windows NT Microsoft Cluster Server (Windows NT Server Enterprise Edition)Server Enterprise Edition)

Client PCsClient PCs PrintersPrinters

Server StorageServer Storage

““Heartbeat” ConnectionHeartbeat” Connection


Server 1Server 1 Server 2Server 2ReportReport

eServiceeServiceeServiceeService


Availability During Server Availability During Server MaintenanceMaintenanceMicrosoft Cluster ServerMicrosoft Cluster Server





Server 2Server 2Server 1Server 1Server 1Server 1




Server 2Server 2Server 1Server 1

Availability During Unplanned Availability During Unplanned DowntimeDowntimeMicrosoft Cluster ServerMicrosoft Cluster Server



Server 2Server 2

Server 2Server 2Server 1Server 1Server 1Server 1

Availability During Unplanned Availability During Unplanned DowntimeDowntimeMicrosoft Cluster ServerMicrosoft Cluster Server



CostelloCostelloCostelloCostello

On Stage TodayOn Stage Today

AbbottAbbottAbbottAbbott

Raid Array Drives X:,Y:,Z:Raid Array Drives X:,Y:,Z:Raid Array Drives X:,Y:,Z:Raid Array Drives X:,Y:,Z:

BingcrosbyBingcrosbyBingcrosbyBingcrosby

Compaq PentiumCompaq PentiumPro Servers Pro Servers

blah blahblah blah

Compaq PentiumCompaq PentiumPro Servers Pro Servers

blah blahblah blah

Compaq Compaq Alpha WKS Alpha WKS blah blahblah blah

Compaq Compaq Alpha WKS Alpha WKS blah blahblah blah

And now 16,257 TPM-CAnd now 16,257 TPM-C

WinNT + SQLServer Progress WinNT + SQLServer Progress in Transaction Processingin Transaction Processing

00

2,0002,000

4,0004,000

6,0006,000

8,0008,000

10,00010,000

12,00012,000

19951995

Windows NT Server 3.51Windows NT Server 3.51Windows NT Server 3.51Windows NT Server 3.51

NT 4.0 + SQL 6.5NT 4.0 + SQL 6.5NT 4.0 + SQL 6.5NT 4.0 + SQL 6.5

19981998

Tpm-CTpm-C

14,00014,000

WinNT & SQLWinNT & SQLEnterprise EditionEnterprise Edition

WinNT & SQLWinNT & SQLEnterprise EditionEnterprise Edition

95th Percentile Market Requirement

100% better100% betterper year!per year!

More comingMore coming Price also Price also

improvedimproved

19961996 19971997

0

50

100

150

200

250

6/95 12/95 6/96 12/96 6/97 12/97 6/98time

$/tp

mC

MS SQL Server $/tpmC vs Time (100%/year better)

TPC Price/tpmC

8

17

4 53

0

5

10

15

20

25

30

35

40

45

50

processor disk software net total/10

HP+ NT4 +SQL Server 16.2 ktpmC @ 33$/tpmC

Windows NT + SQLServer Windows NT + SQLServer Price PerformancePrice Performance

Improved 100%/year for last 3 yearsImproved 100%/year for last 3 years Software is ~10% of costs (30% on UNIX)Software is ~10% of costs (30% on UNIX) UNIX hardware and software has a 6x premiumUNIX hardware and software has a 6x premium

TPC Price/tpmC

45

35

30

7

12

8

17

4 53

0

5

10

15

20

25

30

35

40

45

50

processor disk software net total/10

Sun Oracle 52 k tpmC @ 134$/tpmC

HP+ NT4 +SQL Server 16.2 ktpmC @ 33$/tpmC

$ cost of each component

SQL Server 7: Easy & PowerfulSQL Server 7: Easy & Powerful

EasyEasy Dynamic self managementDynamic self management Multi-site managementMulti-site management Alert/response managementAlert/response management Job scheduling and executionJob scheduling and execution Scriptable managementScriptable management profiling/tuning toolsprofiling/tuning tools Fully UnicodeFully Unicode English Language QueryEnglish Language Query Integrated text search engineIntegrated text search engine

ScalabilityScalability

Data WarehousingData Warehousing

Make It Easy!Make It Easy!(fewer knobs)(fewer knobs)

DesktopDesktop & Workgroups & Workgroups Auto Configure Engine / Dynamic Disk/memoryAuto Configure Engine / Dynamic Disk/memory Reduce Learning Curve, Increase Productivity Reduce Learning Curve, Increase Productivity Self-Managing SQLAgent, Wizards, “Task Pads”Self-Managing SQLAgent, Wizards, “Task Pads”

Large ServersLarge Servers Deploy/manage hundreds of SQL ServersDeploy/manage hundreds of SQL Servers Lower TCO for Large EnvironmentsLower TCO for Large Environments Multi-Server Operations/ “Lights-out” EnvironmentMulti-Server Operations/ “Lights-out” Environment

DBA and Developer ToolsDBA and Developer Tools Built-in GUI Built-in GUI

data/schema designdata/schema design data query & editdata query & edit integrated with programming toolsintegrated with programming tools

SQL Server ProfilerSQL Server Profiler Selected server events and trace criteriaSelected server events and trace criteria ““Capture” output to screen or replayCapture” output to screen or replay

SQL Server ExpertSQL Server Expert Analyzes actual server usage history Analyzes actual server usage history Makes recommendations to improve performanceMakes recommendations to improve performance Recommends Index designRecommends Index design Recommends operations proceduresRecommends operations procedures

Admin servers from one placeAdmin servers from one place Automate simple stuffAutomate simple stuff Wizards for common stuffWizards for common stuff Manage arrays of serversManage arrays of servers operations, security,…operations, security,… ReplicationReplication Import/exportImport/export

Interface is scriptableInterface is scriptable COM object modelCOM object model Script with Java, VB, ...Script with Java, VB, ...

Scheduling and Multi-step jobsScheduling and Multi-step jobs

Multi-Site ManagementMulti-Site Management

Wizards and GUIsWizards and GUIs Wizards galore (over 50 at last count)Wizards galore (over 50 at last count) MS Access as a query interfaceMS Access as a query interface Built-in data access tools (integrated with tools)Built-in data access tools (integrated with tools) Graphical show planGraphical show plan

Many New Wizards...Many New Wizards... Create a DatabaseCreate a Database Scheduled Backup Scheduled Backup Create a Maintenance Plan Create a Maintenance Plan Create a Scheduled Job Create a Scheduled Job Create an AlertCreate an Alert Security WizardSecurity Wizard Import Data to SQL ServerImport Data to SQL Server Export Data From SQLExport Data From SQL Clustering (Wolfpack)Clustering (Wolfpack) Index Tuning WizardIndex Tuning Wizard

Web Assistant Web Assistant Register ServersRegister Servers Configure Replication Configure Replication Create PublicationCreate Publication Create Pull SubscriptionCreate Pull Subscription Create Push SubscriptionCreate Push Subscription Replication PartitioningReplication Partitioning Create an IndexCreate an Index Create Stored ProcedureCreate Stored Procedure Create a ViewCreate a View More to come...More to come...

ReplicationReplication

Transactional and MergeTransactional and Merge Remote updateRemote update ODBC and OLE DB subscribersODBC and OLE DB subscribers WizardsWizards PerformancePerformance

2PC, 2PC, RPCRPC

SubscriberSubscriber

DB2

CICS SubscriberSubscriberSubscriberSubscriber

VSAM

OS 390DB2

PublisherPublisher

Updating SubscriberUpdating Subscriber(immediate updates)(immediate updates)

DistributorDistributor

SubscriberSubscriber

•# of emp. per group# of emp. per group

•total inc. per grouptotal inc. per group

Local Agg.Local Agg.

4 x 50 rows4 x 50 rows

+ + + +

DisksDisks50,000 rows50,000 rows

Global Agg.Global Agg. Result 50 rowsResult 50 rows+

Parallel QueryParallel QuerySMP & Disk ParallelismSMP & Disk Parallelism

Plus DistributedPlus Distributed Plus Hash Join Plus Hash Join Plus Optimized Partitioned viewsPlus Optimized Partitioned views

Distributed Heterogeneous QueriesDistributed Heterogeneous QueriesData Fusion / IntegrationData Fusion / Integration

Join spread sheets, Join spread sheets, databases, databases, directories, directories,

Text DBsText DBs

etc.etc.

Any source that Any source that exposes OLE DB exposes OLE DB interfacesinterfaces

SQL Server as SQL Server as gateway, gateway, even on the even on the desktopdesktop

DatabaseDatabase(DB2, VSAM, Oracle, …)(DB2, VSAM, Oracle, …)

SpreadsheetSpreadsheet

PhotosPhotos

MailMail

MapsMaps

DocumentsDocumentsand the Weband the Web

DirectoryDirectoryServiceService

SQL 7.0Query

Processor

The New SQL Server 7.0 The New SQL Server 7.0 ScalabilityScalability

Win95 Win98 versionWin95 Win98 version Dynamic row-level lockingDynamic row-level locking Improved query optimizerImproved query optimizer Intra-query parallelismIntra-query parallelism 64-bit support64-bit support ReplicationReplication Distributed queryDistributed query High Availability ClustersHigh Availability Clusters

EasyEasy



Scale Down to Windows 95-98Scale Down to Windows 95-98 Full function (Full function (same as NTWsame as NTW)) Self managingSelf managing Many toolsMany tools Integration with Next MS Integration with Next MS

AccessAccess Great for imbedded apps Great for imbedded apps

Data Tidal WaveData Tidal Wave Seagate 47GB drive @ 3k$Seagate 47GB drive @ 3k$

100 GB penny per MB drive coming in 2000100 GB penny per MB drive coming in 2000

10 $/GB = 10 k$/ Terabyte! (in y2k)10 $/GB = 10 k$/ Terabyte! (in y2k) Everyone can afford oneEveryone can afford one

What’s a What’s a terror biteterror bite?? If you sell ten billion items a year If you sell ten billion items a year (e.g Wal-Mart)(e.g Wal-Mart)

And you record 100 bytes on each oneAnd you record 100 bytes on each one Then you get a TerabyteThen you get a Terabyte

Where will the terabytes come from?Where will the terabytes come from? Multimedia (like the TerraServer) and...Multimedia (like the TerraServer) and...

Multi Media: Multi Media: Very Large Data BasesVery Large Data Bases Photo is 100 KB, not 100 BPhoto is 100 KB, not 100 B

So, photo DBs are 1,000x largerSo, photo DBs are 1,000x larger

Examples:Examples: Scanned documentsScanned documents Photo records of Photo records of

products/people/placesproducts/people/places SurveillanceSurveillance Scientific monitoringScientific monitoring

Some TeraByte DatabasesSome TeraByte Databases

Microsoft TerraServer Microsoft TerraServer Sloan Digital Sky Survey:Sloan Digital Sky Survey:

40 TB raw, 2 TB cooked 40 TB raw, 2 TB cooked EOS/DIS (picture of planet each week)EOS/DIS (picture of planet each week) 15 PB by 200715 PB by 2007

Federal Reserve Clearing house: images Federal Reserve Clearing house: images of checksof checks 15 PB by 2006 (7 year history)15 PB by 2006 (7 year history)

Nuclear Stockpile Stewardship ProgramNuclear Stockpile Stewardship Program 10 Exabytes (???!!) 10 Exabytes (???!!)

Kilo

Mega

Giga

Tera

Peta

Exa

Zetta

Yotta


Warehousing FrameworkWarehousing Framework Visual data modelerVisual data modeler Microsoft repositoryMicrosoft repository Data transformation services Data transformation services

(DTS)(DTS) Plato & Dcube - Multi Plato & Dcube - Multi

Dimensional Data CubesDimensional Data Cubes English query 2.0English query 2.0 Built-in text-index engineBuilt-in text-index engine

EasyEasy



Flexible OLAP-Cube Flexible OLAP-Cube Debates between Debates between

MOLAP and MOLAP and ROLAP vendors ROLAP vendors obscure customer obscure customer needsneeds

Plato is the Plato is the product that best product that best supports MOLAP, supports MOLAP, ROLAP and Hybrid ROLAP and Hybrid and offers the and offers the most seamless most seamless integration of all integration of all threethree

Users & apps only Users & apps only see cubessee cubes

MO

LAP

UserView

Dataload

PersistentStore

UserView

Dataaccess

MDCache

RO

LAP

UserView

MDCache

Hyb

rid

Source tableSource table

Partition 1Partition 1

ROLAP



ROLAP

EuropeEurope

USAUSA

AsiaAsia

MD SQLMD SQL

SQLSQL

Plato and DcubePlato and Dcubeand HOLAPand HOLAP

““Plato”Plato” serverserver

““Plato”Plato”

DesignerDesigner

Dcu

be

Dcu

be

ClientClientappapp

User 1User 1

Dcu

be

Dcu

be

ClientClientappapp

User 2User 2

CHEVY

FORD 19901991

19921993

REDWHITEBLUE

By Color

By Make & Year

By Color & Year

By MakeBy Year

Sum

Plato Data Explosion WizardPlato Data Explosion Wizard Aggregation Wizard finds the “80-20” rule in the dataAggregation Wizard finds the “80-20” rule in the data

The 20 percent of all possible pre-aggregations The 20 percent of all possible pre-aggregations that provide 80 percent of the performance gainthat provide 80 percent of the performance gain

Analyses level counts for each dimensions and parent-Analyses level counts for each dimensions and parent-child ratios for each levelchild ratios for each level

Independent Independent of OLAP of OLAP data modeldata model

Platform

SimplicitySimplicity

InternetInternet ScalabilityScalabilityInitiatives

Windows 9XWindows 9XMicrosoft OfficeMicrosoft Office

Visual StudioVisual Studio

Windows NT andWindows NT andMicrosoft BackOfficeMicrosoft BackOffice

Microsoft’s Enterprise FocusMicrosoft’s Enterprise Focus

InteroperabilityInteroperability

Support and Support and ServicesServices

ReliabilityReliability

Summary Summary Microsoft is investing to make Microsoft is investing to make

Windows NT™Windows NT™ BackOffice™BackOffice™

Enterprise ReadyEnterprise Ready

Key Enterprise FeaturesKey Enterprise Features Powerful: do the jobPowerful: do the job Scaleable: can handle the biggest jobsScaleable: can handle the biggest jobs Simple: Easy to build and operateSimple: Easy to build and operate Economic: Lowest total cost of ownershipEconomic: Lowest total cost of ownership Inter-operate with other systemsInter-operate with other systems