Server 7 Launch Japan 1/21/99 gray 1 Server 7 Launch Japan 1/21/99 gray 1 Microsoft SQL Server 7.0 Jim Gray Senior Researcher Microsoft Research Microsoft

Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 11

Microsoft SQL Server™ 7.0Microsoft SQL Server™ 7.0

Jim GrayJim GraySenior ResearcherSenior ResearcherMicrosoft ResearchMicrosoft ResearchMicrosoft CorporationMicrosoft Corporation


Organizations Are Going OnlineOrganizations Are Going Online

Building a digital nervous system.Building a digital nervous system. Inexpensive hardware means huge Inexpensive hardware means huge

databases are possible.databases are possible. But, we are drowning in data.But, we are drowning in data. Databases help organize information.Databases help organize information. Microsoft’s goal:Microsoft’s goal:

Information at your fingertips.Information at your fingertips. Make it easy to Make it easy to capture, capture,

manage, and manage, and analyze information.analyze information.


Microsoft SQL Server 7 GoalsMicrosoft SQL Server 7 Goals Reduce cost of ownership:Reduce cost of ownership:

Easy to build applicationsEasy to build applications Easy to administerEasy to administer Easy to scaleup applicationsEasy to scaleup applications

ScaleableScaleable Scale down to portablesScale down to portables Scale to many nodes (manage, replicate)Scale to many nodes (manage, replicate) Scale to huge nodesScale to huge nodes

Data warehousingData warehousing Data captureData capture Data analysisData analysis


Microsoft SQL ServerMicrosoft SQL Server

Need W2K logo

GigabytesGigabytes100s users100s users

Standard

Full featuredFull featured

EnterpriseEnterprise

TerabytesTerabytes1,000s users1,000s users

Large MemoryLarge Memory ClustersClusters Partitioned cubesPartitioned cubes

DeskTopDeskTop

MegabytesMegabytes

< 5 users< 5 users simple replicationsimple replication

+ Microsoft Data + Microsoft Data Engine in Office 2000Engine in Office 2000


EasyEasy

EasyEasy

Dynamic self managementDynamic self management Multi-site managementMulti-site management Operation ScriptingOperation Scripting Job scheduling and executionJob scheduling and execution Alert/response management Alert/response management DBA profiling/tuning toolsDBA profiling/tuning tools Installation and upgradeInstallation and upgrade UnicodeUnicode Integrated with NT SecurityIntegrated with NT Security

Integrated with NT filesIntegrated with NT files

ScalabilityScalability

Data WarehousingData Warehousing


Made It Made It (Even)(Even) Easier!Easier! DesktopDesktop

Auto ConfigureAuto Configure Self-ConfiguringSelf-Configuring Engine / Dynamic Disk/memory Engine / Dynamic Disk/memory

WorkgroupsWorkgroups Reduce Learning Curve, Increase ProductivityReduce Learning Curve, Increase Productivity Self-ManagingSelf-Managing SQLAgent, Wizards, “Task Pads” SQLAgent, Wizards, “Task Pads”

Large OrganizationsLarge Organizations Deploy/manage “100’s” of SQL ServersDeploy/manage “100’s” of SQL Servers Lower TOC for Large EnvironmentsLower TOC for Large Environments Multi-Server Operations/ Remote OperationMulti-Server Operations/ Remote Operation


Multi-site management Multi-site management through groups, agentsthrough groups, agents

Route events from all Route events from all servers to one masterservers to one master

Script any set of Script any set of operations for all serversoperations for all servers

Job Scheduling and Job Scheduling and WorkflowWorkflow

Shared sub-set of UI for Shared sub-set of UI for web administrationweb administration

Graphical tools for dataGraphical tools for data Import/exportImport/export

Multi-Site ManagementMulti-Site ManagementCommon ConsoleCommon Console


SQL Namespace Object (SQL-NS)SQL Namespace Object (SQL-NS)

SQL-Distributed Management Objects)SQL-Distributed Management Objects)In-Process COM ServerIn-Process COM Server

40+ Objects, 1600+props/methods40+ Objects, 1600+props/methods

DTSDTS

Distributed Management Framework Distributed Management Framework

SQL ServerSQL ServerEngineEngine

SQL Server AgentSQL Server AgentReplicationReplication

Task ExecutionTask ExecutionEvent MgtEvent Mgt

Alerting/PagingAlerting/PagingSNMPSNMP

EventsEvents

ActionsActions

TraceTraceEvents/Events/

PerfPerfMonMon

Microsoft Management ConsoleMicrosoft Management ConsoleDatabaseDatabase ProfilerProfilerMMC - SQL Server Snap-inMMC - SQL Server Snap-in

Administration shellAdministration shell MMC snap-inMMC snap-in Supports all Supports all

operationsoperations Namespace objectsNamespace objects

Navigation + UINavigation + UI For namespace shellsFor namespace shells

COM administration COM administration interfacesinterfaces ActiveXActiveX™™ Scripting Scripting

AgentsAgents Self-managing Self-managing

componentcomponent Activity Activity

monitoring/filtersmonitoring/filters EventsEvents

Queries/trafficQueries/traffic State changes State changes

in enginein engine


Dynamic memory managementDynamic memory management

Dynamic Self ManagementDynamic Self Management

48M Memory, 100 locks48M Memory, 100 locks2 a.m., 5 users1 GB Memory, 10K locks1 GB Memory, 10K locksNoon, 700 users

4 GB on disk, auto-grow4 GB on disk, auto-grow12/97, Sales history table

128 MB on disk, auto-shrink128 MB on disk, auto-shrink1/98, Sales history table

128 MB on disk 128 MB on disk 1/97, Sales history table

Dynamic File Space Management with Auto-Statistics

Au

to-S

tati

stic

s


Wizards and GUIsWizards and GUIs Many Wizards - over 50 at last count Many Wizards - over 50 at last count MS Access as a query interfaceMS Access as a query interface Query tool built into SQL, Visual Studio,...Query tool built into SQL, Visual Studio,... Graphical show planGraphical show plan


DBA and Developer ToolsDBA and Developer Tools

SQL Server ProfilerSQL Server Profiler Select server events and trace criteriaSelect server events and trace criteria ““Capture” output to screen or replayCapture” output to screen or replay

Index Tuning WizardIndex Tuning Wizard Analyzes actual server usage Analyzes actual server usage

history history Makes recommendations to Makes recommendations to

improve performanceimprove performance


Demo: 5 minutesDemo: 5 minutes Tour of the wizards wizardTour of the wizards wizard

(touch on create index, DTS, maintenance plan)(touch on create index, DTS, maintenance plan)

Show database layout (auto schema)Show database layout (auto schema) Show index tuning wizard Show index tuning wizard

(using pre-canned trace file) (using pre-canned trace file) Let it define the indicesLet it define the indices


Index Wizard is Good Index Wizard is Good but we will make it betterbut we will make it better On a complex query set On a complex query set

wizard is 90% of best expert.wizard is 90% of best expert. Extending it to other aspects of DB Extending it to other aspects of DB

designdesign



Win9x/NT4/Win2000 versionWin9x/NT4/Win2000 version Dynamic row-level lockingDynamic row-level locking VLDB improvementsVLDB improvements Improved query optimizerImproved query optimizer Intra-query parallelismIntra-query parallelism VLM supportVLM support Replication improvementsReplication improvements Distributed queryDistributed query High Availability ClustersHigh Availability Clusters

EasyEasy




Query Processor EnhancementsQuery Processor Enhancements

ParallelismParallelism Improved scan, fetch, & sortImproved scan, fetch, & sort Smart hash & merge joinSmart hash & merge join Large joins & groupingLarge joins & grouping Better query optimizationBetter query optimization Multi-index operationsMulti-index operations Automatic statistics maintenanceAutomatic statistics maintenance Distributed QueryDistributed Query Heterogeneous QueryHeterogeneous Query

Focus on Complex Queries


•# of emp. per group# of emp. per group

•total inc. per grouptotal inc. per group

Local Agg.Local Agg.

4 x 50 rows4 x 50 rows

+ + + +

DisksDisks50,000 rows50,000 rows

Global Agg.Global Agg. Result 50 rowsResult 50 rows+

Parallel QueryParallel QuerySMP & Disk ParallelismSMP & Disk Parallelism

Plus DistributedPlus Distributed Plus Hash Join Plus Hash Join (fanciest on the planet)(fanciest on the planet)

Plus Optimized Partitioned viewsPlus Optimized Partitioned views

Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 1717Distributed Heterogeneous QueriesDistributed Heterogeneous QueriesData Fusion / IntegrationData Fusion / Integration

Join spread sheets, Join spread sheets, databases, databases, directories, directories,

Text DBsText DBs

etc.etc.

Any source that Any source that exposes OLE DB exposes OLE DB interfacesinterfaces

SQL Server as SQL Server as gateway, gateway, even on the even on the desktopdesktop

DatabaseDatabase(DB2, VSAM, (DB2, VSAM, Oracle, …)Oracle, …)

SpreadsheetSpreadsheet

PhotosPhotos

MailMail

MapsMaps

DocumentsDocumentsand the Weband the Web

DirectoryDirectoryServiceService

SQL 7.0Query

Processor


ReplicationReplication Transactional and MergeTransactional and Merge Remote updateRemote update ODBC and OLE DB subscribersODBC and OLE DB subscribers WizardsWizards PerformancePerformance

2PC, 2PC, RPCRPC

SubscriberSubscriber

DB2

CICS SubscriberSubscriberSubscriberSubscriber

VSAM

OS 390DB2

PublisherPublisher

Updating SubscriberUpdating Subscriber(immediate updates)(immediate updates)

DistributorDistributor

SubscriberSubscriber


UtilitiesUtilitiesThe Key to LARGE DatabasesThe Key to LARGE Databases

BackupBackup FuzzyFuzzy ParallelParallel IncrementalIncremental RestartableRestartable

RecoveryRecovery FastFast File granularityFile granularity

ReorganizeReorganize shrinks file shrinks file reclusters filereclusters file

Auto-RepairAuto-Repair Index creation Index creation

~2x faster than 6.5~2x faster than 6.5

DBCC DBCC not required, not required, a good practicea good practice 5x - 100x faster5x - 100x faster


SQL Server 7.0 BackupSQL Server 7.0 Backup

Scaling atdevice speed

Transaction Throughput during online backup

0

500

1000

1500

2000

2500

3000

0 500 1000 1500 2000 2500

Time (secs)

Tra

nsa

ctio

ns

BackupNO backup

avg = 2349 tpmavg = 2475 tpm

Parallel Backup Throughput (MBps)

95% of throughputmaintained during full on-line backup

(8 drives)

Max tape backup speed: ~ 600GB/hrMax tape backup speed: ~ 600GB/hr


Recovery Speed ComparisonRecovery Speed Comparison4x faster!4x faster!

0

10

20

30

40

50

60

1 2 3 4

SQL Server 6.5

SQL Server 7.0

# of indices

Rec

ove

ry t

ime

(sec

s)


1011

2400

<300

3537

<1500

5700

95% of 95% of customer customer

needsneeds

SQL Server 7.0 ScalabilitySQL Server 7.0 Scalability

Application:Application: SAP R/3SAP R/3 BAAN IVBAAN IV PeopleSoftPeopleSoft Benchmark:Benchmark: SD UsersSD Users BaanBaan HRMSHRMS

3-Tier3-Tier ReferenceReference UsersUsersUsersUsers

SQL Server 6.5SQL Server 6.5

SQL Server 7.0SQL Server 7.0


Best Single Node NT TPC-CBest Single Node NT TPC-C

6,393 6,8427,650

16,273

23,143

0

5,000

10,000

15,000

20,000

25,000

DBMS Oracle Informix Sybase 6.5 7.0

System:-- 4X Pent-Pro, 200 MHz --

$/tpmC $108 $100 $82 $56 $264X PII, Xeon

PublishedTPC-C resultsas of 1/20/99www.tpc.org


The TPC ReportThe TPC Report 621,784 $ 621,784 $

for 5 yearsfor 5 years 1.7 Tera Byte Disk 1.7 Tera Byte Disk

4 CPU4 CPU 4 GB RAM4 GB RAM 18,850 users18,850 users Affordable & Affordable &

ManageableManageable


Price Performance Leadership Price Performance Leadership 250%/year on Price, 250%/year on Price, 100%/year performance100%/year performance

1.52.755676

$/tpmC vs time

$10

$100

$1,000

Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Dec-98

Date

$/t

pm

C

250 %/year improvement!

tpmC vs time

100

1,000

10,000

100,000

Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Dec-98

Date

tpm

C

100 %/year improvement lately!

Best performance: Best performance: 23,143 tpmC, $26/tpmC 23,143 tpmC, $26/tpmC Best price/performance:Best price/performance: 17715,17715, $22tpmC $22tpmC


VLDB ImprovementsVLDB ImprovementsTerabyte SupportTerabyte Support

File Groups for easier managementFile Groups for easier management Exabyte Database Size (theoretical max)Exabyte Database Size (theoretical max) Tested to 2.5 TerabytesTested to 2.5 Terabytes 64-bit support (up to 32 GB with NT5)64-bit support (up to 32 GB with NT5)


http://www.TerraServer.com

Demo Demo

Microsoft

BackOfficeSPIN-2


StorageTek9710 TimberWolf

10 x DLT7000

Enterprise Storage Array

4 NTFS Stripe Sets (600 gb)28 11-Disk Raid 5 Stripe sets

324 9 GB Seagate Disks

7 HSZ70 Ultra-SCSI Dual redundant Controllers

Site ConfigurationSite Configuration

Alpha8400

(8x440)10GBRam

To the Web

CompaqProliant 5500

4x200mhz512mb RAM20GB Raid5

CompaqProliant 5500


CompaqProliant 5500


CompaqProliant 5500


CompaqProliant 5500


CompaqProliant 5500



HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

HSZ70 A

HSZ70 B

F: G: H: I:

HSZ70 A

HSZ70 B

File System ConfigurationFile System Configuration28 hardwareRAID5 sets

Each raid set has 11 disks (16 spare drives)

4 595 GB NTFS volumes Each striped over 7 Raid sets on 7 controllers

26 20 GB files on F:, G:, H:, I:DB is File Group of 104 files (2 TB)


TerraServer June 22 1998 to Jan 18 1999

0

5000000

10000000

15000000

20000000

25000000

30000000

35000000

6/22

/98

7/6/

98

7/20

/98

8/3/

98

8/17

/98

8/31

/98

9/14

/98

9/28

/98

10/1

2/98

10/2

6/98

11/9

/98

11/2

3/98

Date

Co

un

t

Sessions

Hit

Page View

DB Query

Image

TerraServer StatisticsTerraServer Statistics

Billion SQL queries served

99.98% of scheduled availability

New data loaded in background


Web Web sitesite

Web site filesWeb site files

Database filesDatabase files

Server 1Server 1 Server 2Server 2

BrowserBrowser

Web Web sitesite

Server 1Server 1 Server 2Server 2Server 1Server 1 Server 2Server 2

High AvailabilityHigh AvailabilityMicrosoft ClustersMicrosoft Clusters

Automatic failover in less than a minuteAutomatic failover in less than a minute



Warehousing FrameworkWarehousing Framework Visual data modelerVisual data modeler Microsoft repositoryMicrosoft repository Data transformation services Data transformation services

(DTS)(DTS) Plato & Dcube - Multi Plato & Dcube - Multi

Dimensional Data CubesDimensional Data Cubes Integration with Office2000Integration with Office2000

EasyEasy



Server 7 Launch Japan 1/21/99 gray Server 7 Launch Japan 1/21/99 gray 3333Microsoft Data Warehousing FrameworkMicrosoft Data Warehousing Framework

Data Warehouse Management(Console*, Scheduling, Events,Topology*)

Data Warehouse Management(Console*, Scheduling, Events,Topology*)

Man

agin

g

Data Flow

Meta-Data Flow

Microsoft Repository (Persistent Shared Meta-Data)Microsoft Repository (Persistent Shared Meta-Data)

DB Schema*DB Schema* TransformationTransformation Schedulingdata**

Schedulingdata**

OLAPMetadata**

OLAPMetadata**

OperationalData

(ODBC,OLE-DB)

OperationalData

(ODBC,OLE-DB)

Data Warehouse Design(logical/physical schema/ data flow)

Data Warehouse Design(logical/physical schema/ data flow)

Data Transformation

Services(DTS)

Data Transformation

Services(DTS)

Data Marts

(RDBMS,OLAP)

Data Marts

(RDBMS,OLAP)

Building

Data Mart Design(Cubes/Star schema)

Data Mart Design(Cubes/Star schema)

End-User Tools(Excel,Access,

English Query,3rd parties)

End-User Tools(Excel,Access,

English Query,3rd parties)

Using

OL

E D

BO

LE

DB

* Only partially available in SQL 7** Implemented after SQL 7


Data Warehouse / Data AnalysisData Warehouse / Data Analysis

Data Transformation Services Data Transformation Services to get data into the to get data into the

warehousewarehouse CUBE (OLE/DB OLAP) CUBE (OLE/DB OLAP)

to analyze datato analyze dataOperationa

l Data Extact & Load

Data Warehouse Storage

OLAP


OLE DB OLE DB ODBCODBCFixed FieldFixed FieldASCII DelimitedASCII DelimitedExamples: Examples: Oracle, DB/2, Oracle, DB/2, VSAM, flat filesVSAM, flat files DTS Data PumpDTS Data Pump

SourceSource DestinationDestination

InIn OutOut

StepsSteps

XformsXformsOLE DB OLE DB ODBCODBCFixed FieldFixed FieldASCII DelimitedASCII DelimitedHTML PageHTML PageRepl. PublicationRepl. Publication

Data Transformation ServicesData Transformation Services

Job stepsJob steps

+ Workflow &+ Workflow &

SchedulerScheduler

+ Repository+ RepositoryMetadataMetadata

Data PumpData PumpData PumpData Pump

IDTSDataPumpIDTSDataPump IUnknownIUnknown


Warehouses of Data CubesWarehouses of Data Cubes Warehouse is a collection of cubesWarehouse is a collection of cubes Cubes haveCubes have

Star and Snow Flake SchemasStar and Snow Flake Schemas Data AttributesData Attributes DimensionsDimensions

CHEVY

FORD 19901991

1992

1993

RED

WHITE

BLUE

By Color

By Make & Year

By Color & Year

By MakeBy Year

Sum

Sales

DistrictsDealers

RegionsGeography

QuartersDays

Years

Time

ModelsColors

Lines

Products


Source tableSource table

Partition 1Partition 1

ROLAP



ROLAP

EuropeEurope

USAUSA

AsiaAsia

RRelationalelationalOLAP+MOLAP+MultidmensionalultidmensionalOLAPOLAPHHybridybridOLAPOLAP

SQLSQL

DesignerDesigner

““Plato”Plato”

““Plato”Plato” serverserver

MD SQLMD SQL

Dcu

be

Dcu

be

ClientClientappapp

User 1User 1

Dcu

be

Dcu

be

ClientClientappapp

User 2User 2


OLAP + Office 2000 demoOLAP + Office 2000 demo


ReadinessReadiness

300 applications now days;300 applications now days;3,000 within 18 months3,000 within 18 months

System Integrators and ISVsSystem Integrators and ISVs 52,000 trained DBAs52,000 trained DBAs


Internet PlatformInternet Platform

Site Server Site Server

IISIIS MTSMTS MSMQMSMQ

Windows NT ServerWindows NT Server

WebWebclientclient

OfficeOfficeclientclient

Vis

ual

Stu

dio

V

isu

al S

tud

io

and

Fro

ntP

age

and

Fro

ntP

age


Microsoft SQL Server 7.0Microsoft SQL Server 7.0all these features in one productall these features in one productworkstation, server, enterpriseworkstation, server, enterprise

EasyEasy

ScalableScalable

Data Data WarehousingWarehousing
