41
Microsoft Research TECHNICAL FELLOW Jim Gray SQL Server 2005 Tokyo Launch

Slide 1 - Microsoft Research - Turning Ideas into Reality

  • Upload
    tess98

  • View
    438

  • Download
    0

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Slide 1 - Microsoft Research - Turning Ideas into Reality

Microsoft ResearchMicrosoft ResearchTECHNICAL FELLOWTECHNICAL FELLOW

Jim GrayJim Gray

SQL Server 2005 Tokyo Launch SQL Server 2005 Tokyo Launch

Page 2: Slide 1 - Microsoft Research - Turning Ideas into Reality

OutlineOutline Introduction: The IT revolution Continues

Old problems now look easy The perfect system with low people costs Our challenge

SQL Server 2005 History: SQL Server 6.5, 7.0, 2000 achievementsSQL 2005 Goals Service Oriented Data Architecture: SQL + .NETDBMS is Web Services – from three tiers to two

tiers OLAP, Data Mining Data Integration and Reporting

What’s Next ?A vision for the future

Introduction: The IT revolution Continues Old problems now look easy The perfect system with low people costs Our challenge

SQL Server 2005 History: SQL Server 6.5, 7.0, 2000 achievementsSQL 2005 Goals Service Oriented Data Architecture: SQL + .NETDBMS is Web Services – from three tiers to two

tiers OLAP, Data Mining Data Integration and Reporting

What’s Next ?A vision for the future

Page 3: Slide 1 - Microsoft Research - Turning Ideas into Reality

My CareerMy Career60’s PhD @ Berkeley

in “theory”70’s relational databases

IMS FastPath, SystemR, DB2,…80’s fault-tolerance

Tandem, TPC-A,…90’s commoditization

Data cube1 B transactions/day

00’s eScienceTerraServerSkyServerWorld Wide Telescope

60’s PhD @ Berkeley in “theory”

70’s relational databasesIMS FastPath, SystemR, DB2,…

80’s fault-toleranceTandem, TPC-A,…

90’s commoditizationData cube1 B transactions/day

00’s eScienceTerraServerSkyServerWorld Wide Telescope

Page 4: Slide 1 - Microsoft Research - Turning Ideas into Reality

Old Problems Now Look EasyOld Problems Now Look Easy1985 goal: 1,000 transactions per secondCouldn’t do it at the time At the time:

100 transactions/second50 M$ for the computer

(y2005 dollars)

1985 goal: 1,000 transactions per secondCouldn’t do it at the time At the time:

100 transactions/second50 M$ for the computer

(y2005 dollars)

Page 5: Slide 1 - Microsoft Research - Turning Ideas into Reality

Old Problems Now Look EasyOld Problems Now Look Easy1985 goal: 1,000 transactions per secondCouldn’t do it at the time At the time:

100 transactions/second50 M$ for the computer

(y2005 dollars)

Now: easyLaptop does 8,200 debit-credit tps~$400 desktop

1985 goal: 1,000 transactions per secondCouldn’t do it at the time At the time:

100 transactions/second50 M$ for the computer

(y2005 dollars)

Now: easyLaptop does 8,200 debit-credit tps~$400 desktop

Thousands of DebitCredit Transactions-Per-Second: Easy and Inexpensive, Gray & Levine, MSR-TR-2005-39, ftp://ftp.research.microsoft.com/pub/tr/TR-2005-39.doc

Page 6: Slide 1 - Microsoft Research - Turning Ideas into Reality

Hardware & Software ProgressHardware & Software ProgressThroughput 2x per 2 years

tracks MHz

Throughput 2x per 2 yearstracks MHz

X86&X64 tpmC per CPU over time

100

1,000

10,000

100,000

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006

tpm

C/c

pu

30x in 10 years41%/yearDouble every 2 years

X86&X64 tpmC per Mhz over time

0

5

10

15

20

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006

Throughput/$ 2x per 1.5 years40%/y hardware, 20%/y software

Throughput/$ 2x per 1.5 years40%/y hardware, 20%/y software

A Measure of Transaction Processing 20 Years Later ftp://ftp.research.microsoft.com/pub/tr/TR-2005-57.doc IEEE Data Engineering Bulletin, V. 28.2, pp. 3-4, June 2005

TPC-A and TPC-C tps/$ Trends

0.01

0.10

1.00

10.00

100.00

1000.00

1990 1992 1994 1996 1998 2000 2002 2004

Th

rou

gh

pu

t /

k$

TPC-CTPC A

~100x in 10 years~2x per 1.5 years

No obvious end in sight!

~2x / 1.5 years

Page 7: Slide 1 - Microsoft Research - Turning Ideas into Reality

TPC-C results referenced above are Dell PowerEdge running SQL Server 2005, 38,622 tpmC, .99 $/tpmC, available 11/8/05

Amazing Price/PerformanceAmazing Price/Performance

Page 8: Slide 1 - Microsoft Research - Turning Ideas into Reality

IT Revolution Just StartingIT Revolution Just StartingHistorical trends imply that in 20 years:1. we can store everything in

cyberspace.The personal petabyte.

2. computers will have natural interfacesspeech recognition/synthesisvision, object recognition beyond OCR

Implications1. The information avalanche will only

get worse. 2. The user interface will change:

less typing, more writing, talking, gesturing,more seeing and hearing

3. Organizing, summarizing, prioritizinginformation is a key technology.

Historical trends imply that in 20 years:1. we can store everything in

cyberspace.The personal petabyte.

2. computers will have natural interfacesspeech recognition/synthesisvision, object recognition beyond OCR

Implications1. The information avalanche will only

get worse. 2. The user interface will change:

less typing, more writing, talking, gesturing,more seeing and hearing

3. Organizing, summarizing, prioritizinginformation is a key technology.

Yotta

Zetta

Exa

Peta

Tera

Giga

Mega

Kilo

We are here

Page 9: Slide 1 - Microsoft Research - Turning Ideas into Reality

The Perfect SystemThe Perfect SystemKnows everythingKnows what you want to knowTells you the answer…

in a an easy-to-understand way; just before you ask

Tells you what you should have askedAnd…

It is inexpensive to buyIt is inexpensive to own.

Knows everythingKnows what you want to knowTells you the answer…

in a an easy-to-understand way; just before you ask

Tells you what you should have askedAnd…

It is inexpensive to buyIt is inexpensive to own.

Page 10: Slide 1 - Microsoft Research - Turning Ideas into Reality

Oh! And PEOPLE COSTS are HUGE!

Oh! And PEOPLE COSTS are HUGE!People costs always exceeded IT capital.

But now that hardware is “free” …Key Goal:

self-organizing .self-healing,

No DBAs for cell phones or cameras.

People costs always exceeded IT capital.But now that hardware is “free” …Key Goal:

self-organizing .self-healing,

No DBAs for cell phones or cameras.

Page 11: Slide 1 - Microsoft Research - Turning Ideas into Reality

OutlineOutlineIntroduction: The IT revolution Continues

Old problems now look easy The perfect system with low people costs Our challenge

SQL Server 2005 History: SQL Server 6.5, 7.0, 2000 achievementsSQL 2005 Goals Service Oriented Data Architecture: SQL + .NETDBMS is Web Services – from three tiers to two

tiers OLAP, Data Mining Data Integration and Reporting

What’s Next ?A vision for the future

Introduction: The IT revolution Continues Old problems now look easy The perfect system with low people costs Our challenge

SQL Server 2005 History: SQL Server 6.5, 7.0, 2000 achievementsSQL 2005 Goals Service Oriented Data Architecture: SQL + .NETDBMS is Web Services – from three tiers to two

tiers OLAP, Data Mining Data Integration and Reporting

What’s Next ?A vision for the future

Page 12: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server GenerationsHistory of InnovationSQL Server GenerationsHistory of Innovation

• Lowest TCO• Automatic Tuning

• Reliability & Security• Integrated Business Intelligence

Cross-release objectives

SQL Server 6.0/6.5

Differentiation from Sybase SQL Server

Windows integration

First to include Replication

1st Generation

Page 13: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server GenerationsHistory of InnovationSQL Server GenerationsHistory of Innovation

• Lowest TCO• Automatic Tuning

• Reliability & Security• Integrated Business Intelligence

Cross-release objectives

SQL Server 6.0/6.5

Differentiation from Sybase SQL Server

Windows integration

First to include Replication

1st Generation

SQL Server 7.0

Re-architecture of relational server

Extensive auto resource management

First to include OLAP & ETL

2nd Generation

Page 14: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server GenerationsHistory of InnovationSQL Server GenerationsHistory of Innovation

• Lowest TCO• Automatic Tuning

• Reliability & Security• Integrated Business Intelligence

Cross-release objectives

SQL Server 6.0/6.5

Differentiation from Sybase SQL Server

Windows integration

First to include Replication

1st Generation

SQL Server 7.0

Re-architecture of relational server

Extensive auto resource management

First to include OLAP & ETL

2nd Generation

SQL Server 2000

Performance, scalability focus

XML support First to include

Notification First to include

Data Mining & Reporting

3rd Generation

Page 15: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server GenerationsHistory of InnovationSQL Server GenerationsHistory of Innovation

• Lowest TCO• Automatic Tuning

• Reliability & Security• Integrated Business Intelligence

Cross-release objectives

SQL Server 6.0/6.5

Differentiation from Sybase SQL Server

Windows integration

First to include Replication

1st Generation

SQL Server 7.0

Re-architecture of relational server

Extensive auto resource management

First to include OLAP & ETL

2nd Generation

SQL Server 2005

DependabilityDeveloper

productivityBusiness

IntelligenceNative XMLEnterprise ETL &

Deep Data MiningService BrokerFirst SODA

4th Generation

SQL Server 2000

Performance, scalability focus

XML support First to include

Notification First to include

Data Mining & Reporting

3rd Generation

Page 16: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server Value PropositionSQL Server Value PropositionEverything in one box

Database (SQL, XML, Text,...) Business Intelligence Data Integration Extract Transform Load Reporting Auto Design Auto Administer Auto Tuner

Integrated with Visual Studio, Office, BizTalk, Windows,…

Lowest Total Cost of Ownership

Everything in one box Database (SQL, XML, Text,...) Business Intelligence Data Integration Extract Transform Load Reporting Auto Design Auto Administer Auto Tuner

Integrated with Visual Studio, Office, BizTalk, Windows,…

Lowest Total Cost of Ownership

Page 17: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server Value PropositionSQL Server Value PropositionEverything in one box

Database (SQL, XML, Text,...) Business Intelligence Data Integration Extract Transform Load Reporting Auto Design Auto Administer Auto Tuner

Integrated with Visual Studio, Office, BizTalk, Windows,…

Lowest Total Cost of Ownership

Everything in one box Database (SQL, XML, Text,...) Business Intelligence Data Integration Extract Transform Load Reporting Auto Design Auto Administer Auto Tuner

Integrated with Visual Studio, Office, BizTalk, Windows,…

Lowest Total Cost of Ownership

Source:Source:

Source:Source:

Page 18: Slide 1 - Microsoft Research - Turning Ideas into Reality

Our Vision: Simplify and UnifyOur Vision: Simplify and Unify

Page 19: Slide 1 - Microsoft Research - Turning Ideas into Reality

Simplify and UnifySimplify and Unify

tablet

desktop

pda

department

Data center

Page 20: Slide 1 - Microsoft Research - Turning Ideas into Reality

Database EngineService BrokerHTTP AccessDatabase Tuning Advisor Enhanced Read ahead and scanIndexes with Included ColumnsMultiple Active Result Sets Persisted Computed ColumnsTry/Catch in T-SQL statementsCommon Table ExpressionsServer EventsSnapshot Isolation Level PartitioningSynonymsDynamic Management Views

.NET FrameworkCommon Language Runtime IntegrationCLR-based Types, Functions, and TriggersSQL Server .NET Data Provider

Data TypesCLR-based Data TypesVARCHAR(MAX), VARBINARY(MAX)XML Datatype

Database Failure and RedundancyFail-over Clustering (up to 8 node)Database MirroringDatabase SnapshotsEnhanced Multi-instance Support

XMLNew XML data typeXML IndexesXQUERY SupportXML Schema (XSD) supportFOR XML PATHXML Data Manipulation Language SQLXML 4.0

Database MaintenanceBackup and Restore EnhancementsChecksum Integrity ChecksDedicated Administrator ConnectionDynamic Configuration AWEHighly-available UpgradeOnline Index OperationsOnline Restore

Management ToolsMDX and XML/A Query EditorMaintenance Plan DesignerSource Control SupportProfiler access to non-saSQLCMD Command Line ToolDatabase Mail

Performance Tuning 64-bit (IA-64 and XA-64)Profiling Analysis ServicesExportable Showplan and Deadlocks Profiler EnhancementsNew Trace Events

Full-text SearchBackup/Restore includes FT catalogsMulti-instance service

SQL Client .NET Data ProviderServer Cursor SupportMultiple Active Result Sets

SecurityCatalog and meta-data securityPassword policy enforcementFine Grain Administration RightsSeparation of Users and SchemaSurface Area Configuration

Notification ServicesEmbed NS in existing applicationUser-defined match logicAnalysis Services Event Provider

ReplicationSeamless DDL replicationMerge Web SyncOracle PublicationPeer to Peer Transactional replicationMerge replication perf and scalabilityNew monitor and improved UI

Analysis Services and Data MiningAnalysis Management Objects Windows Integrated Backup and RestoreWeb Service/XML for AnalysisIntegration Services and DM IntegrationEight new Data Mining algorithmsAuto Packaging and DeploymentMigration Wizard

Integration ServicesNew high performance architectureVisual design and debugging environmentExtensible with custom code and scriptsXML task and data sourceSAP connectivityIntegrated data cleansing and text miningSlowly changing dimension wizardImproved flow controlIntegration with other BI products

Reporting ServicesReport BuilderAnalysis Services Query DesignerEnhanced Expression EditorMulti-valued Parameters Date PickerSharepoint Web PartsFloating HeadersCustom Report ItemsXML Data Provider

Some SQLserver 2005 FeaturesSome SQLserver 2005 Features

Page 21: Slide 1 - Microsoft Research - Turning Ideas into Reality

Focus on ManageabilityFocus on ManageabilitySecurity & Privacy:

by default, By design, By deployment,

C2 AuditingRow-level encryption Self tuning & optimization, Database AdvisorManagement reportsnew management programming modelScripting support,

Security & Privacy: by default, By design, By deployment,

C2 AuditingRow-level encryption Self tuning & optimization, Database AdvisorManagement reportsnew management programming modelScripting support,

Page 22: Slide 1 - Microsoft Research - Turning Ideas into Reality

Relational Engine ImprovementsRelational Engine ImprovementsOnline Operations

Index build Page/File restore Reconfigure Fast Recovery

Partitioned tables Enables moving window

management Fast Load

Mirrored Systems Easy setup Low overhead failover in seconds

Online Operations Index build Page/File restore Reconfigure Fast Recovery

Partitioned tables Enables moving window

management Fast Load

Mirrored Systems Easy setup Low overhead failover in seconds

SQL Recursion Apply, Intersect, Except Pivot & Unpivot Analytics (top(N), rank, …) T-SQL exception handling Debugging! Multiple Active Result Sets

Snapshot Isolation Most complete isolation

support

ViewPoints Querable deltas Very low Cost

SQL Recursion Apply, Intersect, Except Pivot & Unpivot Analytics (top(N), rank, …) T-SQL exception handling Debugging! Multiple Active Result Sets

Snapshot Isolation Most complete isolation

support

ViewPoints Querable deltas Very low Cost

Page 23: Slide 1 - Microsoft Research - Turning Ideas into Reality

.Net for the database: end-to-end development toolsStored Procedures in T-SQL, VB.NET,

C#…CLR (.NET runtime) inside SQL ServerIntegrated tools: SQL Server “Studio”Consistent source control environmentIntegrated in-line debugging

Enables new scenariosUser defined data typesEnhanced data access with ADO.NET v2Can put logic inside or outside the

DBMS

SQL Server integration with .NetSQL Server integration with .Net

Data Base

SQL Server

.NETCLR

Page 24: Slide 1 - Microsoft Research - Turning Ideas into Reality

SODA ArchitectureSODA Architecture

CatalogCatalogMaint.Maint.

ServiceService

OrderOrderServiceService

KittingKittingServiceService

CatalogCatalogUpdatesUpdates

OrderOrder

OrderOrderAckAck

InvoiceInvoice

OrderOrder

PaymentPayment

PaymentPayment

Reference DataResource DataActivity DataService Interaction Data

InventoryInventoryServiceService

LedgerLedgerServiceService

Page 25: Slide 1 - Microsoft Research - Turning Ideas into Reality

SQL Server 2005 SODA featuresSQL Server 2005 SODA featuresBuild and Host Native Web Services

CLR Integration Service Endpoint: WSDL, WS-security, SOAP,…

Service broker Service centric architecture Reliable messaging with complete database

integration

Query notifications For scaling out data & presentation caches Reference data scaling

Build and Host Native Web Services CLR Integration Service Endpoint: WSDL, WS-security, SOAP,…

Service broker Service centric architecture Reliable messaging with complete database

integration

Query notifications For scaling out data & presentation caches Reference data scaling

Service Oriented Database Architecture: App Server-Lite?, David Campbell, MSR-TR-2005-129http://research.microsoft.com/pubs/view.aspx?tr_id=983

DatabasesDatabases

Business Business ObjectsObjects

workflowsworkflows

PresentationPresentation

DB

MS

DB

MS

Page 26: Slide 1 - Microsoft Research - Turning Ideas into Reality

Services Live In The DatabaseServices Live In The DatabaseOngoing work in the database

Each Service “instance” is stored in a database Messages are stored in the database

Routing to a database Incoming messages are put in the database Message is matched to the state

and the service is performed Routing incoming web service requests

means delivering to the correct database

Ongoing work in the database Each Service “instance” is stored in a database Messages are stored in the database

Routing to a database Incoming messages are put in the database Message is matched to the state

and the service is performed Routing incoming web service requests

means delivering to the correct database

TransactionTransaction

Service

TransactionTransaction TransactionTransaction

Page 27: Slide 1 - Microsoft Research - Turning Ideas into Reality

Service BrokerService Broker

Inbound messages arrive on protocol pipe

Message is:AuthenticatedDispatched to

right queue

Inbound messages arrive on protocol pipe

Message is:AuthenticatedDispatched to

right queue

Service Program:Driven by queueRuns in new contextInside or outside DBMay send additional

messages

Service Program:Driven by queueRuns in new contextInside or outside DBMay send additional

messages

Service QueueService Queue

TransactionTransaction

ServiceService

Service QueueService Queue

Page 28: Slide 1 - Microsoft Research - Turning Ideas into Reality

Notification and ReplicationNotification and ReplicationReplication

Every kind I can think of

Publish-Distribute-Subscribe model

Huge performance improvements

Simpler management.

Notification service Many outstanding subscription

queries

Notice sent when subscription satisfied

These are key SODA components.

Replication Every kind I can think of

Publish-Distribute-Subscribe model

Huge performance improvements

Simpler management.

Notification service Many outstanding subscription

queries

Notice sent when subscription satisfied

These are key SODA components.

Publisher

Distributor

Subscribers

SQL Server 2005

ApplicationServer

Inquire

Response

Query / Subscription

Results

Inquire

Response Results

Page 29: Slide 1 - Microsoft Research - Turning Ideas into Reality

XMLXMLXML is a native data typeUnderstands XML Schemas

and validates docs against schema

Shredded or just indexedXQuery language support

plus insert, update, delete

Full inter-operability between XML and relational and text.

Customers report good performance.

XML is a native data typeUnderstands XML Schemas

and validates docs against schema

Shredded or just indexedXQuery language support

plus insert, update, delete

Full inter-operability between XML and relational and text.

Customers report good performance.

FLOWRFOR $book in /rootLET …WHERE $book/@author = ‘Joe’ORDER BY $book/@pubdate RETURN <Book/>

Page 30: Slide 1 - Microsoft Research - Turning Ideas into Reality

Integration ServicesExtract-Transform-LoadIntegration ServicesExtract-Transform-Load

DTS redesigned: SQL Server Integration Services (SSIS)

Can pull or push data to or from other sourcesflat files, Oracle, DB2, Internet,…

Built-in data cleaner and fuzzy match

Much cleaner programming model

Interactive debugger, breakpoints, monitor flows Exception handling,

CheckpointingDramatic performance gains.

DTS redesigned: SQL Server Integration Services (SSIS)

Can pull or push data to or from other sourcesflat files, Oracle, DB2, Internet,…

Built-in data cleaner and fuzzy match

Much cleaner programming model

Interactive debugger, breakpoints, monitor flows Exception handling,

CheckpointingDramatic performance gains.

Page 31: Slide 1 - Microsoft Research - Turning Ideas into Reality

Integrated ReportingIntegrated Reporting

Visual tool to design reports

Integrated with Visual

Studio

Integrated with SharePoint

Report builder lets end-

users customize reports

Key Performance Indicators

easy to define and display

Visual tool to design reports

Integrated with Visual

Studio

Integrated with SharePoint

Report builder lets end-

users customize reports

Key Performance Indicators

easy to define and display

Page 32: Slide 1 - Microsoft Research - Turning Ideas into Reality

Business Intelligence – OLAP Business Intelligence – OLAP Developer Studio: end-to-end solution

Unified Dimension Model Unifies Relational, Cube … Dimensions: role, fact, reference Data Mine, N2N

Measures and intelligent calculations.

MDX simplified, generalized Scripting, stored procedures Debugging XML representation

Performance Proactive caching – update cube

when fact table changes Partitioning and Write Back

accelerated.

Enables Real-Time BI.

Developer Studio: end-to-end solution

Unified Dimension Model Unifies Relational, Cube … Dimensions: role, fact, reference Data Mine, N2N

Measures and intelligent calculations.

MDX simplified, generalized Scripting, stored procedures Debugging XML representation

Performance Proactive caching – update cube

when fact table changes Partitioning and Write Back

accelerated.

Enables Real-Time BI.

Cube

Oracle

UDM

cache

SQL ROLAP

SQL OLAP

Reporting

Excel

Tables

Files

Web Service

Page 33: Slide 1 - Microsoft Research - Turning Ideas into Reality

Business Intelligence - Data MiningBusiness Intelligence - Data Mining

Builds Analytic MODELS about your data To categorize data To detect anomalies To make predictions (trends) Time series analysis To evaluate likelihood

10 Built-in algorithms: Decision Tree, Bayes,

Clustering, Neural Net, time series, …

Integrated with SQL (define, train, use)Tools help evaluate model

ISVs can add new Mining Algorithms Integrated with the rest of SQL 2005

Builds Analytic MODELS about your data To categorize data To detect anomalies To make predictions (trends) Time series analysis To evaluate likelihood

10 Built-in algorithms: Decision Tree, Bayes,

Clustering, Neural Net, time series, …

Integrated with SQL (define, train, use)Tools help evaluate model

ISVs can add new Mining Algorithms Integrated with the rest of SQL 2005

Page 34: Slide 1 - Microsoft Research - Turning Ideas into Reality

Developer Productivity .NET frameworkNative XML technologyIntegrated web servicesDistributed application

framework

Business IntelligenceComprehensive ETL platformReal time analyticsAccessible, easy data miningRich, integrated reporting

Enterprise Data ManagementFlexible, interoperable, scalableImproved predictability Self optimization and tuningFast recovery and restore

Secure, Quality Database4 years in developmentMultiple security reviews1,000+ new and improved

featuresLarge private beta for early

quality

Summary SQL Server 2005Summary SQL Server 2005

Page 35: Slide 1 - Microsoft Research - Turning Ideas into Reality

What’s NextWhat’s NextSQLserver 2005 is an installment on

the integration of language & data

WinFS – Unify Files and Databases

CLR opens the door to all datatypes

space, time, text, …

Data Mining is just starting -

Self-managing databases.

SQLserver 2005 is an installment on

the integration of language & data

WinFS – Unify Files and Databases

CLR opens the door to all datatypes

space, time, text, …

Data Mining is just starting -

Self-managing databases.

Page 36: Slide 1 - Microsoft Research - Turning Ideas into Reality

Can you find anything?Can you organize that many

objects?Once you find it will you know what

it is?Could you find it again? Need db features:

Indexing, Pivoting, Queries,… Backup, replication

Unifies data and meta-dataSimpler to manageAutomatic indexing, replication

Can you find anything?Can you organize that many

objects?Once you find it will you know what

it is?Could you find it again? Need db features:

Indexing, Pivoting, Queries,… Backup, replication

Unifies data and meta-dataSimpler to manageAutomatic indexing, replication

SQL

WinFS -- Unify DB and Files So you’ve got everything online – now what do you do with it?

WinFS -- Unify DB and Files So you’ve got everything online – now what do you do with it?

Page 37: Slide 1 - Microsoft Research - Turning Ideas into Reality

How Do We Represent It To The Outside World?How Do We Represent It To The Outside World?

File metaphor too primitive: just a blob

Table metaphor too primitive: just records

Need Metadata describing data context Format Providence (author/publisher/ citations/…) Rights History Related documents

In a standard formatXML and XML schemaDataSet is great example of thisWorld is now defining standard

schemas

File metaphor too primitive: just a blob

Table metaphor too primitive: just records

Need Metadata describing data context Format Providence (author/publisher/ citations/…) Rights History Related documents

In a standard formatXML and XML schemaDataSet is great example of thisWorld is now defining standard

schemas

schema

Data ordifgram

<?xml version="1.0" encoding="utf-8" ?>

- <DataSet xmlns="http://WWT.sdss.org/">

- <xs:schema id="radec" xmlns="" xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata">

<xs:element name="radec" msdata:IsDataSet="true">

<xs:element name="Table">

  <xs:element name="ra" type="xs:double" minOccurs="0" />

  <xs:element name="dec" type="xs:double" minOccurs="0" /> …

- <diffgr:diffgram xmlns:msdata="urn:schemas-microsoft-com:xml-msdata" xmlns:diffgr="urn:schemas-microsoft-com:xml-diffgram-v1">

- <radec xmlns="">

- <Table diffgr:id="Table1" msdata:rowOrder="0">

  <ra>184.028935351008</ra>

  <dec>-1.12590950121524</dec>

  </Table>

- <Table diffgr:id="Table10" msdata:rowOrder="9">

  <ra>184.025719033547</ra>

  <dec>-1.21795827920186</dec>

</Table>

</radec> 

</diffgr:diffgram>

</DataSet>

Page 38: Slide 1 - Microsoft Research - Turning Ideas into Reality

SqlConnection c = new SqlConnection(…); c.Open(); SqlCommand cmd = new SqlCommand( @“SELECT c.Name, c.Phone

FROM Customers c WHERE c.City = @p0”

); cmd.Parameters[“@po”] = “London”; DataReader dr = c.Execute(cmd); while (dr.Read()) { string name = r.GetString(0); string phone = r.GetString(1); DateTime date = r.GetDateTime(2); } r.Close();

Old Data Access in API’s Old Data Access in API’s

Queries in quotes

Arguments loosely bound

Results loosely typed

Compiler cannot help catch mistakes

Page 39: Slide 1 - Microsoft Research - Turning Ideas into Reality

DLINQ and XLINQIntegrated Data AccessDLINQ and XLINQIntegrated Data Access

public class Customer { public int Id; public string Name; public string Phone; … }

Table<Customer> customers = …;

foreach(c in customers.Where(City == “London”)) { Console.WriteLine(“Name: {0} Phone: {1}”, c.Name, c.Phone);}

Classes describe data

Tables are real objects

Query is natural part of the language

Results are strongly typed

Page 40: Slide 1 - Microsoft Research - Turning Ideas into Reality

Data Mining and Approximate ReasoningData Mining and Approximate Reasoning

Data Mining algorithms give approximate answers

Text search results are approximate Precision & Recall tradeoff

Better algorithms appear each year,an area of rapid progress.

Data Mining algorithms give approximate answers

Text search results are approximate Precision & Recall tradeoff

Better algorithms appear each year,an area of rapid progress.

Page 41: Slide 1 - Microsoft Research - Turning Ideas into Reality

OutlineOutlineIntroduction: The IT revolution Continues

Old problems now look easy The perfect system with low people costs Our challenge

SQL Server 2005 History: SQL Server 6.5, 7.0, 2000 achievementsSQL 2005 Goals Service Oriented Data Architecture: SQL + .NETDBMS is Web Services – from three tiers to two

tiers OLAP, Data Mining Data Integration and Reporting

What’s Next ?A vision for the future

Introduction: The IT revolution Continues Old problems now look easy The perfect system with low people costs Our challenge

SQL Server 2005 History: SQL Server 6.5, 7.0, 2000 achievementsSQL 2005 Goals Service Oriented Data Architecture: SQL + .NETDBMS is Web Services – from three tiers to two

tiers OLAP, Data Mining Data Integration and Reporting

What’s Next ?A vision for the future