Embed Size (px)
Citation preview
SQL Server 2005 Integration SQL Server 2005 Integration ServicesServices
Mike TaultyMike Taulty
Developer & Platform GroupDeveloper & Platform Group
Microsoft LtdMicrosoft Ltd
[email protected]@microsoft.com
http://mtaulty.com http://mtaulty.com
Data acquisition from source systems and integration
Data transformation and synthesis
Data enrichment, with business logic, hierarchical views
Data discovery via data mining
Data presentation and distribution
Data access for the masses
IntegrateIntegrate AnalyzeAnalyze ReportReport
SQL Server Business IntelligenceSQL Server Business Intelligence
SQL Server Integration ServicesSQL Server Integration Services
Successor to Data Transformation ServicesSuccessor to Data Transformation Services
New architecture and implementationNew architecture and implementation
Existing DTS packages can be run or migratedExisting DTS packages can be run or migrated
Design time experience in VS 2005 or Business Design time experience in VS 2005 or Business Intelligence Development StudioIntelligence Development Studio
Administration in SQL Server Management Administration in SQL Server Management StudioStudio
Extensibility through .NET codeExtensibility through .NET code
Before Integration ServicesBefore Integration Services
Call centre data: semi structured
Legacy data: binary files
Application database
ETL Warehouse
Reports
Mobiledata
Data mining
Alerts & escalation
•Integration and warehousing require separate, staged, operations.•Preparation of data requires different, often incompatible, tools.•Reporting and escalation is a slow process, delaying smart responses.•Heavy data volumes make this scenario increasingly unworkable.
Handcoding
StagingText Mining
ETL Staging
Cleansing &
ETL
Staging
ETL
With Integration ServicesWith Integration Services
Call centre: semi-structured data
Legacy data: binary files
Application database
Alerts & escalation
•Integration and warehousing are a seamless, manageable, operation.•Sourced, prepare and load data in a single, auditable process.•Reporting and escalation can be parallelized with the warehouse load.•Scales to handle heavy and complex data requirements.
SQL Server Integration Services
Text miningcomponents
Customsource
Standardsources
Data cleansingcomponents
Merges
Data miningcomponents
Warehouse
Reports
Mobiledata
SSIS - ArchitectureSSIS - Architecture
Package
Visual Studio/
SQL BI Studio
IS
Object Model
IS Service
msdb
Package Store
Cfg
SQL
Management Studio
DTUtil
Control Flow
SSIS - PackagesSSIS - Packages
Package (XML)
Connections
Variables
Event Handlers
Log Providers
Control Flow
Container
Task
Task
Precedence
DataFlow Task
Source DestTransform
Path
Configurations
SSIS - ArchitectureSSIS - Architecture
IS Service
msdb
Package Store
Cfg
Package
SQL
Management Studio
List,
Monitor
DTExec
Package
The SSIS PlatformThe SSIS Platform
SSIS provides a platform to component SSIS provides a platform to component developersdevelopers
Extensibility pointsExtensibility points
Control FlowControl Flow
Tasks, Loop enumerators, Event handlers, Log ProvidersTasks, Loop enumerators, Event handlers, Log Providers
Data FlowData Flow
Sources, Destinations, Transformations, Connection Sources, Destinations, Transformations, Connection ManagersManagers
SSIS – Custom ComponentsSSIS – Custom Components
Custom TasksCustom Tasks
Derive from Derive from TaskTask
Implement Implement InitializeTask, Validate, Execute, InitializeTask, Validate, Execute, IDtsTaskUIIDtsTaskUI
ApplyApply DtsTask DtsTask attribute attribute
Custom DataFlow ComponentsCustom DataFlow Components
Derive from Derive from PipelineComponentPipelineComponent
Apply Apply DtsPipelineComponentDtsPipelineComponent attribute attribute
Override Override AcquireConnections, AcquireConnections, ReleaseConnections, Validate, ProcessInput …ReleaseConnections, Validate, ProcessInput …
SQL Server Integration ServicesSQL Server Integration Services
DemoDemo
SQL Server 2005 ResourcesSQL Server 2005 Resources
Web SitesWeb SitesMSDN Centre http://msdn.microsoft.com/sqlMSDN Centre http://msdn.microsoft.com/sql
Product site Product site http://www.microsoft.com/sql/2005/default.asphttp://www.microsoft.com/sql/2005/default.asp
SQL Team SQL Team http://http://www.sqlteam.comwww.sqlteam.com
SQL Junkies SQL Junkies http://http://www.sqljunkies.comwww.sqljunkies.com
SQL Server 2005 Express EditionSQL Server 2005 Express Editionhttp://http://lab.msdn.microsoft.com/express/sql/default.aspxlab.msdn.microsoft.com/express/sql/default.aspx
WebcastsWebcastshttp://msdn.microsoft.com/sql/2005webcastshttp://msdn.microsoft.com/sql/2005webcasts
BooksBookshttp://www.microsoft.com/sql/2005/samplechapters.asphttp://www.microsoft.com/sql/2005/samplechapters.asp
User GroupsUser Groupshttp://msdn.microsoft.com/usergroups/find.asp http://msdn.microsoft.com/usergroups/find.asp
NewsgroupsNewsgroupsMicrosoft.public.sqlserver.*Microsoft.public.sqlserver.*
© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.© 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.
