Enterprise Connect Data Access (ECDA) 12.6 Optimization

INT413 ECDA 12.6 Optimization

Jerry KauffmanSoftware Development Manager

jerry.kauffman@sybase.com7/19/2004

2

The Enterprise. Unwired.

UnwirePeople

UnwireInformation

ManageInformation

InformationManagement

CoreCapture Publish Enrich Deliver

3

The Enterprise. Unwired.

UnwirePeople

UnwireInformation

ManageInformation

Sybase Workspace

Industry and Cross Platform Solutions

• Adaptive Server Enterprise

• Sybase IQ

• Dynamic Archive

• Dynamic ODS

• Real Time Data Services

• Replication Server

• OpenSwitch

• Mirror Activator

• PowerDesigner

• Connectivity Options

• Enterprise Application Server

• PowerBuilder Family

• Adaptive Server Enterprise

• Sybase IQ

• Dynamic Archive

• Dynamic ODS

• Real Time Data Services

• Replication Server

• OpenSwitch

• Mirror Activator

• PowerDesigner

• Connectivity Options

• Enterprise Application Server

• PowerBuilder Family

• Unwired Accelerator

• Unwired Orchestrator

• Unwired Toolkit

• Unwired Accelerator

• Unwired Orchestrator

• Unwired Toolkit

• SQL Anywhere Studio

• Mobile Email & Applications

• Enterprise Portal

• XcelleNet Frontline Solutions

• PocketBuilder

• AvantGo

• SQL Anywhere Studio

• Mobile Email & Applications

• Enterprise Portal

• XcelleNet Frontline Solutions

• PocketBuilder

• AvantGo

4

DirectConnect 12.6 (Where it fits)

Make all your enterprise data look like one database

Any Any mainframe mainframe datadata

OracleOracleMS SQL ServerMS SQL ServerSybaseSybaseDB2 UDB for OS/390, NT/UNIXDB2 UDB for OS/390, NT/UNIXAS/400AS/400InformixInformixODBC-enabled databasesODBC-enabled databasesDocuments/FilesDocuments/Files

CustomCustomSpecialty Data StoresSpecialty Data Stores

ASE/CISMainframe Connect

DirectConnect

Specialty Data Store

Toolkit

Any ClientOr BrowserAny Client

Or Browser

Proxy Tables

5

First major release in 3 years.

Major redesign of several products.

DirectConnect 12.6

6

Enterprise Connect Data Access IPS DirectConnect for Microsoft SQL Server DirectConnect for DB2 UDB DirectConnect for Informix DirectConnect for ODBC DirectConnect for Oracle

MainframeConnect IPS DirectConnect for OS/390

DirectConnect for AS400 Migration to DB2 UDB

All DirectConnect 12.6 Products Updated

7

Performance, Scalability

Peaceful Coexistence

New Features

DCManager Update

12.6 Themes

8

Performance, Scalability

Peaceful Coexistence

New Features

DCManager Update

12.6 Themes

9

New Product Architecture DirectConnect for Microsoft SQL Server DirectConnect for DB2 UDB DirectConnect for Informix DirectConnect for ODBC

SMP Open Server Conversion All DirectConnects

Performance, Scalability

10

New Product Architecture - Background

Predecessor Product ArchitectureMultiple processes

New process for each connection

Interprocess communications

Excess data conversions

12.6 Product Architecture Single Process

New thread for each connect

Data sharing between main thread and connection threads

Simplified data conversions

11

12.5 Product Architecture

OPEN

SERVER

SERVER

MGR

Main Process

Open Server BasedEvent Handler,Service Manager

ASE/CISRep. Server

12

12.5 Product Architecture

OPEN

SERVER

SERVER

MGR

CONN

HANDLR

DBTOOLS

DTYPE

CONV

TDS

LIBRARY

Main Process with Service Library Loaded

Open Server BasedEvent Handler,Service Manager

Service Library(dcany.so)

ASE/CISRep. Server

13

12.5 Product Architecture

OPEN

SERVER

SERVER

MGR

CONN

HANDLR

DBTOOLS

DATA

CONV

TDS

LIBRARY

TDS

SERVER

DATA

CONV

SYBODBC

ODBC

MGR

ODBCDRIVERS

MSSS

INFX

DB2 UDB

TDS Event Hdler,Data conversions,DB operations(dc2any)

Service Library,DB Operations,Data Conversions(dcany.so)

ODBC Drivers(MVMSSS19.so)(MVINFX19.so)(MVDB219.so)

Main processDc2any process(one per connection)

Open Server BasedEvent Handler,Service Manager(direct)

pipeASE/CISRep. Srvr

TargetDB

14

New Product Architecture

Predecessor Product ArchitectureMultiple processes

New process for each connection

Interprocess communications

Excess data conversions

12.6 Product Architecture Single Process

New thread for each connection

Data sharing between main thread and connection threads

Simplified data conversions

15

12.6 Product Architecture

OPEN

SERVER

SERVER

MGR

Main process

Open Server BasedEvent Handler,Service Manager(direct)

ASE/CISRep. Server

16

12.6 Product Architecture

OPEN

SERVER

SERVER

MGR

Main process

Open Server BasedEvent Handler,Service Manager(direct)

CONN

HANDLR

DATA

CONV

SYBODBC

ODBC

MGR

Service Library,DB Operations,Data Conversions(dcany.so)

ASE/CISRep. Server

17

12.6 Product Architecture

OPEN

SERVER

Main process

SERVER

MGR

CONN

HANDLR

DATA

CONV

SYBODBC

ODBC

MGR

ODBCDRIVERS

MSSS

INFX

DB2 UDB

Service Library,DB Operations,Data Conversions(dcany.so)

ODBC Drivers(MVMSSS19.so)(MVINFX19.so)(MVDB219.so)

(one thread per connection)

Open Server BasedEvent Handler,Service Manager(direct)

ASE/CISRep. Server Target

Database

18

12.5 Software Layers Removed

DBTOOLS

DATA

CONV

TDS

LIBRARY

Dc2any process(one per connection)

pipe

TDS

SERVER

Main process

19

12.5 vs. 12.6 Executable Size

12.5 12.6direct 33 61

dcany 2257 1721

dc2any 165 0

Total 2455 1782

Disk Space (KB)

20

12.5 vs. 12.6 Memory – 1 Connection

Memory Utilized (MB)

12.5 12.6direct 18.1 25.1dc2any 13.4 0Total 31.5 25.1

21

12.5 vs. 12.6 Memory – 10 Connections

Memory Utilized (MB)

12.5 12.6

direct 18.6 27.1

dc2any 134.0 0.0

Total 152.6 27.1

22

12.5 vs. 12.6 Memory – 10 Connections

0

50

100

150

200

12.5 12.6

Memory (MB)

Memory (MB)

23

New Product Architecture DirectConnect for Microsoft SQL Server DirectConnect for DB2 UDB DirectConnect for Informix DirectConnect for ODBC

SMP Open Server Conversion All DirectConnects

Performance, Scalability

24

SMP Open Server Conversion DirectConnect for Microsoft SQL Server DirectConnect for DB2 UDB DirectConnect for Informix DirectConnect for ODBC

DirectConnect for Oracle ( available since 12.5)

DirectConnect for OS/390 db2 access service trstcp access service trslu62 access service

SMP Open Server Conversion

25

All DirectConnects are based on Sybase's Open Server SDK. The SDK can be used to build TDS based, database event handling servers.

Open Server can be configured to manage event threads

in many ways.

Open Server release 12.5 introduced the SMPOS option, which provides reentrant libraries for preemptive event handling with native threads.

SMP Open Server Conversion of DirectConnect

26

DirectConnect 12.5 operated in non-preemptive mode using Open Server threads. DirectConnect controlled context switches, usually after all work for the thread was completed. Results in:

• Fewer context switches

• Poor CPU utilization

• Lower throughput

SMP Open Server Conversion (cont)

27

DirectConnect 12.6 uses Open Server preemptive scheduling which utilizes native operating system threads. The operating system controls context switching. Results in:

• Frequent context switches for improved time slicing• Efficient CPU utilization (including SMP)• Higher throughput• Scales to handle more users• Synchronized access to shared resources, ensure

reentrancy and thread safety

SMP Open Server Conversion

28

12.5 vs. 12.6 Performance Comparison

~25% performance increase

29

Performance, Scalability

Peaceful Coexistence

New Features

DCManager Update

12.6 Themes

30

Definition: Internal initiative to improve ability of Sybase products to peacefully coexist when installed together. Minimize/eliminate interference between Sybase applications running on the same machine and within the same directory structure.

Achieved by product and installation changes

Verified by departmental peaceful coexistence testing and independent Sybase quality assurance teams

Peaceful Coexistence

31

Isolation of common libraries

InstallShield

Minimize dependency on system environment

New start and add server scripts

Peaceful Coexistence Changes (cont)

32

Performance, Scalability

Peaceful Coexistence

New Features

DCManager Update

DirectConnect 12.6 Themes

33

Windows Service Execution (All)

Date and Time datatype support (Oracle)

LINUX DC/Oracle DCManager

Express Transfer Microsoft SQL Server, DB2 UDB, Informix, and ODBC UNIX and Windows Platforms

New Features

34

DirectConnect for DB2 UDB Has been available for access to AS400 since 12.5.3 ECDA IPS 12.6 (and beyond) will no longer include the AS400 option

TCP/IP Access Only SNA is not supported

Migrate AS400.cfg files to dcany.cfg file Reconfigure connectivity and character set translation

Migrate Sybase AS400 SQL stored procedures to native AS400 SQL stored procedures

Native stored procedures utilize extensive IBM SQL programming language

DirectConnect for AS400 Migration

35

Benefits of using DirectConnect for DB2 UDB

Express Transfer to/from AS400 targets More powerful SQL stored procedures TCP/IP access Login name and password encryption Keeping pace of DB2 UDB AS400 updates and new features Uses new architecture and the SMPOS

DirectConnect for AS400 Migration (cont)

36

Performance, Scalability

Peaceful Coexistence

New Features

DCManager Update

DirectConnect 12.6 Themes

37

Enhanced Usability

Support for DirectConnect for Oracle

Multiple Platform support

Enhanced Compatibility with other Sybase Central Plug-ins

DCManager Update

38

Enhanced Usability – More Informative

39

Enhanced Usability – Verbose Mode

40

Enhanced Usability – Bottom Panel

41

Enhanced Usability – Limited Field Help

42

508 Compliant Sybase Central v4.3 Support Up to date JConnect Support

Enhanced Usability – Other

43

All the administrative features DirectConnect for Oracle provides are now supported by DCManager.

DCM - Direct Connect for Oracle Support

44

Windows NT, 2000, 2003 Linux Solaris HP-UX AIX

DCM - Multiple Platform support

45

DCManager has been designed to work on the latest version of Sybase Central (Version 4.3) along with the other major Sybase products (ASE and Rep-Server) to enhance compatibility across multiple product plug-ins.

DCM - Enhanced Compatibility

46

Beta Q4 2004

Beta Period - November 23, 2004 through January 18, 2005

For more Info Visit http://www.sybase.com/ecda_mfc126beta

GA Q1 2005

DC 12.6 Availability

47

Port the remaining DirectConnects to Linux platform

Add support for the Unicode datatype

Add support for the new data types “Date” and “Time”

DC 12.6 What’s Next

INT413 ECDA 12.6 Optimization Questions?

Jerry KauffmanSoftware Development Manager

jerry.kauffman@sybase.com7/19/2004