39
VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York Session 9353 / 9394 © Copyright IBM Corporation, 1998, 1999 Page 1

Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

  • Upload
    ledang

  • View
    221

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

VM File SystemsOverview

Alan AltmarkIBM Corporation

Endicott, New York

Session 9353 / 9394

© Copyright IBM Corporation, 1998, 1999 Page 1

Page 2: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

This presentation provides a comparison and contrast of the various file systems available for use in CMS. Characteristics, administration, programming interfaces, and relative performance are discussed.

References to IBM products, programs, or services do not imply that IBM intends to make these available in all countries in which IBM operates. Any reference to an IBM product, program, or service is not intended to state or imply that only IBM's product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe on any of the intellectual property rights of IBM may be used instead. The evaluation and verification of operation in conjunction with other products, except those expressly designed by IBM, are the responsibility of the user.

The following terms are trademarks of IBM Corporation in the United States or other countries or both:

S/390 VM/ESA IBM AIX OS/390

Other company, product, and service names, which may be denoted by double asterisks (**), may be trademarks or service marks of others.

© Copyright International Business Machines Corporation, 1998, 1999

Disclaimer

© Copyright IBM Corporation, 1998, 1999 Page 2

Page 3: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000History

VM available as a product for 26 years!

Minidisk support since The Beginning

Shared File System (SFS) introduced in 1988

Byte File System (BFS) introduced in 1995

Enhanced Network File System (NFS) supportin 1998 and 1999

© Copyright IBM Corporation, 1998, 1999 Page 3

Page 4: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Direct attachment of disk to userexcellent performancewriters can cause I/O errors for readerssecurity via minidisk password or ESM mode 0 files are private, not secure!

Fixed space allocationmanual or automatedfiles size limited to dasd sizechanging size means copying disk

Minidisk

191

© Copyright IBM Corporation, 1998, 1999 Page 4

Page 5: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

No subdirectories

Limited sharing capabilityone writer, multiple readers per minidiskno data integrity for the readersesoteric programming practices

Remote accessshared dasdNFS

Minidisk

191

© Copyright IBM Corporation, 1998, 1999 Page 5

Page 6: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Shared File SystemShared File System

© Copyright IBM Corporation, 1998, 1999 Page 6

Page 7: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Karen

Alan

Shirley

Shared File System (SFS)

Shared File System Filepool

"PHANTOM"

Shared File System Filepool

"VMSYSU"

filepool = named set of minidisks managed by server

© Copyright IBM Corporation, 1998, 1999 Page 7

Page 8: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Shared File System

Server-moderated access to filesaccess control

based on VM user IDowner determines permissions

space managementfilepool owned by serverfile sharing controlsbackup / restore

Multiple servers for multiple policies go

wait

stop

© Copyright IBM Corporation, 1998, 1999 Page 8

Page 9: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Shared File System Server

"PHANTOM"

Shared File System

ALAN

SHIRLEY

1 2 3 4 5 61 2 3 4 5 7

APPC/VM

Standard access through APPC/VM

© Copyright IBM Corporation, 1998, 1999 Page 9

Page 10: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Shared File System

VM Data Spaces can be used to avoid trip toserver for data

data read into memory as needed

ALAN

SHIRLEYShared File

System Server

"PHANTOM"

"data-in-memory"

© Copyright IBM Corporation, 1998, 1999 Page 10

Page 11: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Shared File System

Hierarchical directory structureFile Control

File updates shown whenever file is openedDirectory Control

Access-to-Release consistency for all files Eligible for VM Data Spaces

File sharingone writer, many readers for a filedata integrityno I/O errors

© Copyright IBM Corporation, 1998, 1999 Page 11

Page 12: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

ALAN

SOURCE

OBJECT_FILES

DOCUMENTS

POSTSCRIPT

AFP

Shared File System File Space

> access phantom:alan.source b> listfile * * b

Directories may be empty

ECHO CECHO HPROFILE BACKUP

TEST LISTPS

enroll user alan phantom ( blocks 10000

EMPTY DOC Files may be empty, too!Useful to preserve authorizations

© Copyright IBM Corporation, 1998, 1999 Page 12

Page 13: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Shared File System Benefits

Flexible space allocationuses multiple minidisksfiles may span minidisksblocks allocated as neededcan dynamically add minidisks sum of user limits may exceed physical dasd

May be part of System Managed Storagea better "temp disk" - survives logoffdata can expire or be migrated

© Copyright IBM Corporation, 1998, 1999 Page 13

Page 14: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Shared File System

Remote accessVM users via collection or VTAM (AVS, LU 6.2)NFS

Work units allow explicit commit controlprograms can explicitly rollback or commit workrollback automatic in case of user abendcommit automatic when you return to Ready;Coordinated Resource Recovery (CRR) ensures updates across multiple SFS file pools are all committed or all rolled back

© Copyright IBM Corporation, 1998, 1999 Page 14

Page 15: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Byte File SystemByte File System

© Copyright IBM Corporation, 1998, 1999 Page 15

Page 16: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Byte File System (BFS)

Unix** file systemstreams instead of recordsmultiple users can write to the same filehierarchical directoriesall users in a single file space

Access based on POSIX UID and GIDdefined in CP directory or ESM for each userpermissions: owner, group, otherauthorizations: read, write, executeVM userid translated to POSIX UID/GID

© Copyright IBM Corporation, 1998, 1999 Page 16

Page 17: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Byte File System File Space

.

u binusr

alan karen java

bin

lib spool

© Copyright IBM Corporation, 1998, 1999 Page 17

Page 18: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

alan

source

object_files

documentspostscript

Hierarchical BFS Directory

/../VMBFS:PHANTOM:BFS1/u/alan/source/echo.cecho.cecho.hprofile.backup.19991022

test.ps

. (root directory BFS1)u

karen

enroll user bfs1 phantom (blocks 200000 bfs openvm mount /../VMBFS:PHANTOM:BFS1/ / openvm create directory /u openvm create directory /u/alan openvm create directory /u/karen

© Copyright IBM Corporation, 1998, 1999 Page 18

Page 19: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Byte File System (BFS)

As for SFS, the server moderates accessBFS is just another kind of file space in an SFS filepool

OPENVM MOUNTCannot use ACCESS commandeasiest to use with Shell & Utilities Feature

Remote accessVM users via collection or VTAM (AVS, LU 6.2)NFS

© Copyright IBM Corporation, 1998, 1999 Page 19

Page 20: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Network File Network File SystemSystem

© Copyright IBM Corporation, 1998, 1999 Page 20

Page 21: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Network File System** (NFS)

Enables VM system to act as open systems file server

Insert CMS directory or minidisk into the client's directory structure or assign it a new drive letter

Client applications use local file I/O interfaces device drivers use NFS remote procedure callstransparent to applications

© Copyright IBM Corporation, 1998, 1999 Page 21

Page 22: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

TCPIP NFS SFSBFS

CP

NFS

operating system

read()

local

T C P I P

NFS - A Thousand Words

PC VM

u/alan/vm/my191/profile.exece:\profile.execf:\tools\pctools\coolprog.exe

© Copyright IBM Corporation, 1998, 1999 Page 22

Page 23: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Network File System (NFS)

BFS is an exact match for NFS capabilities

Ordering note:Separate featureAdditional charge

© Copyright IBM Corporation, 1998, 1999 Page 23

Page 24: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Why NFS?

Data is available to any system which has an NFS client

Data is shared, not duplicatedeveryone sees the same versionupdates available immediately

© Copyright IBM Corporation, 1998, 1999 Page 24

Page 25: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Why NFS?

Enjoy all of the advantages of keeping your data on VMestablished facilities to back up and recover dataSystem Managed Storagehost access controlcentralized administration of space allocation

© Copyright IBM Corporation, 1998, 1999 Page 25

Page 26: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000How Do I Use NFS?

NFS clients available for common platformscommonly known as "mount"available for OS/390standard for Unix and AIXadd-on for others

Hummingbird - NFS Maestro**NetManage - InterDrive**, ViewNow** NFS

Currently no NFS client for VM

© Copyright IBM Corporation, 1998, 1999 Page 26

Page 27: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000How Do I Use NFS?

Mount command definesread-only or read-writeauthentication - VM user ID and passwordhow to perform ASCII-EBCDIC translation

For SFS and minidisk the Mount command defines how toconvert CMS file names into PC file namesconvert CMS records into Unix streamsrecognize end of line

© Copyright IBM Corporation, 1998, 1999 Page 27

Page 28: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Read More About NFS

Mount command examples available from the VM TCP/IP NFS home page

http://www.ibm.com/s390/vm/nfs

See "Inside NFS" article in Sterling Software'sFall 1998 VM:News

© Copyright IBM Corporation, 1998, 1999 Page 28

Page 29: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

Programming Programming InterfacesInterfaces

© Copyright IBM Corporation, 1998, 1999 Page 29

Page 30: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Minidisk Programming Interfaces

AssemblerFSSTATE, FSOPEN, FSPOINT, FSREAD, FSWRITE, FSCLOSE

OS and DOS simulationOPEN, CLOSE, GET, PUT, READ, WRITE

Callable Services Library (CSL) routinesDMSOPEN, DMSREAD, DMSWRITE, DMSCLOSE

Standard HLL file system APIs

© Copyright IBM Corporation, 1998, 1999 Page 30

Page 31: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000SFS Programming Interfaces

When directory is accessed, same as for minidisk

CSL routines work for unaccessed directories

Work units allow commit control

© Copyright IBM Corporation, 1998, 1999 Page 31

Page 32: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000BFS Programming Interfaces

Since you cannot ACCESS a BFS directory, traditional file system APIs won't work

CSL RoutinesBFS-specific BPX1....SFS using directory name

OPENVM LISTFILE (NAMES

C for VM/ESA standard file I/Ofopen("./conference.data", "r")read(), fwrite(), scanf(), etc.

© Copyright IBM Corporation, 1998, 1999 Page 32

Page 33: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000NFS Programming Interfaces

NFS Version 2 - RFC 1094

NFS Version 3 - RFC 1813

Boring unless you are writing an NFS client

© Copyright IBM Corporation, 1998, 1999 Page 33

Page 34: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Callable Services Library (CSL)

Introduced in VM/SP Release 6Languages supported

COBOLFORTRANPascalPL/IRexxCAssembleranything that can use OS CALL interface

© Copyright IBM Corporation, 1998, 1999 Page 34

Page 35: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000

call dmscsl("DMSOPEN ",...);

dmscsl

VMLIB CSLLIB

Callable Services Library (CSL)

CMS gives control to the CSL routine at run-time

Different versions of CSL routine can be used without changing your program

Similar to a DLL

.

.

.

DMSOPEN

DMSWRITEDMSREAD

DMSCLOSE

myprog

© Copyright IBM Corporation, 1998, 1999 Page 35

Page 36: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Callable Services Library (CSL)

files and directoriesvirtual machine settingscall a Rexx execVM data spacesCMS program stackworkunitsdata compressionTCP/IP

date and time event managementtimer servicesMonitor data

more...

© Copyright IBM Corporation, 1998, 1999 Page 36

Page 37: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Callable Services Library (CSL)

Create your own CSL libraries

You can substitute your version for IBM version

Excellent for creating well-defined interfacesBetween different productsBetween components of same productExits

"If not loaded, don't call it"

© Copyright IBM Corporation, 1998, 1999 Page 37

Page 38: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000File System References

UsageCMS User's GuideOpenEdition User's GuideOpenEdition Command Reference

ProgrammingCMS Application Development ReferencesCMS Application MultitaskingCMS Application Development GuideOpenEdition Callable Services ReferenceIBM C for VM/ESA Library Reference

© Copyright IBM Corporation, 1998, 1999 Page 38

Page 39: Overview VM File Systems - vm.ibm.com · VM File Systems Overview Alan Altmark IBM Corporation Endicott, New York ... July 2000 This presentation provides a comparison and contrast

SHARESHAREBostonBoston

July 2000July 2000Contact Information

By e-mail: [email protected]

In person: USA 607.752.6027

The Web: http://www.ibm.com/vm/devpages/altmarka

Mailing lists: [email protected]

On TalkLink: VMESA CFORUM

© Copyright IBM Corporation, 1998, 1999 Page 39