34
Autosys Job Scheduling Vinil Gopalkrishnan [email protected]

AutoSys Job Scheduling

  • Upload
    wahhas

  • View
    146

  • Download
    10

Embed Size (px)

DESCRIPTION

AutoSys

Citation preview

Page 1: AutoSys Job Scheduling

Autosys Job Scheduling

Vinil [email protected]

Page 2: AutoSys Job Scheduling

The Unicenter AutoSys Job Management console provides:

◦A single point of control for viewing one or all scheduling servers, allowing you to monitor and control jobs.

◦A virtual console instead of a physical console, accessible from any Unicenter AutoSys Job Management machine. It means - you can bring up the console anywhere in your environment

Page 3: AutoSys Job Scheduling

Autosys has an interface that is easy to master.

Page 4: AutoSys Job Scheduling

CA AutoSys WA provides distributed-hosted event driven automation that aligns workload execution with business policies to:◦Increase operational efficiency ◦Improve productivity ◦Increase availability of critical business services

◦Manage costs and lower risk ◦costs and lower risk

Page 5: AutoSys Job Scheduling

History: AutoSys was first developed by William Arntz and Walter

Goodwin who created AutoSystems Corp to market it. The product was then sold to Platinum Technology International in 1995 (one of many systems management companies acquired by Platinum Technology that year). Platinum invested in new features and functionality including the Xpert and JobVision modules . In May 1999, Platinum was itself acquired by Computer Associates (CA) for 3.5 billion U.S. dollars, at that time the largest transaction in the history of the software industry. CA offered $29.25 per share, almost a three-to-one premium over Platinum's stock price of $9.875. In 2006 CA was the subject of intense media scrutiny as it became clear that a $2.2 billion accounting fraud had been orchestrated by chief executive Sanjay Kumar; however the popularity of the AutoSys product remained unaffected.

William Arntz later became Producer, Director, Screenwriter, President at Captured Light, makers of cult film "What The Bleep".Walter Goodwin became founder and CEO of Stirling Systems Group, LLC and later Terma Software Labs .

Page 6: AutoSys Job Scheduling

What is autosysAutoSys is used for defining,

scheduling and monitoring jobs. These jobs can be a UNIX script,  java program or any other program which can be invoked from shell. Before starting we assume that user has already setup an AutoSys environment. This environment consists of autosys server and autosys client.

Page 7: AutoSys Job Scheduling

And what is latest???

The current version is r11.0 and it has been GA since November 2007. This version comes with eIAM (Embedded Identity and Access management) security management module to secure access to scheduling resources.

Page 8: AutoSys Job Scheduling

Autosys components: 1. Event server (AutoSys database)

2. Event processor3. Remote agent

Event ServerThe event server is a AutoSys database

which stores all system information and events as well as all job, monitor, and report definitions. Sometimes this database is also called as a data server, which actually describes a server instance. That is, it is either a UNIX or Windows process, and it is associated data space (or raw disk storage), that can include multiple databases or tablespaces.

Page 9: AutoSys Job Scheduling

Autosys components: Event Processor This is main component of the autosys system. This processes

all the events it reads from dataserver. The event processor is the program, running either as a UNIX process or as a Windows service that actually runs AutoSys. It schedules and starts jobs. When you start the event processor it continually scans the database for events to be processed. When it finds one, it checks whether the event satisfies the starting conditions for any job in the database.

Remote Agent On a UNIX machine, the remote agent is a temporary process

started by the event processor to perform a specific task on a remote (client) machine. On a Windows machine, the remote agent is a Windows service running on a remote (client) machine that is directed by the event processor to perform specific tasks.The remote agent starts the command specified for a given job, sends running and completion information about a task to the event server, then exits. If the remote agent is unable to transfer the information, it waits and tries again until it can successfully communicate with the database.

Page 10: AutoSys Job Scheduling

Latest Autosys components:Application Server A new component which handles the Database connectivity for the AutoSys r11 clients, Command Line Utilities and the GUI's. It has a persistent connection to the DB to allow improved response speed. It also removes the requirement of having a global database user/password.

Event Server The DB containing the events. Differences from 4.5 include vendor library files for the Server and client components.

Page 11: AutoSys Job Scheduling

Basic functionality of AutoSys

Page 12: AutoSys Job Scheduling

Explanation 1. The event processor scans the event server for the

next event to process. If no event is ready, the event processor scans again in five seconds.2. The event processor reads from the event server that an event is ready. If the event is a STARTJOB event, the job definition and attributes are retrieved from the Event Server, including the command and the pointer (full path name on the client machine) to the profile file to be used for the job. In addition, for jobs running on Windows machines, the event processor retrieves from the database the user IDs and passwords required to run the job on the client machine.3. The event processor processes the event. If the event is a STARTJOB, the event processor attempts to establish a connection with the remote agent on the client machine, and passes the job attributes to the client machine.The event processor sends a CHANGE_STATUS event marking in the event server that the job is in STARTING state.

Page 13: AutoSys Job Scheduling

Explanation 4. On a UNIX machine, the inetd invokes the remote

agent. On a Windows machine, the remote agent logs onto the machine as the user defined as the job’s owner, using the user IDs and passwords passed to it from the event processor.5. The remote agent sends an acknowledgment back to the event processor indicating that it has received the job parameters. The socket connection is terminated. At this point, the event processor resumes scanning the event server database, looking for events to process.6. The remote agent starts a process and executes the command in the job definition.7. The remote agent issues a CHANGE_STATUS event marking in the event server that the job is in RUNNING state.8. The client job process runs to completion, then returns an exit code to the remote agent and quits.

Page 14: AutoSys Job Scheduling

Scheduler

Replaces the Event Processor. A multi-threaded process which selects events from the Event Server and processes them. Changes from 4.5 include multiple event batching and dynamic thread creation.

Page 15: AutoSys Job Scheduling

Autosys command line:Although Windows XP's "at" command

or Korn shell's "cron" allows you to run job at desired time - It lacks enterprise level job scheduling features. PLATINUM Technology might fill this gap by AutoSys.

Page 16: AutoSys Job Scheduling

AutoSys is ...

◦A full job scheduling and management system for NT systems.

◦Allows you create simple or complex sets of instructions to automatically execute at regular intervals.

◦Allows you trigger jobs by date and time, file arrival, and other criteria.

Page 17: AutoSys Job Scheduling

AutoSys is ... Like any scheduling product, AutoSys automatically monitors your jobs. If needed, AutoSys can itself restart jobs that have failed, or cancelled, or were aborted for any reasons. For mission critical projects AutoSys also has a high availability option that will perform rollover of jobs to a backup server if your primary server fails. (Need clustering system like VCS - Veritas Clustering System). . .

Page 18: AutoSys Job Scheduling

Defining autosys job:◦By Autosys Web interface ◦By AutoSys Graphical User Interface (GUI).

◦By using AutoSys Job Information Language (JIL) through a command-line interface.

Page 19: AutoSys Job Scheduling

Autosys job types and structures:There are three types of jobs:

◦Command, ◦File Watcher ◦Box.

Page 20: AutoSys Job Scheduling

Box Jobs : Container of other jobs (including other boxes), and box itself performs no actions, although it can trigger other jobs to run. An important feature of this type of job is that boxes can be put inside of other boxes

File Watcher Jobs : Watch for the arrival of a specified file.

Page 21: AutoSys Job Scheduling

Defining autosys job JIL stands for Job Information Language. Using this

you can instruct autosys to save job definitions. This information saved in autosys database. You can also create a jil file which contains job definition. You can then pass this jil file to autosys.

Essential attributes for defining job1. Job NameJIL Keyword : insert_job. Name used to identify the job.2. Job Typea. JIL Keyword : job_type. The job type is one of job types: command (c), file watcher (f) or box (b).3. Ownera. JIL Keyword : owner

Page 22: AutoSys Job Scheduling

Defining autosys job JIL stands for Job Information Language. Using this

you can instruct autosys to save job definitions. This information saved in autosys database. You can also create a jil file which contains job definition. You can then pass this jil file to autosys.

Essential attributes for defining job1. Job NameJIL Keyword : insert_job. Name used to identify the job.2. Job Typea. JIL Keyword : job_type. The job type is one of job types: command (c), file watcher (f) or box (b).3. Ownera. JIL Keyword : owner

Page 23: AutoSys Job Scheduling

Defining autosys job The job owner specifies whose user ID the command will

be run under on the client machine. This attribute is automatically set to the user who invoked jil or the GUI to define the job, and cannot be changed except by the edit superuser.

Other job attributes: 1. command: The command attribute can be the name of

any command, executable, UNIX shell script or batch file, and its arguments.2. machine: This attribute specifies the client machine on which the command should be run.3. date_condition: The start date/time dependencies attribute is a toggle, which specifies whether or not there are date, time, or both, conditions required for starting the job.4. days_of_week: The days of the week attribute specifies the days on which the job should be run.

Page 24: AutoSys Job Scheduling

Autosys CLI syntax:

Here is a template file that explains the syntax of Autosys JIL. (Job Information Language.)

Page 25: AutoSys Job Scheduling

Autoys jil Sample jil file for command job

echoJob.jil1.insert_job:echoJob 2.machine:unixMachine 3.owner:username 4.command:echo “Hello this is command

job”

To add this job in atosys db. Run following command from unix:

jil < echoJob.jilThis command will add “echoJob” job

to autosys databse.

Page 26: AutoSys Job Scheduling

Commands to control the job

Start job commandsendevent –E FORCE_STARTJOB -J <job_name>

sendevent -E STARTJOB -J <job_name>

To put jobs on OFF ICE or ON ICEsendevent -E OFF_ICE -J <job_name>  sendevent -E ON_ICE -J <job_name>  sendevent -E KILLJOB –J "Job Name Here"

Page 27: AutoSys Job Scheduling

Meaning of AutoSys status

STATUS AUTOSTATUS Meaning RU RUNNING Running

ST STARTING Starting

SU SUCCESS Success

FA FAILURE Failure

TE TERMINATED Terminated

OI ON_ICE On Ice

IN/td> INACTIVE Inactive

AC/td> ACTIVATED Activated

RE/td> RESTART Restart

OH/td> ON_HOLD On Hold

QW/td> QUE_WAIT Queue Wait

RD/td> Refresh Dependencies

RF Refresh Filewatcher

Page 28: AutoSys Job Scheduling

Autosys status abbreviation: The following table lists the abbreviations used in the

ST (status) column of the autorep report, and gives the status for each abbreviation.

AC=ACTIVATED FA=FAILURE IN=INACTIVE OH=ON_HOLD OI=ON_ICE QU=QUE_WAIT RE=RESTART RU=RUNNING ST=STARTING SU=SUCCESS TE=TERMINATED

Page 29: AutoSys Job Scheduling

Autosys GUIUnicenter AutoSys Job Management is an industry

standard job management system that provides exceptional reliability to support enterprise mission critical applications. Autosys is designed for

distributed environments.

Page 30: AutoSys Job Scheduling

Here is a quick look at the GUI of Autosys. Although the screenshot is not very clear, still it gives you the idea that the GUI is more or less similar to standard Windows or KDE Applications.

Page 31: AutoSys Job Scheduling

Autosys Responds to the following Signals.ALARMCHANGE_PRIORITYCHANGE_STATUSCOMMENTDELETEJOBFORCE_STARTJOBJOB_OFF_HOLDJOB_OFF_ICEJOB_ON_HOLDJOB_ON_ICEKILLJOBSEND_SIGNALSET_GLOBALSTARTJOBSTOP_DEMON

Page 32: AutoSys Job Scheduling

Where to find autosys errors:

$AUTOSYS/out/DBMaint.out for DB problems. $AUTOUSER/out/event_demon.$AUTOSERV. $SYBASE/install/errorlog_$DSQUERY when event server

will not start.. ($AUTOUSER/out/event_demon.ACE). /tmp files created for job_run at client machine. NT: AutoNuTc\lib/X11\app-defaults\xpert. Output from the job definition output & error files.

Page 33: AutoSys Job Scheduling

Autosys dependencies:done(job). exitcode(job) > 5 and exitcode(job_b) != 10. failure(job_a) or f (job_b). notrunning (job). success (job) and s(job_b). terminated(job).

value(global_name)=100

Page 34: AutoSys Job Scheduling

END