52
Batch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

Batch Job Management Software - NEC · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

  • Upload
    vantruc

  • View
    223

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

Batch Job Management Software

JobCenter

November, 2015

NEC Corporation,

Cloud Platform Division,

MasterScope Group

Page 2: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group
Page 3: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

Index

1. Product Overview

2. Advantages

3. Operation Steps

4. Functions

5. System Requirements and configurations

6. Appendix

Page 4: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

1. Product Overview

Page 5: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

5 © NEC Corporation 2015

MasterScope JobCenter Product Lineup

Simple installation and Operability Rich functionality Implement 2K+ systems/year

MasterScope is a series of Integrated System Management Software products which enables simple operation and supports in controlling the whole IT system.

Operation Management

Batch Job Management Software Deployment Platform management Backup

JobCenter DeploymentManager SigmaSystemCenter NetBackup

Corporate Management

Unified Management Service level management IT asset management IT Security management

MISSION CRITICAL OPERATIONS

Invariant Analyzer AssetSuite SECUREMASTER

System Management

Server Management Network Management Storage Management Application Management

SystemManager Network Manager iStorageManager Application Navigator

MasterScope JobCenter is a job management tool that automatically runs routine jobs and batch processing, and enables accurate and efficient system operation.

Page 6: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

6 © NEC Corporation 2015

Frequent Issues on System Operation

Human-operated job management often makes mistakes

Even though there are standard tools bundled with OS, it usually gets too

complex as they need a lot of settings

As the system expands, transactions increases accordingly

→ Operation workload increases as well

Cannot make sure if batch command finished successfully or not

日次 処理 日次 処理 Daily

週次 処理 週次 処理 Weekly

不定期 処理 Irregul

ar

月次 処理 月次 処理 Monthly

Accounting

Order Inventory

Cannot remember if that has finished…or not

Ah, I got the wrong order!

Forgot to run the batch process….

1 2 3 4 5

・・・・・・・

Hundred kinds of batch processes

Up to which process it has finished?

I don’t know which process has failed!?

Cannot finish in time!!

? ? ?

Many servers and dealings

Diverge

Wait

Repeat

Schedule

Oh, I can’t modify any more…

▌Human-operated job management often causes unexpected system failures and increases business impacts.

Page 7: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

7 © NEC Corporation 2015

JobCenter Can Solve It!

According to schedule and flow, accurately execute job processes

Can be easily changed and managed by various process parts

Automate routine processes by job management tool to

decrease workload.

Job execution status can be managed at a glance and

bottlenecks can be easily located.

JobCenter

Mgmt

Execute

It’s easy to see in which process errors have occurred.

Parts There are many parts pre-set, it’s easy to change/manage.

Automation

Transaction flow

Can solve procedure mistakes

▌Introducing Job management tool, which automates routine processes and enables accurate and efficient system operations.

日次 処理 日次 処理 Daily

週次 処理 週次 処理 Weekly

不定期 処理 Irregu

lar

月次 処理 月次 処理 Monthly

Page 8: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

2. Advantages

Page 9: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

9 © NEC Corporation 2015

Improvement

▌MasterScope JobCenter is a job management tool that automates customer’s business securely, supports the whole system life cycle from implementation, daily operation and job monitoring to improvement.

What is MasterScope JobCenter?

Implementation

● Create job network

● Create schedule

● Report configuration Info and setting info.

Operation

Design, Implementation

Daily Operations

Analysis, Improvement

● Jobs monitoring, execution

● Changeable schedule

● Operations history

● Replace job definitions at one time

● Analyze job execution history

Page 10: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

10 © NEC Corporation 2015

Large Customer Base

MasterScope JobCenter Advantages

Rich and Easy-to-Use

Functions

Multi Platform Supported

Reasonable Price

▌MasterScope JobCenter is a reliable product in terms of functions, customer base and as well as its reasonable price.

Page 11: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

11 © NEC Corporation 2015

Advantages 1. Rich and Easy-to-Use Functions

▌Provides rich and easy-to-use functions required for job management, which

▌allow efficient operation from defining job flow and schedule to daily operations.

Create job flow Monitor execution status

Manage schedule

Just by drag & drop

Other rich functions

User rights mgmt. Operation log Excel define Execution analysis

Reporting Queue control Calendar e-mail alert

ERP linkage AD linkage Cluster supported etc.

Overall

Drill down to see further info.

Job flow

Detailed log

A lot of pre-set rule options to manage schedule

Page 12: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

12 © NEC Corporation 2015

Mgmt. Server

Advantages 2. Multi Platform Supported

Sales Data

Sales Data

Sales Data

Delivery system

Store A

Store B

Counting Server

Summery Data

Ordering system

Summery Data

・・・

Windows

HP-UX

Linux

Solaris

Start job

◎ Supports various kinds of HA clustering software (CLUSTERPRO,MSFC,ServiceGuard etc.)

◎ Also supports major hypervisors such as vSphere or Hyper-V.

AIX

Even if there are various OS, Virtual software, and cluster software used in the distributed system, it is able to unify and flexibly control/monitor job execution. Supported Language : Japanese, English, Chinese.

Supports Unified management of environment

with various OS (Windows , Linux, Unix)

■Supporting various OS

◎English, Chinese Version

Page 13: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

13 © NEC Corporation 2015

CL/Win×5

MG

SV SV SV SV SV

When operating with 5 Windows servers

■Physical Server

■Virtual Environment

2CPU

1CPU

MasterScope JobCenter Tool A

Less than half!

MasterScope JobCenter Tool A

Less than half!

【Physical Environment】

【Virtual Environment】

ESX ESX

VM VM VM VM

CL/Win×5 MG

SV SV SV SV

Xeon 5606(4cores)*2 Xeon 5606(4sores)*2

When 2 cores are allocated to virtual servers

1CPU

When Tier is same, if the number of CPU increases, price is still same 2CPU

Go up according to the number of CPU

・・・ ・・・

【Notice】 Information described in this page is based on NEC’s investigation on the internet and we do not 100% guarantee that all these information is correct and latest.

▌ MasterScope JobCenter is offered at a reasonable price, for both physical environment and virtual environment. Also, since its price is defined based on machine rank (JobCenter call it ‘Tier’), so if the number of CPU/Core increases, the price is still the same (if the Tier is the same).

Advantages 3. Reasonable Price

Page 14: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

14 © NEC Corporation 2015

Advantages 4. Large Customer Base

■ Major Customers

【Telecom Carrier】 NTT Docomo

【Finance】 Mitsui Sumitomo Bank

【Manufacturing】 Asahi Beer

HP OEM’s JobCenter as job scheduling product of HP Software series since April 2004. They appraise JobCenter in terms of performance and functionality.

■ OEM to HP

【Medical retail】 Toho Pharmaceutical

▌Since its first release in 1994, JobCenter has been accepted by many customers from various industries and has been introduced to broad range of systems ranging from mid-small sized systems to large-scaled mission critical systems in large enterprises.

Page 15: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

3. Operation Steps

Page 16: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

16 © NEC Corporation 2015

MasterScope JobCenter: Simple 3 Steps to Use

▌MasterScope JobCenter automates routine operations quickly and accurately by performing simple 3 steps .

Step. 1

Create Job Network

Step. 2

Set up Schedule

Step. 3

Automated Operation & Monitoring

In addition to these, MasterScope JobCenter also offers

“Appropriate functions that support various operations”

Page 17: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

17 © NEC Corporation 2015

▌Just drag and drop to create job network according to the operation.

① Open the window and create a new job network ② Drag and drop objects(parts) to create flow

④ With various kinds of job parts, it’s very easy to create complex flow.

1. Create Job Network

③ Right-click to write script or configure parameters

Create Job Network ** In this material, “job network” means “workflow of batch job operation”

Just by drag & drop to locate objects to set up the flow

Create category and then create a new job network in it.

Write script to execute or specify the server(or queue) where the job will be

executed.

Right-click

Prepare various kinds of parts such as conditional divergence, parallel

transaction, repeated transaction etc.

Page 18: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

18 © NEC Corporation 2015

2. Set up Calendar/Schedule

Create a basic calendar which defines operation day and holiday. (Without calendar, it is also possible to set up schedule )

Create schedule to set up execution rule, such as, ・ from 9:00 on every Thursday or ・ from 22:00 of the last day of every month

バックアップ処理 マスタ更新処理 DB連携処理

Create Job Network Calendar/Schedule

Operation day : Black Non-operation day: Red

▌Define the date/time of job execution by creating operation calendar/schedule.

▌ Then link with the job network made in the previous step to automatically execute jobs.

Link with the predefined job network and start operation

Page 19: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

19 © NEC Corporation 2015

3. Monitor Job Network Execution Status

Possible to operate by right clicking

◆ Tracker List

Drill down to see detail

Create Job Network Calendar/Schedule Monitoring

▌ Tracker function displays processes of the executed job network and their results, as well as planned job network.

▌ Operation such as re-execution or skipping random job also can be performed through the same window.

※ MasterScope JobCenter calls job execution result “tracker”.

When error occurs, it is also possible to confirm where the error has happened, in

detail.

The job status are distinguished by colors and labels, enabling errors to be

recognized easily.

Possible to confirm detailed information

Page 20: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

20 © NEC Corporation 2015

Create Job Network Calendar/Schedule Monitoring

▌Execution state monitoring, immediate job network submission, and parameter checking can be done through a Web browser. (CL/Web option)

R13.1 Enhanced Function (Option)

Easy-to-use, same as traditional CL/Win(client GUI), just right-click to skip, re-execute etc.

3. Monitor Job Network Execution Status (via Web Browser)

Just like CL/Win(client GUI), CL/Web displays the job flow

graphically

Page 21: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

21 © NEC Corporation 2015

4. Analyze Execution Status

E.g. Relationship between delayed time of jobs and number of executed jobs

Create Job Network Calendar/Schedule Monitoring Analysis

Time D

ela

yed tim

e

Number of executed jobs Average delayed time

By visualizing the frequency of delay of jobs, it is possible to revise the schedule efficiently.

Import data to excel file and click execute button

▌Using excel, it is possible to tally up number of executed jobs and analyze delayed time.

R12.10 Enhanced Function

Page 22: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

22 © NEC Corporation 2015

定義情報

定義情報

Create Job Network Calendar/Schedule Monitoring Analysis Convenient Functions

▌ Using excel, it is possible to edit job network definition, schedule and calendar.

▌With error check function and default functions of excel, it is easier to define job networks.

Job management server

Definition information

Preview

Schedule

Calendar

Upload / download

Export in the format that can be imported to Job management server

5. Edit Job Network Definition by Excel (Option )

Preview job flow using excel to develop job network efficiently

Highlight error, if there is any inconsistency.

Page 23: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

23 © NEC Corporation 2015

◆ Example of exported detailed information of job network ◆ Example of exported parameters by users

R12.10 Enhanced Function Create Job Network Calendar/Schedule Monitoring Analysis Convenient Functions

▌It is possible to export definition information of set job network or calendar to excel file, users can use them for system design document.

5. Export Definition Information to Excel File

Flow chart can be exported as well

Page 24: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

4. Functions

Page 25: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

25 © NEC Corporation 2015

※ indicates option functions

⑦Condition branch Change the job network flow according to

the exit code of a unit job or sub JNW

① Unit job

⑥ Dialog Waits for a response from the operator

⑪ Continuity Jumps to the pre-specified unit job, and re-execute the process after that job executes

⑨ Parallel Execute several jobs or sub job

networks

⑧ Calendar branch

Select an execution flow according to the date

⑤ Hierarchical job network

(Sub Job network)

A large job can also be built by creating sub JNW

※JobCenter calls “sequence of jobs” as “job network”

② ③ ④ ⑤

⑩ OR branch The subsequent parts will be executed when

one of the multiple branch flows finishes.

② Execute SAP command directly

④ Start WebOTX

BatchServer

③Start SVF module

⑥ ⑦ ⑧ ⑨ ⑩ ⑪

”Execution Control Parts” (control transaction flows)

Create job network

MasterScope JobCenter offers various convenient execution controlling parts such as

condition branch, continuity, parallel, dialog, etc., to create job flows easily.

Stop DB Backup Restart DB

Page 26: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

26 © NEC Corporation 2015

⑫ ⑬ ⑮ ⑭ ⑯

”Waiting Control Parts” (enables to synchronize jobs at random point)

Create job network

Using waiting control parts (file waiting, time waiting, event waiting)

enables to make jobs wait and start at random point.

⑯Event transmission / reception

Transmit/receive an event from/at one job network to/from another job network

⑭ File waiting Wait for a specified file to be created, deleted or updated

⑬Job waiting Wait till end of a specified job

⑮Time waiting Wait for a specified time to be

reached

⑫Sub JNW waiting Wait for end of a specified sub

JNW.

Daily batch

Read files

Daily batch

Pre transaction

Post transaction 1

Post transaction 2

Post transaction 3

Page 27: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

27 © NEC Corporation 2015

”Schedule Function” (enables flexible scheduling by combining multiple rules)

Flexibly add new rules on every week, every month, specific day of the week etc. Besides, if the day is a holiday, the operation can be automatically shift to previous or following day.

Instinctively confirm operation day and non-operation day

You can also set rules such as “execute in xx minutes interval”, or “execute on the last day of a month”.

Create schedule

Create flexible schedule by combining multiple rules

R12.10 new

Newly added interval day rule. It is possible to execute on every xx days.

Flexibly and simply set various operation’s execution schedule, required in

business systems by combining multiple rules.

Page 28: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

28 © NEC Corporation 2015

”Calendar Function” (helps operation being conscious of operating / non-operating day)

Create schedule

Operating day : Black Non-operating day : Red

S M T W T F S

System non-operating day

■ Every Mondays 12:00 ■ Every Wednesdays 9:00

Rule exception date (Holiday Shift)

System operating day

Create

cale

nd

ar

C

reate

Sch

ed

ule

C

om

ple

te e

xec. s

ch

ed

ule

Job network operating day (Holiday Shift(following day) )

・ Export Report ・ Backup

・ Replace master file

■ Every Mondays 12:00 ■ Every Wednesdays 9:00

Inherit the setting set in calendar and execute job

on the following day

・ Export Report ・ Backup

・ Replace master file

Calendar function defines operating/non-operating days of jobs.

Using schedule function, shift job execution to previous / following day,

if the set date is a holiday.

S M T W T F S

S M T W T F S S M T W T F S

S M T W T F S

Set rule to easily register operation day and non-operation day

You can also set time zone so that you don’t have to

worry about time difference.

Page 29: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

29 © NEC Corporation 2015

”Reporting function (ReportHelper)”(generates report of setting info. in excel file)

Convenient function

JobCenter Management server

Export setting, definition info.

Import to excel

◆ e.g.1, Details of job network ◆ e.g.2, Schedule list ◆ e.g.3, Job network flow chart

*This function only offers referencing function. Definition Helper (Option license) is required to edit JNW using excel.

Available reports;

■ Definition information ・Job network list ・Details of job network ・Job network flow chart ・Schedule list ・Calendar list

■ Config. Information ・Queue setting ・NQS setting ・User environment setting ・System environment setting ・Permission setting ・Machine list ・Machine group

ReportHelper helps to generate report of configuration or definition

information such as created job network or schedule in excel format.

R12.10 Enhanced Function

It is also possible to output flow chart Editing in excel is easy as compared to documents in other format, such as design document.

Page 30: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

30 © NEC Corporation 2015

”DefinitionHelper” (makes it easier to edit job networks using excel)

MG

JobCenter Management server

Download Upload

Excel

Edit job network

You can use excel for editing job networks simply.

Check if the set parameters are correct on the spot

Confirm transaction flow

Confirm defined job network in excel without any effort

Edit schedule and calendar

Convenient function * Option license is required

DefinitionHelper

DefinitionHelper helps to edit job network, schedule and calendar all

at once using excel.

Schedule and calendar are also editable

Page 31: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

31 © NEC Corporation 2015

“Tracker function”(displays the execution status of job network for unified monitoring)

■ Tracker List

■ Execution results of job network

You can “skip” any scheduled job, or “re-execute” error job

for advanced operation.

■ Example of right-click menu

Monitor execution status

The job status can be checked at a glance as the execution results

are color-coded.

■ Tracker list can be exported as CSV file as well

Drill down to see detailed results of log .

After starting operation, execution status of job network can be monitored through “tracker” list.

Operation such as re-execution or skipping random job can also be done through the same window.

■ Detailed log

Page 32: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

32 © NEC Corporation 2015

Blue (thin line) indicates estimated time (according to execution history) Green (bold line) indicates actual time

★ You can also set alert function when jobs consume more time than estimated.

■ Gantt chart of each job network

“Gantt chart function” (instinctively shows time consumed to execute jobs)

Monitor execution status

Gantt chart shows comparison between estimated time and actual consumed

time to execute jobs, enabling visual and instinctive monitoring.

Page 33: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

33 © NEC Corporation 2015

Analyze execution status

JobCenter Management server

Export execution data

Import to excel

“Performance analyzing function(AnalysisHelper)” (supports in improving

operations)

◆ e.g. 1, Relationship between delayed time and number of executed jobs

As it is pivot table of excel, you can analyze data flexibly

◆ e.g. 2, Number of executed jobs on specific day, by time

There are relatively many jobs between 9:00am-8:00pm. Operator can consider improving execution schedule

You can analyze from various point of view such as, ・ Delayed time ・ Number of executed jobs by time ・ Number of executed jobs by server ・ Number of executed jobs by user

* When there are enormous data to analyze, it may consume a large capacity of disk ** Data analyzing requires memory and CPU, it is recommended to perform analysis on another server

Analysis terminal

AnalysisHelper helps to import and analyze job execution data, accumulated

during daily operation for effective operation management.

R12.10 Enhanced Function

Page 34: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

34 © NEC Corporation 2015

Create rights group, to manage access rights

App A developer

user01 (AP group 1)

user02 (AP group 2)

Execute only

Operator

Control access for specific users

Create JNW

”Permission function” (controls scope of operation and reference)

Execution environment

Access rights such as create, refer and execute for each job network

can be set in detail for each user, to grant appropriate rights to users.

Flexibly configure user rights such as, “Only limited job network is available to create/modify” “Only capable to execute”

App B developer

Create JNW

Page 35: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

35 © NEC Corporation 2015

Transfer queue (Pipe queue)

Job mgmt server Job exec server

Execute queue (Batch queue)

Workload is high → set number of running job as 1

Workload is low → set number of running job as 3

■ Queues on each server can be confirmed and set from GUI

■ Simply set transfer destination of pipe queue on GUI ■ Easily set the number of concurrent jobs

← Concurrent jobs

← Priority

”Queue control function” (control the number of concurrent jobs and priority)

Execution environment

Control the number of concurrent jobs, their multiplicity and priority,

by setting a queue to each job or job network.

Page 36: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

36 © NEC Corporation 2015

① Click button from GUI

■ User menu window

② After clicking button, it pops up help window. Click “OK” to start job network.

③ Registered job network will start

User Menu Create Function

Execution environment

Users can create button that can start any job network by themselves, so that

users can start the registered job network at any time from GUI.

Page 37: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

37 © NEC Corporation 2015

Log Exporting Function

Execution environment

Export log history of every client’s operation/job execution for job network.

Collaborate with log collecting tool to incorporate internal control (for SOX law).

Get the log information from JobCenter CL/Win •Term of keeping logs •Size of logs •Number of backup file

time user host target job operation

time JNW owner JNW executed

-

2013/05/29 17:24:07.353(JST),root,SampleJNW.20130529082407,JNWSTART,-,・・・ 2013/05/29 17:24:21.042(JST),root,SampleJNW.20130529082407,JNWEND,DONE,・・・ 2013/05/29 17:25:36.082(JST),root,SampleJNW.20130529082535,JNWSTART,-,・・・ 2013/05/29 17:25:36.527(JST),root,SampleJNW.20130529082535,JNWEND,WDONE,・・・ 2013/05/29 17:25:44.313(JST),root,SampleJNW.20130529082544,JNWSTART,-,・・・ 2013/05/29 17:25:44.716(JST),root,SampleJNW.20130529082544,JNWEND,EDONE,・・・

2013/05/29 17:02:26.735(JST),root,testServer,JNW,SampleJNW,create 2013/05/29 17:02:42.811(JST),root,testServer,JNW,SampleJNW/JOB1,modify 2013/05/29 17:02:44.343(JST),root,testServer,JNW,SampleJNW,modify 2013/05/29 17:02:46.093(JST),root,testServer,JNW,SampleJNW,submit 2013/05/29 17:02:50.127(JST),root,testServer,TRK,SampleJNW.20130529080246/JOB1,skip

Record “who”, “when”, “from where”, and “what action” has been done in order to create/modify a job network.

Record “when”, “whose”, “which job network” and “what happened” when a job network starts/stops

Operation log

Execution log

Execution of JNW

JobCenter MG

Operation from CL/Win

JobCenter CL/Win

Operation can be done through GUI

Page 38: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

38 © NEC Corporation 2015

・・・

Management console

Job exec server

・・・

Visually understand job execution status in the whole system on GUI

Job exec server

・・・

Exec server Exec server

Execution status

Job exec. control

Management server (machine group)

Centrally manage execution status of distributed management servers

App C, D, E App A

Job mgmt server

App B

Appropriately locate and configure job network according to application or

schedule

Layering Job management server in a large distributed environment

Job mgmt server

Job mgmt server

Use case in large environment

Management server can monitor job network on the other machines also, so

that you can implement large-scale system by balancing the load, by placing

the job definition file over multiple job network.

Page 39: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

39 © NEC Corporation 2015

MasterScope JobCenter Merit Summary

■ Job management tool (MasterScope JobCenter) Accurately and efficiently supports system operations by automating routine

jobs(e.g. data gathering) and batch processing, with simple job flows and flexible schedule function.

■ MasterScope JobCenter Benefits

・ Efficiently automates operation according to schedule ・ Reduces workload of administrators and operators ・ Enables flexible changes in job flows ・ Explicit and quick notification of execution errors ・ Integrable in multi-platform environment ・ Supports internal control

■ MasterScope JobCenter is suitable for customers who… ・ Manually operate order processing using multiple batch files ・ Have many daily/weekly/monthly data summarizing tasks ・ Need to confirm every time to process batch task after updating data file ・ Need batch collaborating platform when system is newly built ・ Want to register procedures of backup/restore that are occasionally used

Page 40: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

5. System Requirements and configurations

Page 41: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

41 © NEC Corporation 2015

MasterScope JobCenter Product Line

MasterScope JobCenter offers 3 tier product configuration i.e operation terminal,

manager server and execution server, to flexibly support various size of systems.

Batch Batch

Batch Batch

Batch Batch

JobCenter CL/Win

JobCenter MG

JobCenter SV

◆MasterScope JobCenter CL/Win

◆ MasterScope JobCenter MG

◆ MasterScope JobCenter SV

・ Client GUI to create job and schedule and to confirm execution results. ・ Also includes reporting function(Report Helper), analysis function(Analysis Helper)

Installed in manager server, to build job execution environment and to centrally monitor the job execution statuses

Installed on each server, to execute jobs submitted by MG

◆ MasterScope JobCenter Definition Helper (Option)

Used to define job network, schedule, and business day calendar in Excel

Excel Editing Option

Other Options

◆ MasterScope JobCenter CJC Option ・・・・・・・・・・・・ Applied to clustered environment

◆ MasterScope JobCenter for ERP Option ・・・・・・・・・ Linkage with SAP/ERP

◆ MasterScope JobCenter for BI Option ・・・・・・・・・・ Linkage with BI funcion of SAP

◆ MasterScope JobCenter CL/Web (Option)

Used for monitoring through web browser * Can be installed to manager server as well

Web browser

JobCenter CL/Web

R13.1New

Page 42: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

42 © NEC Corporation 2015

MasterScope JobCenter Configuration Example 1/2

◆ Configuration Example 1. Basic configuration ・View *1 ・Management server *1 ・Execution server *5

MG

SV SV SV SV SV

Product Name Overview Qty

MasterScope JobCenter Media Installation media(CD-ROM) 1

MasterScope JobCenter MG 1 Management server※1 1

MasterScope JobCenter SV (T0) 1 Execution server ※2 5

※1 MasterScope JobCenter MG includes 5 licenses of CL/Win. ※2 Price of JobCenter SV defers depending on machine rank. Please consult your regional NEC representative for product availability and ordering information.

◆ Configuration Example 2. Clustered environment + Excel editing ・View (Excel editing) *1 ・Management server *2 (Clustered) ・Execution server *5 (Partly clustered)

SV SV SV

Product Name Overview Qty

MasterScope JobCenter Media Installation media(CD-ROM) 1

MasterScope JobCenter MG 1 Management server※1 2

MasterScope JobCenter SV (T0) 1 Execution server ※2 5

MasterScope JobCenter CJC Option Clustering option 4

MasterScope JobCenter Definition Helper License for 5 client terminals 1

MG MG

CJC Option

CJC Option

SV SV

Cluster

Cluster

CJC Option

CJC Option

CL/Win CL/Win

Definition Helper

※1 MasterScope JobCenter MG includes 5 licenses of CL/Win. ※2 Price of JobCenter SV defers depending on machine rank. Please consult your regional NEC representative for product availability and ordering information.

Page 43: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

43 © NEC Corporation 2015

MasterScope JobCenter Configuration Example 2/2

◆ Configuration Example 3. Excel editing + use web browser ・View (Excel editing) *1 ・Management server and CL/Web server *1 ・Execution server *5

CL/Web

SV SV SV SV SV

◆ Configuration. Example 4. External CL/Web server & Clustered ・View *1 ・Management server *2 (Clustered) ・CL/Web server *2 (Clustered) ・Execution server *5 (Partly clustered)

SV SV SV

MG MG

CJC Option

CJC Option

SV SV Cluster

CJC Option

CJC Option

CL/Win

Definition Helper

CL/Win

MG

Product Name Overview Qty

MasterScope JobCenter Media Installation media(CD-ROM) 1

MasterScope JobCenter MG 1 Management server ※1 1

MasterScope JobCenter SV (T0) 1 Execution server ※2 5

MasterScope CL/Web Monitor via web browser 1

MasterScope JobCenter Definition Helper License for 5 client terminals 1

Product Name Overview Qty

MasterScope JobCenter Media Installation media(CD-ROM) 1

MasterScope JobCenter MG 1Management server ※1 2

MasterScope JobCenter SV (T0) 1 Execution server ※2 5

MasterScope JobCenter CJC Option Clustering option 5

MasterScope CL/Web Monitor via web browser 2

Web browser

CL/Web CL/Web

Web browser

Cluster Cluster

CJC Option not required

CJC Option

※1 MasterScope JobCenter MG includes 5 licenses of CL/Win. ※2 Price of JobCenter SV defers depending on machine rank. Please consult your regional NEC representative for product availability and ordering information.

※1 MasterScope JobCenter MG includes 5 licenses of CL/Win. ※2 Price of JobCenter SV defers depending on machine rank. Please consult your regional NEC representative for product availability and ordering information.

Page 44: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

44 © NEC Corporation 2015

System Requirements

※1 MasterScope JobCenter MG includes 5 licenses of CL/Win. ※2 Price of JobCenter SV defers depending on machine rank. ※3 Version of JobCenter MG and CL/Web should be same

Win HP-UX Linux Solaris AIX

JobCenter MG ○ ○ ○ ○ ○

JobCenter SV ○ ○ ○ ○ ○

JobCenter CL/Win ○ ― ― ― ―

JobCenter CL/Web(Server) ○ ― ○ ― ―

JobCenter CJC ○ ○ ○ ○ ○

JobCenter ERP ○ ○ ― ― ―

JobCenter BI ○ ○ ― ― ―

■ MasterScope JobCenter System Requirements

Microsoft Office Excel

2003 2013 2010

Definition Helper * ○ ○

Report Helper/Analysis Helper * ○

(SP2) ○

■ Microsoft Office Excel supported version ■ JobCenter CL/Web supported browser

IE7 IE8 IE9

Supported browser * ○ ○

Page 45: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

6. Appendix

Page 46: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

46 © NEC Corporation 2015

Case Studies of MasterScope JobCenter

① Operation automation

②Automation of repeated transaction

③Automation of

optional operation

④Automation of backup

⑤Automation power supply management

MasterScope JobCenter is used for automation of the following cases.

business

infrastruct

Used at automation system operations for gathering and integrating data for daily, weekly, monthly data analysis etc.

Used for the real-time processing , such as data transaction in 10 minutes interval rule, or performing a sequential processing in case of repeated files received .

Used at automating optional operation , such as error avoidance processing at the time of trouble, or form issuance by pushing button option

Used for maintaining a stationary point, starting of a service after backup and controlling the replication.

Used for ,control of power off order and procedural control of power supply plunge.

Page 47: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

47 © NEC Corporation 2015

Case Study 1 : Operation Automation

It was necessary to wait for all the data to be received from each store, then confirm and start processing manually. In case when system becomes abnormal, it would take much time for confirmation.

Issue

Using MasterScope JobCenter to automate operations, reduced misoperations, helped to grasp abnormalities visually, made operations efficient.

Result

Distribution business company A, automated their operations by using MasterScope JobCenter to realize easy functioning and reduce operator’s cost by avoiding the situation of waiting for sales data from each store.

Distribution business company A

Sales Data

Sales Data

Sales Data

Delivery system

Store A

Store B

Store Z

Tabulation server

Tabulation Data

Begin processing after all the data is

received

Ordering system

If files does not arrive on time, It's possible to give time-out.

Tabulation Data

...

Start preprocessing when files are received

Delivery system

Ordering System Preprocessing A

Preprocessing B

Preprocessing C

Tabulation Processing

While all file’s preprocessing is completed normally, begin whole data's tabulation processing.

Ordering System

Preprocessing A

Preprocessing B

Preprocessing C

Delivery System

Tabulation Processing

Possible to confirm visually at the time of an error

Page 48: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

48 © NEC Corporation 2015

Case Study 2 : Quiescent Point For Backup

(3) Backup starting

MasterScope JobCenter

When backup does not end as scheduled, It is possible to give alert notification.

It could be used for control of MV/RV copy, separation, mount on server etc. in case of backup by the DDR of iStorage.

For Various Industry

Retain a quiescent point before backup

Backup

Job Job Job

In order to backup correctly, MasterScope JobCenter retains a quiescent point , show alerts and informs the administrator while backup fails to complete as per the schedule.

There are still cases where system could not start normally even when stopped by cron, which leads to backup synchronization failure, initiated in the state when data is inconsistent, leading to schedule disparity.

Issue

System with multiple servers can be stopped in right manner and also backed-up properly. If backup did not complete by the over-time warning defined, then it would be forcibly terminated, and system will be automatically restarted.

Result

(5) DB server starting (6) AP server starting (4) Backup completed

AP server DB server Backup server

(1) AP server stop (2) DB server stop

Page 49: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

49 © NEC Corporation 2015

Job Definition Parts Details 1

① Unit Job

- A unit job is the smallest component that can be executed as a job. - From “Script” on the popup menu (write script directly or designate the place where the batch file to be executed exists), to “Parameter” configuration like on which server to execute the job and decision of execution result using end code.

② ERP Job

ERPコマンドを直接記述したり、インフォパッケージやプロセスチェーンを選択し投入することが可能となります。

ERPコマンドを直接記述したり、インフォパッケージやプロセスチェーンを選択し投入することが可能となります。

Write ERP command (ABAP) directly, execute pre-registered information package or process chain

Linkage option with SAP, controls SAP command in the same way as other jobs in job flow

⑥ Dialog

- Dialog is an object which waits for a response from the user. Until the user responds, the respective processes remain in the WAIT status. - End status of dialog can be determined by selecting OK or ERROR option in popup menu when dialog is in WAIT status,. - By placing condition branch under dialog, job flow can be changed.

⑦ Condition Branch

- Condition branch is used for changing the following: - Job Network flow according to the exit code of a unit job or sub-

JobNetwork. - It is possible to define the range of end code for each branch. - Click the number to confirm condition of exit code. Right click to show popup menu to add flow.

⑧ Calendar Branch

- Calendar branch is an object that executes a flow according to a schedule. If the specified schedule condition is satisfied, the right flow is selected. If not, the downside flow is selected. - When allocating the part, related schedule can be selected from schedule setting window.

⑤ Sub Job Network

- Job networks can be defined hierarchically by being placed in the Job Network flow. - Specify the job network created in advance, or create a new job network when allocating the object. - Complex flow can be managed easily.

どのサーバで 実行するか

When executing a job, “Dialog” option manually controls the next job to start with operator’s decision If return value of JOB1 is between 0-12 or 30, execute

JOB2, if other value then execute JOB3 If the specified schedule condition is satisfied, the right flow is selected. If not, the downside flow is selected.

- On which server to execute the job. - Finishing job with exit code , showing normal / abnormal end.

Page 50: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

50 © NEC Corporation 2015

⑨ Parallel Branch ⑩ OR Branch ⑪ Continuity ⑫ JNW Waiting

⑬ Job Waiting ⑮ Time waiting

- OR Branch is an object that executes the subsequent parts if one of multiple branch flows finishes. By default, two flows are prepared in advance. - Flow can be added through “Add Flow” option, by right clicking the parallel branch menu. . Flow can be deleted through “Delete Empty Flow” option, which is required to empty flow .

When either of job is finished, start JOB4

JOB1に戻り、指定の回数繰り返す

- Jumps to the pre-specified job and re-executes the process after that job. In general, the Continuity is used to re-executes processing if a unit job has ended abnormally. - Designated job can be selected from dialog when placing Continuity part.

When both jobs (JOB1 & JOB2) are finished, start JOB4

- Parallel branch is an object that executes multiple-jobs or sub job networks in parallel. By default, two flows are prepared in advance. - Flow can be added through “Add Flow” option, by

right clicking the parallel branch menu. - Flow can be deleted through “Delete Empty Flow”

option, which is required to empty flow .

- This object waits for a specified job network to end. It is used to set a complex job order. - The object can wait for a sub job network that belongs to the same job network or another sub job network in a sub job network or a job network that does not exist in the job network to which the JNW Waiting part belongs, or another user's job network.

- This object waits for end of a specified job. It is used to define any complex order. It is also used to insert another job between any job and a conditional branch. - This object can wait for a job that belongs to the same job network, as well as for a unit job of other job network or sub job network to which the Job Waiting part belongs.

- This object waits for a specified file to exist or to be updated. If the specified file does not pass the condition, it checks the file state at regular intervals. - Waiting time out can also be set. - File name can be inherited to the sequenced job

- Time Waiting object waits untill an indicated time. Time can be specified on setting dialog in Absolute time (in HH:MM format) or Relative time (in +HH:MM format). - If the execution of the waited part does not start till the specified time, an alarm message will be generated in the event log.

R12.10 Enhanced

⑯ Event Transmission / Reception

- Event Transmission is a unit to transmit an event from a job network to other job network. By utilizing Event Transmission object, a process in the job flow network can wait for other processes in other job flow. - Event Reception part is a unit to receive an event from a job network to other job network. By utilizing Event Reception part, a process in the job flow network can wait for other processes in other job flow. - Received event message can be inherited to the sequence job

R12.10 Enhanced

Job Definition Parts Details 2

If “aaa.txt” file exists in C directly of

HOST_A, start JOB3

⑭ File Waiting

Define the name of sub job network

to wait

Define the name of job to wait

Wait for 2 days until 10:00 and then start JOB3

Go back to JOB1, and re-execute specified job

Page 51: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group

51 © NEC Corporation 2015

Realize simple and integrated system operation

If you have any questions about MasterScope, please contact below by e-mail

NEC: [email protected]

Page 52: Batch Job Management Software - NEC  · PDF fileBatch Job Management Software JobCenter November, 2015 NEC Corporation, Cloud Platform Division, MasterScope Group