View
224
Download
3
Category
Preview:
Citation preview
IBM Tivoli Monitoring v6 Cognos Reporting Installation Best Practices September 2010
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli
Monitoring v6
Document version 1.0
Antonio Sgro, Services Availability Performances Management Best Practice Team Stefano Borghetti, IBM Tivoli Monitoring Development Payal Chakravarty, IBM Tivoli Common Reporting Development
© Copyright International Business Machines Corporation 2010. All rights reserved. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
ii
CONTENTS
1 Overview..............................................................................................................4
2 Installation ...........................................................................................................4
2.1 Prerequisites ............................................................................................5
2.1.1 TDW Configuration ................................................................................5
2.1.2 Prepare TDW with Shared Dimensions ..................................................5
2.1.2.1 Adding Tivoli Reporting and Analytics Model (TRAM) Dimensions ..........5
2.1.2.2 Creating and Populating the Managed System Dimension......................8
2.2 Connecting to the TDW via Database Client over ODBC........................11
2.3 Installation using the java tool.................................................................11
2.4 Manual Installation .................................................................................16
3 Configuration .....................................................................................................20
3.1 Setup multiple TDW connection .............................................................20
3.1.1 Setting up Database connection via ODBC using Database Client .......20
3.1.2 Creating new database connection in TCR...........................................21
4 Main Features....................................................................................................26
4.1 OS Agents Data Model...........................................................................26
4.2 Virtual Servers (VMWare VI) Agents Data Model ...................................30
4.3 System P Agents Data Model.................................................................33
5 IBM Tivoli Monitoring Agents TCR Cognos-based Reports ................................36
6 Known issues.....................................................................................................39
7 Appendix............................................................................................................39
Useful links ........................................................................................................39
Acronyms...........................................................................................................40
iii
Trademarks .......................................................................................................41
1 Overview Reporting capability is one of the most important features inside an IT organization
in order to have full visibility of the resources usage over the time. Tivoli Common Reporting is the Tivoli standard infrastructure for creating, viewing, and managing Tivoli product reports. Throughout the rest of this document, we will refer to Tivoli Common Reporting as TCR.
More than 40 Tivoli products ship TCR reports providing historical views of availability, utilization, performance, and many other key metrics that helps users to take value of the collected data in terms of capacity plan, data analysis. TCR 1.1 and 1.2 versions were built on a BIRT reporting technology that required too much programming skill, demanded too much knowledge of the database in order to create reporting. In order to address the above user’s panic and with the help of Cognos acquisition, TCR 1.3 was built on top of Cognos reporting technology and several benefits were provided. This paragraph should be scrubbed by someone from ID. There are lots of opportunities to clean it up:
� Simplified report editing (Launch web-based Report Studio in context from a report)
� Ad-Hoc Reporting (Create ad-hoc, on the fly reports)
� Other Misc. capabilities
o Automatic emailing of reports
o Additional report formats (XML. Excel 2000 & 2000 Single Sheet, 2002, and 2007, CSV, html,pdf)
o Greater granular data security (row-level authorization)
In addition, the newest TCR based on Cognos technology brings values in terms of
� Consistency in reporting with other Tivoli products
� Allowing report data correlation with other Tivoli product data and business data
� Allowing customers access (via upgrade) to IBM Cognos advanced analytics modules for advanced reporting capabilities that were not possible with TCR 1.2.
BIRT reporting continues to be supported by TCR, and some of the adopting products in the Tivoli portfolio may ship BIRT based reports as well as Cognos based reports.
2 Installation In order to install TCR Cognos-based reports, there are some prerequisites that need to be satisfied and that depends from the specific product that is releasing the set of reports. Cognos relies on a data model that helps normalize the data and make it easier to configure reports. The data model is unique to each product. The following section outlines how to configure the prerequisites.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
5
2.1 Prerequisites
These are the prerequisite components for installing and running Tivoli Common Reporting packages in Tivoli Monitoring products.
To use the reports, you need at least the following components: • IBM Tivoli Monitoring Version 6.2.2 Fix Pack 2 or later for OS Agents reports. (OS Agents can
be at 6.2.1 level or later) • ITM 6.2.1 or later for ITCAM for Transactions reports 7.2.0.1 • ITM 6.2.2 FP02 or later for System P and VMWare agents reports 6.2.2.1 • Tivoli Common Reporting Version 1.3 • Report packages: your product might have a separate reports package that must be extracted
For additional requirements, the specific product documentation needs to be consulted.
Notes : With Tivoli Common Reporting 1.3, both BIRT and Cognos report engines can co-exist.
2.1.1 TDW Configuration In order to make TCR Cognos-based reports working, some pre-configuration steps need to be executed on the TDW database. The following sections describe all of the necessary steps.
2.1.2 Prepare TDW with Shared Dimensions
Preparing the Tivoli Data Warehouse for Tivoli Common Reporting includes creating the shared dimensions which are required for running the TCR Cognos-based reports and using the data models. There are two types of dimensions you will create:
1. IBM Tivoli Reporting and Analytics Model (TRAM) Dim ensions: This includes the Time Dimension and Computer System dimension which are used by products across Tivoli providing support for cross product reporting.
2. ITM’s Managed System Dimension or Resource Dimensio n: This dimension consists of a normalized table of all the Managed Systems in the environment.
2.1.2.1 Adding Tivoli Reporting and Analytics Model (TRAM) Dimensions
The following dimensions tables are created by this procedure:
• Schema IBM_TRAM: TRAM stands for Tivoli Reporting and Analytics Model which is the common data model used by Tivoli products.
• Table TIME_DIMENSION with years of time dimensional data and granularity to a specified number of minutes. Each row of this table is a unique minute key with various dimensions related to it, such as hour, weekday, day of month, quarter etc.
• Table MONTH_LOOKUP globalizes the month names for Time Dimension.
• Table WEEKDAY_LOOKUP globalizes the weekday names for Time Dimension.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
6
• Other dimensions conforming to the Tivoli Common Data Model, such as ComputerSystem, BusinessService, and SiteInfo.
You will need the database scripts included in the extracted reports package under the db_scripts directory.
• Procedure
• IBM DB2
1. Copy the database scripts (.db2 files) from the reports package to a location where they can be run against the Tivoli Data Warehouse. The scripts are in the db_scripts directory.
2. Log in as a user with database administrative rights such as db2admin or db2inst1. Your user ID must have administrator access to create the IBM_TRAM schema.
3. Connect to the database that you want to create the dimension tables for. This is your Tivoli Data Warehouse.
db2 connect to WAREHOUS;
4. If you have an older version of the database scripts already installed clean up the database:
start clean.db2
5. Create the schema and tables:
db2 -tf create_schema_IBM_TRAM.db2
After the command completes successfully, several new tables are created in the IBM_TRAM schema: TIME_DIMENSION, MONTH_LOOKUP, WEEKDAY_LOOKUP, ComputerSystem, BusinessService, SiteInfo, and so on.
6. Create the stored procedure for generating the time dimension:
db2 -td@ -vf gen_time_dim_granularity_min.db2
7. To populate TIME_DIMENSION table, call the time dimension stored procedure with dates and granularity to generate the timestamps. You can generate up to five years at a time or have the data regenerated every day.
8. db2 call IBM_TRAM.CREATE_TIME_DIMENSION('start_date',
'end_date', granularity_of_data);
where start date and end date are in this format YYYY-MM-DD-HH.MM.SS.MILSEC and granularity of data is the frequency in minutes. For example, the following command generates from 12/31/2009 to 12/31/2010 with 60-minute granularity.
db2 call IBM_TRAM.CREATE_TIME_DIMENSION('2009-12-31-00.00.00.000000',
'2010-12-31-00.00.00.000000', 60);
• Microsoft SQL Server
1. Copy the database scripts (.sql files) from the reports package to a location where they can be run against the Tivoli Data Warehouse. The scripts are in the db_scripts branch of the directory where the reports package was extracted to.
2. Customize the provided scripts by changing the default database name in the use statement (replace USE IBM_TRAM) to match the name of your Tivoli Data Warehouse database. If the name of your Tivoli Data Warehouse is "warehouse" the statement is “USE warehouse”:
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
7
a. createSchema.sql
b. createProcedure.sql
c. clean.sql
d. populateTimeDimension.sql Also, modify the boundary parameters for the time dimension and granularity. For example,
e. @startDate = '2010-01-01 00:00:00',
f. @endDate = '2010-07-08 00:00:00',
@granularity = 60,
If Monday must be the first day of the week, add the fourth parameter equal to 1; otherwise, release three parameters.
@weekday = 7
3. If you have an older version of the database scripts already installed, clean up the database.
sqlcmd -i clean.sql [-U username -P password] [-S hostname]
4. Run the scripts at the MS SQL command line in this order:
sqlcmd -i createSchema.sql [-U username -P password] [-S host]
sqlcmd -i createProcedure.sql [-U username -P password] [-S host]
sqlcmd -i populateTimeDimension.sql [-U username -P password] [-S host]
• Oracle manual installation
1. Copy the database scripts (.sql files) from the reports package to a location where they can be run against the Tivoli Data Warehouse. The scripts are in the db_scripts branch of the directory where the reports package was extracted to.
2. Start an SQL *Plus session if it is not already running.
3. Check that you can access remotely as sys user.
4. If you have an older version of the database scripts already installed clean up the database (the procedure must be called by the sys user):
clean.sql
5. Take one of the following steps:
� If you can access remotely as sys user, run this command and provide all the information that the script requires:
@MY_PATH\setup_IBM_TRAM.sql
� If you cannot access remotely as sys user, run this command locally at the Oracle server and provide all the information that the script requires:
@MY_PATH\local_setup_IBM_TRAM.sql
• Oracle batch installation
1. Copy the database scripts (.sql files) from the reports package to a location where they can be run against the Tivoli Data Warehouse. The scripts are in the db_scripts branch of the directory where the reports package was extracted to.
2. Start an SQL *Plus session if it is not already running.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
8
3. If you have an older version of the database scripts already installed clean up the database (the procedure must be called by the sys user):
clean.sql
4. Create user IBM_TRAM (the script must be called by a user with system rights, such as SYS/SYSTEM):
5. @MY_PATH\create_IBM_TRAM.sql TCR_PASS USER_TBSPC TEMPORARY_TBSPC
where TCR_PASS is the password for the new user, USER_TBSPC is the default user tablespaces name (must exist), and TEMPORARY_TBSPC is the default temporary tablespaces name (must exist)
6. Create the IBM_TRAM tables (the script must be called by the IBM_TRAM user created in the previous step):
7. @MY_PATH\create_schema.sql USER_TBSPC
where USER_TBSPC is the default user tablespaces name (must exist)
8. Grant privileges to the user, such as ITMUSER (the script must be called by the IBM_TRAM user):
9. @MY_PATH\grant_IBM_TRAM.sql USER
where USER is the name of the user to grant privileges to.
10. Create the procedure (the script must be called by the IBM_TRAM user):
@MY_PATH\gen_time_dim_granularity_hr.sql
11. Load the lookup data (the script must be called by the IBM_TRAM user):
@MY_PATH\populateLookup.sql
12. Generate the time dimension (the procedure must be called by the IBM_TRAM user):
13. @MY_PATH\populateTimeDimension.sql StartDate EndDate Granularity
where StartDate is the start date in the format 'yyyy-mm-dd HH:MM', EndDate is the end date in the format 'yyyy-mm-dd HH:MM', and Granularity is the number of minutes. Example:
@reports/myreports/populateTimeDimension.sql
'2008-12-31 00:00' '2011-12-31 00:00' '60'
• Results
The shared dimensions and time dimensions tables are complete.
2.1.2.2 Creating and Populating the Managed System Dimension
NOTE: This step is only required for OS Agents. If you are deploying reports for other agents you do not need to implement this step and can proceed to the next step.
Preparing the Tivoli Data Warehouse for Tivoli Common Reporting also includes creating and populating the resource dimension table "ManagedSystem", which is required for running the Cognos-based reports and using the data models. This dimension consists of a normalized table of all the Managed Systems in the environment
• Before you begin
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
9
Before starting the procedure to build the resource dimension table, you must first configure historical data collection for one or more of the following attribute groups, depending on the operating system you are getting reports for:
Type Attribute group Table Summarize
Linux Linux IP Address
Linux_IP_Address Daily
UNIX UNIX IP Address
UNIX_IP_Address Daily
Windows Computer Information
NT_Computer_Information Daily
You can configure historical data collection in the Tivoli Enterprise Portal or in the Command Line Interface. The following example shows how a local historical collection for NT Computer Information was created and distributed from the CLI:
tacmd login -s MyComputer -u MyUser -p MyPassword
tacmd tepslogin -s localhost -u sysadmin
tacmd histconfiguregroups -t knt -o "NT Computer Information" -m -d YQMQDH -p Y=2y,Q=2y,M=1y,W=1y,D=6m,H=14d,R=7d
tacmd histcreatecollection -t knt -o "NT Computer Information" -a "ComputerInformation" -c 15m -i 15m -l TEMA -e "Needed for resource dimension table for TCR."
tacmd histstartcollection -t "knt" -o "NT Computer Information" -u sysadmin
See "Historical collection configuration" or tacmd histconfiguregroups , tacmd histcreatecollection , and tacmd histstartcollection in the IBM Tivoli Monitoring Command Reference for details.
• Procedure
• IBM DB2
1. Log in as db2admin . Your user ID must have administrator access to create the resource dimension.
2. Connect to the database that you want to create the resource dimension table for. This is your Tivoli Data Warehouse.
db2 connect to WAREHOUS;
3. Create the tables:
db2 -tf gen_resources.db2
After the command completes successfully, a new table is shown under the ITMUSER schema: ManagedSystem.
4. Create the stored procedure to populate the ManagedSystem table:
db2 -td@ -vf populate_resources.db2
5. To populate ManagedSystem table, call the stored procedure:
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
10
db2 call ITMUSER.POPULATE_OSAGENTS();
• Microsoft SQL Server
1. Customize the provided scripts:
a. In create_table.sql , change the default database name in the use statement (replace USE WAREHOUS) if it is different from the default.
b. In create_procedure.sql , change the default database name in the use statement (replace USE WAREHOUS) if it is different from the default.
c. In populate_agents.sql , change the default database name in the use statement (replace USE WAREHOUS) if it is different from the default.
2. Run the scripts at the MS SQL command line in this order:
sqlcmd -i create_table.sql [-U myusername -P mypassword] [-H myhost])
sqlcmd -i create_procedure.sql [-U myusername -P mypassword] [-H myhost])
sqlcmd -i populate_agents.sql [-U myusername -P mypassword] [-H my_host])
• Oracle manual installation
1. Start a SQL *Plus session if it is not already running.
2. Run this command (path with no spaces) and provide all the information that the script requires:
@MY_PATH\setup_populate_agents.sql
• Oracle batch installation
1. Start a SQL *Plus session if it is not already running.
2. Create the ITMUSER.ManagedSystem table. The script must be called by the Tivoli Data Warehouse user, which is ITMUSER by default. If you used a different user name, modify the script for the correct name.
@MY_PATH\create_table.sql
3. Create the procedure to populate the table:
@MY_PATH\create_procedure.sql
4. Start the procedure to populate the ManagedSystem table:
5. begin
6. POPULATE_OSAGENTS('ITMUSER');
7. end;
• Results
The ManagedSystem table is created and populated with managed systems of your environment.
• Automating the Population of Managed System Table R egularly
The Managed System table is dynamic i.e., the contents will change based on the changes in your environment. As and when new managed systems are added the table needs to be updated. Hence it is necessary to automate the task of populating this table regularly. In order to do this the stored procedure to populate the ManagedSystem table (POPULATE_OSAGENTS) needs to be called by a daily scheduled automated job.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
11
2.2 Connecting to the TDW via Database Client over ODBC Cognos uses ODBC to connect to the database. Hence it is important to first install a database client on the Tivoli Common Reporting server and have it connect to the Tivoli Data Warehouse.
DB2
Make sure you have deployed a DB2 database client on the machine where Cognos-based Tivoli Common Reporting engine is installed. The client should be of the same version as the database that Tivoli Data Warehouse is using. Connect the DB2 database client to the database server by running the Configuration Assistant, configuring the local net service name configuration, and restarting your system.
Oracle
Make sure you have deployed the Oracle database client on the machine where Cognos-based Tivoli Common Reporting engine is installed. Connect the Oracle database client to the database server by running the Oracle Net Configuration Assistant, configuring the local net service name configuration, and restarting your system.
MS SQL Server
Make sure you have deployed the MS SQL database client on the machine where Cognos-based Tivoli Common Reporting engine is installed. Connect the MS SQL client to the database server by running the MS SQL Management Studio Express, configuring the local net service name configuration, and restarting your system.
Important: Note the name of the connection you have created as it is used when you install the reports in Section 2.3
2.3 Installation using the java tool In order to install IBM Tivoli Monitoring Cognos-based Reports, it is needed to use the reports installer packaged with each set of Cognos reports.
Here is the procedure to install the reports (as example, the OS Agents reports are installed)
Procedure
1. From the Cognos reports disk or the directory where the report package was extracted, launch the setup script:
� setup.bat tcr_install_dir. (If Tivoli Common Reporting is installed in the default directory, you do not need to specify an installation directory.)
� ./setup.sh tcr_install_dir
2. Click Next on the following panel
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
12
3. Select the Reports on the left side and click on the right arrow (circled in red in the next panel)
4. Click on the Next button
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
13
5. In the following panel complete the following:
� Installation Type = on TCR 1.3
� Enter the directory where TCR is installed
� Enter the Cognos user name and password
And click on the Next button
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
14
6. If you want to skip the TDW data source, check the devoted flag and click next but then it will be needed to be created manually
7. In the next panel you will be prompted for the TDW data source connection parameters; after filling them, click on the Next button
8. In the following screenshot, you will see a summary of all the installation steps and settings; if everything is ok, click on the Install button
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
15
9. If the installation was successfully executed, you will see the following panel:
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
16
2.4 Manual Installation The Cognos-based reports can be installed not only using the Java installation tool but using a manual procedure hereafter described (as example Virtual Server Reports are used to describe the manual installation procedure):
1. In the ITM reports installation media, identify the reports zip file (ex. IBM Tivoli Monitoring for Virtual Servers Reports.zip)
2. Copy the report zip file in the TCR deployment directory: <TCR_Installation_Directory>/products/tcr/Cognos/c8/deployment
3. In the ITM Reports installation media, identify the images directory (ex. C:\IBM_Tivoli_Monitoring_Virtual_Servers_Reports\packages\VMwareVIAgents\images)
4. Copy the content of the images directory in the TCR images directory <TCR_Installation_Directory>/profiles/TIPProfile/installedApps/TIPCell/IBM Cognos 8.ear/p2pd.war/tivoli/ITM/images
5. Launch the IBM Cognos Administration from the TCR portal as described in the following figure:
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
17
6. From the Configuration tab create a TDW data source
7. From the Content Administration tab choice New Import Button and the report package that needs to be imported
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
18
8. Click Next, choose a name for your report package, and then click Next again.
9. Select the report package and click on the Next button
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
19
10. Click Next twice, and on this panel choose the Save and run once option and click Finish.
11. Finally, click Run and the report package will appear.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
20
3 Configuration General configuration information
3.1 Setup multiple TDW connections Cognos supports the creation of multiple TDW connections. In order to do this you will need to do two things:
1. Use the database client to set up an ODBC connection to your database as explained in Section
2. Add the new connection in Cognos Administration
3.1.1 Setting up Database connection via ODBC using Database Client DB2:
Connect the DB2 database client to the database server by running the Configuration Assistant, configuring the local net service name configuration, and restarting your system.
MS SQL Server:
Connect the MS SQL client to the database server by running the MS SQL Management Studio Express, configuring the local net service name configuration, and restarting your system.
Oracle:
Connect the Oracle database client to the database server by running the Oracle Net Configuration Assistant, configuring the local net service name configuration, and restarting your system.
Important: Note the name of the connection you have created as it is used in one of the following steps.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
21
3.1.2 Creating new database connection in TCR Once you have completed step 1 and are ready to set up the data source connection in TCR, browse to the TCR panel and launch IBM Cognos Administration.
In the Admin Panel, go to Configuration -> Data Sources.
Select TDW that was created by the installation wizard. This is the data source name that is understood by Cognos for the ITM data model. DO NOT change this name.
When you click on TDW it will take you to the database connections that the data source TDW points to. Here you will see a default TDW defined. Click on the New Connection icon
to create a new database connection.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
22
As you can see in the figure above, the Data Source TDW contains six different database connections. Once configured, when a report is run the user is given the ability to choose which database to go against.
Once you click the New Connection, the New Connection wizard will launch.
Enter the Name for this connection. It’s a good practice to give this the same name as the database alias you have created in the client. Click Next.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
23
In the next panel choose the database type from the drop down list i.e., either DB2, Oracle or Microsoft SQL Server (ODBC) and click Next.
DB2 1. On the second panel choose an DB2 database as Type.
2. On the third panel specify the name of the connection you have noted before as the DB2 connect string, and in the Signon section specify a new User ID and Password.
MS SQL 1. On the second panel choose an Microsoft SQL Server database as Type.
2. On the third panel specify the name of the connection you have noted before as the Server name, and in the Signon section specify a new User ID and Password.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
24
Oracle 1. On the second panel choose an Oracle database as Type.
2. On the third panel specify the name of the connection you have noted before as the SQL*Net connect string, and in the Signon section specify a new User ID and Password.
On the third panel as explained above enter the database name and the user ID and password.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
25
Click the Test Connection link. In the next panel, click the Test Connection button
If the connection is successful it will return saying the Connection is successful. You can then hit Close on this panel and the subsequent panel and then a final Finish to save this connection.
Now when you look under the TDW data source you will find a new connection called “Production TDW”.
Video Demo Link to set up data source connections: http://www.youtube.com/watch?v=0s3HbSkUySM
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
26
4 Main Features
4.1 OS Agents Data Model The data model for the Monitoring Agents for Windows OS, Linux OS, and UNIX OS reports will have the following features:
• The model covers data from OS Agents only. • The model contains a subset of the attribute groups collected by OS Agents in
aggregated form for time dimension: AVG, MIN, MAX, SUM, LAT, TOT, HI, LOW.
• The model includes a Managed System dimension with the Agent Type attribute (on Windows, Linux, and UNIX systems). It is placed in the IBM Tivoli Monitoring Shared Dimensions namespace.
• The model includes all the aggregations handled by Summarization and Pruning
from daily to yearly including the raw data.
• The model contains forecasting based on the linear trend for the following metrics for each time dimension:
For Linux : � KLZ_CPU_FCAST_XX.AVG_Idle_CPU � KLZ_Disk_FCAST_XX.AVG_Disk_Used_Percent � KLZ_VM_Stats_FCAST_XX.AVG_Used_Virtual_Storage_Pct � KLZ_Network_FCAST_XX.AVG_Bytes_Transmitted_per_sec � KLZ_Network_FCAST_XX.AVG_Bytes_Received_per_sec
For UNIX:
� System_FCAST_XX.AVG_Idle_CPU � Disk_FCAST_XX.AVG_Space_Used_Percent � Unix_Memory_FCAST_XX.AVG_Virtual_Storage_Pct_Used � Network_FCAST_XX.AVG_Transmitted_MB_Total � Network_FCAST_XX.AVG_Received_MB_Total
For Windows :
� NT_System_FCAST_XX.AVG_%_Total_Processor_Time � NT_Logical_Disk_FCAST_XX.AVG_%_Used � NT_Memory_64_FCAST_XX.AVG_Available_Usage_Percentage � NT_Server_FCAST_XX.AVG_Bytes_Transmitted/sec � NT_Server_FCAST_XX.AVG_Bytes_Received/sec
The metrics data items names reflect the catalog attributes names with the following prefixes: – SUM_ into Sum – LAT_ into Latest – MIN_ into Minimum – MAX_ into Maximum – TOT_ into Total – AVG_ into Average – HI_ into Higher – LOW_ into Lower
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
27
Agent Attribute Group
Linux Linux CPU Averages KLZ_CPU_Averages
Linux CPU KLZ_CPU
Linux Disk KLZ_Disk
Linux Network KLZ_Network
Linux Process KLZ_Process
Linux VM Stats KLZ_VM_Stats Linux Disk IO KLZ_Disk_IO Linux Disk Usage Trends KLZ_Disk_Usage_Trends Linux IO Ext KLZ_IO_Ext Linux NFS Statistics KLZ_NFS_Statistics Linux Process User Info KLZ_Process_User_Info Linux RPC Statistics KLZ_RPC_Statistics Linux Sockets Detail KLZ_Sockets_Detail Linux Sockets Status KLZ_Sockets_Status Linux Swap Rate KLZ_Swap_Rate Linux System Statistics KLZ_System_Statistics
Linux
Linux User Login KLZ_User_Login UNIX Disk Disk Network Network Process Process Unix Memory Unix_Memory System System Disk Performance Disk_Performance NFS and RPC Statistics N_F_S_and_R_P_C_Statistics SMP CPU SMP_CPU Solaris Zones Solaris_Zones
UNIX
User User Windows Logical Disk Hourly NT_Logical_Disk Memory Hourly NT_Memory_64 Network Interface Hourly NT_Network_Interface Process Hourly NT_Process_64 Server Hourly NT_Server System Hourly NT_Process_64 ICMP Statistics Hourly ICMP_Statistics IP Statistics Hourly IP_Statistics Cache Hourly NT_Cache Device Dependencies Hourly NT_Device_Dependencies Devices Hourly NT_Devices Event Log Hourly NT_Event_Log Monitored Logs Report Hourly NT_Monitored_Logs_Report Network Port Hourly NT_Network_Port Objects Hourly NT_Objects Paging File Hourly NT_Paging_File
Windows
Physical Disk Hourly NT_Physical_Disk
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
28
Printer Hourly NT_Printer Processor Hourly NT_Processor Processor Summary Hourly NT_Processor_Summary Redirector Hourly NT_Redirector Server Work Queues Hourly NT_Server_Work_Queues_64 Service Dependencies Hourly NT_Service_Dependencies Services Hourly NT_Services Thread Hourly NT_Thread Print Queue Hourly Print_Queue Process IO Hourly Process_IO TCP Statistics Hourly TCP_Statistics UDP Statistics Hourly UDP_Statistics
Table 1. Attributes groups supported by the data mo del
The following figure shows the data model and some of its available attributes:
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
29
Forecasting
The OS Agents reports provide a new functionality to forecast potential future values for a set of metrics. This forecast is calculated using a linear trending based on historical data in a most recent time window.
There are limits in the future for forecasting depending on the aggregation type:
• Hourly: 60 hours in the future
• Daily: 60 days in the future
• Weekly: 1 year in the future
• Monthly: 5 years in the future
• Quarterly: no limit
• Yearly: no limit
For reference, these are the formulas used to compute the forecasted values:
Input data:
( ){ }niyxINPUT ii ,,2,1:, Κ==
where:
00:00:00 01-01-1970 from seconds ofnumber as expressed s timestampof series=ix
tsmeasuremen of series=iy
( ) iiii xyyx given time in the measured valuemetric, =
samples ofnumber =n
Output data
1. Linear approximation of historical data expressed as:
baxy +=
2. [ )1,02 ∈R to show correlation between historical data and computed linear approximation.
Solution
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
30
( )( )( ) ( )( )
2
1
1
1
1
1
2
/
/
/
RR
SSnSSSnSSSnSR
dSSSSb
dSSnSa
SSnSd
yS
xS
yxS
yyS
xxS
yyyyxxxxyxxy
xyxyxx
yxxy
xxxx
n
iiy
n
iix
n
iiixy
n
iiiyy
n
iiixx
=
−−−=
−=
−=−=
=
=
=
=
=
∑
∑
∑
∑
∑
=
=
=
=
=
Note: Related to forecasting, there is a subset of tables that are visible in the model, but cannot be used in custom queries and reports. These tables are contained in the following folders:
• Forecast Hourly
• Forecast Daily
• Forecast Weekly
• Forecast Monthly
• Forecast Quarterly
• Forecast Yearly
Refer to the following link to see video demos of drag and drop report creation using the ITM OS Agents data model:
http://www.youtube.com/watch?v=RiqnvvQ6Jho
4.2 Virtual Servers (VMWare VI) Agents Data Model
The VMware VI Agent Data Model is what you will see in Data Navigation tree of the Query and Report Studio. The data model is a layer built on top of the Tivoli Data Warehouse to make the data more consumable to the end user. The data model contains pre-defined relationships so that when you drag and drop elements across different tables and views they join and you do not have to manually write any SQL.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
31
The structure of the VMware VI Agents data model is shown in the figure below. Cognos data models are virtual star schema models separated into facts and dimensions. Facts are measurable quantities that can be aggregated like CPU Utilization, Number of Processors. Dimensions are the main identifiers by which facts can be grouped, aggregated and sliced and diced. For example, time and server are dimensions by which the fact CPU Utilization can be grouped.
The data model contains two types of dimensions: the TCR Shared Dimension which are shared across Tivoli by products like Time and ITM for Virtual Servers Shared Dimension which are dimensions shared across the ITM for Virtual Servers agents like Datacenter, Clusters , Servers, Virtual Machines, Datastores etc. The facts in the data model are organized under folders by their summarization type like Daily and Hourly.
On expanding Daily and Hourly you will be able to see the attribute groups (see figure below). Each attribute group corresponds to a table/view in the data warehouse. As you can see each attribute group contains a bunch of facts or measures like MIN_CPU_Utilization, AVG_CPU_Utilization and some identifiers like CPU_Number and Shift and Vacation periods.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
32
To build a report you need to follow this order for dragging and dropping elements:
1. First drag one of the ITM for Virtual Servers Shared Dimensions like Datacenter/Cluster/Server/VMs.Server_Hostname
2. Drag any metric from a related attribute group. For example if you want to look at Server related metrics, drag anything under the attribute groups starting with Server in their name. For VM, drag data from the attribute groups whose names start with VM.
3. Finally drag and drop the Standard Timestamp from TCR Shared Dimensions.Time Dimension. For daily data you can use Date instead of Standard Timestamp. You can use any of the other time metrics to slice and dice the data.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
33
Refer to the following link to see video demos of drag and drop report creation using the VMware VI Agent data model.
http://www.youtube.com/watch?v=8xbNDY4dBkc
4.3 System P Agents Data Model The System P Agents Data Model is what you will see in Data Navigation tree of the Query and Report Studio. The data model is a layer built on top of the Tivoli Data Warehouse to make the data more consumable to the end user. The data model contains pre-defined relationships so that when you drag and drop elements across different tables and views they join and you do not have to manually write any SQL.
The structure of the System P Agents data model is shown in the figure below. Cognos data models are virtual star schema models separated into facts and dimensions. Facts are measurable quantities that can be aggregated like CPU Utilization, Number of LPARs. Dimensions are the main identifiers by which facts can be grouped, aggregated and sliced and diced. For example, time and server are dimensions by which the fact CPU Utilization can be grouped.
The System P Agents Data Model contains data for three agents: CEC Base Agent, AIX Premium Agent and VIOS Agent.
When you expand the data model you will see TCR Shared Dimensions, CEC Base Agent, VIOS Agent and AIX Premium Agent.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
34
The data model contains two types of dimensions: the TCR Shared Dimension which are shared across Tivoli by products like Time and agent specific dimensions like CEC Base Agent Dimensions, VIOS Agent Dimensions and AIX Premium Agent Dimensions which are dimensions shared across the System P agents like ManagedSystem, LPAR etc. The facts in the data model are organized under folders by their summarization type like Daily and Hourly.
On expanding Daily and Hourly you will be able to see the attribute groups (see figure below). Each attribute group corresponds to a table/view in the data warehouse. Each attribute group contains a bunch of facts or measures like AVG_CPU_Allocated and some identifiers like CPU_Number and Shift and Vacation periods.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
35
To build a report you need to follow this order for dragging and dropping elements:
1. First drag one of the dimensions from a specific agent like LPAR from CEC Base Agent Dimensions or SystemName from AIX Premium Agent Dimensions.
2. Drag any metric from a related attribute group. Note that dimensions and metrics should be dragged from the same agent.
3. Finally drag and drop the Standard Timestamp from TCR Shared Dimensions.Time Dimensions. For daily data you can use Date instead of Standard Timestamp. You can use any of the other time metrics to slice and dice the data.
An example of a report for the AIX Premium Agent is shown below.
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
36
5 IBM Tivoli Monitoring Agents TCR Cognos-based Reports Here is the list of ITM agents that already provided a set of TCR Cognos based reports:
� ITCAM for Transactions v7.2.0.1 � ITM for Virtual Servers: VMware VI Agent v6.2.2 � System P Agents (CEC, VIOS and AIX Premium) v6.2.2.1 � ITM OS Agents v6.2.2 FP02
Each of the above reports needs some Warehouse Data collection to be enabled and Daily and hourly summarization must be enabled for.
The following section document the needed attributes groups, however all the details are documented in the specific product documentation .
OS Agents Reports attributes groups :
• Windows agent: o Logical_Disk o Memory o Process o Server o System
• Linux agent:
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
37
o CPU o Disk o Network o Process o VM_Stats
• UNIX agent: o Disk o Network o Process o System o Memory
System P Agents Reports attributes groups :
• AIX Premium Agent o KPX_AMS_POOL o KPX_CPU_DETAIL o KPX_CPU_SUMMARY o KPX_ACTIVE_MEMORY_EXPANSION o KPX_DISKS o KPX_FILE_SYSTEMS o KPX_LOGICAL_PARTITION o KPX_LOGICAL_VOLUMES o KPX_NETWORK_ADAPTERS_RATES o KPX_NETWORK_INTERFACES o KPX_PAGING_SPACE o KPX_PHYSICAL_VOLUMES o KPX_VOLUME_GROUPS o KPX_PHYSICAL_MEMORY o KPX_SYSTEM_CALL o KPX_SYSTEM_IO o KPX_PROCESSES_SUMMARY o KPX_WPAR_INFORMATION o KPX_WPAR_NETWORK o KPX_VIRTUAL_MEMORY_MANAGEMENT
• CEC Base Agent o KPK_AMS_POOLS o KPK_CPU_POOLS o KPK_GLOBAL_CEC o KPK_MON_LPARS o KPK_MON_UNMON_ALLOC o KPK_PER_LPAR
• HMC Base Agent o No reports
• VIOS Premium Agent o KVA_AMS_POOL o KVA_CPU_DETAIL o KVA_CPU_SUMMARY o KVA_DISKS KVA_FILE_SYSTEMS o KVA_INTERNET_PROTOCOL_DETAIL o KVA_INTERNET_PROTOCOL_SUMMARY o KVA_LOGICAL_PARTITION o KVA_LOGICAL_VOLUMES o KVA_NETWORK_ADAPTERS_RATES o KVA_NETWORK_MAPPINGS o KVA_PAGING_SPACE
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
38
o KVA_VOLUME_GROUPS o KVA_PHYSICAL_MEMORY o KVA_SYSTEM_CALL o KVA_SYSTEM_IO o KVA_STORAGE_MAPPINGS o KVA_PROCESSES_SUMMARY o KVA_PROCESSES_DETAIL KVA_TCP
•
VMWare Agent Reports attributes groups
• Windows agent: o Logical_Disk o Memory o Process o Server o System
• Linux agent: o CPU o Disk o Network o Process o VM_Stats
• UNIX agent: o Disk o Network o Process o System o Memory
ITCAM for Transactions Agent Reports attributes groups
• For the Application Management Console agent (raw data): o AMC_Application o AMC_Client o AMC_Transaction o AMC_Server o AMC_Internet_Service o AMC_Internet_Service_Agent o AMC_Internet_Service_Element
• For the Client Response Time agent (raw data, hourly, daily): o CRT_Application_Status o CRT_Transaction_Status
• For the Web Response Time agent (raw data, hourly, daily): o WRT_Application_Status o WRT_Transaction_Status o WRT_User_Sessions
• For the Robotic Response Time agent (raw data, hourly, daily): o RRT_Application_Status o RRT_Transaction_Status o RRT_SubTransaction_Status o RRT_Robotic_Playback_Events (raw data only)
• For the Internet Service Monitoring agent (raw data, hourly, daily): o KIS_HOST_STATISTICS o KIS_MONITOR_STATUS
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
39
o KIS_SERVICE_INSTANCE_STATISTICS o KIS_HTTP o KIS_ICMP
• For the Transaction Tracking agent (raw data, hourly, daily): o Aggregates o Interactions
6 Known issues There is a known issue when the TDW schema is different from ITMUser where the Cognos-based reports cannot be executed.
VMWare agent workaround is documented at the following link:
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.tivoli.itmvs.doc/vmware622_user129.htm#wq154
System P Agent workaround is documented at the following link:
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.itm.doc_6.2.2/paix6221_user177.htm#import
The OS Agent workaround is to install the following Interim Fix that can be obtained through L2 support opening a pmr:
6.2.2.2-TIV_ITM_OS_AGENTS_REPORTS-LA0001
The APAR number is IZ78074 and will be officially released within ITM 6.2.2 FP03
7 Appendix Useful links
Tivoli Common Reporting Web Site
https://www.ibm.com/developerworks/mydeveloperworks/groups/service/html/communityview?communityUuid=9caf63c9-15a1-4a03-96b3-8fc700f3a364
Tivoli Common Reporting Support Site
http://www-947.ibm.com/support/entry/portal/Overview/Software/Tivoli/Tivoli_Common_Reporting
IBM Tivoli Monitoring Administration Guide
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.itm.doc_6.2.2fp2/itm622fp2_admin.htm
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
40
IBM Tivoli Monitoring Operating System Agents User Guides
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/nav/3_0_3_2
IBM Tivoli Monitoring Operating System Agents TCR Cognos-based Reports
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.itm.doc_6.2.2fp2/main_unix170.htm#wq319
IBM Tivoli Monitoring for Virtual Server (VI VMWare Agent) TCR Cognos-based Reports
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.tivoli.itmvs.doc/vmware622_user127.htm#wq149
IBM Tivoli Monitoring System P Agent TCR Cognos-based Reports
http://publib.boulder.ibm.com/infocenter/tivihelp/v15r1/topic/com.ibm.itm.doc_6.2.2/paix6221_user174.htm#wq168
IBM Tivoli Composite Application Manager for Transactions User Guide
http://publib.boulder.ibm.com/infocenter/tivihelp/v24r1/topic/com.ibm.itcamt.doc_7.2.0.1/ic-homepage.html
IBM Tivoli Monitoring support site
www.ibm.com/support
Acronyms
ITM IBM Tivoli Monitoring
TCR Tivoli Common Reporting
TDW Tivoli Data Warehouse
TEMS Tivoli Enterprise Management Server
TEP Tivoli enterprise Portal
TEPS Tivoli Enterprise Portal Server
WPA Warehouse Proxy Agent
SPA Summarization Pruning Agent
Table 1 - Acronyms
Install and configure Tivoli Common Reporting Cognos-based reports within IBM Tivoli Monitoring v6
41
Trademarks
®
© Copyright IBM Corporation 2010 IBM United States of America
Recommended