59
Andrew Sakowicz ArcGIS Monitor: An Introduction

ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Andrew Sakowicz

ArcGIS Monitor: An Introduction

Page 2: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Agenda

• Motivation and audience

• Use cases

• Installation and Configuration

• Key features

- Health

- Alerts

- Availability

- Usage

- Performance

- Root Cause Analysis (RCA)

• 2020 Improvements

Page 3: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

ArcGIS Monitor: Why?

• Need end to end monitoring for effective diagnostics

• Standard monitoring tools:

- Focus primarily on infrastructure

- IT controlled

- No ArcGIS components

- Low success of ArcGIS troubleshooting

- Integrating “ArcGIS” has challenges and high LOE

Optimize Your Enterprise GIS Deployments

Average cost of IT downtime is $5,600 per minute. Source: Gartner

Page 4: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

ArcGIS Monitor: Why?Optimize Your Enterprise GIS Deployments

• Customers require:

- Faster resolution time

- Better performance

- Lower cost of administration

- End-user satisfaction

Page 5: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

• Dozens of components

• Hundreds of discreet metrics

• Which metrics are important?

• Filter the signal from the noise

• ArcGIS Monitor

- Tailored for ArcGIS

- Non-invasive sampling

- Minimal resource footprint

- Conforms to the environment

- Single or multi-datacenter

The Monitored EnvironmentGrowing in complexity

ArcGIS Enterprise

FederatedGIS Server

RelationalDatabase

+ArcGIS Pro users License Manager

GeoEventServer

SpatiotemporalData StoreArcGIS

Monitor

Hosting GIS Server

Relational & TileData Store

Portal

for ArcGIS

Web

Adaptor

Web

Adaptor

Denver

London

Tokyo

Page 6: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Key features

• Monitors Enterprise components and

underlying infrastructure

• Low level data summarized to

meaningful and actionable information

CPUMemoryDiskNetworkEvents

Hardware

Software

Services Response TimeBusy TimeThroughputSOC Usage

Health ChecksLog EntryUsage StatisticsConfigurationSecurity

ArcGIS Monitor:• Health

• Performance

• Usage

Page 7: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

USAGE

Target Audience

RCA

• Administrators:

- Alerts

- Root Cause Analysis (RCA)

• Managers:

- Availability

- Performance

- Usage

• Developers:

- errors analysis

- customization

Alerts

Error Analysis

Availability

Page 8: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Simple use case

Page 9: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Problems: Points “disappeared” from a mapFirst noticed around 7 am

Golf Courses points

“disappeared”

Page 10: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Select RCA for this time rangeAnalyze Sources and click on Log error messages

Page 11: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Analyze error message

Page 12: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Investigate “Source” machine

Problem: ArcGIS Data Store

service not running.Restarting service throws

logging error.

Page 13: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Resolve: correct password and start ArcGIS Data Store service

Page 14: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Verify resolution

Points are visible

Page 15: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

https://enterprise.arcgis.com/en/monitor/latest/get-started/arcgis-

monitor-system-requirements.htm

Installation

Page 16: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Single machine deployment

Page 17: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Distributed deploymentFull stack monitoring

Page 18: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Monitoring service

Configuration

Page 19: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Review your solution(s) architectureExamples

Portal

for ArcGIS

Hosting

Server

ArcGIS

Data Store

(relational + tile cache)

Web Adaptor

GeoEvent

Server

ArcGIS

Server

Page 20: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Gallery: Tutorials and Videos

https://arcgismonitor.maps.arcgis.com

Page 21: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Gallery: Select required Extensions

https://arcgismonitor.maps.arcgis.com

Page 22: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Extensions examples

Page 23: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

License InventoryWhat and how many licenses do we have?

Page 24: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Number of UsersHow many unique users were there

during this time period?

Page 25: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

User NamesWho were the specific users during

this time period?

Page 26: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

% of Licenses UsedWhat percentage of the licenses were used during this time period?

Page 27: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

ArcSOC OptimizerSetting min / max instances across 100 to 1000s of services

in dynamic environments is challenging

Page 28: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

ArcSOC Optimizer

• Decrease or increase instances, based on:

• 1. historical usage

• 2. available memory and process count

Page 29: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Alerts

Page 30: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

AlertsStarting point for troubleshooting

Charts and Stats Details and Logs Source Urls Admin Url

Page 31: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Availability

Page 32: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Availability

• Availability is usually expressed as a percentage of uptime in a given time span

(typically 1 month) and calculated as follows:

Availability (%) = (Total time – Downtime) / Total Time *100%

• ArcGIS Monitor defines downtime based on a critical alert duration.

Page 33: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Availability

• In the case below, in January 2019:

- Total Time= 31*24 = 744 hours (44640 minutes) , see Duration H:M; the total downtime

- Downtime = 47 hours and 24 minutes (2844 minutes), see Non Availability H:M).

- Availability (%) = (44640-2844)/44640*100=93.629%

Page 34: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Usage

Page 35: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Usage

• Usage (or user load) is typically measured using:

- Transactions or requests per time, e.g. per seconds, 5 min, day.

- User IP per time, e.g. per seconds, 5 min, day.

- Users per time, e.g. per seconds, 5 min, day.

• Measured at:

- Load balancer (LB)

- Web server

- ArcGIS Server

- Database

• Format:

- Chart time series

- Table

- Map

Page 36: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Usage at LB: transactions (or requests)Categories > Usage > Tr/Interval

• Chart format

Page 37: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Performance

Page 38: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Performance at LBReports > Usage > Response Time (sec)

Page 39: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Performance at ArcGIS ServerCategories > ArcGIS > Busy Time per Tr (sec)

• Busy Time per Tr (sec) is the total time (seconds) per transaction consumed by

ArcGIS Server service.

Page 40: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Root Cause Analysis (RCA)

Typical cases and

Page 41: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Root Cause Analysis (RCA)“Source” - the most downstream failing component

“Impact” – all upstream failing components

Portal

for ArcGIS

Hosting

Server

ArcGIS

Data Store

(relational + tile cache)

Web Adaptor

GeoEvent

Server

ArcGIS

Server

“Impact”

Portal

for ArcGIS

Hosting

Server

ArcGIS

Data Store

(relational + tile cache)

Web Adaptor

ArcGIS

Server

“Impact”

GeoEvent

Server

Example 1 Example 2

“Source”

“Source”

Page 42: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Overloaded systemLoad exceeds the designed capacity

Source Impact

Page 43: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

RCA: Usage spike Throughput (tr/s)

Page 44: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Bottleneck

Source Impact

Page 45: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

RCA: Free instances = 0 Bottleneck are often created by increased load

Page 46: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Unstable InfrastructureInterruption to the underlying resources

Source Impact

Page 47: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

RCA: CPU spike by unexpected process, e.g. virous scan

Page 48: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

RCA: Portal for ArcGIS Server service stopped

Page 49: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

RCA: ArcGIS Server machine rebooted

Page 50: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

RCA: Database not running

Page 51: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Demo sitehttps://arcgismonitor.esri.com/

Page 52: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

2020 improvements and beta

program

Page 53: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Auto-discovery demo

Page 54: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

PostgreSQL, SQL Server , Oracle

• Power BI integration

- through relational database schema

Page 55: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

ArcGIS Rest API: Portal, Ops Dashboards and Esri JS applications

ArcGIS Rest API

Portal item

Operation Dashboard

Page 56: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Webhooks

ArcGISMonitor

Webhooks

Page 57: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Webhooks Demo

Page 58: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Print Your Certificate of Attendance

Print Stations Located in 150 Concourse Lobby

Tuesday12:30 pm – 6:30 pm

Expo

Hall B

5:15 pm – 6:30 pm

Expo Social

Hall B

Wednesday10:45 am – 5:15 pm

Expo

Hall B

6:30 pm – 9:30 pm

Networking Reception

Smithsonian National Museum

of Natural History

Page 59: ArcGIS Monitor: An Introduction...ArcGIS Monitor: Why? •Need end to end monitoring for effective diagnostics •Standard monitoring tools: -Focus primarily on infrastructure-IT controlled-No

Download the Esri

Events app and find your event

Select the session

you attended

Scroll down to

“Survey”

Log in to access the

survey

Complete the survey

and select “Submit”

Please Share Your Feedback in the App