Upload
endosnipe
View
254
Download
0
Embed Size (px)
Citation preview
APM Solution with powerful diagnosis function
Introduction of
Acroquest Technology Co.,Ltd.
Introduction
1. This presentation explains about which was released as an OSS product on July 10, 2013.
2. You can get information and its data of from these sites.
I. http://www.endosnipe.com/II. http://github.com/endosnipe/ENdoSnipe
2Copyright © Acroquest Technology Co., Ltd. All rights reserved.
[0. Introduction]
1. Introduction of Acroquest Technology Co.,Ltd.
1. Our main mission is an entrusted development of software monitoring and controlling of network.
2. We specialized in Linux and Java 13 years ago and have accumulated knowledge since then.
3
2000 Built “GNMS” the platform about monitoring and controlling of network by Java and sell it as a package software.
2001 Opened Java Trouble Shooting(JTS) site.(http://www.acroquest.co.jp/webworkshop/JavaTroubleshooting/index.html)
2004 Started Java Trouble Shooting Service ”JaTS”
2008
1. Started Java Trouble Shooting mail magazine.(http://www.acroquest.co.jp/webworkshop/JTSMM/index.html)
2. Released ENdoSnipe 3.4 and 3.53. Released ”PROMA-C DevNavi 1.0”, the configuration management
SaaS
2009 1. Released ENdoSnipe Ver. 4.0 and 4.1
2012 1. Released ENdoSnipe Ver. 4.7
[0. Introduction]
2. About
4
1. Rare trouble shooting service which guarantees solving problems within fixed term.
2. We provide this service to more than 60 troubles a year.3. Currently, solution rate is 100%.
(Except for the cases which finished investigation because of no recurrence)
4. is a product that packages know-hows of Java trouble shooting accumulated in
If we can’t solve the problem within the term, we cash back the half the amount of the charge.
Contents
1. Feature of ENdoSnipe Ver. 5.02. Powerful functions3. FAQ4. Roadmap
5Copyright © Acroquest Technology Co., Ltd. All rights reserved.
1. Feature of ENdoSnipe Ver. 5.0
Powerful diagnosis function• Detect the problems which lead system stop and performance problem,
and support to solve them.• Measure and analyze not only Java program but also SQL and so on.
Implemented system visualization• Visualize processing frequency and time• Visualize the operation flow of the system• Visualize the change of resource usage by Excel report
Big enhancement of monitoring function• Add judgment of threshold which enables user to monitor resource
usage.• Offer map function which enables user to design unique dashboard.• Offer UIs for each monitoring target by plugin structure.
Copyright © Acroquest Technology Co., Ltd. All rights reserved.6
Copyright © Acroquest Technology Co., Ltd. All rights reserved.7
[2-1 Powerful diagnosis function]
1. Automatic diagnosis by PerformanceDoctor
Detect problems which lead system halt and performance problem, and support to find causes.
No. Category Summary1
Java
Call count of method2 Turn around time of methods3 CPU usage of thread4 Thread block wait count and time5 GC count and stop time by GC6 Long time stop by full GC7 Occurrence of memory leak
8
Typical frequent operation such as initialization of framework(It is usually operated once when the system launches.Frequent operation leads waste of resources, CPU, disk I/O and so on)
9 Risk of infinite loop by HashMap access(Data destruction by the same time access by plural thread)
10 Occurrence of dead lock
8
It point out directly why the operation takes long time. This feature is different from profiler and debugger.
Rules written with red letters alarms you when problem is detected.
[2-1 Powerful diagnosis function]
2-1. Detect memory leak and risk of hung-up
No. category summary711
JavaFailure in designation of time out in socket communication
12 Frequency of linear search to List13
JDBC
Turn around time of performing queries14 The number of issuance of queries15 The number of issuance of the same query16 Risk of the large number of issuance of SQL17
SQL
Operation of full scan18 Cost of execution plan19 The number of combination by JOIN within a query20 The number of “or” and “union” within a query
9
[2-1 Powerful diagnosis function]
2-2. Detect inefficient database access
Copyright © Acroquest Technology Co., Ltd. All rights reserved.10
[2-2. Implemented system visualization]
1. Visualize processing frequency and time for each function
This shows graphs of average, max. and min. time, call count and the number of operations which stop long time for each function.You can see execution plan of SQL.
Copyright © Acroquest Technology Co., Ltd. All rights reserved.11
[2-2. Implemented system visualization]
2. Visualizing the operation flow
You can see operation of the system as a sequence diagram using ArrowVision, other software we released.
You can see contents and execution plans of issued SQL.Of course, you can also see calls of Java method and return values of the method.
Copyright © Acroquest Technology Co., Ltd. All rights reserved.12
[2-2. Implemented system visualization]
3. Offer the powerful reporting function
0
10
20
30
40
50
60
70
80
90
100
2009/11/04
11:27:00
2009/11/04
13:43:09
2009/11/04
15:59:17
2009/11/04
18:15:26
2009/11/04
20:31:34
2009/11/04
22:47:43
2009/11/05
01:03:52
2009/11/05
03:20:00
2009/11/05
05:36:09
2009/11/05
07:52:17
CPU使用率
(%)
CPU使用率
CPU使用率(最大) CPU使用率(最小) CPU使用率(平均)
0
10
20
30
40
50
60
70
80
90
100
2009/11/04
11:27:00
2009/11/04
13:43:09
2009/11/04
15:59:17
2009/11/04
18:15:26
2009/11/04
20:31:34
2009/11/04
22:47:43
2009/11/05
01:03:52
2009/11/05
03:20:00
2009/11/05
05:36:09
2009/11/05
07:52:17
CPU使用率
(%)
CPU使用率
CPU使用率(最大) CPU使用率(最小) CPU使用率(平均)
You can customize it easily because it is output as Excel format.
Set up the report output settings with target node and term.(We will offer regular report output in the future.)
Show the list of the output reports.
Copyright © Acroquest Technology Co., Ltd. All rights reserved.13
[2-3. Big enhancement of monitoring function]
1. Offer Strong Monitoring by The Function of The Judgment of Threshold
Judge whether the values exceeded the threshold, and show the result with signal color.
Appoint the signal with thetarget data and threshold.
[2-3. Big enhancement of monitoring function]
2. Offer map function which enables you to design unique Dashboard
Copyright © Acroquest Technology Co., Ltd. All rights reserved.14
①
②
③
You can design the unique monitoring screen by arranging 1.graph, 2.signal and 3.links to other maps.
Copyright © Acroquest Technology Co., Ltd. All rights reserved.15
Offer an exclusive UI for Hadoop and HBase by plugin structure.http://gihyo.jp/admin/serial/01/halook
HDFS View MR Arrow Chart
MR Gantt Chart MR Bubble Chart HBase Grow Map
HBase Region Map
[2-3. Big enhancement of monitoring function]
3. Offer UI expansion by plugin structure
Copyright © Acroquest Technology Co., Ltd. All rights reserved.16
[3. FAQ]
1. How high is the overhead?
25.66(60.7%)
25.99(61.5%)
41.40(98.0%)
41.91(99.2%)
42.24
0.00 10.00 20.00 30.00 40.00 50.00 60.00
性能診断
標準
性能試験
性能監視
ENdoSnipe未適用
Throughput(responses/sec)
Get lower only 2%.We realize low overhead in performance monitoring and performance test.
The overheads occurred by each settings are shown below.(Please see as reference because it depends on environment. )
With no ENdoSnipe
Performance monitor
Standard
Performance test
Performance diagnosis
Function Test Performance and Load Test Operation
Copyright © Acroquest Technology Co., Ltd. All rights reserved.17
MonitoringYou can notify the increase of GC time and response getting worse. Recording rich information and it helps trouble shooting.
TestConfirm the achievement for performance and stable operation by ENdoSnipe.
DiagnosisYou can reduce man-hour because you can detect the problems before performance test.
[3. FAQ]
2. Use and efficiency of ENdoSnipe
Performance Management (APM).
You can use ENdoSnipe for wide purpose and stage of process from trouble shooting to Application Performance Management (APM).
18
20132013 20142014
• Poring PerformanceDoctor
• Porting report export function
• Hadoop/Hbase monitoring
• Linux monitoring
• Apache monitoring
• PostgreSQL/MySQLmonitoring
• PHP/Python/Rubymonitoring
Ver. 5
• Porting ArrowVision
• Porting BottleneckEye
• Enhancement of Linuxmonitoring
• Enhancement of Apachemonitoring
• Enhancement of PostgreSQL/MySQL monitoring
• Enhancement of PHP/Python/Ruby monitoring
Ver. 7Enhanced monitoring target.Performance monitoring to operational environment.
• Outlier detection
• System map
• AWS support
• Add Backend DBMS(SQLite)
Ver. 6
Plan to enhance APM function such as outlier detection. You can start diagnostics and monitoring without configuration.
Plan to enhance monitoring function
【Extra】
3. Roadmap of ENdoSnipe
Contact us
Copyright © Acroquest Technology Co., Ltd. All rights reserved.19
Infrastructures Evolution
ContactAcroquest Technology Co., Ltd.
TEL :+81-(0)45-476-3171 E-Mail:[email protected]