Enhancing an HTM System with Monitoring, Visualization and ... · Summary 10 10.04.2012 Kirchhofer...

Preview:

Citation preview

1 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Chair for Computer Architecture and Parallel Processing, Institute of Computer Engineering, Karlsruhe Institute of Technology

Enhancing an HTM System with Monitoring, Visualization andAnalysis Capabilities

Philipp Kirchhofer1, Martin Schindewolf1, Nehir Sonmez2, Oriol Arcas2,Osman S. Unsal2, Adrián Cristal2, Wolfgang Karl11Karlsruhe Institute of Technology (KIT) 2Barcelona Supercomputing Center (BSC)

KIT – University of the State of Baden-Wuerttemberg andNational Research Center of the Helmholtz Association www.kit.edu

Motivation

2 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Transactional Memory simplifies parallel programming

But how to achieve good performance and scalability?

Need for a monitoring infrastructure to

identify runtime characteristics of an applicationrunning on an HTM system

detect application bottlenecks

get insight into interaction between application andHTM system

Project Goals

3 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Develop a monitoring infrastructure for the TMbox HTMsystem using event logs:

Generate events at run time and save for later processing

Recreate HTM state offline

Visualize and analyse saved information

Additional goals:

No probe effect, small hardware overhead, high extensibility,ease of use

DesignThe TMbox system

4 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Developed at Barcelona Supercomputing Center

MIPS compatible multi-core system(FPGA based, 16 cores on 1 FPGA)

SupportsSTM (TinySTM)HTM (BeeTM)HybridTM (Modified TinySTM)

DesignThe TMbox system - Block Diagram

5 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignEvent Generation, Log Unit, Bus Controller

6 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignPost Processing, Visualization, Analysis

7 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignPost Processing, Visualization, Analysis

7 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

DesignPost Processing, Visualization, Analysis

7 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

ResultsParaver workflow

8 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

ResultsExample: 4 conflicting threads

9 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Idle

Compute

Compute Wasted

Try Lock

Commit

Abort

ResultsExample: 4 conflicting threads

9 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Idle

Compute

Compute Wasted

Try Lock

Commit

Abort

Summary

10 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

X Application / HTM runtime behavior is trackablewith no probe effects

X Visualization capabilities lead to in-depth understandingof application / HTM runtime behavior

Metrics provided via offline analysis, e.g.Time spent in Committed & Aborted TransactionsContention / Commit & Abort RateContention between specific threadsHTM System Overhead

11 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Summary at a glance

The TMbox system now supports:

X Identification of detailed runtime characteristicsof an application

X Easy detection of application bottlenecks

X Getting hints to optimize application concerningboth performance and scalability

Ongoing work

12 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Combine monitoring with STM runtime environment:Allows analysis of HybridTM systems

See further work in full paper “A low-overhead profilingand visualization framework for Hybrid TransactionalMemory” (to appear in FCCM 2012)

Acknowledgment

This work was supported by a Short Term Scientific Mission(STSM) grant from the European Cooperation in Scienceand Technology (COST) Action IC1001 (EuroTM) duringJune and July 2011.

13 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Chair for Computer Architecture and Parallel Processing, Institute of Computer Engineering, Karlsruhe Institute of Technology

Enhancing an HTM System with Monitoring, Visualization andAnalysis Capabilities

Philipp Kirchhofer1, Martin Schindewolf1, Nehir Sonmez2, Oriol Arcas2,Osman S. Unsal2, Adrián Cristal2, Wolfgang Karl11Karlsruhe Institute of Technology (KIT) 2Barcelona Supercomputing Center (BSC)

KIT – University of the State of Baden-Wuerttemberg andNational Research Center of the Helmholtz Association www.kit.edu

Additional slides

14 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Additional slides

Workflow

15 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Event Diagram

16 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

Event diagram

FPGA Usage

17 10.04.2012 Kirchhofer et. al. - Enhancing an HTM System with Monitoring, Visualization and Analysis Capabilities

KIT

1 2 4 8 16-40-20

020406080

100120140

Slice Registers Slice LUTsBlock RAM Slice LUTs (Regression curve)

Cores

Uni

ts

TMbox FPGA Usage (with monitoring infrastructure) - Increase per Core

Recommended