16
Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Embed Size (px)

Citation preview

Page 1: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Analyze User Instructions, adapted from MVT

Bob SchwankeSiemens

WITH FUNDING SUPPORT

PROVIDED BY NATIONAL

INSTITUTE OF STANDARDS AND

TECHNOLOGY

Page 2: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

QI-Bench Overview

2222

Formulate

Statistical Analysis Results (Relation

strength)

Annotation and Image Markup,

Non-imaging Clinical Data

Primary Data: Images and other

Raw Data

Reference Data SetsQIBO

Specify

RDF Triple Store

CT Volumetry CT

obtained_by

Tumor growth

measure_of

TherapeuticEfficacy

used_for

Analyze

Y=β0..n+β1(QIB)+β2T+ eij

Execute

Feedbac k

Feed

bac

k

Page 3: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

BiomarkerDB.SummaryStatistic+ = Analyze ({ReferenceDataSet .CollectedValue});

33

Role Use Case Supported Now Gap vs. Model

Domain expert

Run and modify statistical analyses

Web App (thin) n/a Create the web app

Informaticist

Configure set of analysis scripts in toolbox

Desktop (thick)

Run relevant calculations at technical performance level

Persist statistical calculations results as N-ary relations in knowledge store, across larger data sets and at clinical level too

IT systems expert

Configure data input and output services

Server-sideConnects to (some)caGrid data services

Connect directly to RDSM and knowledge store (and through Formulate, broader set of data services)

Page 4: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Load Cases and Run MVT (measurement variability tool)

Page 5: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

AIM output for selected case (from Batch Analysis Service)

Page 6: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Choose Analysis Type (we’ll be adding new Types)

Page 7: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Ground truth can be direct or indirect

Page 8: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Deselect RECIST and WHO measurements

Choose Biomarker Measurements to Analyze (we’ll be adding Measurements)

Page 9: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

R Script for summary statistic

Some Methods exist; we will create new ones (e.g., factor analysis)

Page 10: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Column per measurement

Columns for calculation according to the Methods

Page 11: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Intra- and Inter-reader comparisons

Output of Analysis Type run (this example intra-reader)

Page 12: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Inter-reader measurements

Output of Analysis Type run (this example inter-reader)

Page 13: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

… calculated

Additional outputs based on Methods

Page 14: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Outliers list

Outlier Analysis with Drill-down is Supported (access to raw imagery)

Page 15: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

Configure plots as needed

Resulting plots – we’ll be adding plot types, e.g., box, radar, and K-M

Page 16: Analyze User Instructions, adapted from MVT Bob Schwanke Siemens WITH FUNDING SUPPORT PROVIDED BY NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY

1616