38
IVY workbench evaluation Diogo Martins Nuno Pinto Rui Freitas 10910 12797 10908

IVY workbench evaluation

Embed Size (px)

DESCRIPTION

IVY workbench evaluationDiogo MartinsNuno JobRui Freitas

Citation preview

Page 1: IVY workbench evaluation

IVY workbench evaluation

Diogo Martins

Nuno Pinto

Rui Freitas

10910

12797

10908

Page 2: IVY workbench evaluation

Outline

• HCI and IVY workbench

• Objectives

• Interface evaluation

• The case study

• The experience results

• The statistical results

• Conclusions

Page 3: IVY workbench evaluation

HCI

Page 4: IVY workbench evaluation
Page 5: IVY workbench evaluation

IVY workbench

Page 6: IVY workbench evaluation

Objectives

Page 7: IVY workbench evaluation

Objectives

Page 8: IVY workbench evaluation

Objectives

Page 9: IVY workbench evaluation

?

Objectives

Page 10: IVY workbench evaluation

Interface evaluation

• Methods

Page 11: IVY workbench evaluation

Interface evaluation

• Methods

• Groups

Page 12: IVY workbench evaluation

Interface evaluation

• Methods

• Groups

• Local

Page 13: IVY workbench evaluation

Interface evaluation

• Methods

• Groups

• Local

• The experience

Page 14: IVY workbench evaluation

The case study

• Problem description

• Given examples

Page 15: IVY workbench evaluation

The case study

• Problem description

Page 16: IVY workbench evaluation

The case study

• Given examples

Page 17: IVY workbench evaluation

The experience results

• User’s behavior

• previous knowledge in Model Checking

• no previous knowledge in Model Checking

• User’s opinions

• physical states

• tabular

Page 18: IVY workbench evaluation
Page 19: IVY workbench evaluation

User’s behavior

• Users with previous knowledge in Model Checking:

• Comfortable

• Easy learning

• Problem identified

Page 20: IVY workbench evaluation
Page 21: IVY workbench evaluation

User’s behavior

• Users without previous knowledge in Model Checking:

• Difficulties in understanding the Tabular representation

• Easy understanding in the Physical States representation

• Problem identified in both cases

Page 22: IVY workbench evaluation

User’s opinions

• Physical states

Page 23: IVY workbench evaluation

User’s opinions

- Action Highlight

Page 24: IVY workbench evaluation

User’s opinions

- Components Highlight

Page 25: IVY workbench evaluation

User’s opinions

- State variables insidethe state boxes

Page 26: IVY workbench evaluation

User’s opinions

- Zoom

Page 27: IVY workbench evaluation

User’s opinions

- Horizontal diagram (reduce scroll, easier to compare states)

Page 28: IVY workbench evaluation

User’s opinions

- Loop Arrow connectedand should have the action

Page 29: IVY workbench evaluation

User’s opinions

- Highlight changed variables

Page 30: IVY workbench evaluation

User’s opinions

- Highlight condition violation

Page 31: IVY workbench evaluation

User’s opinions

• Tabular

Page 32: IVY workbench evaluation

User’s opinions

- Explain the yellow color

Page 33: IVY workbench evaluation

User’s opinions

- Loop

Page 34: IVY workbench evaluation

User’s opinions

- Highlight the action

Page 35: IVY workbench evaluation

User’s opinions

- System component

Page 36: IVY workbench evaluation

User’s opinions

- Highlight condition violation

Page 37: IVY workbench evaluation

The statistical results

Page 38: IVY workbench evaluation

Conclusions