63
Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal nets Nicolás Javier Pizarro de la Fuente Thesis submitted in fulfillment of the requirements for the degree of Master of Science in Engineering Advisor: Marcos Sepúlveda Fernández, Ph.D.

Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

Embed Size (px)

Citation preview

Page 1: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

Pontificia Universidad Católica de ChileSchool of EngineeringDepartment of Computer Science

A feedback-based framework for process enhancement of causal nets

Nicolás Javier Pizarro de la FuenteThesis submitted in fulfillment of the requirements for the degree of Master of Science in Engineering

Advisor: Marcos Sepúlveda Fernández, Ph.D.

Page 2: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

2

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 3: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

3

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 4: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

4

What is Process Mining?

31-07-2015

Business Intelligence

Data Science

Data Mining

Process Mining

Business Process Management

Page 5: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

5

Event logs: A process binnacle

• Process operational information– Case number– Activities– Resources– Execution times

• Who made what, when and for which case?

31-07-2015

Page 6: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

6

Event logs: A process binnacle

31-07-2015

Instance Activity Timestamp Resource

001 Register vehicle 05-07-2015 07:43:22 Nicolás

001 Generate invoice 05-07-2015 08:10:15 Jorge

002 Register vehicle 05-07-2015 08:12:42 Marcos

001 Generate payment 05-07-2015 08:13:55 Jorge

002 Illumination test 05-07-2015 08:20:36 Nicolás

002 Suspension test 05-07-2015 08:25:59 Jorge

… … … …

986 Car delivery 30-07-2015 17:57:37 Marcos

Page 7: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

7

Categories in Process Mining

31-07-2015

Process Mining

Process Discovery

Conformance Checking

Process Enhancement

Inputs Outputs

Page 8: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

8

Categories in Process Mining

31-07-2015

Process Enhancement

Process Extension

Inputs Outputs

Process Repair

Page 9: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

9

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 10: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

10

Problems with existing methods

• Logs are usually biased– Noise– Incompleteness

31-07-2015

Model behaviour

Log behaviour

Noise

Incompleteness

All behaviour

Page 11: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

11

Problems with existing methods

31-07-2015

Page 12: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

12

Problems with existing methods

• Logs are usually biased– Noise– Incompleteness

• No “silver bullet algorithm” in Process Discovery– Different results– Different notations

Strong context dependency

31-07-2015

Page 13: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

13

Problems with existing methods

• Development of repair techniques– Based on event logs• Use of log information: Incompleteness

– Based on reference models• Requires the construction of a whole reference model

Need of post-processing stages that correct the log incompleteness problem

31-07-2015

Page 14: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

14

Research hypothesis

“Process models generated by discovery algorithms can be enhanced using the

knowledge of a domain expert”

31-07-2015

Page 15: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

15

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 16: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

16

A feedback-based framework for process enhancement of causal nets

31-07-2015

Page 17: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

17

Operators and feedback types

31-07-2015

“These two activities occur simultaneously”

“This activity occurs after this other activity”

“These two activities are unrelated”

Order relations

Parallelism(||)

Causality()

Indifference(#)

Page 18: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

18

Dual-activity feedback enhancement

31-07-2015

“Activities X and Y occur simultaneously”

X || Y

Page 19: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

19

Process Models: Causal nets

31-07-2015

Page 20: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

2031-07-2015

Input (I) Activity Output (O){ }∅ a {{b, c, d}}{{a}} b {{e}}{{a}} c {{h}}

… … …{{e, c, g}} h {{i}, {j}}

{{h}} i {{k}}{{h}} j {{k}}

{{i}, {j}} k { }∅

Page 21: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

21

Proposal: Running example

31-07-2015

Page 22: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

22

Proposal: Running example

31-07-2015 A feedback-based framework for process enhancement of causal nets

a

b e

f g

c h

d || f

d

Page 23: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

23

Proposal: Running example

31-07-2015

a

b e

d

fg

c h

Page 24: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

24

A feedback-based framework for process enhancement of causal nets

31-07-2015

Page 25: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

25

Proposal: SESEs

31-07-2015

Page 26: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

26

Proposal: Running example

31-07-2015 A feedback-based framework for process enhancement of causal nets

a

b e

f g

c h

d || (f, g)

d

S

Page 27: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

27

Proposal: Running example

31-07-2015 A feedback-based framework for process enhancement of causal nets

a

b e

S

c h

d || S

d

Page 28: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

28

Proposal: Running example

31-07-2015 A feedback-based framework for process enhancement of causal nets

a

b e

S

c h

d

Page 29: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

29

Proposal: Running example

31-07-2015 A feedback-based framework for process enhancement of causal nets

a

b e

f

c h

d

gS

Page 30: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

30

Proposal: SESEs y RPST

31-07-2015

Page 31: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

3131-07-2015

d f g b e

c h i j k

R

a h

RPST - Refined Process Structure Tree

Page 32: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

32

A feedback-based framework for process enhancement of causal nets

31-07-2015

Page 33: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

33

Recommendations

• Based on logs– Conformance checking– Frequent behavior

• Based on models– Deadlocks– Complexity

31-07-2015

Page 34: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

34

Alignments

Log-based recommendations

31-07-2015

Non-fitting traces

Fitting traces

Page 35: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

35

Conformance Checking: Alignments

a, b, c, d, f, g, h, j, ka, d, f, b, g, e, h, j, ka, d, b, e, c, f, g, h, i ,k

31-07-2015

Page 36: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

3631-07-2015

Model a b c d f g e h j kLog a b c d f g >> h j k

Model a d f b g e c h j kLog a d f b g e >> h j k

Model a d b e c f g h i kLog a d b e c f g h i k

Page 37: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

37

Log-based recommendations

31-07-2015

Non-fitting traces

Fitting traces

Page 38: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

38

Log-based recommendations

31-07-2015

Model a d b e c f g h i kLog a d b e c f g h i k

Page 39: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

39

Model-based recommendations

31-07-2015

• Complexity

Page 40: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

40

Model-based recommendations

31-07-2015

• Deadlocks

Page 41: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

41

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 42: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

42

Implementation

• Developed on ProM– FeedbackRepair Plugin– Available for version 6.4 nighly builds

• Other libraries– jBPT - Business Process Technologies for Java

31-07-2015

Page 43: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

4331-07-2015

Page 44: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

4431-07-2015

Page 45: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

4531-07-2015

Page 46: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

46

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 47: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

47

Evaluation Methodology

• User evaluation– Two user types• Analysts• Reaserchers

• Algorithm performance– Application of techniques on large models

31-07-2015

Page 48: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

48

User evaluation

31-07-2015

Page 49: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

49

Algorithm performance

• 50 simulated operations of each type in real model c-net

|A| = 113 y |D| = 150

31-07-2015

Operation C-net modification RPST calculation

Causality () 0,12 3,2

Parallelism (||) 0,11 3,6

Indifference (#) 0,11 3,1

SESE collapse 0,15 3,4

Total 0,11 3,5

Average execution time (s)

Page 50: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

50

Agenda

• General context• Problems with existing methods• Proposals• Implementation• Algorithm evaluation• Conclusions and future work

31-07-2015

Page 51: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

51

Conclusions

• Users agree on the usefulness of these tools and the validity of the methodology– Operators allows to include all kind of feedback– Subprocess collapsing is useful in this context

• Feasibility of incorporating multiple feedback operations in a few seconds

31-07-2015

Page 52: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

52

Future work

• New GUI• Exhaustive SESE search methodology• New operators• New visualization libraries

31-07-2015

Page 53: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

Pontificia Universidad Católica de ChileSchool of EngineeringDepartment of Computer Science

A feedback-based framework for process enhancement of causal nets

Nicolás Javier Pizarro de la FuenteThesis submitted in fulfillment of the requirements for the degree of Master of Science in Engineering

Advisor: Marcos Sepúlveda Fernández, Ph.D.

Page 54: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

54

ANNEXES

31-07-2015

Page 55: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

55

Causal nets

C = (A, ai, ao, D, I, O)– A is a set of activities– ai and ao are the initial and final activities, respectively– D is the set of dependency relations– I and O are the input and output functions

31-07-2015

Page 56: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

56

Causal nets

– I and O are functions such that:

with

31-07-2015

XØØXP(A)XAS |ASAOASAI :y :

Page 57: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

57

Petri nets v/s causal nets

31-07-2015

Page 58: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

58

Adoption levels: Gartner Hype Cycle for Emergent Technologies

31-07-2015

Page 59: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

59

Definitions: Causality ()

• Causality ( )

(1): “y tiene que estar en el output set de x, así como x tiene que estar en el input set de y”

(2) y (3): “Ninguna otra actividad que contenga a y en su input o output set puede tener a x y viceversa”

31-07-2015

III

OOO

OIOO

asxasyaIasyxAa

asyasxaOasyxAa

asxyIasasyxOas

)(,, \

)(,, \

|)( |)(

yx

(1)

(2)

(3)

Page 60: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

60

Definitions: Parallelism (||)

• Parallelism ( )

(1) y (2): “Si y aparece en el input o output set de alguna actividad, también debe aparecer x y viceversa”

(3) y (4): “y no aparece ni en el input ni en el output set de x y viceversa”

31-07-2015

IIOO

IIOO

III

OOO

asxyIasasxyOas

asyxIasasyxOas

asxasyaIasyxAa

asyasxaOasyxAa

)( )(

)( )(

)(,, \

)(,, \

yx ||(1)

(2)

(3)

(4)

Page 61: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

61

Definitions: Indifference (#)

• Indifference ( )

(1): “Las actividades no son ni una causalidad de la otra, ni tampoco son paralelas”

31-07-2015

yxxyyx ||

yx#

(1)

Page 62: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

62

Algorithms

31-07-2015

Causality

Page 63: Pontificia Universidad Católica de Chile School of Engineering Department of Computer Science A feedback-based framework for process enhancement of causal

A feedback-based framework for process enhancement of causal nets

6331-07-2015

Parallelism

Indifference