Embed Size (px)
Citation preview
Contrived Techniques
Contrived Techniques Techniques that involve the expert performing tasks they would not normally do as part of their job.
Most of these techniques come from psychology
Useful for capturing tacit knowledge, excellent for conceptualisations.
Important types: card sorting
three card trick
repertory grid technique
constrained tasks
20-questions
commentating
teach back
Triadic Elicitation Method
Triadic Elicitation Method
technique used to capture the way in which an expert views the concepts in a domain.
Involves presenting three random concepts and asking in what way two of them are similar, but different, from the third.
A good way of acquiring tacit knowledge
1. List domain examples
2. Form triad at random
3. Choose the odd one out and classify what the two have in common
4. Write down one attribute for the two (classification attribute)
5. Score all examples on that attribute
6. Repeat from step 2 until a 2D grid is produced
7. Create a table of differences
List domain examples
1. ADA
2. LISP
3. PROLOG
4. COBOL
Form triad at random
1. ADA
2. LISP
3. PROLOG
Choose the odd one out
and classify what the two have in common
The odd one out is ADA
• because of its numeric orientation
• LISP and PROLOG have a symbolic orientation
Write down one attribute
(classification attribute)
Orientation
(two are symbolic, one is numeric)
Score all examples on that attribute
Orientation
Name Score Reason
ADA 1 numeric
LISP 5 symbolic
PROLOG 5 symbolic
COBOL 1 numeric
Repeat from step 2
Form triad at random
1. LISP
2. PROLOG
3. COBOL
Choose the odd one out
and classify what the two have in common
The odd one out is LISP
• because its used regularly
• COBOL and PROLOG are rare
Write down one attribute
(classification attribute)
Availability
(two are seldom, one is common)
Score all examples on that attribute
Availability
Name Score Reason
ADA 2 Not as widely
LISP 3 regularly
PROLOG 1 Not as widely
COBOL 1 Not as widely
Repeat from step 2
Triad Similarity Difference Attribute
123 Symbolic Numeric Orientation
234 Not as widely Regular Availability
134 No Yes Military use
124 Good Poor Development Environment
Results (Grid)
Ori
en
tati
on
Av
aila
bilit
y
Milit
ary
En
vir
on
me
nt
ADA 1 2 5 1
LISP 5 3 1 5
PROLOG 5 1 2 4
COBOL 1 1 1 1
Card Sorting
Or Affinity Diagramming
Getting Organized
We have lots of user-oriented info on what the product should do.
But its all a mess!
How do we group the info to have the big picture? Conceptualise it!
Affinity Diagramming….
Tools for Making Sense Card Sorting - to create Affinity Diagrams
Card sorting also useful for web site organization
Do it with multiple users
Card Sorting Technique in which a collection of concepts are written on separate cards and sorted into piles by experts in order to elicit classes based on attributes.
The piles represent discovered high-level knowledge. Related concepts.
Creating ….
1. Generate ideas
2. Display ideas
3. Sort ideas
4. Create header cards
5. Draw diagram
Affinity Diagram - from Card Sorting
Header Cards?
Proposed category or relationship – a unifying theme, the conceptualization.
Meta-relationships and meta-meta relationships more than possible.
Group?
Why do it as a group?
Sounds expensive!
3. Solutions to wicked problems are not right or
wrong. They are simply “better,” “worse,” “good enough,” or “not good enough.”
With wicked problems, the determination of solution quality is not objective and cannot be derived from following a formula.
Solutions are assessed in a social context in which: - “many parties are equally equipped, interested, and/or entitled to judge [them],”
- and these judgments are likely to vary widely and depend on the stakeholder’s independent values and goals.
In this situation…
How do we even define…
“better,” “worse,” “good enough,” or “not good enough.”
Hence….
We adopt a proxy.
Undertake the exercise as a group activity …. and
Use …. CONSENSUS as a proxy for CORRECT
(Crowdsourcing is a variation on this theme)
