111
1 How to get a PhD in Information Technology Peter Eades, PhD

1 How to get a PhD in Information Technology Peter Eades, PhD

Embed Size (px)

Citation preview

Page 1: 1 How to get a PhD in Information Technology Peter Eades, PhD

1

How to get a PhD in Information Technology

Peter Eades, PhD

Page 2: 1 How to get a PhD in Information Technology Peter Eades, PhD

2

How to get a PhD in information technology

Six steps

1. Find a good topic

2. Find a good supervisor

3. Use a good research method

4. Give lots of good talks

5. Write lots of good papers

6. Write a good thesis

Page 3: 1 How to get a PhD in Information Technology Peter Eades, PhD

3

How to get a PhD in information technology

1. Find a good topic

Page 4: 1 How to get a PhD in Information Technology Peter Eades, PhD

4

Independent Ira

Find a good topic

Keywords in ArmenianKeywords in Armenian

Phylogenia of -systems: the case k=4Phylogenia of -systems: the case k=4

Two extreme topics

I have always thought that programming languages which use keywords in Armenian lead to more productive software engineering.

Now I can use my time as a PhD student to prove it.

My supervisor wrote the first -system, and for the past 17 years has been studying the phylogenia of such systems.

Three other students are studying k=1, k=2, and k=3; I will study k=4.

Team member Terri

Page 5: 1 How to get a PhD in Information Technology Peter Eades, PhD

5

Find a good topic

Independent Ira: has an idea, and wants to pursue it, even alone.

Team member Terri: adds a bit to a long term project of her supervisor

Two extreme topics

Dangerous topic• may lead nowhere• may be uncompetitive

Can be satisfying for some people

Funding unlikely

Safe topic Can be satisfying for

some people More chance of

funding

Page 6: 1 How to get a PhD in Information Technology Peter Eades, PhD

6

Find a good topic

Independent topicAdvantages• More exciting for some

people

Disadvantages• Funding unlikely• Dangerous at examination

time

Part of a teamAdvantages• Better support from

colleagues as well as your supervisor

• Good chance of funding

Disadvantages• Can be boring for some

people

Page 7: 1 How to get a PhD in Information Technology Peter Eades, PhD

7

Independent Part of a team

Find a good topic

Most IT theses are somewhere in the middle; other sciences tend to be more team oriented

My adviceMost people do better

in a team.

My adviceMost people do better

in a team.

Page 8: 1 How to get a PhD in Information Technology Peter Eades, PhD

8

Irene the introvert

Find a good topic

2231-1 is a prime number2231-1 is a prime number

2231-1 is a prime number2231-1 is a prime number

Two extreme topics

This problem has been bothering me for decades. I can’t rest until I know the answer.

A guy in a software security company has been phoning my supervisor to ask about this “possibly prime” number, 2231-1.

I’ll try to solve the problem.

Eddie the extravert

Page 9: 1 How to get a PhD in Information Technology Peter Eades, PhD

9

Find a good topic

Irene the introvert: self-motivated, wants to find out for her own sake.

Eddie the extravert: Has a customer who wants to know, he will try to find out

Two extreme topics

There is no customer Customer oriented

The customer may be an industrial partner, or a separate community of academic researchers

Page 10: 1 How to get a PhD in Information Technology Peter Eades, PhD

10

Find a good topic

Introverted research

Advantages• More exciting for some

people

Disadvantages• Funding unlikely• May be worthless to

everyone except yourself

Customer-oriented researchAdvantages• Good chance of good

feedback• Good chance of funding• Better scientific criticism• Better grounded in reality

Disadvantages

Page 11: 1 How to get a PhD in Information Technology Peter Eades, PhD

11

Introspective Customer-oriented

Find a good topic

My adviceAlways ensure that

your research has a customer

My adviceAlways ensure that

your research has a customer

Page 12: 1 How to get a PhD in Information Technology Peter Eades, PhD

12

Find a good topic

The effect of the use of critical path planning in managing software projects

The effect of the use of critical path planning in managing software projects

How to manage software projects

How to manage software projects

Two more extreme topics

Narrow and deep: An investigation of a few variable parameters, with many parameters held fixed.

Wide and shallow: Considers many parameters at once.

Narrow Nancy

Broad Betty

Page 13: 1 How to get a PhD in Information Technology Peter Eades, PhD

13

Find a good topic

Assume• an OO design

method• Java• small teams• 10K – 100K SLOCInvestigate effect of• use of critical path

planning

Assume• an OO design

method• Java• small teams• 10K – 100K SLOCInvestigate effect of• use of critical path

planning

Investigate the effects of

• 15 different design methodologies

• 7 different programming languages

• Small – huge SLOC• 17 different planning

methods

Investigate the effects of

• 15 different design methodologies

• 7 different programming languages

• Small – huge SLOC• 17 different planning

methods

Narrow and broad

Narrow Nancy Broad Betty

Page 14: 1 How to get a PhD in Information Technology Peter Eades, PhD

14

Find a good topic

Narrow and deep topicAdvantages• More chance of pushing the

boundary of knowledge• More exciting

Disadvantages• Your “model” may be too

abstract and unrealistic• It’s hard to choose the

variable parameters

Wide and shallow topicAdvantages• Realistic• Good training for industrial

research

Disadvantages• Mostly boring, like a

collection of honours theses• Unlikely to contribute a lot

Page 15: 1 How to get a PhD in Information Technology Peter Eades, PhD

15

Narrow Wide

Find a good topic

My adviceChoose a narrow and

deep topic, and choose your variable and fixed parameters very carefully.

My adviceChoose a narrow and

deep topic, and choose your variable and fixed parameters very carefully.

Page 16: 1 How to get a PhD in Information Technology Peter Eades, PhD

16

Find a good topic

Robustness theorems for non-pre-emptive scheduling methods

Robustness theorems for non-pre-emptive scheduling methods

Disk cache scheduling for Gnu C++ memory management on a Pentium 4 processor running Solaris

Disk cache scheduling for Gnu C++ memory management on a Pentium 4 processor running Solaris

Another two extreme topics

Fundamental topic: abstraction of specific hardware and software

Applied topic: specific hardware, specific software

Fred the fundamentalist Andy the applicationist

Page 17: 1 How to get a PhD in Information Technology Peter Eades, PhD

17

Find a good topic

Fundamental topicAdvantages• Your thesis will have a

longer life• Your work can have more

applications

Disadvantages• It’s hard to push the

boundaries very far• Your “model” may be too

abstract and unrealistic

Applied topicAdvantages• Easier problems• May help with getting a job

in industry• Can contribute a lot to a

relevant area

Disadvantages• Your thesis can die young• Your employment

prospects can be shortlived• Restricted applications

Page 18: 1 How to get a PhD in Information Technology Peter Eades, PhD

18

Find a good topic

P=NPP=NPWeb-enabled distributed data mining for ubiquitous computing in XML

Web-enabled distributed data mining for ubiquitous computing in XML

Another two extreme topics

I want to solve an problem that has defeated many others

I want a lot of newspaper coverage

Classical Kirsty

Popstar Paul

Page 19: 1 How to get a PhD in Information Technology Peter Eades, PhD

19

Find a good topic

Classical topicAdvantages• You may win the lottery and

solve a hard problem• Your thesis may have a

long life• Better referees• Higher scientific quality

Disadvantages• Can be frustrating• Immediate rewards can be

small

Hot topicAdvantages• Better immediate feedback• With good timing, you can

get rich• Easier to publish• Easier problems• Vibrant community

Disadvantages• Your thesis can die young• Scientific quality can be low

Page 20: 1 How to get a PhD in Information Technology Peter Eades, PhD

20

Find a good topic

Classical hard

problemsNew hot topics

Another two extreme styles

There are IT theses all over this range, but there is a tendency to be near the hot end.

My advice

Investigate a fundamental and classical topic, with some applications to a couple of hot and applied topics.

My advice

Investigate a fundamental and classical topic, with some applications to a couple of hot and applied topics.

Page 21: 1 How to get a PhD in Information Technology Peter Eades, PhD

21

Find a good topic

Extreme Extreme

General advice on topics

Investigate a classical, fundamental, deep, and narrow topic, with some (perhaps shallow) applications to a couple of hot applied topics.

Obtain breadth by being a member of a team.

Think of your topic in terms of your thesis . . .

General advice on topics

Investigate a classical, fundamental, deep, and narrow topic, with some (perhaps shallow) applications to a couple of hot applied topics.

Obtain breadth by being a member of a team.

Think of your topic in terms of your thesis . . .

Page 22: 1 How to get a PhD in Information Technology Peter Eades, PhD

22

Find a good topic

Thesis structure: Fundamental

principles Case studies Refer to case

studies of other team members

PhD Thesis

. . .

Chapter 2

Investigation of a very difficult well known classical fundamental problem

. . .

. . .

Chapter 5: Case study 1, some hot topic

Chapter 6: Case study 2, applied topic

. . .

Chapter 9 Conclusions: Refer to case studies by your colleagues

Page 23: 1 How to get a PhD in Information Technology Peter Eades, PhD

23

Find a good topicA model of optimizing compilers . . .Chapter 2 Describe a new model for optimal

codeChapter 3 Algorithms for creating optimal code

under this model. . . .Chapter 5: Case study 1: how this model

applies to mobile agentsChapter 6: Case study 2: comparison of

optimal/sub-optimal code in a distributed transaction system

. . .Chapter 9 Conclusions: further support for your

hypotheses from work of your colleagues

Classical fundamental problem

Applications to hot and very applied topics

Page 24: 1 How to get a PhD in Information Technology Peter Eades, PhD

24

How to get a PhD in information technology

2. Find a good supervisor

Page 25: 1 How to get a PhD in Information Technology Peter Eades, PhD

25

Find a good supervisor

The relationship between supervisor and student is very important.

It’s like a marriage that lasts for 3 – 4 years: Commitment is important. You must like each other. You depend on each other:

Each needs the other for a good research career

In many cases, you don’t get a chance to choose a supervisor;

But if you have a choice . . .

Page 26: 1 How to get a PhD in Information Technology Peter Eades, PhD

26

Find a good supervisor

Algorithm Find_Good_Supervisor

Repeat

1. Locate person X

2. Test supervision quality of person X

a) Is X a good teacher?

b) Is X a good researcher?

c) Does X have enough money?

d) Does X have good international contacts?

e) Can X help you join a local team?

Until quality is sufficient

Page 27: 1 How to get a PhD in Information Technology Peter Eades, PhD

27

Find a good supervisor

a) X should be a good teacher Can I understand what X is talking about? Did I enjoy lectures by X? Has X written any good textbooks? Has X received any teaching awards? Has X had many other PhD students?

Page 28: 1 How to get a PhD in Information Technology Peter Eades, PhD

28

Find a good supervisor

b) X should be a good researcher Is X cited often?

(From www.citeseer.com:

Citeseer_count/2 > years_since_PhD ? ) Does X publish lots of papers?

( journal_paper_count > years_since_PhD ? )

Page 29: 1 How to get a PhD in Information Technology Peter Eades, PhD

29

Find a good supervisor

c) X should have lots of money Can X get you salary/scholarship? Can X get you enough equipment/software? ($2Kpa?) Can X get you enough travel? ($5Kpa?) Does X supply systems/secretarial support? Does X supply nice office space?

Page 30: 1 How to get a PhD in Information Technology Peter Eades, PhD

30

Find a good supervisor

d) X should have good international contacts Does X have joint publications with other people? Is X involved in conference organization? Is X an editor of an international journal? Do the former students of X have good jobs?

Page 31: 1 How to get a PhD in Information Technology Peter Eades, PhD

31

Find a good supervisor

e) X should be in a local research team Does X have many students/ postdocs/

associates in the Department? Does X regularly attend a research team

meeting? Is X a member of too many research

teams?

Page 32: 1 How to get a PhD in Information Technology Peter Eades, PhD

32

Find a good supervisor

My advice

The three bananas may never come up together, but you should try for at least two.

My advice

The three bananas may never come up together, but you should try for at least two.

Page 33: 1 How to get a PhD in Information Technology Peter Eades, PhD

33

How to get a PhD in information technology

3. Use a good research method

Page 34: 1 How to get a PhD in Information Technology Peter Eades, PhD

34

Use a good research method

1. The customer has a problem.2. The researcher produces an initial model of the

problem.3. Repeat

a) The researcher solves the problem, according to the model.

b) The researcher evaluates the solution of the model problem.

c) The customer evaluates the solution to the real problem.

d) The researcher adjusts the the model.Until the customer is satisfied.

The research procedureThe research procedure

Page 35: 1 How to get a PhD in Information Technology Peter Eades, PhD

35

Use a good research method

Researchers have several roles to play1. Create and adjust models of problems

abstract away non-essential details use scientific theories and formalisms

2. Solve model problems Use skills in

CS/Math/sociology/psychologycommonsense .. Form hypotheses

3. Evaluate solutions to model problems Use skills in Math/Experiments/UCST

4. Present solutions to other researchers and to customers

Page 36: 1 How to get a PhD in Information Technology Peter Eades, PhD

36

Use a good research method

1. The customer has a problem.

2. The researcher produces an initial model of the problem.

3. Repeat

a) The researcher solves the problem, according to the model.

b) The researcher evaluates the solution of the model problem.

c) The customer evaluates the solution to the real problem.

d) The researcher adjusts the the model.

Until the customer is satisfied.

In practice, the research procedure takes a long timeIn practice, the research procedure takes a long time

In practice, a PhD student is usually involved in a part of the procedure, perhaps only one of:

1. Creating/adjusting a model

2. Finding a solution

3. Evaluating a solution

In practice, a PhD student is usually involved in a part of the procedure, perhaps only one of:

1. Creating/adjusting a model

2. Finding a solution

3. Evaluating a solution

We need to know

1. How to create/adjust a model?

2. How to find a solution?

3. How to evaluate a solution?

We need to know

1. How to create/adjust a model?

2. How to find a solution?

3. How to evaluate a solution?

Page 37: 1 How to get a PhD in Information Technology Peter Eades, PhD

37

Use a good research method

Create/adjust a model

1. Creating/adjusting a model

A model is formed by forgetting some of the parameters of the real problem; models are simplifications of real problems.

In IT, models are usually formal and mathematical.

Software Engineers are very familiar with modeling.

Page 38: 1 How to get a PhD in Information Technology Peter Eades, PhD

38

Use a good research method

In practice, many models are models of models.

A: Model of thereal problem

Realproblem

B: Model ofproblem A

Researcher B

C: Model ofproblem B

Researcher C

Researcher A

. . .

Good researchers can only consider a few parameters at a time.

In practice, PhD students may be involved at level B or C or even D …

Page 39: 1 How to get a PhD in Information Technology Peter Eades, PhD

39

Use a good research method

2. Finding a solution

Solutions are artifacts that help the customer.

ProgramsPrograms

AlgorithmsAlgorithms

MetaphorsMetaphors

ProtocolsProtocols

ArchitecturesArchitectures

. . . .. . . .

Artifacts that make up a solution

Artifacts that make up a solution

Page 40: 1 How to get a PhD in Information Technology Peter Eades, PhD

40

Use a good research method

A solution is found using the skills of the researcher.

Your skill set is probably not enough to create a solution.

You need to Remember your undergraduate

work Read books and research papers Attend seminars and conferences Ask your supervisor

Better research comes from a better skill base.

Compilers

Mathematics

OO models

Algorithms

Concurrency

Formal logic

Skills that contribute to a solution

Skills that contribute to a solution

. . . .. . . .

Page 41: 1 How to get a PhD in Information Technology Peter Eades, PhD

41

Use a good research method

Researchers draw on a number of fundamental skills to create a solution consisting of a number of artifacts.

Compilers

Mathematics

OO models

Algorithms

Concurrency

Formal logic ProgramProgram

AlgorithmAlgorithm

MetaphorMetaphor

ProtocolProtocol

ArchitectureArchitecture

ProblemProblem

SolutionSolution

Page 42: 1 How to get a PhD in Information Technology Peter Eades, PhD

42

Use a good research method

3. Evaluating a solution

To evaluate a solution, you need An evaluation measure that tells you

whether the solution is good or bad An evaluation method to compute

the measure

Page 43: 1 How to get a PhD in Information Technology Peter Eades, PhD

43

Use a good research method

Evaluation measures

There are three basic measures for the quality of a solution:

Measures

Effectiveness

Elegance Efficiency

Page 44: 1 How to get a PhD in Information Technology Peter Eades, PhD

44

Use a good research method

The three measures:

1. Effectiveness: is the solution logically correct?

2. Efficiency: does the solution use computational resources efficiently?

3. Elegance: is the solution beautiful, simple, and elegant?

All solutions can be measured in terms of these three parameters.

Page 45: 1 How to get a PhD in Information Technology Peter Eades, PhD

45

Use a good research method

There are three basic evaluation methods

Evaluation

methods

Mathematics

Experiments UCST

And many combinations of these approaches

Page 46: 1 How to get a PhD in Information Technology Peter Eades, PhD

46

Use a good research method

The three methods:1. Mathematics: theorems, proofs2. Experiments

Run programs on test data Collect data about software projects Test systems with human subjects Needs skills in statistics

3. UCST: Try to sell your solution

These are the only evaluation methods in information technology.

Page 47: 1 How to get a PhD in Information Technology Peter Eades, PhD

47

Use a good research method

Example: the plotter problem

A pen plotter is a calligraphic device: it has a pen which moves over the paper to draw the picture.

Page 48: 1 How to get a PhD in Information Technology Peter Eades, PhD

48

Use a good research method

The plotter problem• A pen plotter has a pen which can

be up or down.• It accepts a sequence of

penUp/Down/moveTo instructions.

penUp; moveTo (20,80)

penDown; moveTo (80,80)

penUp; moveTo (20,20)

penDown; moveTo (80,20)

penUp; moveTo (20,20)

penDown; moveTo (80,20)

penUp; moveTo (20,80)

penDown; moveTo (20,20)

penUp; moveTo (80,80)

penDown; moveTo (80,20)

penUp; zero

Page 49: 1 How to get a PhD in Information Technology Peter Eades, PhD

49

Use a good research method

The order of the instructions has an effect on the pen-up time.

penUp; moveTo (20,20)

penDown; moveTo (20,80)

moveTo (80,80)

moveTo (80,20)

moveTo (20,20)

penUp; zero

The plotter problem:

Sort the instructions into an order that minimizes pen-up time.

Page 50: 1 How to get a PhD in Information Technology Peter Eades, PhD

50

Use a good research method

(20,80) (80,80)

(20,20) (80,20)

Say speed = 5cm/sec

Bad solution:

Pen-up time = 71 seconds.

Good solution:

Pen-up time = 6 seconds

Page 51: 1 How to get a PhD in Information Technology Peter Eades, PhD

51

Use a good research method

The model

We have: A set of “primitives” Each primitive has a start point and a finish point. The pen-up time is the sum of the distances from

the finish point of one primitive to the start point of the next primitive.

We want: An ordering for the primitives to minimize pen-up

time.

Page 52: 1 How to get a PhD in Information Technology Peter Eades, PhD

52

Use a good research method

Solution

One easy solution is the greedy algorithm:

1. Choose the first primitive so that its start point is the closest start point to PEN_ZERO.

2. Repeat for k=1 to NUM_PRIMS-1

Choose kth so that its start point is the closest unused start point to the previous finish point.

Page 53: 1 How to get a PhD in Information Technology Peter Eades, PhD

53

Use a good research method

This may be convincing for some customers, but not for PhD thesis examiners.

2. The greedy solution is elegant by UCST: it is easy to understand, easy to implement.

Evaluation by UCST

1. The greedy solution can be “proven” effective by UCST.

UCS Assertion: “Since it chooses the best alternative at each stage, it gives minimum pen up time”.

Page 54: 1 How to get a PhD in Information Technology Peter Eades, PhD

54

Use a good research method

Mathematical EvaluationThe greedy solution can be investigated for

effectiveness using Mathematics.

a) Negative result: Greedy does not always give optimal results.

Total pen-up time =~ 12.5

Page 55: 1 How to get a PhD in Information Technology Peter Eades, PhD

55

Use a good research method

The optimal path is shorter.

Total pen-up time =~ 7

Page 56: 1 How to get a PhD in Information Technology Peter Eades, PhD

56

Use a good research method

Mathematical evaluation

b) The greedy method is close to optimal:

Theorem

If GREED is the pen-up time with the greedy solution and OPT is the pen-up time with the optimum solution then

GREED / OPT = O( logn ).

Proof: lots of mathematics lots of mathematics lots of mathematics and lots and lots of mathematics lots of mathematics lots of mathematics lots of mathematics lots of mathematics lots of mathematics and even more mathematics and more and an incredible amount of complicated mathematics and lots of mathematics lots of ……

Page 57: 1 How to get a PhD in Information Technology Peter Eades, PhD

57

Use a good research method

Experimental Evaluation

Plotter

instructions

Greedy

Algorithm

Effectiveness

test

Random

Customer-supplied

Benchmark

Measure Pup

Compute LBOPT

Calculate Pup/LBOPT

Page 58: 1 How to get a PhD in Information Technology Peter Eades, PhD

58

Use a good research method

Experiments showed that greedy is very close to optimal: for larger plots it is within 10% of optimal.

BUT . . .100

110

120

1000 2000 3000 4000 5000 6000

%Pup/LBOPT

Page 59: 1 How to get a PhD in Information Technology Peter Eades, PhD

59

Use a good research method

Experimental Evaluation

We replaced the quality evaluation with a real plotter

Plotter

instructions

Greedy

Algorithm

Real

plotter

And timed the real plotter using the wall clock. The customer was happy, but it revealed two problems:• The model was wrong,• The greedy algorithm was too expensive.

Page 60: 1 How to get a PhD in Information Technology Peter Eades, PhD

60

Use a good research method

The research procedureThe research procedure

1. The customer has a problem.

2. The researcher produces an initial model of the problem.

3. Repeat

a) The researcher solves the problem, according to the model.

b) The researcher evaluates the solution of the model problem.

c) The customer evaluates the solution to the real problem.

d) The researcher adjusts the the model.

Until the customer is satisfied.

Page 61: 1 How to get a PhD in Information Technology Peter Eades, PhD

61

Use a good research method

Our model was wrongAt a micro-level, the plotter pen moved in three

ways: Horizontally Vertically (some plotters) At 450 to horizontal

Each micro-movement takes one unit of time.This implies that the distance function is L1 or Linf

rather than L2.

Page 62: 1 How to get a PhD in Information Technology Peter Eades, PhD

62

Use a good research method

Mathematical Evaluation

It was easy to check that the mathematical results remain true for any distance function, and this change in model did not change the theorems significantly.

Experimental Evaluation

We repeated the experiments and the results did not change significantly.

Page 63: 1 How to get a PhD in Information Technology Peter Eades, PhD

63

Use a good research method

Our solution was not efficient

Plotter

instructions

Greedy

Algorithm

Real

plotter

The greedy algorithm runs in time O(n2).

This was slower than the drawing procedure.

Page 64: 1 How to get a PhD in Information Technology Peter Eades, PhD

64

plotter

Use a good research method

Solution: optimize one buffer-sized section at a time.

Greedy

Algorithm

Plotter

mechanics

An “optimized” bufferfull is sent from the greedy algorithm to the buffer whenever the plotter exhausted the current buffer.

Buffer

Page 65: 1 How to get a PhD in Information Technology Peter Eades, PhD

65

plotter

Use a good research method

The bufferised greedy algorithm was almost as effective as the straight greedy algorithm, and much faster.

Greedy

Algorithm

Plotter

mechanicsBuffer

Page 66: 1 How to get a PhD in Information Technology Peter Eades, PhD

66

Use a good research method

Mathematics •Robust to model changes•Good evaluation of pathological behavior

•Does not evaluate the model

Experiments •Evaluates the model•Good evaluation of normal behavior

•Poor evaluator for pathological behavior

UCST •Convinces the non-scientific customer

•OK to evaluate elegance

•Poor evaluator of efficiency / effectiveness.

Lessons from the plotter problem

Page 67: 1 How to get a PhD in Information Technology Peter Eades, PhD

67

Use a good research method

It’s more complex than that . . .

Firstly, there are loops within each step

1. The customer has a problem.2. The researcher produces an initial model of the

problem.3. Repeat

a) The researcher solves the problem, according to the model.

b) The researcher evaluates the solution of the model problem.

c) The customer evaluates the solution to the real problem.

d) The researcher adjusts the the model.Until the customer is satisfied.

Page 68: 1 How to get a PhD in Information Technology Peter Eades, PhD

68

Use a good research method

Measures

Effectiveness

Elegance Efficiency

Secondly, in many projects:• All three measures need considerable refinements• One can only compute one or two of the three

measures• One can compute one measure subject to fixed

values of another.

Page 69: 1 How to get a PhD in Information Technology Peter Eades, PhD

69

Use a good research method

Evaluation

methods

Mathematics

Experiments UCST

Thirdly, evaluations tend to be combinations of the three basic evaluation methods.

Page 70: 1 How to get a PhD in Information Technology Peter Eades, PhD

70

Use a good research method

My adviceTo find a solution:• Use your own skills• Read a lot• Attend seminars and conferencesTo evaluate your solution• Concentrate on mathematical and

experimental methods, avoid UCST• Relate your results to effectiveness,

efficiency and elegance

My adviceTo find a solution:• Use your own skills• Read a lot• Attend seminars and conferencesTo evaluate your solution• Concentrate on mathematical and

experimental methods, avoid UCST• Relate your results to effectiveness,

efficiency and elegance

Page 71: 1 How to get a PhD in Information Technology Peter Eades, PhD

71

How to get a PhD in information technology

3. Write lots of good papers

Page 72: 1 How to get a PhD in Information Technology Peter Eades, PhD

72

Write good papers

You can write Papers in NLCs (nice local conferences) Papers in IK-CCs (international killer-

competitive conferences) Papers in journals Chapters in books Books

Students mostly write conference papers; I will concentrate on this.

Page 73: 1 How to get a PhD in Information Technology Peter Eades, PhD

73

Write good papers

There are three basic kinds of conferences

Conferences

IK-CCNLC

Scams

Any many in between

I will concentrate on IK-CC and near IK-CC

Page 74: 1 How to get a PhD in Information Technology Peter Eades, PhD

74

Write good papers

How the process works

a) You write the paper

b) You submit the paper to the program committee chair

c) The program committee chair sends it to members of the program committee (takes about a week)

d) They read it (in about 4 weeks) and write a brief report. They decide whether to accept your paper

e) If your paper is accepted, you revise the paper according to the referee’s comments (2 – 4 weeks)

f) You give a talk at the conference

Page 75: 1 How to get a PhD in Information Technology Peter Eades, PhD

75

Write good papers

How do the program committee decide which papers to accept?• In most cases, the papers are scored

and sorted on score.• Very few papers get a very high score

or very low score.• Accept/reject decisions for middle-

score papers can be fairly arbitrary

10 - 20%

Obviously

Accepted

10 - 20%

Obviously

Rejected

60 - 80%

random and ad-hoc decisions

Page 76: 1 How to get a PhD in Information Technology Peter Eades, PhD

76

Write good papers

Three steps

1. Write a good conference paper

2. Choose a good conference, and adjust your paper to that conference

3. Send the paper, sit around and hope that it is accepted

Page 77: 1 How to get a PhD in Information Technology Peter Eades, PhD

77

Write good papers

1. Write a good conference paperAssuming that that the page limit is

10 pages:

Motivation and background

00

33

Main results

88Conclusion

8.58.5

Everyone understands

Experts understand

References1010

Everyone understands

Page 78: 1 How to get a PhD in Information Technology Peter Eades, PhD

78

Write good papers

2. Choose a good conference, and adjust your paper to that conference

Choose a conference The best conference possible A good program committee Realistic deadline Avoid “scams”

Adjust your paper Motivation aimed toward the conference

community Research methods that are familiar to the

conference community Don’t insult people on the program committee

Page 79: 1 How to get a PhD in Information Technology Peter Eades, PhD

79

Write good papers

3. Send the paper, sit around and hope that it is accepted• Don’t worry if it is rejected.

Page 80: 1 How to get a PhD in Information Technology Peter Eades, PhD

80

Write good papers

How to get your paper rejected

The top methods

1. Write in bad English

2. Be unaware of current trends in the specific conference community

3. Organize your thoughts badly

4. Omit motivation

Page 81: 1 How to get a PhD in Information Technology Peter Eades, PhD

81

How to get a PhD in information technology

4. Give lots of good talks

Page 82: 1 How to get a PhD in Information Technology Peter Eades, PhD

82

Give good talks

Giving a talk is beneficial to the speaker It helps you

define your problemunderstand your own workorganize your ideasbecome famous write a thesis

It brings feedback from others

Page 83: 1 How to get a PhD in Information Technology Peter Eades, PhD

83

Give good talks

You can present your research At IK-CCs At NLCs To research visitors to your lab As a poster / web page At PostGrad sessions To your supervisor To your associate supervisor To your sister . . .

At least twice in 3 years

Twice per year

Often

Continuously

Often

Very often

Often

Page 84: 1 How to get a PhD in Information Technology Peter Eades, PhD

84

Give good talks

How to give a talk at a conference

Giving a talk consists of three elements:

a) Organization

b) Talking and walking

c) Visuals

These elements vary depending on the type of presentation.

Some comments about research conference presentations . . .

Page 85: 1 How to get a PhD in Information Technology Peter Eades, PhD

85

Give good talks

a) Organization

Motivation00

55Overview

of the

research1515

Something difficult2020

Conclusion2525

Overview2323

Everyone understands

Some understand

Page 86: 1 How to get a PhD in Information Technology Peter Eades, PhD

86

Give good talksExample:

Title: Fast spatial data mining in low dimensions

Data mining helps people 0

5Your data mining algorithms:• description at a high level• no proofs, no details

15Proof of the 2D case

20

Repeat main results25

Chart of experimental results23

Everyone

understands

Some

understand

Page 87: 1 How to get a PhD in Information Technology Peter Eades, PhD

87

Give good talks

b) Talking and walking Look at the audience as much as possible

Choose specific people to focus on Speak slowly and clearly, and avoid idiomatic

EnglishEnglish is a second language to most people in

IT Use your hands for expression

avoid holding a microphone Don’t waste time

Check your data-projector/laptop connectionHave your OHP slides well sorted out before

you start

Page 88: 1 How to get a PhD in Information Technology Peter Eades, PhD

88

Give good talks

c) Visuals Use a medium that is suitable

Use a computer for graphicsUse a blackboard for mathematics

Use a medium that is well supported by the local system

Ensure that your visuals are perfectNo speeling errorsNo spacing errorsAttractive layout (e.g., avoid linebreaks

as much as possible) Don’t use visuals as notes to yourself Use pictures wherever possible Avoid ducks

Page 89: 1 How to get a PhD in Information Technology Peter Eades, PhD

89

Give good talks

Look at the audience; avoid ducks

Page 90: 1 How to get a PhD in Information Technology Peter Eades, PhD

90

Give good talks

Look at the audience; use your hands

Page 91: 1 How to get a PhD in Information Technology Peter Eades, PhD

91

Give good talks

Look at the audience; avoid holding a microphone; ensure that your slides are perfect

Page 92: 1 How to get a PhD in Information Technology Peter Eades, PhD

92

Give good talks

Look at the audience

Page 93: 1 How to get a PhD in Information Technology Peter Eades, PhD

93

Give good talks

Ensure that your slides are perfect

Page 94: 1 How to get a PhD in Information Technology Peter Eades, PhD

94

Give good talks

Use the slides for the audience, not as reminders for you

Formal specification of Security Protocols

• The need for security

• The need for formal specification

• Porter and Quirk’s language

• Inadequacies

Page 95: 1 How to get a PhD in Information Technology Peter Eades, PhD

95

Give good talks

More advice• Give a practice talk to your team• Ask people to look out for

errors and ducks in the visuals idiomatic and ambiguous English not looking at the audience

and write it all down, and tell you• Video the talk, look at the video

More advice• Give a practice talk to your team• Ask people to look out for

errors and ducks in the visuals idiomatic and ambiguous English not looking at the audience

and write it all down, and tell you• Video the talk, look at the video

Page 96: 1 How to get a PhD in Information Technology Peter Eades, PhD

96

How to get a PhD in information technology

5. Write a good thesis

Page 97: 1 How to get a PhD in Information Technology Peter Eades, PhD

97

Write a good thesis

It is very important to write a good thesis.

Your 3+ years of PhD research are examined on the basis of:

1. your thesis.

2. your thesis.

3. your thesis.

Not on the basis of Computer systems that you have written Undergraduate tutorials that you have given Ideas that you have had but not written down

Page 98: 1 How to get a PhD in Information Technology Peter Eades, PhD

98

Write a good thesis

The examiner reads your thesis, and not much else, then writes a very simple report.

Plus three or four pages of comments . . .

Plus three or four pages of comments . . .

Page 99: 1 How to get a PhD in Information Technology Peter Eades, PhD

99

Write a good thesis

Your examiner basically

just ticks a box

Page 100: 1 How to get a PhD in Information Technology Peter Eades, PhD

100

Write a good thesis

Your examiner basically

just ticks a box

1. Award a PhD

2. Award it after some minor corrections

3. Award it as long as the student makes some corrections

4. Ask the student to rewrite part (or all), and re-submit

5. Tell the student to go away.

Page 101: 1 How to get a PhD in Information Technology Peter Eades, PhD

101

Write a good thesis

Evaluation of a thesis

Examiners are basically asked:

“Is this a good thesis?”

The evaluation measures vary from one University to another.

Some typical measures: Original and significant contributions Methodology Expression Scholarship, reference to literature

Page 102: 1 How to get a PhD in Information Technology Peter Eades, PhD

102

Write a good thesis

Length

The research content of a thesis should be about 3 good journal papers.

However, a thesis is different from a paper It has to tell a single story More background More references Extensive evidence of all the claims (sometimes) Justification of the research

methodology

Page 103: 1 How to get a PhD in Information Technology Peter Eades, PhD

103

Write a good thesis

My advice: before you begin to write:

• Carefully read at least one thesis from someone outside your field.

• Read at least 3 examiners reports

My advice: before you begin to write:

• Carefully read at least one thesis from someone outside your field.

• Read at least 3 examiners reports

Page 104: 1 How to get a PhD in Information Technology Peter Eades, PhD

104

Write a good thesis

My advice: The writing process• Take 3 – 4 months• Write about 150 pages; about 3 pages

per day for the first draft• Ensure that your supervisor reads

every word• Get someone outside your field to

read the introduction• List your original contributions in the

first chapter

My advice: The writing process• Take 3 – 4 months• Write about 150 pages; about 3 pages

per day for the first draft• Ensure that your supervisor reads

every word• Get someone outside your field to

read the introduction• List your original contributions in the

first chapter

Page 105: 1 How to get a PhD in Information Technology Peter Eades, PhD

105

Write a good thesis

How to get your thesis rejected

Some top methods1. Take a job before you submit2. Teach more than one undergraduate unit3. Don’t evaluate your solutions4. Ignore feedback5. Be unaware of current trends in your

research community6. Organize your thoughts badly7. Write a very long thesis

Page 106: 1 How to get a PhD in Information Technology Peter Eades, PhD

106

Winding up now …

Topics that I have not mentioned

1. Part-time or full-time?

2. Managing your time

3. Three stages of a PhD candidature

a) Learning

b) Research

c) Writing

4. What do you do when something goes wrong?

5. PhDs and careers

a) What kind of PhD leads to an industrial career?

b) What kind of PhD leads to an academic career?

Page 107: 1 How to get a PhD in Information Technology Peter Eades, PhD

107

How to get a PhD in information technology

Conclusion

1. Find a good topic

2. Find a good supervisor

3. Use a good research method

4. Give lots of good talks

5. Write lots of good papers

6. Write a good thesis

Conclusion

1. Find a good topic

2. Find a good supervisor

3. Use a good research method

4. Give lots of good talks

5. Write lots of good papers

6. Write a good thesis

7. Have fun . . .

Page 108: 1 How to get a PhD in Information Technology Peter Eades, PhD

108

How to get a PhD in information technology

Read all about it

J. Zobel,

Writing for Computer Science,

Springer 1997.

Page 109: 1 How to get a PhD in Information Technology Peter Eades, PhD

109

How to get a PhD in information technology

Read all about it

E. M. Phillips and D. S. Pugh,

How to get a PhD,

Open University Press, 2000.

Page 110: 1 How to get a PhD in Information Technology Peter Eades, PhD

110

How to get a PhD in information technology

Read all about it

D. Lindsay,

A Guide to Scientific Writing,

Longman Cheshire 1984.

Page 111: 1 How to get a PhD in Information Technology Peter Eades, PhD

111

How to get a PhD in information technology

Read all about it

E. Tufte,

Three books on presentation of information,

1980s – 1990s