View
225
Download
0
Category
Tags:
Preview:
Citation preview
Research MethodologyResearch Methodology
Paul WagnerPaul Wagner
(Student ACM Meeting, Fall 2003)(Student ACM Meeting, Fall 2003)
MessagesMessages
Research:Research: Should be about some problem that Should be about some problem that
encourages enthusiasm (for you) and interest encourages enthusiasm (for you) and interest (for others)(for others)
Is often generated from the thought “what Is often generated from the thought “what we’ve got now/from the past isn’t quite we’ve got now/from the past isn’t quite right/good enough – we can do better…”right/good enough – we can do better…”
Consists of work that leads to a meaningful Consists of work that leads to a meaningful contributioncontribution
Generates, in some way, a better solution to Generates, in some way, a better solution to the problemthe problem
What Is Research?What Is Research?
Merriam-Webster’s definition:Merriam-Webster’s definition:
11 :: careful or diligent search careful or diligent search22 :: studious inquiry or examination; studious inquiry or examination; especiallyespecially :: investigation or experimentation aimed at the investigation or experimentation aimed at the discovery and interpretation of facts, revision of discovery and interpretation of facts, revision of accepted theories or laws in the light of new accepted theories or laws in the light of new facts, or practical application of such new or facts, or practical application of such new or revised theories or lawsrevised theories or laws33 :: the collecting of information about a particular the collecting of information about a particular subject subject
What Is Research? (2)What Is Research? (2)
““A combination of investigation of past work and A combination of investigation of past work and effort in the present that will help others in the effort in the present that will help others in the future”future”
A set of oppositesA set of opposites Fun and frustrationFun and frustration Small steps and large insightsSmall steps and large insights Building on others’ work and contributing your own Building on others’ work and contributing your own
workwork
Finding or developing something new that Finding or developing something new that changes the world….changes the world….
What is Research? (3)What is Research? (3)
Quantitative vs. Qualitative ResearchQuantitative vs. Qualitative Research Quantitative – use of statistical, formulaic or Quantitative – use of statistical, formulaic or
numerical analysis to generate resultsnumerical analysis to generate resultsMain approach: analysis; causal determination, Main approach: analysis; causal determination, prediction, generalization of findingsprediction, generalization of findingsResults: “This solution is N% better”Results: “This solution is N% better”
Qualitative – not quantitative; use of non-Qualitative – not quantitative; use of non-numeric techniquesnumeric techniques
Main approach: discovery; illumination, Main approach: discovery; illumination, understanding, extrapolation to similar understanding, extrapolation to similar circumstancescircumstancesResults: “This is a new way of solving our problem”Results: “This is a new way of solving our problem”
Scope of ResearchScope of Research
Varies by level of workVaries by level of work Ph.D. students – contribution expected at Ph.D. students – contribution expected at
world level; e.g.world level; e.g.background investigation on all past workbackground investigation on all past workmake meaningful addition to world knowledgemake meaningful addition to world knowledge
Undergraduate students – contribution can be Undergraduate students – contribution can be at local to national to world level; e.g.at local to national to world level; e.g.
background investigation at university up to world background investigation at university up to world levellevelmake meaningful addition to university up to world make meaningful addition to university up to world level of knowledgelevel of knowledge
What Isn’t ResearchWhat Isn’t Research
Playing with technologyPlaying with technology
Book reportBook report
Programming projectProgramming project
Doing what others have already doneDoing what others have already done
However, each of these can be done as However, each of these can be done as part of researchpart of research
Who Does Research?Who Does Research?
Graduate StudentsGraduate Students Masters Degree (lower standard)Masters Degree (lower standard) Ph.D. Degree (higher standard)Ph.D. Degree (higher standard)
Researchers at universitiesResearchers at universities Post-Doctoral studentsPost-Doctoral students Faculty membersFaculty members
Researchers in industryResearchers in industry Research scientistsResearch scientists Many other technical workersMany other technical workers
Undergraduate students (like you)Undergraduate students (like you)
Who Does Research? (2)Who Does Research? (2)
IndividualsIndividuals
TeamsTeams
Teams almost always make the process Teams almost always make the process easiereasier Division of laborDivision of labor Feedback from team membersFeedback from team members Each member can work to own strengthsEach member can work to own strengths
Research Process (Methodology)Research Process (Methodology)
Initial IdeaInitial IdeaBackground InvestigationBackground InvestigationRefinement of IdeaRefinement of IdeaCore WorkCore Work Investigation and DevelopmentInvestigation and Development DocumentationDocumentation Prototype (if appropriate)Prototype (if appropriate)
EvaluationEvaluationIdentification of Future WorkIdentification of Future WorkPresentationPresentation
Research Process – Initial IdeaResearch Process – Initial Idea
Stems from critical thinkingStems from critical thinkingBe on the lookout for and open to seeing problemsBe on the lookout for and open to seeing problems
Gaps in frameworkGaps in framework Repetitive behavior that’s slightly different (and can be Repetitive behavior that’s slightly different (and can be
generalized)generalized) Manual solutions (that can be automated)Manual solutions (that can be automated) Inelegant solutionsInelegant solutions
Ask questionsAsk questions ““Is something missing here?”Is something missing here?” ““Can this be done in a better way?”Can this be done in a better way?” ““Is there a need for a new approach?”Is there a need for a new approach?”
Should be an area you’re interested in, as:Should be an area you’re interested in, as: You’ll be spending a lot of time with itYou’ll be spending a lot of time with it It won’t always be easy/fun to continue…It won’t always be easy/fun to continue…
Research Process – Research Process – Background InvestigationBackground Investigation
Given an idea, need to determine:Given an idea, need to determine: Has this work been done previously?Has this work been done previously? What similar work has been done leading up to this What similar work has been done leading up to this
point?point? How is any previous work distinguished from what I’m How is any previous work distinguished from what I’m
planning to do?planning to do? What group of people will be positively impacted by What group of people will be positively impacted by
the research?the research?
ToolsTools Literature Review using library resources (e.g. online Literature Review using library resources (e.g. online
databases such as ACM and IEEE, popular databases such as ACM and IEEE, popular magazines)magazines)
WWW searchWWW search
Research Process – Research Process – Refinement of IdeaRefinement of Idea
Based on background investigation, need Based on background investigation, need to refine ideato refine ideaIssues:Issues: Precision – focus on precisely identifying:Precision – focus on precisely identifying:
ProblemProblem Possible solutions (plural!)Possible solutions (plural!)
Scope – need to “build fences”Scope – need to “build fences”What’s an essential part of this work? (fence in)What’s an essential part of this work? (fence in)What’s tangential, additional, or for any other What’s tangential, additional, or for any other reason best left for later/someone else? (fence out)reason best left for later/someone else? (fence out)
Research Process – Core Work, Research Process – Core Work, Investigation and DevelopmentInvestigation and Development
Provide yourself with infrastructureProvide yourself with infrastructure equipment / softwareequipment / software additional knowledge (“get up to speed”)additional knowledge (“get up to speed”)
Do the workDo the work Experimentation (scientific process)Experimentation (scientific process) Develop opinionsDevelop opinions Look for better ways of solving problemLook for better ways of solving problem
Can you generalize?Can you generalize?Can you develop a framework?Can you develop a framework?
Discuss, brainstormDiscuss, brainstorm Reevaluate as you proceedReevaluate as you proceed
Look for improvements, changes to your original ideasLook for improvements, changes to your original ideas
Research Process – Core Work, Research Process – Core Work, Investigation and Development (2)Investigation and Development (2)
ProcessProcess Work regularlyWork regularly
Easier to keep going if have a commitment to a Easier to keep going if have a commitment to a regular work timeregular work time
Helps you keep your past work in mindHelps you keep your past work in mind Allocate large block of time for researchAllocate large block of time for research
Takes time to get going/back to speedTakes time to get going/back to speed
Make sure can do something significant each work Make sure can do something significant each work sessionsession
Research Process – Research Process – Core Work, DocumentationCore Work, Documentation
Need to document as you goNeed to document as you go Don’t want to lose any informationDon’t want to lose any information
1) Maintain a journal for day-to-day thoughts1) Maintain a journal for day-to-day thoughts Can be paper, electronic, ...Can be paper, electronic, ... Keep it with you at all timesKeep it with you at all times
Never know when good ideas will hitNever know when good ideas will hit
2) Keep an updated task list2) Keep an updated task list Focus on accomplishing something each work sessionFocus on accomplishing something each work session
3) Write up your work3) Write up your work Periodically, write a few pages on a subset of your workPeriodically, write a few pages on a subset of your work
Summarize work, accomplishments, problemsSummarize work, accomplishments, problems At end, write up a summary documentAt end, write up a summary document
Can be based on steps discussed hereCan be based on steps discussed here
Research Process – Research Process – Core Work, PrototypeCore Work, Prototype
Need to demonstrate the merit of your Need to demonstrate the merit of your ideasideas
If work is non-theoretical, do this through a If work is non-theoretical, do this through a developed systemdeveloped system No need to build the entire systemNo need to build the entire system Just need to demonstrate the value of the Just need to demonstrate the value of the
core ideascore ideas
Research Process - EvaluationResearch Process - Evaluation
Perhaps the most difficult part….Perhaps the most difficult part…. Best if can show others are already using your workBest if can show others are already using your work
QuantitativeQuantitative Test your prototypeTest your prototype What improvements exist over currently available What improvements exist over currently available
alternative?alternative? How much of an improvement do you see?How much of an improvement do you see?
QualitativeQualitative What can you do now that couldn’t be done before?What can you do now that couldn’t be done before? What are the benefits of your solution?What are the benefits of your solution?
Research Process – Research Process – Identification of Future WorkIdentification of Future Work
Helps you organize any future effortsHelps you organize any future efforts
Helps others build on your workHelps others build on your work
Sources:Sources: What you excluded in your idea refinementWhat you excluded in your idea refinement New problems that have surfaced during your New problems that have surfaced during your
workwork
Research Process - PresentationResearch Process - Presentation
It’s not a contribution to the field if no one It’s not a contribution to the field if no one knows about it or can use itknows about it or can use it
Presentation/DisseminationPresentation/Dissemination Conferences, Journals, WebConferences, Journals, Web
e.g. National Undergraduate Research conferencee.g. National Undergraduate Research conference Papers, Talks, Poster SessionsPapers, Talks, Poster Sessions
e.g. UWEC and UW System Research Dayse.g. UWEC and UW System Research Days
ExampleExample
my Master’s projectmy Master’s project
an example for each of youan example for each of you choose a CS subject you’re interested inchoose a CS subject you’re interested in think of a problem or issue you see in that areathink of a problem or issue you see in that area refine your interest to a possible project that involves refine your interest to a possible project that involves
one or more ways of solving that problemone or more ways of solving that problem outline the steps you’d take to do the project work and outline the steps you’d take to do the project work and
test your ideastest your ideas what is your hypothetical conclusion?what is your hypothetical conclusion? how would you evaluate the quality of your solution?how would you evaluate the quality of your solution?
Research Opportunities in the Research Opportunities in the Computer Science Department at Computer Science Department at
UW-Eau ClaireUW-Eau Claire
Research on ownResearch on ownCollaborative faculty-student research Collaborative faculty-student research projectsprojects funded by Research Office and Departmentfunded by Research Office and Department possibly for credit: CS 493possibly for credit: CS 493
Supervised student research projectsSupervised student research projects CS 482 (Research I), CS 492 (Research II)CS 482 (Research I), CS 492 (Research II)
SIG-ResearchSIG-Research
ResourcesResources
http://www.cs.indiana.edu/mit.research.hohttp://www.cs.indiana.edu/mit.research.how.to/mit.research.how.to.htmlw.to/mit.research.how.to.html
http://www-2.cs.cmu.edu/afs/cs.cmu.edu/uhttp://www-2.cs.cmu.edu/afs/cs.cmu.edu/user/mleone/web/how-to.htmlser/mleone/web/how-to.html
http://www.honors.ucr.edu/research.htmhttp://www.honors.ucr.edu/research.htm
http://www.utexas.edu/research/eureka/rehttp://www.utexas.edu/research/eureka/resources/why/index.phpsources/why/index.php
Recommended