DATA COLLECTION METHODS, FIELD

WORKand ETHICAL CONSIDERATION

DPPM 1, MONDAY 15TH OCTOBER, 2012

BYMaria Kaguhangire-

Barifaijo, PhDmkbarifaijo@umi.ac.ug

Objectives

At the end of this session you should be ableand gainfully to :a) Describe various data collection

methods, their uses and limitations. b) Discuss sources of datac) Employ a combination of different data

collection methods;d) Explain procedures for Fieldwork

activitiese) Identify ethical issues involved in the

implementation of research.

AgendaOverview of data collection methods

The importance of combining different data collection methods and techniques

Activities in the FieldEthical considerations

Introduction: What is Data Collection?

Any process of preparing and collecting data;

A term used to describe a process of preparing and collecting data;

A systematic approach of gathering information;

Can be formal or informal

Why data collection?...For a specific project/programme;

To draw logical conclusionsTo enable informed decision making.

Sources of DataThere are two major sources ofdata; Primary and; Secondary data

Data Collection Methods: Qual. & Quant.

There are two broad categories of data collection methods/approaches: qualitative and quantitative

Each category applies different data collection techniques/tools

Four main Methods of Data collection.CensusSample surveyExperimentObservational study

1. The CensusA census is a study that obtains data from every member of population;

In most studies, a census is not practical, because of the cost and/or time required.

2. Sample SurveyA sample survey is a study that obtains data from a subset of a population, in order to estimate population attributes;

Here, you only take a portion of the population;

Sampling strategies are employed.

3. Experiment.This is a controlled study in which the researcher attempts to understand cause-and-effect relationships;

The study is "controlled" in the sense that the researcher controls: (1) how subjects are assigned to groups and (2) which treatments each group receives.

4. Observational study.Like experiments, observational studies attempt to understand cause-and-effect relationships;

Unlike experiments, the researcher is not able to control (1) how subjects are assigned to groups and/or (2) which treatments each group receives.

Types of Data Collection Tools

1. Structured 2. Semi-Structured and3. Unstructured

When to Use Structured Approach:

Wish to be very precise;Working with a large sample or

populations;Sure of what you wish to

measure;To show your results numerically;To make comparisons across

different populations or interventions

Semi-structured Approach

Systematic and follow generalprocedures but data are not collected inexactly the same way every time

More open and fluidDoes not follow a rigid script– may ask for more detail– people can tell what they want in their own way (you do not restrict them).

Unstructured ApproachYou are conducting exploratory work in a new development area;

You are seeking understanding, themes, and/or issues;

New product, new idea?

Unstructured ApproachYou want stories, or in-depth information;

You are not sure of what you wish to measure;

There is no need to qualify.

Data Collection Methods: Pros and Cons

Each method of data collection has advantages and disadvantages:Resources (human, financial, material and time)

Generalizability (requires randomness)

General Rules for data collectionThere are general rules when

collecting data or else you falter along the way and never realize yourdream! 1. Use available data if they already

exist;2. If using available data, be sure to

find out how they:

Cont’d…

Collected the data Defined the variables Ensured accuracy of the data

Data Collection General Rules..

If you must collect original data: Establish procedures and follow them Maintain accurate records of

definitions and coding Pre-test, pre-test, pre-test Verify accuracy of coding, data input

Be Sure of:CredibilityValidityReliabilityPrecision

How Good are your Measures or Data Collection Tools?Are your measures credible?Are they valid?Are you measuring what counts?Are your measures reliable?Are your measures precise?

Credibility

How trustworthy or believable is yourdata collection methods?

Are the data you are collecting giving you information about the actual situation?

Make sure data you are collecting arerelevant and most important information.

What is Validity?The agreement between a test score or measure and the quality it is believed to measure;

It measures the gap between what a test actually measures and what it is intended to measure.

ReliabilityTerm to describe the stability of your

measurement;Measures the same thing, same way in

repeated tests;Examples:– in sports, speed measured by stopwatch– birth weights of newborn infants– attendance rates at schools

PrecisionHow the language used in the datacollection matches the measureExample:

– if the question is about the organization, the measures must be at the organizational level;– if the question is about employees,

the measures must be on the individual level

(e.g. performance)

Questions

What are the advantages of: Census Sample surveys Focused group discussion Observation

Specific Methods of Data Collection

InterviewsQuestionnaireObservation Administrative by-productDocumentary reviewFocus group discussion

Methods of Field Work Involves the collection of primary data or information that is new;

Collected through interviews, surveys and questionnaires that are made out specifically for a purpose.

The Usefulness of Fieldwork

Improves observation Skills; Improves human interaction through

interviewing; Contributes to understanding of the

processes of research in general; Provides opportunities to learn through

direct & concrete experiences, Enhances the understanding that comes

from observing the 'real world’.

Field Research Enables Researchers:

a) Plan and carry out learning independently; b) Develop and apply analytical skills;c) Develop a range of skills (many of which are not used in the classroom);d) Experience real-life research;e) Develop investigative, communicative and participatory skills;.

Effective FieldworkTo be effective fieldwork should:Be well planned, Interesting, Cost effective and Represent an effective use of the time available;

Have clear and specific objectives derived from the topic;

Procedural GuideObtain the necessary permission to

collect data;Identify and obtain the resources

(manpower, materials etc.) needed to collect data;

Review the availability of subjects and information and organize logistics for data collection;

Procedural Guide…Train interviewers, research,

assistants or supervisors;Refine, pre-test and revise the

research instruments and procedures for data collection;

Collect the required data and; Process the data.

Preparing fieldwork InstructionsInstruction sheets should be prepared forInterviews : The manual for interviews shouldhave instructions concerning the:Purpose of the investigation;Role of the interviewers;Ways interviewers should introduce

themselves to informants; Interview techniques; Interview guide/questionnaire:

Preparing fieldwork manuals…

General format Clarification of terms and what the

research units (unit of analysis are -e.g., household, family, respondent)

Instructions regarding how to ask complicated questions (e.g., whether to mention pre-categorized answers or not and whether to probe for more than one answer or not)

Preparing fieldwork Instruments…

Instructions concerning how to fill in answers (e.g., the need to write answers to open-ended questions using the words of the informants)— Use of the map (if any)— Sampling procedures (and what

to do if informant is absent, etc.)

SupervisionIn addition to all instructions givenabove, instructions should include adirections on:Maintaining a record of attendance of

research team members;Safe-keeping of data and recordsRecording the number of

interviews/FGDs/observations, etc.,

Ethics in Research

1. Important for prohibitions against a) fabricating, b) falsifying, or c) misrepresenting research data

promote the truth and avoid error;

2. Ethical standards promote trust, accountability, mutual respect,

and fairness.

Ethics in Research..

3. Many of the ethical norms help to ensure that researchers can be held accountable to the public.

4. Ethical norms in research also help to build public

support for research.

Ethical Conduct in ResearchHonestyObjectivity IntegrityCarefulnessOpenness

Ethical Conduct…

Respect for Intellectual PropertyConfidentialityResponsible PublicationResponsible MentoringRespect for colleaguesSocial ResponsibilityNon-Discrimination

Scientific dishonesty

1. Plagiarism2. Fabrication and falsification3. Non-publication of data

Scientific dishonesty

4. Faulty data-gathering procedures5. Poor data storage and retention6. Misleading authorship7. Sneaky publication practices

Dishonesty in the Field

Involuntary participation Uninformed consentPosing risk of harm to participants

Betraying confidentiality Forcing participants to disclose their identity

Further ReadingAbramson JH (1990, 4th ed.) Survey Methods in

Community Medicine. London: Churchill- Livingstone.

Barifaijo, K.M., Basheka, B., & Oonyu, J. (2010. Writing a Good Dissertation. A guide for Graduate Students. Newvision, Kampala.

Kaplan, R.M. and Saccuzzo, D.P. (2001). Psychological Testing: Principle, Applications and Issues (5th Edition), Belmont, CA: Wadsworth

Shamoo A and Resnik D. (2009). Responsible Conduct of Research, 2nd ed. (New York: Oxford University Press).