25
Observation, Rating Scales, Classification Methods, Environmental Assessment, Records & Personal Documents, and Performance- Based Assessment Informal Assessments are developed by individuals who have specific assessment needs and can be subjective in nature.

Informal Assessment: Observation, Rating Scales, Classification Methods, Environmental Assessment, Records & Personal Documents, and Performance-Based

Embed Size (px)

Citation preview

Informal Assessment:

Observation, Rating Scales, Classification Methods, Environmental

Assessment, Records & Personal Documents, and Performance-Based

Assessment

Informal Assessments are developed by individuals who have specific

assessment needs and can be subjective in nature.

Informal Assessments:Advantages

Although informal assessments lack test worthiness, they have some distinct advantages:1. Adding informal assessments to the total assessment process

increases our understanding of the individual being assessed.

2. Informal assessments can target specific attributes

3. Informal assessments can be developed quickly in the event a timely treatment must be devised

4.Some informal assessments are “non-intrusive” allowing for a less threatening mechanism for assessment

5. Informal assessments are generally inexpensive or free

6. Informal assessments are usually easy to administer and interpret

Informal Assessments: TypesObservation

Conducted by professionals, significant others, or self-report.

Often utilizes event or time sampling• Event sampling: Viewing and assessment of targeted

behavior without specific time segments. Targeted behavior must be strictly defined.

• Time sampling: Observations made of targeted behaviors for specific time periods. Target behavior must be strictly defined.

• Event & Time sampling: Observations made of a target behavior for specific amount of time.

Rating ScalesRating Scales

Subjective quantification of an attribute or characteristic.

• Potential for error is great due to possibility of bias on the part of the rater

– Halo effect: Overall impression of client causes inaccurate rating

– Generosity error: Rater identifies with the person being rated and rates the individual inaccurately

• Common rating scales: – Numerical scales

– Likert-type scales

– Semantic differential scales

– Rank-order scales

Rating Scales:Types

Numerical Scales: A written statement or question that can be rated from high to low on a number line. Commonly used to prioritize issues or assess progress Systematic Unit of Discomfort (SUD): Scale

commonly used during systematic desensitization to determine whether to move to the next level in a hierarchy when imagining anxiety-provoking situations. Clients move up the hierarchy when they experience a 10 or less at their current level.

Rating Scales:Types

Likert-Type Scales: Items rated on same theme, anchored by numbers and a statement.

Example:Please indicate how strongly you agree or disagree with each of the following

statements:

Strongly Somewhat Neither agree Somewhat Strongly

disagree disagree nor disagree agree agree

It is fine to view 1 2 3 4 5

a client’s personal

web page without

informing the

client.

Rating Scales:Types

Semantic Differential Scale: Number scale with opposite traits at each end. The rater places a mark on the line that is reflective of how much of the quality he/she believes the individual has.

Example:Place an “X” on the line to represent how much of each quality you possess.

Sadness__________________________________________________Happiness

1 2 3 4 5 6 7 8

Anxious__________________________________________________Calm

1 2 3 4 5 6 7 8

Rating Scales:Types

Rank-Order Scales: Provides a series of statements which the respondent can place in hierarchical order based on his/her preferences.

Example:Please rank order your preferred method of doing counseling. Place a 1 next to the

item that you most prefer - and go down until 5 represents your least preferred method.

_____ I prefer listening to clients and then reflecting back what I hear from them in

order to facilitate client self-growth.

_____ I prefer advising clients and suggesting mechanisms for change.

_____ I prefer interpreting client behaviors in the hope that they will gain insight

into themselves.

Classification MethodsClassification methods: Provide information about whether

an individual has, or does not have, specific attributes or characteristics.

Two common checklists: Behavior Checklists & Feeling Word Checklists• Behavior checklists: Allows an individual to identify the words that best

describe typical or atypical behaviors he/she might exhibit• Characteristics: Easy to develop, simple to give, and can quickly uncover

important patterns of behavior

Example:Check those behaviors you have exhibited toward your partner and your partner has

exhibited toward you.

Exhibited by You Exhibited by Partner

to Your Partner to You

1. Hitting ________ ________

2. Pulling hair ________ ________

Classification Methods:Continued

Feeling Word Checklists: Type of classification method that assesses feelings.

• Used in therapy situations to identify problem feelings

• Identification of feelings is the first step toward being able to effectively communicate one’s feelings to others

Example: Feeling Word Checklist to Identify Problematic Feelings

Abandoned Embarrassed Lying Stuck-up

Aggravated Empty Mean Stupid

Aggressive Envious Miserable Suppressed

Angry Exasperated Misunderstood Teased

Environmental AssessmentEnvironmental Assessment: Collecting

information from a client’s home, school, or workplace via observation or self-reports.

• Environmental Assessment can be accomplished via:– Direct observation

– Situational assessment: Role-play to determine how individuals might act

– Sociometric assessment: Used to assess the social dynamics of a group

– Environmental assessment instrument: Used in conjunction with observation

• Direct Observation: An environmental assessment through observation

Environmental Assessment Instruments Comprehensive Assessment of School Environments Information

Management System (CASE-IMS):• Used to assess the entire school environment & climate.

• Uses self-report surveys of students, parents, teachers, & the principal

• Data yields school’s strengths & weaknesses as normed against other schools

Behavior Rating Inventory of Executive Function - Preschool:• Assesses a number of cognitive processes important for the management of

cognitive, behavioral, & emotional functions

• Completed by teachers & parents of preschool children ages 2-6

• Uses Likert-like scale

Emotional or Behavior Disorder Scale-Revised:• Identifies students with emotional & behavioral disorders

• Has behavioral (64 items) and vocational component (54 items)

• Completed by those familiar with the studewnt

Records and Personal DocumentsExamining personal documents and records help

the examiner understand the beliefs, values, and behaviors of the person being assessed. Common records to be examined include:

• Biographical inventories

• Cumulative records

• Anecdotal information

• Autobiographies

• Journals & Diaries

• Genograms

Records & Personal Documents: Biographical Inventories Biographical inventories provide a detailed picture of the individual from

birth.• Information can be gathered via:

– Involved, structured interview

– Checklist completion by client

– Client responses to a series of questions

– Information gathered includes:

– Demographic information

– Presenting problem

– Family of origin

– Current family

– Educational history

– Vocational background

– Financial history

– History of counseling & mental illness

– Medical history

– Substance use & abuse history

– History of legal issues

– Physical changes in last 6 months

– Sexual orientation

– History of aggressive behaviors

– History of self-injurious behaviors

– Affective & mental state

Cumulative Records

Cumulative Records: Collected documentation from a school, employer, or mental heath agency. Can add vital information to understanding of client Can be collected from schools (test scores, grades,

behavioral problems, family issues, relationships with others, etc.)

Workplaces also maintain collected information

Anecdotal Information

Anecdotal information: Subjective comments or notes in client’s records regarding typical and atypical behaviors.

Autobiography

Autobiography: Client writes his/her life story. A type of projective test in that the client

unconsciously chooses certain information to include - information that has affected the development of the individual’s sense of self.

Journals & Diaries

Having clients log their daily thoughts, actions, or dreams. By examining themes found in journals and

diaries, helpers and clients may focus more attention on behaviors that may have seemed insignificant.

Provides “inside” perspective of the client

Genograms

Genogram is a map of client’s family relationships and relevant history.

Genogram may include:• Family history of illnesses• Family history of mental disorders• Substance use• Expectations• Relationships• Cultural issues

Therapists usually draws the genogram while asking the client questions

Dates/ages are useful Going back as far as the grandparents is useful

Performance-Based Assessment

Performance-Based Assessment: Assessment procedures based on real-world responsibilities. Occurring in many settings:

• Business

• Higher education

• For purposes of credentialing Portfolio Assessment: Collection of items that

demonstrate competencies in a wide range of areas that meet specific standards, such as accreditation standards.

Informal Assessments: Test Worthiness

Validity: How well the examiner defines what is being assessed. The more clearly one is able to identify and define

the target behaviors to be observed, the more valid the obtained data will be

Validity with regard to informal assessments is based on the examiner’s ability to specifically define the target behavior being observed

Informal Assessments: Reliability

Reliability: With regard to informal assessments, reliability is based on inter-rater reliability, which is agreement or consistency among two or more evaluators.

Informal Assessment: Cross-Cultural Fairness

Cross-Cultural Fairness: The possibility of bias must be recognized and addressed. Cultural bias may occur in two ways:

• Unconscious or conscious bias (examiner may misinterpret the verbal or nonverbal behaviors of minority being observed

• Examiner may be ignorant about the verbal or nonverbal behaviors of a particular minority group

Informal Assessments: Practicality

Informal Assessments: Informal procedures are inexpensive, easy to administer, and easy to interpret.

Role of Helpers

School counselors observe children in the classroomParents observe children at homeClinicians have clients assess their progress by using

rating scales, as well as having them keep journals and diaries to encourage insight

Academic cumulative records and anecdotal reports help us understand the learning style of the client

Faculty can use portfolios to help student integrate what they have learned