Upload
aira-ferrer-ramel
View
236
Download
0
Embed Size (px)
Citation preview
7/31/2019 Predictive Validity
1/16
7/31/2019 Predictive Validity
2/16
7/31/2019 Predictive Validity
3/16
1. Obtain test scores from a group of respondents,
but do not use the test in making a decision.
2. At some later time, obtain a performance measure
for those respondents, and correlate these
measures with test scores to obtain predictive
validity.
7/31/2019 Predictive Validity
4/16
EXAMPLES
For instance, we might theorize that a measure of math
ability should be able to predict how well a person will do
in an engineering-based profession.
We could give our measure to experienced engineers and
see if there is a high correlation between scores on the
measure and their salaries as engineers.
A high correlation would provide evidence for predictive
validity -- it would show that our measure can correctly
predict something that we theoretically thing it should beable to predict.
7/31/2019 Predictive Validity
5/16
A TEST MUST BE VALID-
Predictive ValidityWhen evaluating test to real-life predictions, even very
modest correlations ofr= .02 or .03 can be of considerable
importance. For example, the impact of chemotherapy on
breast cancer survival is r= .03.
In selection, hiring, and counseling contexts, currentinterpretations suggest that correlations as low as r= .02 or
.03 are meaningful, with many psychological (and medical
test) assessments and real life criteria falling in the r = .10 to
.30 level, and a few rising beyond that level.
-
7/31/2019 Predictive Validity
6/16
Y
Giving high school juniors the ACT test for
admission to a university.
The test is the predictor and first semester grades
in college are the criterion. If the correlation is
large, this means the ACT is useful for predicting
future grades.
7/31/2019 Predictive Validity
7/16
The extent to which scores on the scale are related to, and
predictive of, some future outcome that is of practicalutility.
e.g., If higher scores on the SAT are positively correlated
with
higher G.P.A.s and visa versa, then the SAT is said to
have predictive validity.
The Predictive Validity of the SAT is mildly supported by
the relation of that scale with performance in graduate
school.
7/31/2019 Predictive Validity
8/16
7/31/2019 Predictive Validity
9/16
A certain percentage of individuals are
conditioned, as children, to behave in ways that
are contrary to their natural and naturally
preferred behaviors and are, as a result, oftenunaware of their natural tendencies and unable to
utilize them effectively as adults. In such cases,
individuals are unable to recognize or report
ownership of inborn traits. These individualsgenerally recognize, identify with and report their
conditioned traits, even though these traits may
be ineffective and counterproductive to the
individual's functioning.
7/31/2019 Predictive Validity
10/16
Prediction:
Such individuals can easily misrepresentthemselves on single dimensional profiles and this
misrepresentation cannot be detected or
determined by such an instrument.
The result is that single dimensional profiles
describe the profiler's erroneous self-perception
thereby deepening the conviction and the
discomfort attached to it, rather than identifying itas erroneous and helping the individual move
away from ineffective or harmful conditioning.
7/31/2019 Predictive Validity
11/16
Result: In 90% (84% of group one and 96% of
group two) of subjects who were not self-aware
enough to test congruently, further examination of
the incongruence resulted in the subject beingable to discover and define the source (or sources)
of the conflict, thereby gaining the awareness
necessary to correct the incongruence to their
satisfaction. We cannot say whether the
corrections were actually made in every case, only
that subjects reported an awareness of what was
needed to make such changes.
7/31/2019 Predictive Validity
12/16
When circumstances create high stress situations, individuals may choose
to draw upon functions that are not commonly used, in an effort to
handle the situation or reduce the stress. During these times, the
individual may report only the functions currently in use, even thoughthese are not the functions that are used naturally in ordinary or low
stress situations.
When circumstances create high stresssituations, individuals may choose to draw
upon functions that are not commonly
used, in an effort to handle the situation or
reduce the stress. During these times, the
individual may report only the functions
currently in use, even though these are not
the functions that are used naturally inordinary or low stress situations.
7/31/2019 Predictive Validity
13/16
Prediction:
Should a single dimensional profile, which measures
preferences and reports an overall "personality" based on
the chosen preferences, be taken during such high stressperiods.
The result will be erroneous and can add to the confusion
of the subject rather than clarify what is happening as a
result of the stressful situation. The same subject could take the preferences profile after
the situation has passed and get a completely different
reading on his or her "personality".
The multidimensional approach allows individuals to see
where stressors have altered their functioning and
enables them to consciously work through the situation,
and to more purposefully use the preferences that are
aiding them now in similar future situations.
7/31/2019 Predictive Validity
14/16
Result: In 90% (84% of group one and 96% of
group two) of subjects who were not self-aware
enough to test congruently, further examination
of the incongruence resulted in the subject being
able to discover and define the source (orsources) of the conflict, thereby gaining the
awareness necessary to correct the incongruence
to their satisfaction. We cannot say whether the
corrections were actually made in every case,only that subjects reported an awareness of
what was needed to make such changes.
7/31/2019 Predictive Validity
15/16
7/31/2019 Predictive Validity
16/16
Predictive validity is regarded as a very strong
measure of statistical validity, but it does contain
a few weaknesses that statisticians and
researchers need to take into consideration.
Predictive validity does not test all of the
available data, and individuals who are not
selected cannot, by definition, go on to produce ascore on that particular criterion.