11
The Short-EMBU in Australia, Spain, and Venezuela Factorial Invariance, and Associations with Sex Roles, Self-Esteem, and Eysenckian Personality Dimensions W.A. Arrindell 1 , Alma Akkerman 1 , Nuri Bagés 2 , Lya Feldman 2 , Vicente E. Caballo 3 , Tian P.S. Oei 4 , Bárbara Torres 5 , Gloria Canalda 6 , Josefina Castro 6 , Iain Montgomery 7 , Maryanne Davis 7 , Manuel G. Calvo 8 , Justin A. Kenardy 9 , David L. Palenzuela 10 , Jeffrey C. Richards 11 , C.C. Leong 12 , Miguel A. Simón 13 , and Flor Zaldívar 14 1 Department of Clinical and Developmental Psychology, Heymans Institute, University of Groningen, 2 Universidad Simón Bolívar, Caracas, Venezuela, 3 Universidad de Granada, Granada, Spain, 4 University of Queensland, Brisbane, Queensland, Australia, 5 Universidad del País Vasco, San Sebastián, Spain, 6 Universidad de Barcelona, Barcelona, Spain, 7 University of Tasmania, Hobart, Tasmania, Australia, 8 Universidad de La Laguna, Tenerife, Spain, 9 University of Newcastle, Callaghan, New South Wales, Australia, 10 Universidad de Salamanca, Salamanca, Spain, 11 Curtin University, Perth, Western Australia, 12 Northern Territory University, Darwin, Northern Territory, Australia, 13 Universidad de La Coruña, La Coruña, Spain, 14 Universidad Autónoma de Madrid, Madrid, Spain Abstract. The short(s)-EMBU (Swedish acronym for Egna Minnen Beträffande Uppfostran [My memories of upbringing]) consists of 23 items, is based on the early 81-item EMBU, and was developed out of the necessity of having a brief measure of perceived parental rearing practices when the clinical and/or research context does not adequately permit application of time- consuming test batteries. The s-EMBU comprises three subscales: Rejection, Emotional Warmth, and (Over)Protection. The factorial and/or construct validity and reliability of the s-EMBU were examined in samples comprising a total of 1950 students from Australia, Spain, and Venezuela. The data were presented for the three national groups separately. Findings confirmed the cross-national validity of the factorial structure underlying the s-EMBU. Rejection by fathers and mothers was consistently associated with high trait-neuroticism and low self-esteem in recipients of both sexes in each nation, as was high parental emo- tional warmth with high femininity (humility). The findings on factorial validity are in keeping with previous ones obtained in East Germany, Greece, Guatemala, Hungary, Italy, and Sweden. The s-EMBU is again recommended for use in several different countries as a reliable, functional equivalent to the original 81-item EMBU. Keywords: Parenting, EMBU, s-EMBU, cross-cultural comparison, factorial invariance, personality, sex roles, psychometrics For measuring adults’ perceptions of their parents’ rear- ing behavior, the short (s)-EMBU (Swedish acronym for Egna Minnen Beträffande Uppfostran [My memories of upbringing]; Arrindell, Sanavio, Aguilar, Sica, Hatz- ichristou, Eisemann, Recinos, Gaszner, Peter, Battagli- ese, Kállai, & van der Ende, 1999) was explicitly devel- oped for use when administration-time is very limited. The s-EMBU is an abbreviated, 23-item alternative to its early 81-item counterpart (Perris, Jacobsson, Lindström, von Knorring, & Perris, 1980). It contains three sub- scales, namely Rejection (7 items), Emotional Warmth (6 items), and (Over)Protection (9 items). All items (in- cluding one that is not scaled) are scored for fathers and mothers separately. The s-EMBU was developed on the basis of data col- lected among students in Italy, Hungary, Guatemala, and Greece. On the basis of the psychometric findings ob- tained with these national samples, it was concluded that DOI 10.1027/1015-5759.21.1.56 European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers

The Short-EMBU in Australia, Spain, and Venezuela

  • Upload
    esade

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and VenezuelaEuropean Journal of PsychologicalA ssessment 2005; Vol. 21(1):56–66©2005Hogrefe&HuberPubli shers

The Short-EMBU in Australia,Spain, and Venezuela

Factorial Invariance, and Associations with Sex Roles,Self-Esteem, and Eysenckian Personality Dimensions

W.A. Arrindell1, Alma Akkerman1, Nuri Bagés2, Lya Feldman2,Vicente E. Caballo3, Tian P.S. Oei4, Bárbara Torres5, Gloria Canalda6,

Josefina Castro6, Iain Montgomery7, Maryanne Davis7, Manuel G. Calvo8,Justin A. Kenardy9, David L. Palenzuela10, Jeffrey C. Richards11, C.C. Leong12,

Miguel A. Simón13, and Flor Zaldívar14

1Department of Clinical and Developmental Psychology, Heymans Institute, University of Groningen,2Universidad Simón Bolívar, Caracas, Venezuela, 3Universidad de Granada, Granada, Spain,

4University of Queensland, Brisbane, Queensland, Australia, 5Universidad del País Vasco, San Sebastián, Spain,6Universidad de Barcelona, Barcelona, Spain, 7University of Tasmania, Hobart, Tasmania, Australia,

8Universidad de La Laguna, Tenerife, Spain, 9University of Newcastle, Callaghan, New South Wales, Australia,10Universidad de Salamanca, Salamanca, Spain, 11Curtin University, Perth, Western Australia, 12NorthernTerritory University, Darwin, Northern Territory, Australia, 13Universidad de La Coruña, La Coruña, Spain,

14Universidad Autónoma de Madrid, Madrid, Spain

Abstract. The short(s)-EMBU (Swedish acronym for Egna Minnen Beträffande Uppfostran [My memories of upbringing])consists of 23 items, is based on the early 81-item EMBU, and was developed out of the necessity of having a brief measure ofperceived parental rearing practices when the clinical and/or research context does not adequately permit application of time-consuming test batteries. The s-EMBU comprises three subscales: Rejection, Emotional Warmth, and (Over)Protection. Thefactorial and/or construct validity and reliability of the s-EMBU were examined in samples comprising a total of 1950 studentsfrom Australia, Spain, and Venezuela. The data were presented for the three national groups separately. Findings confirmed thecross-national validity of the factorial structure underlying the s-EMBU. Rejection by fathers and mothers was consistentlyassociated with high trait-neuroticism and low self-esteem in recipients of both sexes in each nation, as was high parental emo-tional warmth with high femininity (humility). The findings on factorial validity are in keeping with previous ones obtained inEast Germany, Greece, Guatemala, Hungary, Italy, and Sweden. The s-EMBU is again recommended for use in several differentcountries as a reliable, functional equivalent to the original 81-item EMBU.

Keywords: Parenting, EMBU, s-EMBU, cross-cultural comparison, factorial invariance, personality, sex roles, psychometrics

For measuring adults’ perceptions of their parents’ rear-ing behavior, the short (s)-EMBU (Swedish acronym forEgna Minnen Beträffande Uppfostran [My memories ofupbringing]; Arrindell, Sanavio, Aguilar, Sica, Hatz-ichristou, Eisemann, Recinos, Gaszner, Peter, Battagli-ese, Kállai, & van der Ende, 1999) was explicitly devel-oped for use when administration-time is very limited.The s-EMBU is an abbreviated, 23-item alternative to itsearly 81-item counterpart (Perris, Jacobsson, Lindström,

von Knorring, & Perris, 1980). It contains three sub-scales, namely Rejection (7 items), Emotional Warmth(6 items), and (Over)Protection (9 items). All items (in-cluding one that is not scaled) are scored for fathers andmothers separately.

The s-EMBU was developed on the basis of data col-lected among students in Italy, Hungary, Guatemala, andGreece. On the basis of the psychometric findings ob-tained with these national samples, it was concluded that

DOI 10.1027/1015-5759.21.1.56

European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers

the three factors are factorially-invariant across nations.In addition, the corresponding scales were internallyconsistent, showed similar patterns of intercorrelationsacross nations and demonstrated significant predictedcorrelations with specific personality measures. In a fur-ther study, Arrindell, Richter, Eisemann et al. (2001) ex-tended the factorial validity of the s-EMBU with studentsfrom East Germany and Sweden. Arrindell et al. (1999,2001), thus, recommended the s-EMBU as a reliable,valid, and functional equivalent to the early 81-itemEMBU (Arrindell & van der Ende, 1984; Perris et al.,1980) for use when the clinical and/or research contextdoes not adequately permit the application of time-con-suming test batteries.

The present study represents an attempt to extend thecross-national utility of the s-EMBU by addressing itspsychometric qualities in three further national contexts,namely Australia, Spain, and Venezuela. Cross-nationalinvestigations such as these are relevant for at least threereasons (cf. Arrindell, Perris, Eisemann, van der Ende,Gaszner, Iwawaki, Maj, & Zhang, 1994). First, providedthat favorable psychometric qualities can be generalizedfrom one national context to another, cross-culturaladoption of parental rearing measures provide usefulclinical assessment techniques for the new cultures. Ey-senck and Eysenck (1983) have pointed out that it cannotbe assumed that the same set of items will be found toshare common variance when different cultures are be-ing studied, and that the assumption that they do so mustbe empirically verified. In fact, Eysenck and Eysenck(1983) provided a survey of studies in which cross-cul-tural comparisons of factorial structures were more oftenfound to be incongruent than congruent. Second, adoptedinstruments may serve useful research purposes in theirnew culture: These adoptions could entail a mutually re-warding endeavor in that cross-cultural research mayalso lead to the discovery of universals (see Barrett, Pet-rides, Eysenck, & Eysenck, 1998). Thus, studies such asthese provide information with respect to the extent towhich parental rearing constructs postulated as the resultof research in one culture can be applied universally.Though universality cannot actually be proven, demon-strating invariance of constructs across many and diversecultures can strengthen its plausibility (e.g., Ben-Porath,1990). Third, provided that factors, correspondingscales, and items function adequately across nationalsamples, cross-cultural studies of parental rearing behav-ior further provide the possibility of comparison of “typ-ical” styles of upbringing in two or more cultures bycomparing mean scale scores across cultures.

Using data collected among students in Venezuela,Spain, and Australia, the present investigation examinedthe factorial validity and reliability of the s-EMBU.Moreover, it attempted to provide evidence of construct

validity by relating the resulting factorially-derived di-mensions of the s-EMBU to two major Eysenckian di-mensions of personality (Neuroticism and Extraversion),sex role orientation, and self-esteem (predictions as out-lined below).

MethodSubjects and Procedures

In the context of a cross-national study on personalityand self-assessed fears, volunteer students in 11 coun-tries located in Australasia, Europe, and South Americacompleted a test battery which included, among othermeasures, the s-EMBU. To maximize diversity in termsof geographic location and major course of study, stu-dents were, where possible, recruited from universitiessituated in different regions of each country and amongstudents who were enrolled in any of the four major areasof science, which were categorized as the natural scienc-es (e.g., physics, chemistry, computer sciences, mathe-matics), humanities (e.g., history, literature, law, philos-ophy), life sciences (e.g., medical biology, dentistry,medicine), and social sciences (e.g., economics, wom-en’s studies, sociology, social and physical geography,education, psychology). The present sample as a wholecomprised 1950 students, 750 from Australia, 708 fromSpain, and 492 from Venezuela. Table 1 describes eachsample in terms of biological sex, age, and major course

Table 1. Distribution of sex, age and major course of study for eachnational sample.

Nation

Australia Spain Venezuela

Biological sex

Male 271 310 179

Female 479 398 313

N 750 708 492

Age

M 23 22 21

SD 8 3 3

Range 17–70 18–42 16–42

N 736 700 483

Major course of study

Natural sciences 208 175 176

Humanities 101 167 2

Life sciences 14 188 96

Social sciences 412 178 212

N 735 708 486

W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela 57

© 2005 Hogrefe & Huber Publishers European Journal of Psychological Assessment 2005; Vol. 21(1):56–66

of study. Variable Ns are due to relatively small numbersof missing data.

The students from Australia and Spain were enrolledat any of the universities with which the different coau-thors were affiliated . The students from Venezuela wereenrolled at either Universidad Simón Bolívar (Caracas),Universidad Católica “Andrés Bello” (Caracas), Univer-sidad Centro-Occidental Lisandro Alvarado (Bar-quisimeto, Estado Lara), Universidad de Oriente (Nu-cleo Puerto Ordaz, Puerto Ordaz, Estado Bolívar), orUniversidad de Los Andes (Mérida, Estado Mérida).

Measures

s-EMBU

The criteria for selecting items for the short form weredescribed in Arrindell et al. (1999). In following thesecriteria, 7, 6, and 10 items were chosen for the Rejection,Emotional Warmth and Protection factors, respectively,thereby reducing the original 81-item form to 23 items.These 23 items, the scoring key, and the instructions forfilling out the form are given in Arrindell et al. (1999).Evidence in favor of the convergent and discriminantvalidity of the s-EMBU in relation to the Parental Bond-ing Instrument (Parker, Tupling, & Brown, 1979) waspublished in Arrindell and Engebretsen (2000).

Eysenck Personality QuestionnaireRevised-Abbreviated

The EPQR-A is a 24-item version of the 48-item short-EPQ-Revised (Eysenck & Eysenck, 1991). The EPQR-Awas developed by Francis, Brown, and Philipchalk(1992) and was used in the present study for measuringNeuroticism and Extraversion. Cronbach’s αs for thepresent samples were: for Neuroticism 0.69 (Australia),0.71 (Spain), and 0.65 (Venezuela); the correspondingfigures for Extraversion were 0.81, 0.71, and 0.69, re-spectively. Scores on the Lie scale were discarded be-cause in some instances the reliability was too low(< 0.7).

Short(s)-Bem Sex Role Inventory

The s-BSRI (Bem, 1981) was utilized for assessing Mas-culinity and Femininity. Each subscale contained 10items, with filler items removed from the original shortform. Cronbach’s αs for Masculinity were 0.87 (Austra-lia), 0.79 (Spain), and 0.80 (Venezuela). The correspond-ing figures for Femininity were 0.90, 0.82, and 0.83, re-spectively.

The Rosenberg Self-Esteem (SE) Scale

The SE scale was used for measuring self-esteem (Ro-senberg, 1965). Cronbach’s αs were 0.89 (Australia),0.84 (Spain), and 0.82 (Venezuela).

As the early 81-item version of the EMBU was avail-able in the native language for each of the countries par-ticipating in the present investigation (cf. Arrindell et al.,1994), the 23 items of interest were simply selected fromthe longer forms and placed in the order indicated in theAppendix in Arrindell et al. (1999). Items for the EPQR-A were also available for each of the countries involved(see Barrett & Eysenck, 1984; Barrett et al., 1998; Fran-cis et al., 1992) and, again, the relevant items were se-lected from the original translations. Spanish translationsand back-translations (to English) of the s-BSRI and Ro-senberg’s SE scale were done in accordance with guide-lines proposed in the methodological literature pertain-ing to cross-cultural psychology (e.g., Brislin, 1986).

Measures were either group-administered in class-room settings or individually-administered throughsmall scale mail surveys. All questionnaire sets werecompleted anonymously.

Statistical Analyses

Since a subset of items had been chosen from the earlyEMBU to represent each of the original factors, a de-scriptive test for the existence of three hypothetical pa-rental rearing factors was made using the multiple groupmethod (MGM) of confirmatory analysis (e.g., Gorsuch,1983; Nunnally, 1978; Nunnally & Bernstein, 1994).MGM is closely related to the rotation of componentweights to perfect congruence and the cross-validationof component weights (ten Berge, 1986a, 1986b, 1996).Basically, with this method factors obtained with the pre-sent samples are compared with a known theoreticalstructure. In doing so, the theoretical weight matrix,which reflects the three primary parental rearing dimen-sions, was cast as the hypothetical weight matrix in bi-nary form. This implies that all items rationally definedas comprising a particular dimension (e.g., Rejection)were assigned a 1 for that dimension and a 0 for the othertwo dimensions, which resulted in a matrix in which eachrow had one non-zero entry only; the column of weights,thus, conformed to item sets theoretically assigned toeach parenting dimension. Next, the binary weight ma-trix was used to compute, for each national sample, astructure matrix from the 23 × 23 correlation matrix ofs-EMBU items. Convergence between the patterns ofcomponent loadings across binary weight matrix andstructure matrix provides evidence of factorial invari-ance. The weights impose correlated components on the

58 W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela

European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers

data matrices, i.e., the MGM allows components to becorrelated (oblique). The correlations between compo-nents provide crucial information with respect to the ex-tent of relative separate existence of factors. The compo-nents are considered standardized weighted summationsof item-scores. Comparison of the strength of corre-sponding components across national samples providesfurther information regarding the cross-sample constan-cy of the components of interest. Each component shouldexplain at least (1/k) × 100% of the total variance, inwhich k = the total number of items involved in the anal-ysis, in this case 23 (ten Berge, 1986a, 1986b).

Actual calculations involved were performed with theSimultaneous Components Analysis (SCA) computerprogram (Kiers, 1990). For further details on the theoret-ical and technical backgrounds of MGM, see Gorsuch(1983) and Nunnally (1978).

Following Brand-Koolen (1972), for purposes of in-terpretation loadings with absolute values < 0.20 wereconsidered small, loadings from 0.20 to 0.39 as moder-ate, loadings from 0.40 to 0.70 as high, and loadings> 0.70 as very high.

The item-test biserial correlation, as employed instandard item analysis, was used for identifying biaseditems (cf. Ironson & Subkoviak, 1979). Items may beconsidered biased across national samples if they pro-vide item-discrimination indices that are either poor(e.g., too low or negative in sign) or differ quite sizablyin magnitude from one sample to another. Application ofthis standard analysis served the function of improvingscales across national groups through the identificationand elimination of undesirable items.

A statistical method, developed by Humphreys(1978), enabled the computation of the difference, in asingle sample, between two correlations when three vari-ables were involved (ra,c vs rb,c), taking into account ra,b

and N.For purposes of interpretation, Cohen (1992) consid-

ers a correlation with an absolute value equal to 0.10 asreflecting small Effect Size (ES), r = 0.30 as reflectingmedium ES, and r = 0.50 as reflecting large ES*.

Results and Discussion

Descriptive item-statistics indicated that no difficultyfactors (Gorsuch, 1983) could be expected to emergefrom any of the analyses performed below. In addition,there were no s-EMBU items with zero variance.

Factorial Invariance of the s-EMBUMeasuring Constructs

Table 2 shows, for each nation and for ratings of mothersand fathers separately, the results obtained through ap-plication of the multiple group method. Each of the 23s-EMBU items has been abbreviated. Table 3 gives, foreach nation separately, the correlations among the com-ponents/scales.

It will be seen from Table 2 that all items hypothesizedto load at least highly on the Rejection or EmotionalWarmth factors were found to do so in a very acceptablefashion. In cases where an item loaded at least highly onmore than one factor, the pattern was for (1) a rejectionitem to load negatively on the Emotional Warmth factorand more strongly and positively on its theoretically-relat-ed Rejection factor (e.g., Item 1 in the ratings of the fathersand the mothers in the Australian sample) or, conversely,(2) for an emotional warmth item to load negatively on theRejection factor and more strongly and positively on itstheoretically-related Emotional Warmth factor (e.g., Items2 and 23 in the ratings of both fathers and mothers, again,in the Australian sample). This was not deemed problem-atic in view of the consistently negative and sizeable cor-relations of medium to large ESs that have been observedbetween Rejection and Emotional Warmth with both the81-item EMBU (e.g., Arrindell et al., 1989, 1994, 1998)and the s-EMBU (Arrindell & Engebretsen, 2000).

All items, except Item 9 (“My parents tried to spur meto become the best”), that were hypothesized to load onthe Protection components did so in line with expecta-tion. In terms of comparative factor loadings, the sameItem 9 had caused difficulties in previous cross-nationalstudies and was, therefore, rejected as being unsuitablefor the Protection scales (Arrindell et al., 1999). Interest-ingly, as predicted, this item did evidence high loadingson the Protection components in the Spanish sample.However, Item 9 obtained a different meaning in theAustralian and Venezuelan samples where, with compo-nent loadings in the .40s and .50s, it had a connotation ofemotional warmth. In view of the on-going difficultiesobserved with Item 9 across national samples, it wasagain removed from further study.

In the Spanish sample, Item 10 (“My parents wouldlook sad or in some other way show that I had behavedbadly so that I got real feelings of guilt”) just failed toattain a loading of 0.40 in the recipients’ ratings of theirfathers (0.39), but was retained since the difference wasonly marginal.

W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela 59

© 2005 Hogrefe & Huber Publishers European Journal of Psychological Assessment 2005; Vol. 21(1):56–66

* It should be pointed out that empirical guidelines for interpreting the magnitudes of correlation coefficients are, to some extent, artificial.Cohen (1992) provided perhaps the most widely known guidelines for interpreting the magnitudes of correlation coefficients typically foundin the behavioral sciences. However, Hemphill (2003) demonstrated empirically that the absolute value Cohen chose to represent a large r(0.50) occurs somewhat infrequently in many key research studies in psychology and that a lower value might be warranted in some instances.

60 W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela

European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers

This item loaded as highly on Protection as it did onRejection, which is probably due to the positive associ-ation between the corresponding factors/scales (e.g., Ar-rindell et al., 1994). However, the observation in relationto Item 10 may also reflect a sampling accident.

Item 17 (“I was allowed to go where I liked withoutmy parents caring too much,” reversed scoring) had highloadings on both Protection components (fathers andmothers) in Australia and Spain, while failing to attainthe lower bound of 0.40 in Venezuela where the compo-nent loadings still reflected at least medium ESs. Impor-tantly, the same item had near zero to small loadings onits theoretically-unrelated components. While this obser-vation may also reflect a quirk of sampling (only a rep-etition of the study will enable us to be certain on thispoint), maintenance or rejection of this item would haveto depend on the results of reliability analyses presentedbelow.

Thus, only 8 out of 414 [items × nations × factors ×

sex of parent] component loadings (i.e., 2% of the totalnumber of loadings inspected) failed to load as predicted,which is an outstanding result and a good indication of ageneral confirmation of the hypothesized loading pat-terns.

Table 2 gives, for each nation involved in the presentstudy, the strength of each component in terms of sum ofsquared component loadings. The percentage explainedvariance = [sum of squared component loadings/23] ×100%. The component strengths were relatively strong-est for Australia: 24.52% (fathers, F) and 26.30% (moth-ers, M) for Rejection, 23.65% (F) and 24.26% (M) forEmotional Warmth, and 19% (F) and 20.35% (M) for(Over)Protection. The corresponding figures for Spainwere 17.91% (F) and 19.70% (M) for Rejection, 19.78%(F) and 18.39% (M) for Emotional Warmth, and 14.22%(F) and 15.09% (M) for (Over)Protection. The figures forVenezuela were very much comparable to those yieldedfor Spain, namely 17.22% (F) and 18.70% (M) for Re-

Table 3. Correlations (Pearson type) between s-EMBU factors, by nation.

Nation

Australia Spain Venezuela

R EW P R EW P R EW P

R 100 100 100

Of the fathers EW –57*** 100 –47*** 100 –36***

P 37*** 06* 100 28*** 14*** 100 40*** 21*** 100

R 100 100 100

Of the mothers EW –58*** –48*** –43***

P 44*** –03 100 37*** 02 100 36*** 08* 100

Notes. R means Rejection, EW Emotional Warmth, P (Over)Protection. Correlations × 100 (decimal points have been omitted). Ns:723–743 (Australia), 695–703 (Spain), 463–488 (Venezuela). *p ≤ .05, **p ≤ .01, ***p ≤ .001 (one-tailed tests).

Table 4. Reliability analysis for each s-EMBU scale, by nation.

Nation

Australia Spain Venezuela

R EW P R EW P R EW P

Of the fathers

Cronbach’s α 84 90 83 75 87 71 75 82 75

Mean inter-item r 43 59 35 31 52 21 30 43 25

Range of item- L 52 62 34 35 50 23 40 44 22

remainder rs U 66 76 65 57 75 55 54 69 59

Of the mothers

Cronbach’s α 84 90 83 79 82 73 78 81 71

Mean inter-item r 44 60 36 36 45 23 34 42 21

Range of item- L 55 64 38 43 41 23 40 42 11*

remainder rs U 67 79 67 62 69 57 61 67 60

Notes. R means Rejection, EW Emotional Warmth, P (Over)Protection. For sample Ns see the Methods section. Analyses were conductedafter the removal of item No. 9, and the obvious recoding of item No. 17. Coefficients × 100 (decimal points have been deleted).L = Lower bound, U = Upper bound. *Item No. 17 (p < .05). The next smallest value observed was 0.24 for item No. 10.

W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela 61

© 2005 Hogrefe & Huber Publishers European Journal of Psychological Assessment 2005; Vol. 21(1):56–66

jection, 17.61% (F) and 17.65% (M) for EmotionalWarmth, and 16.04% (F) and 14.13% (M) for (Over)Pro-tection. Importantly, all factors were stronger than theminimum required 4% explained variance. Overall, ho-mologous components produced comparable componentloading patterns and component strengths across nations,which is a strong indication of cross-national invarianceof the s-EMBU factors.

Cumulatively, the parental rearing components ex-plained 51.34% (Australia), 42.69% (Spain), and41.97% (Venezuela) of the total variance in the fathers’data. The corresponding figures for the mothers’ datawere 52.39% (Australia), 42.74% (Spain), and 41.54%(Venezuela).

The general patterns of correlations among the earlyEMBU factors have been: (1) statistically significantand substantially negative rs between Rejection and

Emotional Warmth, (2) statistically significant and pos-itive associations between Rejection and (Over)Protec-tion; and (3) statistically nonsignificant and negligiblylow associations between Emotional Warmth and(Over)Protection (Arrindell et al., 1994). Table 3 givesthe corresponding associations for the s-EMBU, by na-tion, where it will be seen that patterns (1) and (2) weremore than clearly replicated. The general pattern of anonsignificant or negligible relation (r < 0.10) betweenEmotional Warmth and Protection was confirmed for 4out of 6 correlations. However, even the larger rs weretoo small to jeopardize the relative independence of thecomponents of interest. Moreover, importantly, neitherone of the correlations among the components/scales ex-ceeded the scale reliabilities. The corresponding reliabil-ities are displayed in Table 4. In fact, the correlationsbetween the components were clearly smaller than the

Table 5. Correlations (Pearson type) between s-EMBU scales, on the one hand, and the EPQR-A, s-BSRI and Rosenberg SE scales onthe other hand: males and females separately.

Nation

Australia Spain Venezuela

R EW P R EW P R EW P

Males of the fathers

EPQR-A Neuroticism 25*** –17** 13* 20*** –12* 10* 21** –21** 09

Extraversion 02 08 05 02 16** 11* –01 31*** 18**

s-BSRI Masculinity –01 09 –05 05 08 06 03 19** 07

Femininity –17** 18** –07 –03 21*** 08 –02 22*** –08

Rosenberg Self-Esteem –23*** 22*** –14** –23*** 26*** –06 –23*** 16* –05

Males of the mothers

EPQR-A Neuroticism 18** –13* 11* 11* –06 15** 19** –16* 12

Extraversion 03 13* 12* 01 11* 02 –03 18** 01

s-BRSI Masculinity –08 13* –08 03 05 02 –00 08 –10

Femininity –23*** 24*** –10 06 19*** 08 –15* 20** –11

Rosenberg Self-Esteem –21*** 23*** –16** –26*** 28*** –10* –13* 03 –23***

Females of the fathers

EPQR-A Neuroticism 25*** –23*** 20*** 16*** –22*** 10* 19*** –25*** 06

Extraversion –01 09* –03 –07 21*** –05 –06 26*** 05

s-BSRI Masculinity 03 08* –01 –06 22*** –03 –14** 15** –12*

Femininity –05 16*** 05 –04 26*** –02 –06 22*** 03

Rosenberg Self-Esteem –28*** 27*** –16*** –20*** 28*** –10* –22*** 26*** –12*

Females of the mothers

EPQR-A Neuroticism 25*** –21*** 20*** 20*** –21*** 15** 22*** –17*** 15**

Extraversion –07 11** –09* –04 16*** –07 –06 26*** –06

s-BRSI Masculinity –01 11** –03 –02 23*** –06 –03 18*** –07

Femininity –04 20*** 02 –07 23*** –04 –08 22*** –05

Rosenberg Self-Esteem –26*** 22*** –20*** –23*** 27*** –08 –21*** 26*** –22***

Notes. R means Rejection, EW Emotional Warmth, P (Over)Protection, EPQR-A Eysenck Personality Questionnaire Revised-Abbrevi-ated, s-BSRI Short Bem Sex Role Inventory, SE Self-Esteem scale. N (males): 257–268 (Australia), 304–308 (Spain), 174–178 (Vene-zuela); N (females): 458–476 (Australia), 389–395 (Spain), 289–311 (Venezuela). Correlations × 100 (Decimal points have been deleted).*p < .05, **p < .01, ***p < .001 (one-tailed tests).

62 W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela

European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers

scale reliabilities (see below), clearly indicating that theparental rearing dimensions could be distinguished reli-ably from one another in ratings of nonclinical subjects.

Reliability and Item-Bias Analysis

The results of reliability and homogeneity analysesshown in Table 4 excluded Item 9. From Table 4 it willbe seen that the internal consistency coefficients (Cron-bach’s α) were all, without any exception, of high mag-nitude (> 0.70).

These levels of internal consistency are considered tobe good to excellent (Cicchetti, 1994).

The range of the item-remainder correlations pertain-ing to each EMBU scale showed that the individual rswere all, except one (0.11 for Item 17 in the Venezuelansample), well within acceptable limits. Leaving this itemaside, the remaining item-remainder rs ranged from 0.22to 0.79, the lowest acceptable bound being 0.2 (Nunnal-ly, 1978). In addition, the mean interitem rs (as measuresof homogeneity) were also of acceptable magnitudes andranged from 0.21 to 0.60. These mean interitem figureswere of particular interest since they indicated that whilethe sample of items from the EMBU scales would prob-ably correlate 0.7 to 0.9 (based on the αs) with anothersample of items drawn from the same population, at thesame time we are dealing with homogeneous sets of scaleitems. The acceptable range for the mean interitem r hasbeen reported to lie somewhere between 0.1 and 0.5,with the 0.2–0.4 range of intercorrelations offering anacceptable balance between bandwidth on the one handand fidelity on the other (Briggs & Cheek, 1986). Homo-geneity figures well above 0.50 would point to some ex-tent of measure redundancy (Briggs & Cheek, 1986).Thus, in view of the homogeneity figures of 0.6, Emo-tional Warmth could probably be measured in Australianstudent samples with scales containing a smaller numberof items than the set of only six contained by the s-EMBU.

Going back to the Protection Items 10 (fathers’ ratingsin the Spanish sample) and 17 (fathers’ and mothers’ rat-ings in the Venezuelan sample), the following was ob-served. Recipients’ ratings of their fathers in the Spanishsample for Item 10 yielded an acceptable item-remainderr-value of 0.23 and the item was, therefore, kept. On Item17, recipients’ ratings of their fathers and mothers in theVenezuelan sample yielded item-remainder rs of 0.22and 0.11, respectively. Both rs were statistically signifi-cant. While the first correlation attained an acceptablevalue, elimination of the item of interest in the mothers’data would have led to a marginal increase of Cronbach’sα from 0.71 to only 0.72. Therefore, Item 17, too, waskept.

These reliability analyses warrant the use of a scoringkey that is totally in line with the one given in Arrindellet al. (1999, Table 5) where only Item 9 had to be re-moved from the subscale to which it was originally as-signed (Protection).

Further Evidence of Construct Validity

As predicted from theory, many studies have previouslyshown that Ss who described their parents as loving alsodescribed themselves as lower in neuroticism (i.e., aswell-adjusted), as having a more positive self-concept,and as higher in extraversion, agreeableness, and consci-entiousness than Ss who described their parents as unlov-ing. Low parental care does not necessarily imply highRejection, but the latter has also been implicated in manypsychiatric conditions, as has parental overprotection,which has been especially linked with neurotic difficul-ties such as anxiety disorders (for reviews or actual find-ings, see for example Perris, Arrindell, & Eisemann,1994). On the basis of these findings, it was predictedthat the following general correlational patterns wouldemerge in correlating the s-EMBU subscales with self-esteem, masculinity, femininity, neuroticism, and extra-version.

Emotional Warmth would correlate negatively withNeuroticism. In addition, Emotional Warmth would cor-relate positively with high self-esteem and with mea-sures of positive affect such as Extraversion, Masculinity(which correlates negatively and positively, respectively,with Neuroticism and Extraversion) and Femininity(which contains such facets as tender-mindedness,agreeableness, modesty, and altruism).

Rejection was hypothesized to correlate positivelywith Neuroticism and with low self-esteem (typicallyfound in depression, which is correlated with neuroti-cism).

Overprotection was hypothesized to be significantlycorrelated with Neuroticism, which has obsessional wor-rying and anxiety as important facets, among others (Ey-senck & Eysenck, 1991).

The outcome of correlational analyses linking s-EMBU scores with scores on the EPQR-A, s-BSRI, andRosenberg’s Self-Esteem scale are displayed in Table 5for each national sample. These correlations are present-ed for females and males separately.

The findings in Table 5 may be summarized as fol-lows.

Emotional Warmth

In females, Emotional Warmth correlated consistentlynegatively with trait-Neuroticism. According to Cohen

W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela 63

© 2005 Hogrefe & Huber Publishers European Journal of Psychological Assessment 2005; Vol. 21(1):56–66

(1992), the observed associations reflected small to prac-tically medium ESs. The same was true for males, exceptthat no significant association was observed in the Span-ish data in relation to the ratings of the mothers. In males,significant associations all reflected small ESs.

In females, Emotional Warmth consistently correlatedsignificantly positively with Extraversion (small to prac-tically medium ESs), with the largest associations ob-served in the Venezuelan sample, namely 0.26 (in ratingsof both fathers and mothers). In both males and females,mothers’ Emotional Warmth correlated, as predicted,significantly positively with Extraversion in each coun-try. In the fathers’ data significant associations were ob-served with Extraversion in Spanish and Venezuelan Ss(small to medium ESs). Associations in Australian Sswere negligible. Emotional Warmth, again, correlatedconsistently positively with both Masculinity and Femi-ninity in females (small to practically medium ESs). Inmales, Emotional Warmth correlated significantly posi-tively with Femininity in each country (small ESs),whereas the positive associations of small ESs with Mas-culinity were significant in Australia (mothers’ ratingsonly) and Venezuela (fathers’ ratings only).

In females, Emotional Warmth consistently correlatedpositively with high self-esteem (small to practically me-dium ESs). In males, Emotional Warmth correlated con-sistently positively with self-esteem in Australian andSpanish Ss (small to practically medium ESs). In malesin Venezuela, both variables were only significantly as-sociated in the ratings of the fathers (small ES).

Rejection

As anticipated, in both males and females, significantlypositive associations were observed in each country withtrait-Neuroticism in ratings of both fathers and mothers(small to practically medium ESs). As predicted, in bothmales’ and females’ ratings of their fathers and mothers,Rejection correlated significantly negatively with self-esteem in each country (small to practically mediumESs).

Protection

In females’ ratings of their mothers, high Protection cor-related consistently with high Neuroticism in each coun-try (small ES). Positive associations were also found infemales’ ratings of their fathers in Australia and Spain(small ESs), but not in Venezuela. Males’ ratings of theirfathers and mothers correlated positively with Neuroti-cism in Australia and Spain (small ES’), but not in Ven-ezuela.

General Discussion

On the basis of the psychometric findings obtained inthree national contexts, the present authors can continueto recommend the s-EMBU as a functional equivalent tothe early 81-item EMBU when the clinical and/or re-search context does not permit the application of theoriginal longer version. The Rejection, EmotionalWarmth, and Protection scales of the short 23-itemEMBU are reliable and valid, and the corresponding fac-tors invariant across national samples.

Attention should be drawn to the fact that some inter-esting differences emerged between nations in their pat-terns of associations relating parental rearing styles topersonality factors. For example, when daughters’ rat-ings of their mothers were considered, significant asso-ciations were observed between Emotional Warmth andExtraversion in Greek and Italian samples, but not in thegroups from Guatemala and Hungary. These differencesrequire a sociopsychological explanation, which proba-bly could be most profitably sought in cross-nationaldifferences in such dimensions of national culture asPower Distance and Masculinity-Femininity (see Hof-stede, 1991). Such dimensions of national culture de-scribe, among other things, how parents in differentcountries think children should be raised best. These di-mensions of national culture also describe the ways inwhich parents actually raise their children. Nationalbaseline differences in rearing styles are among the fac-tors that probably affect the kind and magnitude of thecorrelations between rearing styles and personality for-mation. Further data from a variety of countries are need-ed in order to empirically test this speculation.

An important limitation of the present study should bepinpointed. In determining item bias, the item-total cor-relation procedure (corrected for auto-correlation) wasemployed. However, more sophisticated differentialitem functioning (DIF) procedures than the item-remain-der correlation could have been used. The use of pointbiserial correlations is limited because they are sampledependent. An anonymous reviewer pointed out that if,for example, the Spanish sample had been more homo-geneous than the other two national samples, the pointbiserials would all be expected to be lower, without anyevidence of item bias. More appropriate alternative pro-cedures than the item-remainder correlation have beendescribed in the literature by, for example, Van de Vijverand Leung (1997). These include the Mantel-Haenszelprocedure, logistic regression, and delta plots (for a de-scriptive outline see Van de Vijver & Leung, 1997). Fur-ther studies are needed in which these alternative proce-dures are applied to rule out item-bias as an importantprerequisite for cross-cultural comparisons on the s-EMBU in terms of mean scale scores.

64 W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela

European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers

Acknowledgments

The contribution of Dr. W.A. Arrindell was made possi-ble by a fellowship (1991–1996) of the Royal Nether-lands Academy of Arts and Sciences (KNAW).

References

Arrindell, W.A., & van der Ende, J. (1984). Replicability andinvariance of dimensions of parental rearing behavior: FurtherDutch experiences with the EMBU. Personality and IndividualDifferences, 5, 671–682.

Arrindell, W.A., & Engebretsen, A.A. (2000). Convergent validityof the Short-EMBU and the Parental Bonding Instrument(PBI): Dutch findings. Clinical Psychology and Psychothera-py, 7, 262–266.

Arrindell, W.A., Gerlsma, C., Vandereycken, W., Hageman,W.J.J.M., & Daeseleire, T. (1998). Convergent validity of thedimensions underlying the Parental Bonding Instrument andthe EMBU. Personality and Individual Differences, 24, 341–350.

Arrindell, W.A., Methorst, G.J., Kwee, M.G.T., van der Ende, J.,Pol, E., & Moritz, B.J.M. (1989). Expanding the validity of ameasure of reported parental rearing practices with psychiatricinpatients: Further Dutch experiences with the EMBU. Person-ality and Individual Differences, 10, 493–500.

Arrindell, W.A., Perris, C., Eisemann, M., van der Ende, J., Gasz-ner, P., Iwawaki, S., Maj, M., & Zhang, J.-E (1994). Parentalrearing behaviour from a cross-cultural perspective: A sum-mary of data obtained in 14 nations. In C. Perris, W.A. Arrin-dell, & M. Eisemann (Eds.), Parenting and psychopathology.Chichester: Wiley.

Arrindell, W.A., Richter, J., Eisemann, M., Gärling, T., Rydén, O.,Hansson, S.B., Kasielke, E., Frindte, W., Gillholm, R., & Gus-tafsson, M. (2001). The Short-EMBU in East Germany andSweden: A cross-national factorial validity extension. Scandi-navian Journal of Psychology, 42, 157–160.

Arrindell, W.A., Sanavio, E., Aguilar, G., Sica, C., Hatzichristou,C., Eisemann, M., Recinos, L.A., Gaszner, P., Peter, M., Bat-tagliese, G., Kállai, J., & van der Ende, J. (1999). The develop-ment of a short form of the EMBU: Its appraisal with studentsin Greece, Guatemala, Hungary, and Italy. Personality and In-dividual Differences, 27, 613–628.

Barrett, P., & Eysenck, S. (1984). The assessment of personalityfactors across 25 countries. Personality and Individual Differ-ences, 5, 615–632.

Barrett, P.T., Petrides, K.V., Eysenck, S.B.G., & Eysenck, H.J.(1998). The Eysenck Personality Questionnaire: An examina-tion of the factorial similarity of P, E, N, and L across 34countries. Personality and Individual Differences, 25,805–819.

Bem, S.L. (1981). Bem Sex-Role Inventory: Professional manual.Palo Alto, CA: Consulting Psychologists Press.

Ben-Porath, Y.S. (1990). Cross-cultural assessment of personality:The case for replicatory factor analysis. In J.N. Butcher & C.D.Spielberger (Eds.), Advances in personality assessment, vol-ume 8. Hillsdale, NJ: Erlbaum.

Brand-Koolen, M.J.M. (1972). Factoranalyse in het sociologischonderzoek: Explicatie en evaluatie van enige modellen [Factoranalysis in sociological research: Explication and evaluation ofsome models]. Leiden, The Netherlands: Stenfert Kroese.

Briggs, S.R., & Cheek, J.M. (1986). The role of factor analysis inthe development and evaluation of personality scales. Journalof Personality, 54, 106–148.

Brislin, R.W. (1986). The wording and translation of researchinstruments. In W.J. Lonner & J.W. Berry (Eds.), Field methodsin cross-cultural research. Beverly Hills, CA: Sage.

Cicchetti, D.V. (1994). Guidelines, criteria, and rules of thumb forevaluating normed and standardized assessment instruments inpsychology. Psychological Assessment, 6, 284–290.

Cohen, J. (1992). A power primer. Psychological Bulletin, 112,155–159.

Eysenck, H.J., & Eysenck, S.B.G. (1983). Recent advances in thecross-cultural study of personality. In J.N. Butcher & C.D.Spielberger (Eds.), Advances in personality assessment, vol-ume 2. Hillsdale, NJ: LEA.

Eysenck, H.J., & Eysenck, S.B.G. (1991). Manual of the EysenckPersonality Scales (EPS Adult). London: Hodder & Stoughton.

Francis, L.J., Brown, L.B., & Philipchalk, R. (1992). The devel-opment of an abbreviated form of the Revised Eysenck Person-ality Questionnaire (EPQR-A): Its use among students in Eng-land, Canada, the U.S.A. and Australia. Personality andIndividual Differences, 13, 443–449.

Gorsuch, R.L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ:LEA.

Hemphill, J.F. (2003). Interpreting the magnitudes of correlationcoefficients. American Psychologist, 58, 78–79.

Hofstede, G. (1991). Cultures and organizations: Software of themind. London: McGraw-Hill.

Humphreys, L.G. (1978). Differences between correlations in asingle sample: A correction and amplification. PsychologicalReports, 43, 657–658.

Ironson, G.H., & Subkoviak, M.J. (1979) Acomparison of severalmethods of assessing item bias. Journal of Educational Mea-surement, 16, 209–225.

Kiers, H.A.L. (1990). SCA: A program for simultaneous compo-nents analysis of variables measured in two or more popula-tions; user’s manual. Groningen, The Netherlands: iec Pro-Gamma.

Nunnally, J.C. (1978). Psychometric theory (2nd ed.). New York:McGraw-Hill.

Nunnally, J.C., & Bernstein, I.H. (1994). Psychometric theory(3rd ed.). New York: McGraw-Hill.

Parker, G., Tupling, H., & Brown, L.B. (1979). A Parental Bond-ing Instrument. British Journal of Medical Psychology, 52,1–10.

Perris, C., Arrindell, W.A., & Eisemann, M. (Eds.) (1994). Par-enting and psychopathology. Chichester: Wiley.

Perris, C., Jacobsson, L., Lindström, H., Von Knorring, L., &Perris, H. (1980). Development of a new inventory for assess-ing memories of parental rearing behaviour. Acta PsychiatricaScandinavica, 61, 265–274.

Rosenberg, M. (1965). Society and the adolescent self-image.Princeton, NJ: Princeton University Press.

ten Berge, J.M.F. (1986a). Some relationships between descriptive

W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela 65

© 2005 Hogrefe & Huber Publishers European Journal of Psychological Assessment 2005; Vol. 21(1):56–66

comparisons of components from different studies. Multivari-ate Behavioral Research, 21, 29–40.

ten Berge, J.M.F. (1986b). Rotation to perfect congruence and thecross-validation of component weights across populations.Multivariate Behavioral Research, 21, 41–64.

ten Berge, J.M.F. (1996). The Kaiser, Hunka and Bianchini factorsimilarity coefficients: A cautionary note. Multivariate Behav-ioral Research, 31, 1–6.

Van de Vijver, F. & Leung, K. (1997). Methods and data analysisfor cross-cultural research. Thousand Oaks, CA: Sage.

Address for correspondence

W.A. ArrindellClinical PsychologyHeymans Institute, University of GroningenGrote Kruisstraat 2/1NL-9712 TS GroningenThe NetherlandsTel. +31 50 363-7607Fax +31 50 363-7602E-mail [email protected]

66 W.A. Arrindell et al.: The Short-EMBU in Australia, Spain, and Venezuela

European Journal of Psychological Assessment 2005; Vol. 21(1):56–66 © 2005 Hogrefe & Huber Publishers