1
An example for a mixed methods research approach by using MAXQDA & SPSS Validation of inductive code building means by EFA 1. Introduction The strict separation of qualitative and quantitative methods is no longer seen as a stringent necessity in the scientific community. Both paradigms are no longer seen as two disciplines that exclude each other, but as some that complete and complement each other (Gläser-Zikuda, Seidel & Rohlfs et. al. 2012, p. 7). Both combined are seen as a way to answer scientific questions more detailed or even in different ways. This poster presents an example of research project „BerTTram: Belastungsreduktion durch Techniken der Klassenführung – Transfermöglichkeiten“ which deals with questions of school improvement by using mixed methods (Bonsen, Frey & Obermeier 2016, p. 62). 2. Question Which categories can be summarized? 4.1 Results 4.2 Results 19. MAXQDA International Conference (MQIC), Berlin 2017 3. Methods Usually EFA (exploratory factor analysis) helps developing scales in a quantitative data set. In this study it was used to find out, which of the vast amount of categories can be summarized as supposed by Mayring (Mayring 2012, p. 31). 199 teachers were asked to write down their associations with „Classroom Management“. Methodically two steps of data analysis had to be done consecutively. The first one was to sort the noted data material by content analysis (MAXQDA). Since there is no theoretical model of teachers’ associations with classroom management, categories were developed inductively. They were built separately and as unambiguously as possible from each other without any hierarchical structure among them. Secondly all categories developed in MAXQDA were transformed into single variables in an SPSS data set to be analysed by EFA. Rotated component matrix Subcodes Factorloading α I II III IV V VI VII Probleme/Konflikte lösen ,703 Sonstiges ,683 Assoziationen/Gefühle/Wertung ,619 Rahmen/Rituale/Regeln ,651 Lehrkraft: Persönliche Eigenschaften ,527 Zeit/Abläufe/Effektivität ,492 Didaktik & Methodik ,774 Motivation/Aktivierung ,559 ,390 Transparenz/Ziele/Planung ,516 Lernen/Wissensvermittlung -,589 Begleitung/Beratung/Betreuung ,547 Wissenschafts- und/oder Theoriebezug -,542 Klassengemeinschaft/Beziehung z. d. SuS ,669 Erziehung/Werte/Pädagogik ,668 Elternarbeit ,692 Leitung/Führung/Klassenlehrer -,554 ,423 Organisation/ Verwaltung/ Struktur ,391 ,459 Verantwortung ,375 ,419 Monitoring/Aufmerksamkeit ,798 % of cumulative variance 8,5% 7,6% 7,3% 7,1% 7,1% 6,8% 6,6% Extraction method: Principal component analysis. Rotation method: Varimax rotation. Rotation is converged in 13 iterations. 6. Discussion Although some factors can be extracted clearly, single variables do not fit the model. Nevertheless, the way of conducting EFA to sort your qualitative data is a technique that makes you independent of other researchers. It is more efficient compared to teamwork as a technique which is used in order to validate the codings. The team based results can also be controlled additionally by EFA independently. On the other hand EFA requires a sample size of N>200 (Rost 2013, p. 229). Qualitative research seldom provides such a huge amount of cases, which makes it unattractive for many users. Conducting EFA does not guarantee an output which summarizes factors convincingly. Moreover researchers need to know their data material detailed in order to decide whether the suggested factors are acceptable. Following these guidelines it can be said that the presented technique (EFA) is especially appropriate for mixed methods designs which are characterized by a big number of data material. 5. Benefit While the 19 former existing categories were not designed to be used by SPSS, since they display too small case numbers, four or five main codes were built by EFA (Rost 2013, p. 223). The main codes refer to the given factors. It’s meant to have a clearer and simpler overlook concerning the amount of variables and their relating case numbers. At last meaningful statistical steps of analysis can be conducted. Fig. 01: All codes of teachers‘ associations with classroom management including frequencies. Sorted by expected factors. Fig. 02: EFA of all codes of teachers‘ associations with classroom management. Number of Codes: 19 Codings: 688 N=199 Figure designed by MAXMaps (MAXQDA, Version 22) Inductive codebuilding of teachers‘ associations with classroom management Reduction of dimensions by exploratory factor analysis (EFA) Contact: Ann-Cathrin Obermeier M.A. Institute of Educational Sciences Mail: [email protected] Phone: + 49 251-83 21158 Bonsen, M., Frey, K. A., & Obermeier, A.-C. (2016). Wie hast Du's mit der Klassenführung? Die Auseinandersetzung von Lehrkräften mit einer zentralen Dimension der Unterrichtsqualität. In D. Prinz & K. Schwippert (Eds.), Der Forschung – Der Lehre – Der Bildung – Aktuelle Entwicklungen der Empirischen Bildungsforschung. Münster: Waxmann. Gläser-Zikuda, M., Seidel, T., Rohlfs, C., Gröschner, A., & Ziegelbauer, S. (2012). Mixed Methods in der empirischen Bildungsforschung – eine Einführung in die Thematik. In M. Gläser-Zikuda, T. Seidel, C. Rohlfs, A. Gröschner & S. Ziegelbauer (Eds.), Mixed Methods in der empirischen Bildungsforschung (pp. 7–13). Münster: Waxmann. Mayring, P. (2012). Qualitative Inhaltsanalyse – ein Beispiel für Mixed Methods. In M. Gläser-Zikuda, T. Seidel, C. Rohlfs, A. Gröschner & S. Ziegelbauer (Eds.), Mixed Methods in der empirischen Bildungsforschung (pp. 27–36). Münster: Waxmann. Rost, D. H. (2013). Interpretation und Bewertung pädagogisch-psychologischer Studien. Eine Einführung (3. ed.). Bad Heilbrunn: Klinkhardt. Literature: Ann-Cathrin Obermeier M.A.

Validation of inductive code building means by EFA · 2017-03-13 · An example for a mixed methods research approach by using MAXQDA & SPSS . Validation of inductive code building

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Validation of inductive code building means by EFA · 2017-03-13 · An example for a mixed methods research approach by using MAXQDA & SPSS . Validation of inductive code building

An example for a mixed methods research approach by using MAXQDA & SPSS

Validation of inductive code building means by EFA

1. Introduction The strict separation of qualitative and quantitative methods is no longer seen as a stringent necessity in the scientific community. Both paradigms are no longer seen as two disciplines that exclude each other, but as some that complete and complement each other (Gläser-Zikuda, Seidel & Rohlfs et. al. 2012, p. 7). Both combined are seen as a way to answer scientific questions more detailed or even in different ways. This poster presents an example of research project „BerTTram: Belastungsreduktion durch Techniken der Klassenführung – Transfermöglichkeiten“ which deals with questions of school improvement by using mixed methods (Bonsen, Frey & Obermeier 2016, p. 62).

2. Question Which categories can be summarized?

4.1 Results 4.2 Results

19. MAXQDA International Conference (MQIC), Berlin 2017

3. Methods Usually EFA (exploratory factor analysis) helps developing scales in a quantitative data set. In this study it was used to find out, which of the vast amount of categories can be summarized as supposed by Mayring (Mayring 2012, p. 31). 199 teachers were asked to write down their associations with „Classroom Management“. Methodically two steps of data analysis had to be done consecutively. The first one was to sort the noted data material by content analysis (MAXQDA). Since there is no theoretical model of teachers’ associations with classroom management, categories were developed inductively. They were built separately and as unambiguously as possible from each other without any hierarchical structure among them. Secondly all categories developed in MAXQDA were transformed into single variables in an SPSS data set to be analysed by EFA.

Rotated component matrix

Subcodes Factorloading α

I II III IV V VI VII h²

P r o b l e m e / K o n f l i k t e l ö s e n ,703

S o n s t i g e s ,683

A s s o z i a t i o n e n / G e f ü h l e / W e r t u n g ,619

R a h m e n / R i t u a l e / R e g e l n ,651

L e h r k r a f t : P e r s ö n l i c h e E i g e n s c h a f t e n ,527

Z e i t / A b l ä u f e / E f f e k t i v i t ä t ,492

D i d a k t i k & M e t h o d i k ,774

M o t i v a t i o n / A k t i v i e r u n g ,559 ,390

T r a n s p a r e n z / Z i e l e / P l a n u n g ,516

L e r n e n / W i s s e n s v e r m i t t l u n g -,589

B e g l e i t u n g / B e r a t u n g / B e t r e u u n g ,547

W i s s e n s c h a f t s - u n d / o d e r T h e o r i e b e z u g -,542

K l a s s e n g e m e i n s c h a f t / B e z i e h u n g z . d . S u S ,669

E r z i e h u n g / W e r t e / P ä d a g o g i k ,668

E l t e r n a r b e i t ,692

L e i t u n g / F ü h r u n g / K l a s s e n l e h r e r -,554 ,423

O r g a n i s a t i o n / Ve r w a l t u n g / S t r u k t u r ,391 ,459

Ve r a n t w o r t u n g ,375 ,419

M o n i t o r i n g / A u f m e r k s a m k e i t ,798

% of cumulative variance 8,5% 7,6% 7,3% 7,1% 7,1% 6,8% 6,6%

Extraction method: Principal component analysis. Rotation method: Varimax rotation.

Rotation is converged in 13 iterations.

6. Discussion Although some factors can be extracted clearly, single variables do not fit the model. Nevertheless, the way of conducting EFA to sort your qualitative data is a technique that makes you independent of other researchers. It is more efficient compared to teamwork as a technique which is used in order to validate the codings. The team based results can also be controlled additionally by EFA independently. On the other hand EFA requires a sample size of N>200 (Rost 2013, p. 229). Qualitative research seldom provides such a huge amount of cases, which makes it unattractive for many users. Conducting EFA does not guarantee an output which summarizes factors convincingly. Moreover researchers need to know their data material detailed in order to decide whether the suggested factors are acceptable. Following these guidelines it can be said that the presented technique (EFA) is especially appropriate for mixed methods designs which are characterized by a big number of data material.

5. Benefit While the 19 former existing categories were not designed to be used by SPSS, since they display too small case numbers, four or five main codes were built by EFA (Rost 2013, p. 223). The main codes refer to the given factors. It’s meant to have a clearer and simpler overlook concerning the amount of variables and their relating case numbers. At last meaningful statistical steps of analysis can be conducted.

Fig. 01: All codes of teachers‘ associations with classroom management including frequencies. Sorted by expected factors.

Fig. 02: EFA of all codes of teachers‘ associations with classroom management.

Number of Codes: 19 Codings: 688

N=199 Figure designed by MAXMaps (MAXQDA, Version 22)

Inductive codebuilding of teachers‘ associations

with classroom management

Reduction of dimensions by exploratory factor analysis

(EFA)

Contact: Ann-Cathrin Obermeier M.A. Institute of Educational Sciences Mail: [email protected] Phone: + 49 251-83 21158

Bonsen, M., Frey, K. A., & Obermeier, A.-C. (2016). Wie hast Du's mit der Klassenführung? Die Auseinandersetzung von Lehrkräften mit einer zentralen Dimension

der Unterrichtsqualität. In D. Prinz & K. Schwippert (Eds.), Der Forschung – Der Lehre – Der Bildung – Aktuelle Entwicklungen der Empirischen Bildungsforschung.

Münster: Waxmann. Gläser-Zikuda, M., Seidel, T., Rohlfs, C., Gröschner, A., & Ziegelbauer, S. (2012). Mixed Methods in der empirischen Bildungsforschung –

eine Einführung in die Thematik. In M. Gläser-Zikuda, T. Seidel, C. Rohlfs, A. Gröschner & S. Ziegelbauer (Eds.), Mixed Methods in der empirischen

Bildungsforschung (pp. 7–13). Münster: Waxmann. Mayring, P. (2012). Qualitative Inhaltsanalyse – ein Beispiel für Mixed Methods. In M. Gläser-Zikuda, T.

Seidel, C. Rohlfs, A. Gröschner & S. Ziegelbauer (Eds.), Mixed Methods in der empirischen Bildungsforschung (pp. 27–36). Münster: Waxmann. Rost, D. H. (2013).

Interpretation und Bewertung pädagogisch-psychologischer Studien. Eine Einführung (3. ed.). Bad Heilbrunn: Klinkhardt.

Literature:

A n n - C a t h r i n O b e r m e i e r M . A .