23
Educational Evaluation and Policy Analysis June 2018, Vol. 40, No. 2, pp. 196–218 DOI: 10.3102/0162373717742198 © 2017 AERA. http://eepa.aera.net IN a growing body of literature, education researchers are applying social network theory to study teacher learning and school improve- ment (Spillane, Hopkins, & Sweet, 2014). Theory and empirical research suggest that teachers’ professional ties, and the social capital that such ties enable, influence teachers’ learn- ing, instructional improvement, and the success with which reforms take hold in schools (e.g., Atteberry & Bryk, 2010; Bryk & Schneider, 2002). While social capital can take on a variety of forms, the term generally refers to the poten- tial for individuals to “secure benefits by virtue of membership in social networks or other social structures” (Portes, 1998, p. 6). Such benefits may come through the flow of information or material resources, obligations and expectations, trust, or norms and sanctions. In education, researchers have shown the importance of teach- ers’ social capital for numerous outcomes, including the success of instructional reform efforts (Bryk & Schneider, 2002; Coburn, Russell, Kaufman, & Stein, 2012; Daly, Moolenaar, Bolivar, & Burke, 2010; Frank, Zhao, & Borman, 2004), the content and extent of teachers’ learning and instructional improve- ment (Atteberry & Bryk, 2010; Coburn & Russell, 2008; Parise & Spillane, 2010), the diffusion of instructional innovations and best practices (Frank et al., 2004; Sun, Penuel, Frank, Gallagher, & Youngs, 2013; Sun, Wilhelm, Larson, & Frank, 2014), and teacher satisfaction and retention (Johnson, 2004). Given the importance of ties and their implications for school improvement, theory and practice would be advanced by research into the 742198EPA XX X 10.3102/0162373717742198Teachers’ Ties and Social CapitalQuinn and Kim research-article 2017 Experimental Effects of Program Management Approach on Teachers’ Professional Ties and Social Capital David M. Quinn University of Southern California James S. Kim Harvard Graduate School of Education Theory and empirical work suggest that teachers’ social capital influences school improvement efforts. Social ties are prerequisite for social capital, yet little causal evidence exists on how malleable factors, such as instructional management approaches, affect teachers’ ties. In this cluster-random- ized trial, we apply a decision-making perspective to compare a literacy intervention managed under a “fidelity-focused” approach, in which teachers were expected to implement researcher- designed procedures faithfully, versus a “structured adaptive” approach, in which teachers collabora- tively planned program adaptations. In the short term, the adaptive approach increased teachers’ accessing of intervention-related social capital, but decreased their accessing of social capital unrelated to the intervention. Short-term effects varied based on participants’ role in the interven- tion. No group differences were found on social capital measures one year later, suggesting that the structured adaptive approach did not make teachers more likely to form ties that would be useful outside of the intervention. Keywords: social capital, social network analysis, teacher networks, fidelity of implementation, adaptive implementation, cluster-randomized trial

Experimental Effects of Program Management Approach on

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Experimental Effects of Program Management Approach on

Educational Evaluation and Policy AnalysisJune 2018, Vol. 40, No. 2, pp. 196 –218

DOI: 10.3102/0162373717742198© 2017 AERA. http://eepa.aera.net

In a growing body of literature, education researchers are applying social network theory to study teacher learning and school improve-ment (Spillane, Hopkins, & Sweet, 2014). Theory and empirical research suggest that teachers’ professional ties, and the social capital that such ties enable, influence teachers’ learn-ing, instructional improvement, and the success with which reforms take hold in schools (e.g., Atteberry & Bryk, 2010; Bryk & Schneider, 2002). While social capital can take on a variety of forms, the term generally refers to the poten-tial for individuals to “secure benefits by virtue of membership in social networks or other social structures” (Portes, 1998, p. 6). Such benefits may come through the flow of information or material resources, obligations and expectations, trust, or norms and sanctions. In education,

researchers have shown the importance of teach-ers’ social capital for numerous outcomes, including the success of instructional reform efforts (Bryk & Schneider, 2002; Coburn, Russell, Kaufman, & Stein, 2012; Daly, Moolenaar, Bolivar, & Burke, 2010; Frank, Zhao, & Borman, 2004), the content and extent of teachers’ learning and instructional improve-ment (Atteberry & Bryk, 2010; Coburn & Russell, 2008; Parise & Spillane, 2010), the diffusion of instructional innovations and best practices (Frank et al., 2004; Sun, Penuel, Frank, Gallagher, & Youngs, 2013; Sun, Wilhelm, Larson, & Frank, 2014), and teacher satisfaction and retention (Johnson, 2004).

Given the importance of ties and their implications for school improvement, theory and practice would be advanced by research into the

742198 EPAXXX10.3102/0162373717742198Teachers’ Ties and Social CapitalQuinn and Kimresearch-article2017

Experimental Effects of Program Management Approach on Teachers’ Professional Ties and Social Capital

David M. Quinn

University of Southern CaliforniaJames S. Kim

Harvard Graduate School of Education

Theory and empirical work suggest that teachers’ social capital influences school improvement efforts. Social ties are prerequisite for social capital, yet little causal evidence exists on how malleable factors, such as instructional management approaches, affect teachers’ ties. In this cluster-random-ized trial, we apply a decision-making perspective to compare a literacy intervention managed under a “fidelity-focused” approach, in which teachers were expected to implement researcher-designed procedures faithfully, versus a “structured adaptive” approach, in which teachers collabora-tively planned program adaptations. In the short term, the adaptive approach increased teachers’ accessing of intervention-related social capital, but decreased their accessing of social capital unrelated to the intervention. Short-term effects varied based on participants’ role in the interven-tion. No group differences were found on social capital measures one year later, suggesting that the structured adaptive approach did not make teachers more likely to form ties that would be useful outside of the intervention.

Keywords: social capital, social network analysis, teacher networks, fidelity of implementation, adaptive implementation, cluster-randomized trial

Page 2: Experimental Effects of Program Management Approach on

Quinn and Kim

197

organizational and instructional management factors that decision-makers can manipulate to effectively shape tie formation and social capital exchange within schools—factors such as the level of autonomy given to teachers, collaborative work structures, and the type of professional development (PD) offered. Such research could help school and district leaders predict the ways in which interventions and organizational restructuring efforts that manipulate these mal-leable factors might affect professional networks. This would enable administrators to influence tie formation and leverage social capital in support of school-wide instructional improvement. However, little is known about the ways in which different instructional management approaches may differentially affect ties, and no experimen-tal studies exist on the matter, making causal inference elusive. Furthermore, we lack empirical evidence on the effect that interventions with varying instructional management approaches might have on teachers’ ties and exchanges of social capital relevant to instructional matters unrelated to the intervention. The expected direc-tion of such an effect is not obvious, as there is reason to anticipate that teachers might use newly formed intervention-related ties to exchange social capital unrelated to the intervention or, conversely, that newly formed intervention-related ties might crowd out ties unrelated to the intervention. Our study answers the call made by education network researchers for randomized designs that enable causal inferences about teacher network outcomes (Sun et al., 2013).

In this study, we use data from a cluster- randomized trial of READS for Summer Learning (READS), a summer literacy program for fourth graders that includes school- and home-based program components, to present the first experimental evidence on the formation of teachers’ professional ties. Specifically, we compare two versions of the program: (a) Core READS, which takes a fidelity-focused manage-ment approach in which teachers are expected to faithfully implement researcher-designed pro-gram procedures, and (b) Adaptive READS, which takes a structured adaptive management approach in which teachers work within formal collaborative structures to adapt the program in ways they believe will improve its effectiveness. Guided by the decision-making perspective on

tie formation, we examine how the contrasting program management approaches affect educa-tors’ consultation decisions (Nebus, 2006)—spe-cifically, does program management approach affect the size of teachers’ consultation networks, the people from whom teachers seek consulta-tion, or the content and frequency of consulta-tion? We separately examine these outcomes for consultation on instructional matters related to the intervention and instructional matters unre-lated to the intervention. We also ask whether these effects differ depending on the individual’s role in the intervention. Because ties and consul-tation are prerequisite for social capital exchange (Spillane, Kim, & Frank, 2012), it is important to understand the malleable factors that affect them, separately from understanding what character-izes social capital exchanges that lead to improved student outcomes (a topic which we leave to future study).

We begin by providing background on net-work theory and the relevance of teacher ties to school improvement. We then summarize the decision-making perspective on how ties are formed, outline different approaches to instruc-tional management, and consider the theoretical predictions regarding how contrasting approaches to instructional management may differentially affect tie formation among teachers. Next, we describe Adaptive and Core READS, the two models of intervention management studied here. Finally, we describe the methods, present results, and discuss implications.

Network Theory, Social Ties, and Social Capital

Social network theory can refer to theory about how individuals derive benefits from social capital or to theory about how and why individuals form social ties with one another (Borgatti & Lopez-Kidwell, 2011). Social ties and social capital are deeply connected, as social capital is something that “exists in the relations among persons” (Coleman, 1988, pp. 100–101, emphasis in original). Social capital “facilitate[s] produc-tive activity” (Coleman, 1988, p. 101) and can take the form of obligations and expectations, norms and sanctions, or information-flow capability (Coleman, 1988). Across its varied forms, a defining feature of social capital is that

Page 3: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

198

social ties are necessary (though not sufficient) for its development (Spillane et al., 2012). As discussed below, education researchers have focused on particular aspects of social ties that are especially relevant to school improvement: the capacity of ties to transmit advice and information, support the implementation of reform initiatives, diffuse innovation, and serve as a source of moral support for teachers.

How Are Social Ties Relevant to School Improvement?

Information and Advice Transmission. The information-transmission potential in social ties is of interest to education researchers because instructional improvements require teacher learning, and advice and information are critical components of learning (Elmore, 1996; Hill, 2004). Teaching is complex, uncertain, and non-routine (Hawley & Valli, 1999); when faced with such tasks, people often seek consultation from others (Nebus, 2006). Sharing information through social ties leads to new knowledge by allowing individuals to integrate the information with previously held knowledge (Choo, 1998), and facilitates joint sense-making (Coburn, 2001; Daly & Finnigan, 2010; Frank et al., 2004; Uzzi, 1997). Through the transmission of advice and information, social ties therefore have the poten-tial to help teachers improve instruction and stu-dent learning. Indeed, research shows that teachers become more effective when other effective teachers join their grade-level team (Jackson & Bruegmann, 2009; Sun, Loeb, & Grissom, 2017).

Innovation Diffusion. Both weak and strong ties play a role in the diffusion of innovations within and across schools. As transmitters of information, weak ties—or ties that serve as “bridges” between separate intraconnected networks—are impor-tant for innovation diffusion because new infor-mation gained by an “ego” (the focal individual in a particular network analysis) through a weak tie is less likely to already be circulating among the ego’s close network ties (Granovetter, 1973). For example, Sun and colleagues (2013) found that when teachers attended out-of-school PD, the strategies presented in the PD diffused through the attendees’ schools. In this case, the attending teacher’s weak tie with the PD provider

served as a bridge introducing particular teaching methods to the more insular network of the school. Stronger ties among individuals within a school can also help innovations take hold in the school through the influence of social pressure to implement the innovation (Frank et al., 2004).

Reform Efforts. The ties held among teachers within a school have implications for the success of reform initiatives at that school, given that tie structure influences the flow of resources among network members (Daly et al., 2010). When teachers work in isolation and hone their skills through solitary trial and error, the development of shared, commonly held principles of pedagogy is stifled (Lortie, 1975). In contrast, when teach-ers are well connected with one another, stan-dards of practice are able to develop and to be enforced through social norms (Frank et al., 2004). Ties can therefore serve as a useful resource in a reform initiative, given that changes become more embedded in practice when indi-viduals interact around them (Daly et al., 2010). In the context of instructional reforms, more interaction around the reform has been associated with more collective action related to the reform (Daly et al., 2010) and with better and more sus-tainable implementation (Coburn et al., 2012; Frank et al., 2004). The underlying networks in a school, then, can be leveraged to support and improve instructional reform.

Teacher Morale. Finally, ties among teachers can be valuable because of their role in promoting a feeling of connectedness in the workplace. Teachers who are disconnected from advice and support networks tend toward feeling uncertain, unsupported, overwhelmed, and ineffective (Johnson, 2004). Over time, these feelings can lead teachers to exit the profession (Johnson, 2004). Consequently, interventions that help build ties, even if these ties do not result in the exchange of social capital that directly improves instruction, can indirectly contribute to school improvement by reducing teacher turnover.

The Decision-Making Perspective on Tie Formation and Dissolution

Despite the indispensable role that ties play in building and transmitting social capital in its various manifestations, little is known about the

Page 4: Experimental Effects of Program Management Approach on

Quinn and Kim

199

ways in which contrasting instructional manage-ment approaches may differentially affect the networks and social capital within schools. Understanding this will allow for the prediction of how adopting different instructional manage-ment approaches, or introducing interventions with varying instructional management approaches, might affect professional networks. Such an understanding will enable school leaders to leverage ties and social capital in support of school-wide instructional improvement.

Following Nebus (2006), we adopt a decision-making perspective on how information and advice ties1 are formed. Building on expectancy theory, Nebus sought to explain why an ego contacts a particular “alter,” or potential advice-giver. He proposed that an ego’s decision to contact an alter for consultation on some matter was a function of two things: (a) the ego’s expec-tancy on what Nebus calls the “first-level out-come,” or the ego’s perception of the probability that the request would result in the receipt of advice, and (b) the ego’s expectancy on the “sec-ond-level outcome,” or the ego’s perception of the probability that the received advice will be useful in advancing the goal that motivated the advice-seeking. In deciding when to contact whom and for what purpose, the ego weighs the perceived value of receiving advice from a par-ticular alter against the perceived cost of contact-ing that alter. Costs include opportunity costs because time or resources spent contacting or interacting with one alter to advance one second-level outcome cannot be applied toward contact-ing or interacting with some other alter, or advancing some other second-level outcome (Nebus, 2006).

Given that the number of ties one can simulta-neously maintain is limited (Granovetter, 1973), the accumulation over time of decisions to con-tact one alter rather than another can result in the dissolution of network ties (Nebus, 2006). Relatedly, it is often easier to maintain currently held ties than to form new ones (Nebus, 2006). Theory therefore predicts, and empirical work provides evidence, that people often use ties they formed for one purpose to access information or advice related to some other purpose (Coleman, 1988; Cross & Sproull, 2004).

In one study examining tie formation in a school setting, Spillane and colleagues (2012)

found that shared individual characteristics such as race and gender predicted teachers’ advice ties (a common phenomenon known as homophily), but teachers’ organizational positions, such as shared grade-level assignment and holding a for-mal leadership position, were more important predictors. Relatedly, a change in grade-level assignment predicts the dissolution of ties with former grade-level colleagues (Spillane & Shirrell, 2017). In the context of accountability pressures, teachers are more likely to seek advice from high, rather than low, value-added teachers (Wilhelm, Chen, Smith, & Frank, 2016). All of these findings can be explained by the decision-making perspective, in that they provide exam-ples of additional factors that individuals consider when weighing the value and costs of pursuing a tie. Teachers seeking instructional advice are more likely to expect that teachers in their same grade level, or with higher value-added scores, will have useful advice (compared with teachers outside their grade level or with lower value-added scores); similarly, teachers may expect that people in leadership positions will have helpful advice, or will be more likely to respond to requests for advice.

Teacher Networks and Instructional Management Approaches

The decision-making perspective on tie for-mation is helpful when considering how different approaches to instructional reform and manage-ment might affect the networks and social capital in schools. Two common and contrasting man-agement approaches to instructional improve-ment are what we will call the “fidelity-focused” and the “structured adaptive” approaches (McDonald, Keesler, Kauffman, & Schneider, 2006). These approaches differ in their underlying assumptions about the nature of the work of teaching and, by extension, the role that teachers should play in school improvement efforts. As discussed below, these differences may result in contrasting effects on ties and social capital flow.

Improvement efforts taking the fidelity-focused approach are based on the assumption that instruction should be standardized and regu-lated, and that the teacher’s job is primarily to implement prescribed instructional routines faithfully (Rowan, 1990; Rowan & Miller, 2007).

Page 5: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

200

Contrariwise, interventions taking the structured adaptive approach are rooted in the view that teaching is a nonroutine task that cannot be stan-dardized; rather, high-quality instruction requires that teachers diagnose problems and make judg-ments about how to adapt instruction to best fit a given situation (Rowan, 1990; Rowan & Miller, 2007). Interventions rooted in this view promote collaborative learning among teachers and aim to help teachers understand instructional principles, which they can then draw from flexibly as they adapt instruction (Penuel, Gallagher, & Moorthy, 2011; Rowan & Miller, 2007).

Effects of Fidelity-Focused Versus Structured Adaptive Instructional Management on Teacher Ties. As discussed above, the decision-making perspective (Nebus, 2006) suggests that fidelity-focused and adaptive approaches to educational interventions will lead to different outcomes for teachers’ networks. Given that the goals (or the second-level outcomes) of teachers participating in these interventions differ, teachers’ perceived value of seeking advice related to the interven-tion will likely differ. While the fidelity-focused approach presents teachers with a series of tasks to implement, the structured adaptive approach charges teachers with the nonroutine, complex task of adapting instruction for a given situation. Because such challenges have no single correct solution, egos will seek consultation from alters for insight into possible paths and their likely results (Nebus, 2006). Instructional adaptation requires ongoing knowledge development, which is facilitated by professional ties and interactions among teachers (Spillane et al., 2012). In other words, the adaptive approach may introduce more of a perceived value to contacting alters, resulting in more tie-generation and social capi-tal exchange compared with the fidelity-focused approach.

Effects on ties related and unrelated to an intervention. The evidence cited above suggests that the introduction of an intervention or reform into a school may affect teachers’ network ties and their activation of social capital. However, past studies have not distinguished between ties through which teachers seek advice on interven-tion-related matters and ties through which teach-ers seek advice on instructional matters unrelated

to the intervention. As such, even less is known about how an intervention may differentially affect teachers’ ties or social capital in areas related and unrelated to the intervention. Theory offers two contrasting possibilities.

According to the theory outlined above, acquiring information can be costly (in terms of expending time, energy, or resources), and there-fore people often use ties maintained for one pur-pose to acquire information for other purposes (Coleman, 1988; Cross & Sproull, 2004). Teachers who form a professional tie through their participation in an educational intervention may therefore use that tie to access information and expertise in some other instructional setting. Relatedly, if those with whom participants form new ties provide helpful consultation related to the intervention, the “halo effect” (Nebus, 2006) predicts that participants will expect this new tie to have helpful advice in other areas as well. Consequently, we might expect to see that increases in the number of people from whom teachers seek intervention-related advice are accompanied by increases in the number of peo-ple from whom the teacher seeks advice on other intervention-unrelated instructional areas.

At the same time, theory offers reasons as to why the opposite may be true. Due to the finitude of time and resources, cultivating or maintaining one tie presents opportunity costs for cultivating or maintaining another tie, and seeking advice for one purpose means a lost opportunity for seeking advice for some other purpose. With lim-its to the amount of consultation that one can receive over a given period of time, expanding one’s network in one area may require a counter-balancing deactivation (at least temporarily) of network ties in another area. Over the longer term, attention to certain ties at the expense of others may result in the dissolution of inactive ties (Nebus, 2006). Relatedly, when actors focus their attention on using their ties to access social capital in one area, this may require an offsetting decrease in the amount of social capital accessed for other purposes.

Effects by position in the organizational structure. An individual’s position in the orga-nizational structure of an intervention may also influence the effect that participating in the intervention has on his or her network outcomes

Page 6: Experimental Effects of Program Management Approach on

Quinn and Kim

201

(Lincoln, 1982, as cited by Cross & Sproull, 2004). Responsibilities vary by organizational position and therefore so do second-level goals. The decision-making perspective suggests that this will motivate egos to seek different types of expertise from different alters, depending on the ego’s position. For example, managers or admin-istrators tasked with overseeing the execution of some project face different challenges compared with people tasked with executing the project. As such, people working on the same project may exhibit different choices regarding the forma-tion of ties and the type of social capital accessed through their ties.

Although no direct evidence exists on the dif-ferential effects of contrasting instructional man-agement regimes on network outcomes, or on whether these effects vary depending on one’s position in the school’s organizational structure, researchers have used observational data to study reform initiatives, organizational role, and social capital. In descriptive cross-sectional data, schools participating in reform initiatives tended to exhibit more ties among teachers (Weinbaum, Cole, Weiss, & Supovitz, 2008). Results from studies using longitudinal single-group/treat-ment-only designs suggest that instructional reforms with built-in collaborative structures may help schools develop instructional support networks (Atteberry & Bryk, 2010; Coburn, Mata, & Choi, 2013). Furthermore, the establish-ment of formal structures for teacher interaction has been associated with the depth of teachers’ interactions, and teachers take advantage of opportunities to seek advice from instructional coaches when coaches are introduced into a school (Coburn & Russell, 2008). Malleable organizational structures therefore represent a potential tool for school leaders hoping to build teachers’ social capital. However, an unexplored question is whether educational interventions with different underlying assumptions about the role of the teacher, and with different approaches to organizing the teacher’s work, differentially affect teachers’ ties and social capital.

Effects in the long term. Social networks are dynamic, and changes to an ego’s network that are precipitated by exogenous forces (such as a change in instructional management approach) may or may not be maintained over the longer

term (Kossinets & Watts, 2006; Lubbers et al., 2010). Just as the decision-making perspective can be applied to predict tie formation, so can it be used to predict the tie dissolution. For exam-ple, if teachers have a strong incentive to consult with their grade-level colleagues about instruc-tion (Spillane et al., 2012), teachers who change their grade-level teaching assignment will likely form consultation ties with their new grade-level colleagues and weaken or dissolve consultation ties with their former grade-level colleagues (Spillane & Shirrell, 2017). Similarly, just as the introduction of a structured adaptive manage-ment approach may motivate teachers to seek new consultation ties, the removal of a structured adaptive instructional management approach may reduce teachers’ incentives for seeking instruc-tional consultation, resulting in the dissolution of ties. At the same time, tie-persistence has been shown to be predicted by closeness, frequency of contact, and the centrality in one’s egocentric network (Lubbers et al., 2010). Consequently, if teachers form meaningful ties through partici-pation in a structured adaptive intervention, or develop new intervention-unrelated incentives for seeking consultation through these ties, the ties may be maintained in the longer term even after the adaptive intervention ends.

Summary and Research Questions

Theory and empirical work have illuminated the important role of social capital, and of the social ties that enable social capital, in teacher learning and school improvement. At the same time, little is known about how different approaches to instructional reform and manage-ment may differentially affect the network ties and social capital within schools, and no causal evidence on this question exists. The decision-making perspective on tie formation suggests that an adaptive, collaborative intervention may promote the development of intervention-related social capital more so than an intervention with a fidelity-focused approach to management. These effects may differ depending on the individual’s role in the intervention, given that one’s role determines one’s second-level outcomes. Theory also offers contrasting predictions about how an intervention’s management approach may affect participants’ social capital in instructional areas

Page 7: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

202

unrelated to the intervention. On one hand, teach-ers may use ties they formed or strengthened through their participation in an adaptive, collab-orative intervention to access instructional resources unrelated to the intervention; on the other hand, limits to teachers’ time and resources may require that an increase in intervention-related ties and social capital be offset by a decrease in intervention-unrelated ties and social capital. Finally, the decision-making perspective would suggest that ties formed through participa-tion in a structured adaptive intervention may dissolve at the conclusion of the intervention, unless intervention-unrelated incentives develop for teachers to maintain those ties.

In this study, we contribute to the literature on teacher networks by presenting unique causal evidence on these issues; in particular, we exam-ine the effects of implementing a particular inter-vention through a structured adaptive management approach, as compared with a fidel-ity-focused management approach. Using data from a school-level cluster-randomized trial of READS for Summer Learning, a summer read-ing program for fourth graders, we ask the fol-lowing research questions:

Research Question 1a (RQ1a): What are the immediate effects of a structured adaptive approach to educational program manage-ment (as compared with a fidelity-focused management approach) on teachers’ num-ber of intervention-related ties overall, teachers’ intervention-related ties with alters in specific intervention roles, and the frequency with which teachers consult with alters for different intervention-related purposes?

Research Question 1b (RQ1b): Do these immediate effects on intervention-related outcomes depend on the ego’s role in the intervention?

Research Question 2a (RQ2a): What are the immediate effects of a structured adaptive approach to educational program manage-ment (as compared with a fidelity-focused management approach) on teachers’ num-ber of intervention-unrelated ties overall, the presence of intervention-unrelated ties with participants in specific intervention roles, and the frequency with which teachers

access social capital for different interven-tion-unrelated purposes?

Research Question 2b (RQ2b): Do these immediate effects on intervention- unrelated outcomes depend on the ego’s role in the intervention?

Research Question 3a (RQ3a): What are the 1-year follow-up effects (i.e., 1 year after the conclusion of the intervention) of a structured adaptive approach to educa-tional program management (as compared with a fidelity-focused management approach) on teachers’ number of interven-tion-unrelated ties overall, the presence of intervention-unrelated ties with partici-pants in specific intervention roles, and the frequency with which teachers consult with alters regarding intervention-related and intervention-unrelated instructional areas?

Research Question 3b (RQ3b): Do these follow-up effects depend on the ego’s role in the intervention?

Method

Intervention Procedures

READS for Summer Learning. READS for Sum-mer Learning is a program designed to narrow income-based reading skill gaps. We compare two versions of READS—Core READS and Adaptive READS—which were randomly assigned to be executed at different schools over the 2014–2015 school year and summer of 2015. For both versions of the program, only fourth-grade students, their teachers, and school coordi-nators (SCs; described below) participated. Core READS is an evidence-based program (Kim et al., 2016) representing a fidelity-focused approach in which teachers receive training and resources to support their adherence to researcher-designed program procedures. In contrast, Adap-tive READS takes a structured adaptive approach by having teachers work collaboratively with their grade-level teams to adapt READS in ways they believe will increase the program’s effectiveness.

Core READS. Students in Core READS receive books in the mail over the summer, which are matched to their reading level and

Page 8: Experimental Effects of Program Management Approach on

Quinn and Kim

203

interests. Each book includes a “tri-fold” that leads students through the “READS reading rou-tine.” This routine, which is designed to engage students and scaffold their reading, includes a prereading activity that focuses students’ atten-tion on important text elements and a postreading comprehension check. Students are expected to mail back completed trifolds (with postage pre-paid).

Core READS teachers attend a 2-hour train-ing during which they learn how to implement six scripted lessons at the end of the school year that prepare students for independently applying best practices for reading comprehension with their matched books over the summer. To bridge the home and the school, students and their fami-lies are invited to a READS Family Night (RFN) in the spring. At this event, families learn about READS and the trifolds. Also in the spring, stu-dents complete a reading comprehension assess-ment and reading interest survey; this information is used in an algorithm to match students to books. Over summer break, students receive 10 books: eight personalized matches and two books from the end-of-year lessons. In the Core condi-tion, the only implementation expectation of teachers is that they adhere to the six end-of-year lesson scripts.

Adaptive READS. Teachers at schools assigned to Adaptive READS attended an orientation ses-sion in November 2014 in which they learned the underlying principles of READS. Teachers received school-specific data from a previous year of (Core) READS implementation (e.g., data on trifold return rates and RFN attendance) and examined these data with their grade-level teams to develop hypotheses about ways the program may be improved in their school. After this ini-tial meeting, teachers could opt for earning dis-trict PD credit by completing six online modules in December to learn more about the research-based principles underlying READS (81% of teachers surveyed in the spring participated in the modules). Teachers then met twice more formally—once in January and once in Febru-ary—to finalize a plan, based on the data and the research-based principles, for how they would adapt READS. Examples of potential adapta-tions include developing new strategies to better scaffold the summer reading process, improving

the quality of comprehension instruction at the end of the school year, developing strategies to strengthen the home–school connection, or using more detailed information about students’ inter-ests and reading levels to improve the summer book matches.

SCs and Communities in Schools (CIS) READS Leads. The nonprofit organization CIS–North Carolina (CIS-NC) served as an implementation partner for all participating schools. In each district, CIS assigned a “CIS READS Lead” to work with all participating schools in the district (Core and Adaptive). The role of the CIS READS Lead differed slightly for each condition. For Core READS schools, Leads served as managers ensuring that components (e.g., teacher trainings, RFN) were executed as planned; in Adaptive READS schools, Leads had this same responsibility but also led the February working group meeting and worked with teach-ers and SCs to support them in executing their adaptation plans as needed.

At each school, the principal chose an instruc-tional leader (e.g., literacy specialist, instruc-tional coach, etc.) or teacher from outside of the fourth-grade teaching team to serve as the school’s READS SC. In Core READS, SCs served as the school’s contact person for the CIS READS Lead and provided assistance and answered questions for participating READS teachers as needed. In Adaptive READS, SCs had the additional responsibility of leading teach-ers in developing and executing their adapta-tions. Adaptive READS SCs participated in monthly phone meetings with Leads and the research team to plan any upcoming working group meetings or implementation activities, and address questions as they arose. In Adaptive READS, teachers received a US$600 stipend and SCs received US$1,000; in Core READS, teach-ers received US$300 and SCs received US$600.

As discussed earlier, the effect of instructional management approaches on social capital out-comes may differ depending on an ego’s position in the organizational structure, given that differ-ent roles inspire different second-level outcomes. In READS, SCs play more of a management/supervisory role compared with the teachers; consequently, the effect of a fidelity-focused approach versus a structured adaptive approach

Page 9: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

204

on SCs’ network outcomes may differ from the effect on teachers’ network outcomes. It will therefore be important to examine whether the effects of the Adaptive condition differ for teach-ers versus SCs to determine whether any observed main effects mask variation in effects across intervention roles.

Setting, Design, and Participants

Twenty-seven high-poverty elementary schools in seven North Carolina school districts participated in READS over the 2014–2015 school year and summer of 2015. All participat-ing schools were recruited from a pool of schools that had participated in Core READS for at least 1 year prior. Schools with READS experience were recruited because their familiarity with the READS procedures would better enable Adaptive READS schools to make productive program adaptations. Although each participating school had experience implementing Core READS, the prior READS experience of participating teach-ers varied because in past years, students and teachers were randomly assigned to READS within schools.

Within districts, pairs (and one triad) of schools were matched based on school poverty level and performance on the state standardized test. Within each of these randomization blocs, one randomly selected school was assigned to Adaptive READS; the other schools were assigned to Core READS. All fourth-grade teach-ers at each participating school were required to implement their school’s version of READS. To preserve the exogeneity of treatment assignment, we only include in our models teachers who were in the schools at the time of randomization.

Measures

To answer our research questions about imme-diate effects, we administered a Web-based sur-vey to teachers and SCs in the spring of 2015 with questions about participants’ intervention experiences (including constructs not examined here; see Kim et al., 2017; Quinn & Kim, 2017). The survey included original items and items adapted from other researchers’ previously vali-dated surveys. In developing the survey, we went through several rounds of review with external

experts in the areas of social networks and survey development. We also piloted the items with teacher consultants prior to finalizing the survey. To answer our research questions about long-term effects, we administered a 1-year follow-up survey in the spring of 2016.

Network Ties (Intervention-Related and Inter-vention-Unrelated). We measured participants’ ties through survey questions based on a previ-ously validated teacher network survey (Pitts & Spillane, 2009), with some adaptations made to align the survey with recommendations from the network survey literature (de Lima, 2010a; Mars-den, 2011). Because our interest was in the effects of management approach on participating teachers’ ties and consultation behavior, we took an egocentric approach to network analysis.

Immediate effects. For our outcomes mea-sured immediately after the program period, we first surveyed teachers about their ego networks for consultation on instruction unre-lated to READS. For this survey item, teachers were shown a list of faculty from their school (including administrators, other school leaders such as literacy coaches, and teachers in Grades 2–5), along with their CIS READS Lead, and were asked to select the names of colleagues with whom they had consulted about teaching in general (unrelated to READS) over the past 2 months. They were told that the consulta-tion could have taken place in a group setting, one-on-one, in person, over the phone, or over email. Respondents were also provided with two blank text boxes in which they could enter the names of anyone not on the list (respondents were given the opportunity to indicate that they had not consulted with anyone over the past 2 months, but no respondent selected this choice). On a subsequent survey item, participants were shown the same roster and were told to select the names of people with whom they had con-sulted about READS over the past school year. Respondents were given the same list of pos-sible settings in which consultation could have taken place.

As discussed above, egos may be differen-tially motivated to contact alters holding differ-ent organizational positions. Past research shows that teachers are far more likely to have advice

Page 10: Experimental Effects of Program Management Approach on

Quinn and Kim

205

ties with other teachers in their grade level than with teachers outside of their grade level (Spillane et al., 2012). Grade-level teams are dense net-works (i.e., a relatively high proportion of poten-tial ties are realized), and the theory of weak ties discussed earlier suggests that alters outside of an ego’s primary network are particularly impor-tant for exposing egos to novel information, per-spectives, or advice. As such, we examine the effect of Adaptive READS on egos’ propensity to form ties with alters inside and outside the imme-diate school READS team, and in specific inter-vention roles (CIS Lead, SC).

Using the two survey items described above, we constructed the following intervention-related outcome variables: (a) “Num. READS Alters (Total),” the total number of intervention-related ties; (b) “Consult CIS Lead on READS,” a binary indicator for whether the respondent consulted with his or her CIS Lead about READS; (c) “Consult SC on READS,” a binary indicator for whether the respondent (teachers only) reported consulting with his or her SC about READS; (d) “Num. READS Alters from READS Team,” a count of the number of people from the respon-dent’s school READS team (other fourth-grade teachers, SC) with whom the respondent con-sulted about READS; and (e) “Num. Non-READS Team READS Alters,” a count of the number of people at the respondent’s school who were not on the school’s READS team with whom the respondent consulted about READS. We created an analogous set of outcome vari-ables related to consultation on instruction in general, unrelated to READS.

One-year follow-up effects. Our 1-year follow-up survey included the network ques-tion from the original survey, in which teachers were asked to select the names of colleagues with whom they had consulted about “teaching in general” over the past 2 months. From these survey questions, we created two variables simi-lar to those described above for the short-term survey: “Num. Alters (Total)” and “Consult CIS Lead.”

Frequency of Consultation for Various Con-tent. The structured adaptive approach to orga-nizing READS is hypothesized to affect not only the presence or absence of particular ties for

participants but also the frequency and content of participants’ consultations with their colleagues.

Immediate effects. For intervention-related consultation, we asked participants how often they had consulted with colleagues over the past 2 months about (a) how to implement READS as designed by researchers and (b) changes they are making to READS that will improve the pro-gram for their students. Answer choices for these questions included never, once or twice a month, about once a week, a couple times a week, and daily or almost daily, which were assigned val-ues of 1 to 5 before being standardized to a mean of 0 and SD of 1. We named these outcomes “Consult on READS Implementation” and “Con-sult on READS Adaptations.”

For intervention-unrelated consultation, we asked teachers how often they had consulted with colleagues over the past 2 months on the following topics: subject matter content knowl-edge, planning course content, instructional strat-egies, preparing students for the North Carolina state test, and classroom management. Answer choices for these questions were the same five frequency categories listed above. We conducted a principal components analysis (PCA) on these five items (α = .87), which yielded one factor with an eigenvalue above 1 (3.33), positively weighting all items and explaining 67% of total variation. We used these predicted component scores, standardized to a mean of 0 and SD of 1, as the “Freq. General Consult Index.”

One-year follow-up effects. On our 1-year follow-up survey, we asked participants two sets of questions about the frequency of particular types of consultation. Because teachers had not been involved with READS over the previous school year, we did not ask them about imple-menting or adapting READS (as in the original survey). However, using the same question for-mats as described above, we asked teachers how frequently they consulted with colleagues over the past 2 months about five literacy-related activities that READS was designed to impact (teaching students a reading comprehension rou-tine, matching books to students for independent reading, engaging students’ families in student literacy, supporting students’ independent read-ing, and increasing students’ engagement in

Page 11: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

206

reading). We used PCA to form these items (α = .87) into a “Freq. of Literacy Consultation” index, standardized to mean 0 and SD 1 (PCA yielded one factor with an eigenvalue above 1 at 3.32, positively weighting all items and explain-ing 66% of total variation). Second, we repeated the same procedures as described above to form a 1-year follow-up version of the “Freq. General Consult Index” (α = .85, one factor with eigen-value above 1 at 3.22, positively weighting all items and explaining 64% of total variation).

Analytic Plan

For each of the outcomes described above, we begin by fitting models of the form

Y ADAPTIVE SC

NumPeersis s i

s s is

= ++ + +

β ββ π1 2

3 RB , (1)

where Yis represents the relevant outcome for respondent i in school s, and εis is an error term assumed to be normally distributed. In this model, ADAPTIVE is a binary indicator for whether the respondent was in a school randomly assigned to the Adaptive READS condition (vs. the Core READS condition), SC is an indicator for whether the respondent is the SC, and RB is a vector of indicator variables representing ran-domization blocs. The meaning of the NumPeers variable differs depending on the outcome being analyzed. When the outcome is the number of READS team colleagues with whom the focal teacher consulted (about READS or non-READS), NumPeers represents the total number of peers on the teacher’s READS team; when the outcome is the total number of teachers outside the READS team with whom the teacher con-sulted, NumPeers represents the total number of teachers outside the READS team; NumPeers equals the sum of these when the outcome is the total number of colleagues with whom the teacher consulted or any of the remaining out-comes.2 In all models, we use school-level clus-ter-robust standard errors (with proper adjustments for finite group-level sample size).3 To test whether the effect of Adaptive READS differed for teachers and SCs, we fit additional models that add to Model 1 an interaction between SC and ADAPTIVE (interactions were

not included on follow-up analyses due to small cell sizes).

Results

Descriptive Statistics

In Table 1, we present descriptive statistics by condition for baseline characteristics (top panel) and for outcome variables (bottom panel). As seen, random assignment was successful in cre-ating groups of schools that were similar in terms of student percent free or reduced-price lunch and reading achievement. Teachers in both con-ditions were similar on years of experience and education. A higher proportion of teachers in the Adaptive condition had prior experience with READS, and Adaptive READS teachers were slightly more likely to be female compared with Core READS teachers. Importantly, the size of the READS teams tended to be slightly larger in the adaptive schools (5.3 members on average, compared with 4.46 in Core READS schools), making this variable a critical control variable for the outcomes measuring teachers’ number of ties (gender and prior READS experience were not significant outcome predictors and were not included in the models; key findings are robust to their inclusion).

All teachers submitted the first spring survey. On the 1-year follow-up, usable social network data were obtained from approximately 60% of teachers, and rates did not differ by condition.

RQ1: Immediate Effects on Teachers’ Intervention-Related Ties and Consultation (RQ1a), and Interaction Effects by Ego’s

Position in Intervention (RQ1b)

To address our RQ1a, we examined immedi-ate effects of the structured adaptive approach on teacher outcomes. In Table 2, we present models predicting intervention-related ties. As seen in column 1, Adaptive READS caused participants to expand their intervention networks, with those in Adaptive READS reporting having consulted with approximately .8 more people about READS, compared with Core READS partici-pants. In column 2, we see that the effect of Adaptive READS on participants’ READS ties was descriptively larger for teachers as compared with SCs (RQ1b; p < .10). For teachers, Adaptive

Page 12: Experimental Effects of Program Management Approach on

207

TABLE 1

Descriptive Statistics by Condition

Core READS Adaptive READSAdj. T-C

Diff p valueVariable M SD n M SD n

Background characteristics School-level variables School percent free or reduced-

price lunch84.61 10.39 14 85.81 6.5 13 1.38 .54

Average score on fourth-grade state reading test

441.72 3.08 14 442.08 3.18 13 0.12 .87

% of fourth graders scoring proficient or above on state reading test

41.84 14.61 14 43.66 13.34 13 0.79 .84

Teacher-level variables Number of years working in field

of education9.74 7.76 53 10.46 6.71 54 1.19 .14

Number of years teaching in current grade level (Grade 4)

4.41 4.96 54 4.08 4.03 53 −0.3 .52

Number of years working at current school

4.61 5.73 54 4.81 5.42 54 0.26 .65

Worked with READS before this school year? (1 = Y, 0 = N)

0.55 56 0.68 56 0.13 .05

Have, or working toward, master’s degree? (1 = Y, 0 = N)

0.54 54 0.56 54 0.02 .67

Female (1 = Y, 0 = N) 0.88 56 0.96 56 0.08 .05 Black (1 = Y, 0 = N) 0.2 54 0.31 54 0.12 .19 White (1 = Y, 0 = N) 0.67 54 0.57 54 −0.1 .23 Number on school READS team

(teachers and SC)4.46 0.81 56 5.3 1.37 56 0.82 .03

Num. Peers 20.61 4.39 56 23.61 5.6 56 2.67 .14Outcomes Immediate term Num. READS alters 4.04 1.64 56 5.14 2.05 56 1.07 <.01 Consult CIS READS Lead on

READS (1 = Y, 0 = N)0.25 0.44 56 0.38 0.49 56 0.14 .01

Consult SC on READS (1 = Y, 0 = N)

0.67 0.47 43 0.78 0.42 46 0.13 .13

Num. READS alters from READS team (teachers and SC only)

3.02 0.9 56 3.71 1.34 56 0.68 .02

Num. non-READS team READS alters

0.77 1.24 56 1.05 1.12 56 0.26 .21

Freq. consult on READS implementation (std.)

0.2 0.96 56 −0.23 0.94 56 −0.4 .05

Freq. consult on READS adaptations (std.)

−0.33 1.03 56 0.26 0.82 56 0.61 <.01

Num. non-READS alters 8.43 4.47 56 8.21 5.04 56 −0.14 .87 Consult CIS Lead on non-READS

(1 = Y, 0 = N)0.14 0.35 56 0.23 0.43 56 0.09 .07

(continued)

Page 13: Experimental Effects of Program Management Approach on

208

READS expanded the size of their READS net-work by 1.1 person, on average, while a post hoc test revealed that the effect of Adaptive READS was not significant for SCs (b = −.33, p = .61).

In the remaining columns of Table 2, we see that these overall effects on participants’ inter-vention-related ties mask variation in effects based on the role of the potential alter. Specifically, the overall effects are driven by Adaptive READS increasing the likelihood that teachers consulted with their CIS READS Lead (columns 3 and 4) and with other teachers out-side of their READS team (columns 8 and 9). Adaptive READS also may have made teachers more likely to consult with their SCs (p < .10, column 5).

In Table 3, we examine the immediate treat-ment effects on the frequency of teachers’ READS-related consultations. As expected, we find evidence that, compared with teachers in Core READS, teachers in Adaptive READS con-sulted less frequently with their peers about implementing READS with fidelity (–0.67 SD, column 2). However, the effect on this outcome for SCs differed (as demonstrated by the signifi-cant Adaptive × SC interaction term in column 2); for SCs, the effect was null and positively signed (1.255 – .667 = .58; p = .13).

As seen in column 3 of Table 3, Adaptive READS caused participants to more frequently consult with colleagues about adaptations to READS (0.58 SD). However, as seen in column 4, this effect was driven by SCs; while the effect for teachers was not significant (effect size [ES] = 0.38 SD), the effect for SCs was (1.37 SD; sub-group effects were significantly different from each other). The null effect of the Adaptive con-dition for teachers may be reflective of the time period inquired about; that is, it appears that teachers did not discuss adaptations after their formal READS meetings had ended.

RQ2: Immediate Effects on Intervention-Unrelated Ties and Consultation (RQ2a), and

Interaction Effects by Ego’s Position in the Intervention (RQ2b)

In Table 4, we present the results of models testing the effect of the structured adaptive approach to READS on participants’ ties in instructional areas unrelated to the intervention. We find that the structured adaptive approach had no significant overall effect on participants’ total number of non-READS consultation ties (column 1), and the effect did not differ by inter-vention role (column 2).

Core READS Adaptive READSAdj. T-C

Diff p valueVariable M SD n M SD n

Consult SC on non-READS (1 = Y, 0 = N)

0.51 0.51 43 0.46 0.5 46 −0.02 .86

Num. non-READS alters from READS team (teachers and SC only)

2.91 0.9 56 3.16 1.23 56 0.25 .4

Num. non-READS alters outside READS team

5.38 4.07 56 4.82 4.36 56 −0.47 .51

Freq. general consult index (std.) 0.1 0.98 56 −0.07 0.99 56 −0.14 .5 One-year follow-up Num. alters (total) 10.35 4.62 34 9.79 5.37 33 −0.34 .53 Consult CIS Lead (1 = Y, 0 = N) 0.03 0.17 34 0.08 0.28 37 0.06 .2 Freq. literacy consult index (std.) −0.04 0.97 34 0.17 0.95 35 0.26 .26 Freq. general consult index (std.) 0.03 1 34 0.22 0.75 37 0.15 .26 Num. Peers 20.88 5.26 34 22 5.71 37 1.18 .46

Note. Means and SD are unadjusted. Adj. T-C Diff = difference estimated from regression that controls for fixed effects of randomization blocs. The p value is for test of the null hypotheses that T-C = 0 (standard errors clustered at the school level). CIS = Communities in Schools; SC = school coordinator; freq = frequency; std = standardized.

TABLE 1 (CONTINUED)

Page 14: Experimental Effects of Program Management Approach on

209

TAB

LE

2

Imm

edia

te T

reat

men

t Eff

ects

on

RE

AD

S C

onsu

ltat

ion

Ties

(R

Q1a

and

RQ

1b)

(1)

(2)

(3)

(4)

(5)

(6)

(7)

(8)

(9)

N

um. R

EA

DS

al

ters

(to

tal)

Num

. RE

AD

S

alte

rs (

tota

l)C

onsu

lt C

IS L

ead

on R

EA

DS

Con

sult

CIS

L

ead

on R

EA

DS

Con

sult

SC

on

RE

AD

S

Num

. RE

AD

S

alte

rs f

rom

R

EA

DS

team

Num

. RE

AD

S

alte

rs f

rom

R

EA

DS

team

Num

. non

-R

EA

DS

team

R

EA

DS

alt

ers

Num

. non

-R

EA

DS

team

R

EA

DS

alt

ers

b/

SEb/

SEb/

SEb/

SEb/

SEb/

SEb/

SEb/

SEb/

SE

Ada

ptiv

e0.

807*

*1.

096*

**0.

149*

*0.

225*

0.17

5†0.

081

0.14

10.

355†

0.49

6*(0

.228

)(0

.267

)(0

.053

)(0

.091

)(0

.098

)(0

.079

)(0

.111

)(0

.192

)(0

.216

)S

C1.

584*

**2.

222*

**0.

226

0.39

3†0.

402†

0.53

0**

0.97

3***

1.28

5***

(0.3

62)

(0.3

32)

(0.1

52)

(0.1

95)

(0.2

05)

(0.1

79)

(0.2

16)

(0.3

14)

Num

. Pee

rs

(Spr

.)0.

136*

**0.

136*

**0.

001

0.00

1−

0.01

60.

758*

**0.

757*

**−

0.02

1−

0.02

1(0

.028

)(0

.027

)(0

.007

)(0

.007

)(0

.010

)(0

.029

)(0

.030

)(0

.019

)(0

.019

)A

dapt

ive

×

SC

−1.

423†

−0.

373

−0.

286

−0.

695

(0

.741

)(0

.300

)(0

.439

)(0

.449

)n

112

112

112

112

8911

211

211

211

2R

2.4

06.4

28.1

21.1

46.3

58.6

24.6

26.2

26.2

40

Not

e. S

tand

ard

erro

rs c

lust

ered

at

the

scho

ol l

evel

in

pare

nthe

ses.

All

mod

els

cont

rol

for

fixe

d ef

fect

s of

ran

dom

izat

ion

bloc

s. R

Q =

res

earc

h qu

esti

on;

CIS

= C

omm

unit

ies

in S

choo

ls;

SC

= s

choo

l co

ordi

nato

r; S

pr =

spr

ing.

Mod

el 5

doe

s no

t in

clud

e S

Cs.

For

eac

h m

odel

, Num

. Pee

rs r

epre

sent

s to

tal

poss

ible

num

ber

of p

eers

tha

t fo

cal

teac

her

coul

d ha

ve s

elec

ted

for

give

n ou

tcom

e; i

n M

odel

s 1

to 5

, Num

. Pee

rs =

tot

al n

umbe

r of

alt

ers

list

ed o

n su

rvey

.† p

< .1

0. *

p <

.05.

**p

< .0

1. *

**p

< .0

01.

Page 15: Experimental Effects of Program Management Approach on

210

This nonsignificant overall effect masks inter-esting variation in effects on different types of ties, however. Adaptive READS made teachers and SCs more likely to consult with their school’s CIS READS Lead on non-READS instructional matters (columns 3 and 4). This positive effect was counterbalanced by making teachers and SCs less likely to discuss non-READS matters with other members of their READS team (col-umns 6 and 7).

In Table 5, we examine the effect of structured adaptive management on the frequency with which participants consulted with their col-leagues about nonintervention instructional mat-ters. While Adaptive READS had no significant overall effect on the frequency with which par-ticipants consulted with colleagues on non-READS instructional matters (column 1), effects differed for teachers and SCs (column 2). The condition caused teachers to consult with col-leagues about general instructional matters sig-nificantly less often compared with Core READS teachers (−0.45 SD); for SCs, the effect was not significant (b = −.452 + .965 = .51, p = .24).

RQ3: 1-Year Follow-Up Effects

In Table 6, we present results from the 1-year follow-up survey. As seen, random assignment to the Adaptive condition in the previous school year had no effect on the total number of alters with whom participants consulted on instruc-tional matters (column 1) or the probability that a participant would consult with his or her former CIS Lead about instruction (column 2). The fol-low-up survey also showed no sustained effects on the frequency with which participants con-sulted with colleagues about literacy areas related to READS (column 3) or unrelated to READS (column 4).

Discussion

This study offers the first causal evidence on how the management structure of an educational intervention can affect teachers’ social capital, as measured by consultation ties and frequency of different types of consultation. Immediately fol-lowing the intervention, the collaborative, struc-tured adaptive approach increased teachers’

TABLE 3

Immediate Treatment Effects on Frequency of READS Consultation on Implementation and Adaptation (RQ1a and RQ1b)

(1) (2) (3) (4)

Freq. consult on READS

implementation (std.)

Freq. consult on READS

implementation (std.)

Freq. consult on READS

adaptations (std.)

Freq. consult on READS

adaptations (std.)

b/SE b/SE b/SE b/SE

Adaptive −0.412† −0.667** 0.579* 0.378(0.215) (0.213) (0.228) (0.234)

Sch. Coordinator

0.262 −0.300 0.188 −0.255(0.215) (0.234) (0.218) (0.265)

Num. Peers (Spr.)

0.009 0.009 0.015 0.015(0.022) (0.022) (0.020) (0.020)

Adaptive × SC

1.255** 0.989* (0.358) (0.365)

n 112 112 112 112R2 .148 .215 .221 .262

Note. Standard errors clustered at the school level in parentheses. All models control for fixed effects of randomiza-tion blocs. Outcomes are standardized versions of a metric that originally represented frequency categories ranging from 1 = never to 5 = daily or almost daily. Num. Peers = total number of alters on teacher’s network survey. RQ = research question; SC = school coordinator; freq = frequency; std = standardized; Spr = spring.† p < .10. *p < .05. **p < .01. ***p < .001.

Page 16: Experimental Effects of Program Management Approach on

211

TAB

LE

4

Imm

edia

te T

reat

men

t Eff

ects

on

Inst

ruct

iona

l (N

on-R

EA

DS)

Con

sult

atio

n Ti

es (

RQ

2a a

nd R

Q2b

)

(1)

(2)

(3)

(4)

(5)

(6)

(7)

(8)

(9)

Num

. non

-R

EA

DS

al

ters

(to

tal)

Num

. non

-R

EA

DS

al

ters

(to

tal)

Con

sult

CIS

L

ead

on n

on-

RE

AD

S

Con

sult

CIS

L

ead

on n

on-

RE

AD

S

Con

sult

SC

on

non

-R

EA

DS

Num

. non

-RE

AD

S

alte

rs f

rom

R

EA

DS

team

Num

. non

-RE

AD

S

alte

rs f

rom

RE

AD

S

team

Num

. non

-RE

AD

S

alte

rs o

utsi

de

RE

AD

S te

am

Num

. non

-RE

AD

S

alte

rs o

utsi

de

RE

AD

S te

am

b/

SEb/

SEb/

SEb/

SEb/

SEb/

SEb/

SEb/

SEb/

SE

Ada

ptiv

e−

0.71

6−

0.77

00.

115*

*0.

114*

−0.

004

−0.

348*

−0.

348*

−0.

636

−0.

696

(0.6

31)

(0.6

03)

(0.0

40)

(0.0

54)

(0.0

96)

(0.1

50)

(0.1

44)

(0.5

63)

(0.5

89)

SC

5.76

5***

5.64

6**

0.32

3*0.

321*

0.05

40.

053

5.40

2***

5.26

9**

(1.3

92)

(1.6

21)

(0.1

19)

(0.1

46)

(0.2

33)

(0.2

96)

(1.2

53)

(1.4

96)

Num

. Pee

rs

(Spr

.)0.

348*

*0.

348*

*−

0.00

3−

0.00

3−

0.00

50.

726*

**0.

726*

**0.

266*

0.26

6*(0

.099

)(0

.100

)(0

.006

)(0

.006

)(0

.010

)(0

.059

)(0

.058

)(0

.112

)(0

.112

)A

dapt

ive

×

SC

0.26

40.

005

0.00

30.

296

(2

.773

)(0

.251

)(0

.488

)(2

.447

)n

112

112

112

112

8911

211

211

211

2R

2.4

32.4

32.2

49.2

49.5

83.5

33.5

33.4

14.4

14

Not

e. S

tand

ard

erro

rs c

lust

ered

at

the

scho

ol l

evel

in

pare

nthe

ses.

All

mod

els

cont

rol

for

fixe

d ef

fect

s of

ran

dom

izat

ion

bloc

s. R

Q =

res

earc

h qu

esti

on;

CIS

= C

omm

unit

ies

in S

choo

ls;

SC

= s

choo

l co

ordi

nato

r; S

pr =

spr

ing.

Mod

el 5

doe

s no

t in

clud

e S

Cs.

For

eac

h m

odel

, Num

. Pee

rs r

epre

sent

s to

tal

poss

ible

num

ber

of p

eers

tha

t fo

cal

teac

her

coul

d ha

ve s

elec

ted

for

give

n ou

tcom

e; i

n M

odel

s 1

to 5

, Num

. Pee

rs =

tot

al n

umbe

r of

alt

ers

list

ed o

n su

rvey

.† p

< .1

0. *

p <

.05.

**p

< .0

1. *

**p

< .0

01.

Page 17: Experimental Effects of Program Management Approach on

212

accessing of social capital related to the interven-tion, but decreased their accessing of social capi-tal unrelated to the intervention. Furthermore, the organizational positions of participants influ-enced whether they sought consultation and whether they were sought for consultation. However, 1 year after the intervention, we found no lasting effect on our social capital indicators.

Immediate Intervention-Related Outcomes (RQ1a and RQ1b)

Effects on Ties. By charging participants with a complex task (i.e., to adapt the researcher-designed program) and providing a collaborative support structure for participants as they engaged with that task, Adaptive READS caused partici-pants to increase the size of their READS-related

egocentric networks. Furthermore, this effect was driven by teachers, who differed from SCs in that they were directly responsible for develop-ing the adaptations, compared with SCs who were expected to play more of a supervisory role. The increase in network size came not because Adaptive READS teachers were more likely (compared with Core READS teachers) to con-sult with their grade-level team about READS, but because Adaptive READS teachers were more likely to consult with colleagues outside of their grade-level team, as well as the CIS Lead (and possibly the SC). Interpreting this result in light of the decision-making perspective, this suggests that charging people with an open-ended, complex, nonroutine task provides a stronger Level 2 incentive for an ego to consult with a greater number of alters. The reason why teachers experienced larger effects compared with SCs may be because teachers’ roles in the intervention induced more perceived value at Level 2 in contacting alters for consultation.

The decision-making perspective can also help us understand the simultaneous null effect on egos’ ties with READS team alters and positive effect on egos’ ties with colleagues outside of the READS team. Faced with a more complex chal-lenge, Adaptive READS teachers have motiva-tion to expand their advice networks to include alters from whom they are more likely to get a fresh perspective; that is, they are more likely to access consultation through a weak tie. For exam-ple, teachers in the Adaptive READS condition may be interested in making adaptations to RFN that will encourage higher attendance rates or will more effectively invest families in the program. Seeking advice from school personnel outside of the READS team would be a way of injecting novel ideas into such planning. In addition, weak ties are more effective for transferring simple—rather than complex—knowledge (Hansen, 1999), making weak extra-grade-level ties well-suited to exchanging simple planning strategies. For more complex knowledge-sharing, Adaptive READS teachers may have looked more toward their fellow READS team members with whom they held stronger ties. Finally, some teachers from outside of the fourth-grade team had experi-ence implementing READS in previous years of the experiment, and the more complex work of Adaptive READS may have incentivized teach-ers to seek out these colleagues. In contrast, the

TABLE 5

Immediate Treatment Effects on Frequency of Instructional (Non-READS) Consultation (RQ2a and RQ2b)

(1) (2)

Freq. general consult index

(std.)

Freq. general consult index

(std.)

b/SE b/SE

Adaptive −0.256 −0.452*(0.176) (0.179)

Sch. Coordinator −0.186 −0.618*(0.233) (0.279)

Num. Peers (Spr.) 0.040** 0.040**(0.014) (0.014)

Adaptive × SC 0.965* (0.454)

n 112 112R2 .145 .183

Note. Standard errors clustered at the school level in parentheses. All models control for fixed effects of randomization blocs. Outcome is a standardized prin-cipal components analysis–derived index comprised of survey items on the frequency with which participants consulted with colleagues about subject matter content knowledge, planning course material, instructional strate-gies, classroom management, and preparing students for the state test (1 = never, 5 = daily or almost daily). Num. Peers = total number of alters on teacher’s network survey. RQ = research question; SC = school coordinator; freq = frequency; std = standardized; Spr = spring.† p < .10. *p < .05. **p < .01. ***p < .001.

Page 18: Experimental Effects of Program Management Approach on

213

Core READS teachers have the more straightfor-ward task of implementing the prescribed pro-gram procedures, which induces less perceived value in contacting alters from outside the current READS team.

Consultation Content and Frequency. Given the differing second-level outcomes across con-ditions, it is also not surprising that Core READS would cause participants to more fre-quently consult with colleagues about imple-menting READS as designed by researchers while Adaptive READS would cause partici-pants to more frequently consult with colleagues about adaptations to the program. But why would the effect of Adaptive READS on fre-quency of implementation consultation be nega-tive for teachers while SCs experienced a significantly different and positively signed but null effect? The answer likely lies in the differ-ent roles that teachers and SCs play in READS. In both versions of the program, SCs are respon-sible for managing the school’s READS team as they execute their version of the program.

Despite the fact that Adaptive READS teachers are expected to adapt the intervention, the struc-tures through which schools develop adapta-tions—that is, the working group meetings and online modules—were not subject to adapta-tion. Given that Adaptive READS SCs managed this overall process, they had more reason to seek advice on implementation than did teach-ers in Adaptive READS (note, however, that Adaptive READS SCs also consulted with col-leagues about adaptations).

Immediate Intervention-Unrelated Outcomes (RQ2a and RQ2b)

The decision-making perspective also helps make sense of the observed short-term effects on nonintervention instructional ties and consulta-tion. If Adaptive READS increased the perceived value of contacting alters for READS-related con-sultation, the flip side to this would be an increase in the perceived cost of contacting alters for consultation unrelated to READS. In principle, participants could have reallocated time and

TABLE 6

One-Year Follow-Up Treatment Effects on Instructional (Non-READS) Consultation Ties, Literacy Consultation Frequency, and General Instructional Consultation Frequency (RQ3a and RQ3b)

(1) (2) (3) (4)

Num. alters

(Total)Consult

CIS LeadFreq. consult on

literacy (std.)Freq. general consult

index (std.)

b/SE b/SE b/SE b/SE

Adaptive −0.113 0.069 0.280 0.124(0.640) (0.050) (0.235) (0.153)

Num. Peers 0.094 0.002 −0.042† 0.009(0.083) (0.003) (0.024) (0.022)

Sch. Coordinator

2.836* 0.113 −0.319 −0.259(1.023) (0.086) (0.389) (0.368)

n 67 71 69 71R2 .492 .342 .218 .187

Note. Standard errors clustered at the school level in parentheses. All models control for fixed effects of randomization blocs. Freq. consult on literacy (std.) = standardized PCA-derived index comprised of survey items on the frequency with which partici-pants consulted with colleagues about various matters related to literacy. Freq. consult overall (std.) = standardized PCA-derived index comprised of survey items on the frequency with which participants consulted with colleagues about subject matter content knowledge, planning course material, instructional strategies, classroom management, and preparing students for the state test (1 = never, 5 = daily or almost daily). Num. Peers = total number of alters on teacher’s network survey. RQ = research question; CIS = Communities in Schools; PCA = principal components analysis; freq = frequency; std = standardized.†p < .10. *p < .05. **p < .01. ***p < .001.

Page 19: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

214

resources from any number of other activities toward their increase in READS-related network activities. In practice, however, participants may have decided to decrease their consultation on non-READS-related matters because time and opportunity for teachers to consult with colleagues are limited to common prep periods or before or after school. If teachers are using these opportuni-ties to consult on READS-related matters, they have less opportunity to consult on other instruc-tional matters. These results suggest that teachers may have some limit—either psychologically or in terms of actual available time—to how many ties they can keep active over any given period of time, or to the number of topics about which they can consult with some fixed number of alters over a given period of time. Follow-up analyses pro-vide supporting evidence of this notion: Adaptive READS had no effect on teachers’ total number of unique ties (related or unrelated to READS; see Appendix B, available in the online version of the article).

One-Year Follow-Up Effects (RQ3)

One year after the intervention ended, no last-ing effects of intervention management approach were found on the size of participants’ (interven-tion-unrelated) instructional networks, or on the probability that participants would consult with their former CIS Lead. Although this may not be surprising given that management approach did not affect the overall size of participants’ inter-vention-unrelated networks even in the short term (Table 4, columns 1 and 2), it provides evi-dence that the intervention-related network ties formed in the short term did not morph into inter-vention-unrelated ties after the intervention’s conclusion. One possibility is that the structures in Adaptive READS did not produce ties of the sort that have been found in previous research to be durable over time—namely, ties that are strong, central to one’s network, and contacted frequently (Lubbers et al., 2010). Doing so may require a longer intervention duration or struc-tures specifically designed to generate interven-tion-unrelated ties. However, the lack of long-term effects may also be related to the fact that we surveyed participants specifically about their instructional consultation (professional ties), as opposed to surveying them about their

relations (e.g., closest colleagues). Frequent exchanges can lead to emotional closeness, whereby a tie becomes a relation that is valued in and of itself (Lawler & Yoon, 1996, 1998). If teachers’ more frequent instructional consulta-tion with one another under Adaptive READS led them to develop relations that continued beyond the intervention, but with more personal (rather than professional) content, our survey would not have detected this.

The 1-year follow-up also showed that man-agement approach did not, in the long term, affect the frequency with which participants con-sulted with colleagues about literacy areas related to the intervention or instructional matters out-side of those areas. Considering that the struc-tured adaptive approach caused short-term decreases in the frequency with which teachers consulted about intervention-unrelated instruc-tional matters, this second finding is reassuring. It suggests that we perhaps need not worry that introducing a temporary structure that redirects teachers’ attention to accessing social capital for some specific purpose will have negative long-term consequences for participants’ social capital in other areas.

Implications for Policy and Practice

We began this article by arguing that the for-mation of teachers’ consultation ties, and their frequencies of consultation about instructional matters, are important to understand because ties are prerequisite for the flow of social capital—including the transmission of information and innovation—and affect teacher learning, teacher morale, and the extent to which reform efforts take hold (Atteberry & Bryk, 2010; Daly et al., 2010; Johnson, 2004; Parise & Spillane, 2010). From the perspective of school or district leaders, then, teacher ties are not likely to be seen as ends in and of themselves but rather as potential facili-tators of processes that ultimately lead to higher student achievement. As such, the findings in this study will be most useful when used alongside evidence about the circumstances under which social capital exchange leads to meaningful teacher learning and instructional improvement.

The contribution of this study lies in its illu-mination of the effects on the channels through which social capital flows—to whom, from

Page 20: Experimental Effects of Program Management Approach on

Quinn and Kim

215

whom, and under what management approaches. We leave it to practitioners to decide how this evidence is informative to their context and their goals. For example, if—as suggested by our findings—network ties and consultation are zero-sum matters, this has implications for schools’ decisions to adopt particular interven-tions or PD experiences. Careful thought should be given to the endeavors around which schools decide to build social capital to ensure the social capital is built to support the activities that will yield the most benefit to students in a particular context. Some school or district lead-ers may prioritize building teachers’ social cap-ital around a particular instructional reform, and may not mind that consultation related to this reform may displace consultation on other instructional matters. Relatedly, different les-sons may be taken from this evidence by lead-ers who are afraid that increasing teacher ties will only further entrench an existing toxic cul-ture, compared with leaders who witness indi-vidual teachers making positive innovations should spread across classrooms.

Limitations and Future Research

As described above, Adaptive READS teach-ers received a slightly larger stipend compared with Core READS teachers, given the greater time investment required of them. Consequently, we cannot rule out the possibility that the net-work effects observed here were due in part to compensation differences (though we have no reason to believe it to be the case). Relatedly, we should acknowledge that the greater time invest-ment required of adaptive teachers must be con-sidered part of the intervention in this case. That is, the adaptive treatment is the combination of the charge to adapt the program, the training, and the additional collaborative time and structures given to teachers to develop their adaptations. Effects may have been different, for example, if we had compared the structured adaptive man-agement strategy with a third type of instruc-tional management strategy in which teachers worked collaboratively to support one another toward faithful implementation of READS.

As discussed earlier, ties are necessary, but not sufficient, for the formation of social capital. Similarly, not all consultation yields learning or

increased productivity. In this study, we do not have measures of the quality of participants’ con-sultation or of the extent to which ties facilitated the flow of productive social capital. While the negative effect of the structured adaptive approach on the frequency of intervention-unre-lated consultation (and on the number of non-READS ties outside of the READS team) could be a sign that less productive consultation was replaced by more productive consultation, it is also possible that this shift had no effect, or even a negative effect, on the quality and productivity of social capital exchanged among educators. Further research is needed on the conditions under which these types of effects on ties and flows affect teacher learning, instruction, and ultimately, student learning.

Given that high-poverty schools were pur-posely selected for this study, we cannot know the extent to which these findings might general-ize to other types of schools. High poverty schools are more likely to experience account-ability pressures, and accountability pressures may cause teachers to seek advice from higher, rather than lower, value-added colleagues (Wilhelm et al., 2016). The extent to which these forces might interact with different instructional management approaches in affecting teacher net-work outcomes is unknown.

Further study is also needed to understand the extent to which instructional management approaches and baseline school context influ-ence the productivity of these tie effects and social capital flows. For example, it may be that for school contexts in which teachers are inexperienced or ineffective, an increase in social capital servicing a structured adaptive approach to instructional management would be less effective than an increase in social cap-ital servicing a fidelity-focused approach that aims to improve the adherence to a research-based instructional program (Rowan, 1990). Similarly, critics of “contrived collaboration” (Hargreaves, 1991) have argued that increas-ing collaboration in schools in which teachers lack shared trust or high standards may actu-ally be detrimental and result in a downward leveling of norms (de Lima, 2010b; Portes, 1998). These are important questions for future research that are beyond the scope of the present study.

Page 21: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

216

Conclusion

To our knowledge, this is the first experi-mental study exploring how instructional man-agement approaches to educational interventions affect teachers’ social ties and the flow of social capital through those ties. The results suggest a complicated system of causes and effects, in which the short-term effects of instructional management approaches differ depending on the organizational position of the ego, the orga-nizational position of the alter, and whether it is intervention-related or intervention-unrelated social capital that is of interest. These patterns offer evidence about how educational interven-tions affect the channels through which social ties and social capital can improve educational outcomes. This is an important step in the direction of being able to anticipate interven-tions’ effects on schools’ networks and social capital, and to harness social ties in service of instructional improvement. At the same time, these results call attention to questions about the conditions under which short-term effects on social capital might be sustained over the long term, and under which effects on these first-level network outcomes might enable schools to better accomplish their second-level outcomes of improving student learning outcomes.

Authors’ Note

The contents of this article do not represent the policy of the U.S. Department of Education and are solely the responsibility of the authors. Any errors or omissions are the responsibility of the authors.

Acknowledgments

We are grateful to Heather Hill and Ebony Bridwell-Mitchell for feedback on earlier drafts, and to Andrew Volkert and Margaret Troyer for research assistance. Helen Chen Kingston, Mary Burkhauser, and Kirsten Aleman contributed to the design of Adaptive READS. Communities in Schools–North Carolina were crucial to implementation efforts.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of inter-est with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was made possible by an Investing in Innovation Fund (i3) Grant from the U.S. Department of Education (PR/Award No. U396B100195). David Quinn received support from the Dean’s Summer Fellowship at the Harvard Graduate School of Education.

Notes

1. Nebus (2006) used the term “advice” and the term “consult” to describe the seeking of advice. Many social network surveys query respondents about whom they turn to for “advice” (e.g., Pitts & Spillane, 2009). As described in the “Method” section, we asked respondents to identify colleagues with whom they had “consulted.” We chose this term so as to include in-depth exchanges (Coburn & Russell, 2008) as opposed to only the transfer of discrete pieces of “advice.”

2. Results for the count outcomes were largely robust to using Poisson regression (see Appendix A, available in the online version of the article); we pres-ent count outcome analyses using linear models for ease of interpretation (residual plots suggest that linear models provide a reasonable summary of the data).

3. A challenge in many social network analyses is that individuals’ tie outcomes are not independent of one another, and complex modeling strategies have been developed to address this concern. In the current study, such complex modeling is not neces-sary given that the inference of interest regards a randomized treatment, and outcome dependencies are constrained within schools. As such, school-level cluster-robust standard errors are sufficient to account for dependencies.

References

Atteberry, A., & Bryk, A. S. (2010). Centrality, con-nection, and commitment: The role of social net-works in school-based literacy. In A. J. Daley (Ed.), Social network theory and educational change (pp. 51–76). Cambridge, MA: Harvard Education Press.

Borgatti, S. P., & Lopez-Kidwell, V. (2011). Network theory. In J. Scott & P. J. Carrington (Ed.), The SAGE handbook of social network analysis (pp. 40–54). London, England: SAGE.

Bryk, A. S., & Schneider, B. (2002). Trust in schools. New York, NY: Russell Sage Foundation.

Choo, C. W. (1998). The knowing organization: How organizations use information to construct mean-ing, create knowledge, and make decisions. New York, NY: Oxford University Press.

Page 22: Experimental Effects of Program Management Approach on

Quinn and Kim

217

Coburn, C. E. (2001). Collective sensemaking about reading: How teachers mediate reading policy in their professional communities. Educational Evaluation and Policy Analysis, 23, 145–170.

Coburn, C. E., Mata, W. S., & Choi, L. (2013). The embeddedness of teachers’ social networks: Evidence from a study of mathematics reform. Sociology of Education, 86, 311–342.

Coburn, C. E., & Russell, J. L. (2008). District pol-icy and teachers’ social networks. Educational Evaluation and Policy Analysis, 30, 203–235.

Coburn, C. E., Russell, J. L., Kaufman, J. H., & Stein, M. K. (2012). Supporting sustainability: Teachers’ advice networks and ambitious instructional reform. American Journal of Education, 119, 137–182.

Coleman, J. S. (1988). Social capital in the creation of human capital. American Journal of Sociology, 94, S95–S120.

Cross, R., & Sproull, L. (2004). More than an answer: Information relationships for actionable knowl-edge. Organization Science, 15, 446–462.

Daly, A. J., & Finnigan, K. S. (2010). A bridge between worlds: Understanding network structure to under-stand change strategy. Journal of Educational Change, 11, 111–138.

Daly, A. J., Moolenaar, N. M., Bolivar, J. M., & Burke, P. (2010). Relationships in reform: The role of teachers’ social networks. Journal of Educational Administration, 48, 359–391. doi:10.1108/09578231011041062

de Lima, J. A. (2010a). Studies of networks in educa-tion: Methods for collecting and managing high-quality data. In A. J. Daly (Ed.), Social network theory and educational change (pp. 243–258). Cambridge, MA: Harvard Education Press.

de Lima, J. A. (2010b). Thinking more deeply about networks in education. Journal of Educational Change, 11, 1–21. doi:10.1007/s10833-008-9099-1

Elmore, R. F. (1996). Getting to scale with good edu-cational practice. Harvard Educational Review, 66, 1–26.

Frank, K. A., Zhao, Y., & Borman, K. (2004). Social capital and the diffusion of innovations within organizations: The case of computer technology in schools. Sociology of Education, 77, 148–171.

Granovetter, M. S. (1973). The strength of weak ties. American Journal of Sociology, 78, 1360–1380.

Hansen, M. T. (1999). The search-transfer problem: The role of weak ties in sharing knowledge across organizational subunits. Administrative Science Quarterly, 44, 82–111.

Hargreaves, A. (1991). Contrived collegiality: The micropolitics of teacher collaboration. In J. Blase (Ed.), The politics of life in schools: Power,

conflict, and cooperation (pp. 46–72). London, England: SAGE.

Hawley, W. D., & Valli, L. (1999). The essentials of effective professional development: A new consen-sus. In L. Darling-Hammond & G. Sykes (Eds.), The heart of the matter: Teaching as the learn-ing profession (pp. 127–150). San Francisco, CA: Jossey-Bass.

Hill, H. C. (2004). Professional development standards and practices in elementary school mathematics. Elementary School Journal, 104, 215–231.

Jackson, C. K., & Bruegmann, E. (2009). Teaching students and teaching each other: The importance of peer learning for teachers. American Economic Journal: Applied Economics, 1, 85–108.

Johnson, S. M. (2004). Finders and keepers: Helping new teachers survive and thrive in our schools. San Francisco, CA: Jossey-Bass.

Kim, J. S., Burkhauser, M. A., Quinn, D. M., Guryan, J., Kingston, H. C., & Alemean, K. (2017). Effectiveness of structured teacher adaptations to an evidence-based summer literacy program. Reading Research Quarterly, 52, 443–467. doi:10.1002/rrq.178

Kim, J. S., Guryan, J., White, T., Quinn, D. M., Capotosto, L., & Kingston, H. C. (2016). The delayed effects of a low-cost and large-scale sum-mer reading intervention on elementary school children’s reading comprehension. Journal of Research on Educational Effectiveness, 9(Suppl. 1), 1–22. doi:10.1080/19345747.2016.1164780

Kossinets, G., & Watts, D. J. (2006). Empirical analy-sis of an evolving social network. Science, 311, 88–90. doi:10.1126/science.1116869

Lawler, E. J., & Yoon, J. (1996). Commitment in exchange relations: Test of a theory of relational cohesion. American Sociological Review, 61, 89–108.

Lawler, E. J., & Yoon, J. (1998). Network structure and emotion in exchange relations. American Sociological Review, 63, 871–894.

Lortie, D. C. (1975). Schoolteacher. Chicago, IL: The University of Chicago Press.

Lubbers, M. J., Molina, J. L., Lerner, J., Brandes, U., Avila, J., & McCarty, C. (2010). Longitudinal anal-ysis of personal networks: The case of Argentinean migrants in Spain. Social Networks, 32, 91–104. doi:10.1016/j.socnet.2009.05.001

Marsden, P. V. (2011). Survey methods for network data. In J. Scott & P. J. Carrington (Eds.), The SAGE handbook of social network analysis (pp. 370–388). London, England: SAGE.

McDonald, S., Keesler, V. A., Kauffman, N. J., & Schneider, B. (2006). Scaling-up exemplary inter-ventions. Educational Researcher, 35(3), 15–24.

Page 23: Experimental Effects of Program Management Approach on

Teachers’ Ties and Social Capital

218

Nebus, J. (2006). Building collegial information net-works: A theory of advice network generation. The Academy of Management Review, 31, 615–637.

Parise, L. M., & Spillane, J. P. (2010). Teacher learn-ing and instructional change: How formal and on-the-job learning opportunities predict change in elementary school teachers’ practice. The Elementary School Journal, 110, 323–346.

Penuel, W. R., Gallagher, L. P., & Moorthy, S. (2011). Preparing teachers to design sequences of instruc-tion in earth systems science: A comparison of three professional development systems. American Educational Research Journal, 48, 996–1025. doi:10.3102/0002831211410864

Pitts, V. M., & Spillane, J. P. (2009). Using social network methods to study school leadership. International Journal of Research & Method in Education, 32, 185–207. doi:10.1080/17437270902946660

Portes, A. (1998). Social capital: Its origins and appli-cations in modern sociology. Annual Review of Sociology, 24, 1–24.

Quinn, D. M., & Kim, J. S. (2017). Scaffolding fidelity and adaptation in educational program implementation: Experimental evidence from a literacy intervention. American Educational Research Journal. Advance online publication. doi:10.3102/0002831217717692

Rowan, B. (1990). Commitment and control: Alternative strategies for the organizational design of schools. Review of Research in Education, 16, 353–389.

Rowan, B., & Miller, R. J. (2007). Organizational structures for promoting instructional change: Implementation dynamics in schools working with comprehensive school reform providers. American Educational Research Journal, 44, 252– 297.

Spillane, J. P., Hopkins, M., & Sweet, T. M. (2014). Intra- and inter-school interactions about instruc-tion: Exploring the conditions for social capital development. American Journal of Education, 122, 71–110. doi:10.1086/683292

Spillane, J. P., Kim, C. M., & Frank, K. A. (2012). Instructional advice and information provid-ing and receiving behavior in elementary schools: Exploring tie formation as a building block in social capital development. American Educational Research Journal, 49, 1112–1145. doi:10.3102/0002831212459339

Spillane, J. P., & Shirrell, M. (2017). Breaking up isn’t hard to do: Exploring the dissolution of teachers’ and school leaders’ work-related ties. Educational

Administration Quarterly, 53, 616–648. DOI: 0013161X17696557

Sun, M., Loeb, S., & Grissom, J. (2017). Building teacher teams: Evidence of positive spillovers from more effective colleagues. Educational Evaluation and Policy Analysis, 39, 104–129. doi:10.3102/0162373716665698

Sun, M., Penuel, W. R., Frank, K. A., Gallagher, H. A., & Youngs, P. (2013). Shaping professional devel-opment to promote the diffusion of instructional expertise among teachers. Educational Evaluation and Policy Analysis, 35, 344–369.

Sun, M., Wilhelm, A. G., Larson, C. J., & Frank, K. A. (2014). Exploring colleagues’ professional influ-ence on mathematics teachers’ learning. Teachers College Record, 116(6), 1–30.

Uzzi, B. (1997). Social structure and competition in interfirm networks: The paradox of embed-dedness. Administrative Science Quarterly, 42, 35–67.

Weinbaum, E. H., Cole, R. P., Weiss, M. J., & Supovitz, J. A. (2008). Going with the flow: Communication and reform in high schools. In J. A. Supovitz & E. H. Weinbaum (Eds.), The implementation gap: Understanding reform in high schools (pp. 68–102). New York, NY: Teachers College Press.

Wilhelm, A. G., Chen, I. C., Smith, T. M., & Frank, K. A. (2016). Selecting expertise in context: Middle school mathematics teachers’ selection of new sources of instructional advice. American Educational Research Journal, 53, 456–491.

Authors

DAVID M. QUINN is an assistant professor of educa-tion at the Rossier School of Education, University of Southern California. His research focuses on measur-ing and explaining inequalities in educational out-comes by race/ethnicity and socioeconomic status; he is particularly interested in the role that teacher- and school-focused policies and programs can play in clos-ing achievement gaps and improving student outcomes.

JAMES S. KIM is a professor at Harvard University. His research examines the effectiveness of literacy reforms and interventions in improving student outcomes.

Manuscript received July 19, 2017Revision received September 28, 2017

Accepted October 23, 2017