14
The timing of online lecture slide availability and its effect on attendance, participation, and exam performance Kimberley A. Babb * , Craig Ross Department of Psychology, University of Windsor, 401 Sunset Ave., Windsor, Ontario, Canada N9B 3P4 article info Article history: Received 1 March 2008 Received in revised form 2 December 2008 Accepted 14 December 2008 Keywords: Improving classroom teaching Teaching/learning strategies Post-secondary education Pedagogical issues abstract The use of PowerPoint slides has become an almost ubiquitous practice in university classrooms, how- ever little research has examined whether the timing of lecture slide availability to students (either before or after lecture) affects classroom behaviour or exam performance. Using a 2 (slide availability condition) Â 2 (course type) between-subjects design, the present study examined lecture slide availabil- ity differences in attendance, participation, and exam performance in two courses – Research Methods and Cognitive Development – taught in both the Fall and Winter semesters. For each type of course, lec- ture slides were made available on the course website before lecture in one semester and after lecture in the other semester. Course material was held constant across semesters. Results showed that mean attendance was higher when slides were available before lecture, but only for the type of course that did not include attendance points as part of students’ final grades. For students who participated in class, participation was more frequent when slides were available before lecture. No significant difference in exam performance was found between lecture slide availability conditions, however. These findings sug- gest that making lecture slides available to students before lecture may lead to better overall attendance and participation, but exam performance is determined by more than just whether or not students have lecture slides available for their note-taking. Ó 2009 Elsevier Ltd. All rights reserved. 1. Introduction In recent years, more professors have been making use of computer-based presentation tools, such as PowerPoint (Microsoft Corpora- tion, 1998), to facilitate student note-taking and to increase student learning (Apperson, Laws, & Scepansky, 2006). Students often express a preference for PowerPoint presentations over traditional chalkboard lectures, and they have been shown to rate the course and the pro- fessor in a more favorable light when PowerPoint slides are used (Apperson et al., 2006). Students also have reported that being able to download lecture slides prior to class helps them focus on and comprehend lecture material, and this helps them study for exams (Austin, Lee, Thibeault, Carr, & Bailey, 2002; Frey & Birnbaum, 2002; Murphy & Cross, 2002; Pardini, Domizi, Forbes, & Pettis, 2005). Many students have come to expect that if PowerPoint slides are used in class, they will have online access to these slides. Although this is becoming a more common practice, some professors do not offer access to slides at all. Those who do offer online access sometimes choose to provide them before class so that students can use them as a guide for note-taking, and some prefer to offer them after class so that they are used as a supplement, but not a substitute, for students’ own note-taking. This can sometimes create conflict between stu- dents and professors because students may perceive that withholding lecture slides until after lecture is a disadvantage to their note-tak- ing. Therefore, there is a need for empirical research on providing online lecture slides to students either before or after class sessions in order to inform professors how slide availability affects student learning and classroom behaviour. The purpose of this study is to examine the timing of slide availability and how it affects students’ attendance, class participation, and exam performance. 1.1. Attendance Class attendance is an important consideration when making the decision to provide lecture slides to students. Some professors may be concerned that if slides are made available to students, they will use them as a substitute for attending class. Teaching to a relatively empty classroom can be disheartening to a professor who has spent numerous hours preparing his or her lectures and activities, and it can create 0360-1315/$ - see front matter Ó 2009 Elsevier Ltd. All rights reserved. doi:10.1016/j.compedu.2008.12.009 * Corresponding author. Tel.: +1 (519) 253 3000x2221; fax: +1 (519) 973 7021. E-mail address: [email protected] (K.A. Babb). Computers & Education 52 (2009) 868–881 Contents lists available at ScienceDirect Computers & Education journal homepage: www.elsevier.com/locate/compedu

The timing of online lecture slide availability and its

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Computers & Education 52 (2009) 868–881

Contents lists available at ScienceDirect

Computers & Education

journal homepage: www.elsevier .com/ locate/compedu

The timing of online lecture slide availability and its effect on attendance,participation, and exam performance

Kimberley A. Babb *, Craig RossDepartment of Psychology, University of Windsor, 401 Sunset Ave., Windsor, Ontario, Canada N9B 3P4

a r t i c l e i n f o a b s t r a c t

Article history:Received 1 March 2008Received in revised form 2 December 2008Accepted 14 December 2008

Keywords:Improving classroom teachingTeaching/learning strategiesPost-secondary educationPedagogical issues

0360-1315/$ - see front matter � 2009 Elsevier Ltd. Adoi:10.1016/j.compedu.2008.12.009

* Corresponding author. Tel.: +1 (519) 253 3000x22E-mail address: [email protected] (K.A. Babb).

The use of PowerPoint slides has become an almost ubiquitous practice in university classrooms, how-ever little research has examined whether the timing of lecture slide availability to students (eitherbefore or after lecture) affects classroom behaviour or exam performance. Using a 2 (slide availabilitycondition) � 2 (course type) between-subjects design, the present study examined lecture slide availabil-ity differences in attendance, participation, and exam performance in two courses – Research Methodsand Cognitive Development – taught in both the Fall and Winter semesters. For each type of course, lec-ture slides were made available on the course website before lecture in one semester and after lecture inthe other semester. Course material was held constant across semesters. Results showed that meanattendance was higher when slides were available before lecture, but only for the type of course thatdid not include attendance points as part of students’ final grades. For students who participated in class,participation was more frequent when slides were available before lecture. No significant difference inexam performance was found between lecture slide availability conditions, however. These findings sug-gest that making lecture slides available to students before lecture may lead to better overall attendanceand participation, but exam performance is determined by more than just whether or not students havelecture slides available for their note-taking.

� 2009 Elsevier Ltd. All rights reserved.

1. Introduction

In recent years, more professors have been making use of computer-based presentation tools, such as PowerPoint (Microsoft Corpora-tion, 1998), to facilitate student note-taking and to increase student learning (Apperson, Laws, & Scepansky, 2006). Students often express apreference for PowerPoint presentations over traditional chalkboard lectures, and they have been shown to rate the course and the pro-fessor in a more favorable light when PowerPoint slides are used (Apperson et al., 2006). Students also have reported that being able todownload lecture slides prior to class helps them focus on and comprehend lecture material, and this helps them study for exams (Austin,Lee, Thibeault, Carr, & Bailey, 2002; Frey & Birnbaum, 2002; Murphy & Cross, 2002; Pardini, Domizi, Forbes, & Pettis, 2005).

Many students have come to expect that if PowerPoint slides are used in class, they will have online access to these slides. Although thisis becoming a more common practice, some professors do not offer access to slides at all. Those who do offer online access sometimeschoose to provide them before class so that students can use them as a guide for note-taking, and some prefer to offer them after classso that they are used as a supplement, but not a substitute, for students’ own note-taking. This can sometimes create conflict between stu-dents and professors because students may perceive that withholding lecture slides until after lecture is a disadvantage to their note-tak-ing. Therefore, there is a need for empirical research on providing online lecture slides to students either before or after class sessions inorder to inform professors how slide availability affects student learning and classroom behaviour. The purpose of this study is to examinethe timing of slide availability and how it affects students’ attendance, class participation, and exam performance.

1.1. Attendance

Class attendance is an important consideration when making the decision to provide lecture slides to students. Some professors may beconcerned that if slides are made available to students, they will use them as a substitute for attending class. Teaching to a relatively emptyclassroom can be disheartening to a professor who has spent numerous hours preparing his or her lectures and activities, and it can create

ll rights reserved.

21; fax: +1 (519) 973 7021.

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 869

an overall unpleasant atmosphere for the students who do show up to class (Brauer, 1994). Furthermore, students who do not attend thelecture miss out on lecture-only information. This not only has disadvantages for student performance on exams (Devadoss & Foltz, 1996),but also makes it more likely that professors will be asked questions that were already covered in lecture.

Some studies have supported the claim that providing lecture notes reduces attendance (e.g., Grabe, 2005; Grabe, Christopherson, &Douglas, 2005; Pardini et al., 2005). For example, Grabe and his colleagues found that students who used lecture notes reported that havingthe notes available to them played a ‘‘very significant” role in their absence from lecture (Grabe et al., 2005). Consistent with these findings,Grabe (2005) showed that 79% of students in his study who used online lecture notes reported using them as a replacement for class atten-dance at least once, and 29% of these students reported using the notes as a replacement for attendance six or more times.

Other studies have suggested that providing lecture slides to students may have less of an effect, or no effect, on whether or not theyattended class (e.g., Debevec, Shih, & Kashyap, 2006; Frey & Birnbaum, 2002). In a survey on student perceptions about their professor’s useof PowerPoint in lecture, Frey and Birnbaum (2002) found that only 15% of students reported that they were less likely to attend lecturewhen provided online lecture slides. Furthermore, Debevec et al. (2006) found no significant main effect of the frequency of lecture slideaccess on students’ attendance.

The differences in the findings of these studies may be due to the use of different measures of attendance. Many of these studies as-sessed attendance through retrospective self-report, rather than using students’ actual attendance. Students might not be accurate inreporting their absences because they simply forget how many classes they missed. Furthermore, students might report a greater associ-ation between their absences and having access to lecture slides in order to avoid taking responsibility for not attending class. Objectivemeasures of attendance, such as those used in the Debevec et al. (2006) study, are not subject to these biases, and therefore may be thereason why their findings differed from others’ results.

Most studies that examine how providing online lecture slides affects attendance are usually completed within one term, during whichonline lecture slides are made available before class. What may be more useful to professors, however, is knowing whether providing lec-ture slides either before lecture or after lecture can affect overall class attendance. If students perceive lecture slides merely as a substitutefor taking their own notes, classes that have lecture slides available before class should not differ in average attendance from classes thathave slides available only after class. Alternatively, allowing students access to slides before class may actually increase attendance. Stu-dents have reported that using lecture slides during class fosters a better learning environment by increasing their focus in class and draw-ing their attention to important information in the lecture (Pardini et al., 2005). If students perceive a benefit in using slides during lectureto improve their performance in the course, we would expect that students who are able to download slides before lecture would be morelikely to attend class than if they were only able to download them after lecture. In this study, to test whether the timing of providing slidesto students leads to differences in overall attendance, we compared the average class attendance of two classes with identical material thatvaried in the timing of slide availability.

1.2. Class participation

Another important issue to consider is how class participation may be affected by the availability of lecture slides. Although participa-tion may not be required for all types of classes, it is often an essential part of the dynamics of smaller or seminar-style classes. Professorswho teach these types of classes want to encourage student participation for the exchange of ideas and different perspectives, and theymay require participation as part of students’ grades.

One obstacle for class participation is the time needed to take notes. Students do not always have efficient note-taking skills, and theyoften attempt to write down the professor’s lecture, verbatim, rather than the more efficient way of synthesizing the lecture informationand writing notes in their own words (Kiewra, DuBois, Christensen, Kim, & Lindberg, 1989). When more attention is directed toward ver-batim note-taking, less attention is available for other learning activities. By making slides available for note-taking during lecture, this mayreduce the cognitive effort of taking notes and increase students’ attention toward asking and responding to questions about the lecturematerial (Austin et al., 2002; Barbetta & Skaruppa, 1995; Pardini et al., 2005). Furthermore, providing lecture slides before class can allowstudents the chance to formulate questions about the material prior to lecture.

Few studies have directly assessed the impact of the availability of lecture slides on class participation. Austin et al. (2002) found thatproviding guided notes (paper notes that were identical to the presented lecture slides) at the beginning of lecture led to more professorprompts and increased student responses, compared to when guided notes were not provided. These conclusions were limited by the factthat this study was done in a single class, with the different experimental conditions presented on different days. To truly assess the effectsof providing lecture notes ahead of time, lecture material should be identical between the two experimental conditions. The between-sub-jects design used in the present study allows this comparison of slide availability conditions, holding constant the course material, to exam-ine whether providing lecture slides before or after lecture facilitates class participation. To our knowledge, this is the first study to directlyassess slide availability and class participation using this methodology.

1.3. Exam performance

Exam performance also may be affected by the availability of lecture slides. Research has identified two functions of note-taking thatcontributes to exam performance: encoding (learning through the process of recording notes) and external storage (having notes availablefor later exam review; DiVesta & Gray, 1972). Note-taking has been shown to be most beneficial for recall of material and test performancewhen these functions are used in combination (Kiewra et al., 1989, 1991; Knight & McKelvie, 1986). Simply put, students generally performbetter on exams when they take notes during class (encoding) and use them for studying for exams (external storage) than if they only usenotes for one of these purposes. The quality of the notes, however, is a factor in how well this process works. Students are known to beinefficient note-takers. In a review of note-taking studies, students were found to record as little as 20% of lecture ideas when taking inde-pendent notes (Armbruster, 2000). As a result, students’ notes may not contain information they need to study for their exams.

With evidence indicating that students lack adequate note-taking skills, researchers suggest that providing professors’ lecture slides tostudents can help maximize the usefulness of students’ notes for both the encoding and external storage functions (Armbruster, 2000; Kie-wra, 1985a, 1985b). By providing slides that contain key definitions and concepts, students can attend to, think about, and record the most

870 K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881

important ideas from the lecture, thus improving the quality of their notes for later exam review. Austin, Lee, and Carr (2004) found thatwhen students were given a handout of the overhead lecture slides to use for note-taking, they showed the highest percentage of criticalpoints in their notes, compared to when they were not given the handout or when they had no lecture slides at all. If providing lecturenotes for students to use as note-taking guides leads to more efficient recording of the material, we would expect this to be reflected instudents’ performance on exams.

Research exploring differences in lecture slide usage and exam performance has recently gained momentum, however findings havebeen mixed. Some studies have demonstrated that when students were provided with paper copies of the lecture slides (e.g., Austinet al., 2002) or when they accessed the lecture slides online (e.g., Grabe et al., 2005) they had better exam scores than when lecture slideswere not used. In contrast, other evidence suggests that students who used lecture slides had lower exam scores than those who did notuse lecture slides (e.g., Murphy & Cross, 2002; Weatherly, Grabe, & Arthur, 2002–2003). Clearly, there is a need for more research on whatfactors involved in lecture slide usage explains these discrepancies in exam performance outcomes.

One possible factor that might account for these discrepancies is individual differences in prior academic achievement. When exam per-formance was measured in these studies, many of them did not take into consideration students’ typical exam performance in other classes(e.g., Debevec et al., 2006; Grabe, 2005). This makes any observed group differences difficult to interpret as the result of lecture slide usage,rather than simply a difference in typical exam performance. In response to this limitation, the present study used students’ cumulativegrade point averages (GPAs) as a covariate in the analyses on slide availability and exam performance.

Another factor contributing to differences in findings could be the timing of when lecture slides are accessed by students. Some researchon slide usage and exam performance has either not asked about lecture slide access (e.g., Weatherly et al., 2002–2003), or has not distin-guished between those who used notes during lecture and those who used them after lecture (e.g., Debevec et al., 2006). Different oper-ationalizations of lecture slide usage may lead to different results. For example, although Grabe (2005) found that students who used theonline lecture slides had higher exam scores than did students who never used them, a closer examination of the group who used the slidesrevealed no differences in exam performance between those who accessed them before lecture and those who accessed them after lecture.This finding demonstrates the need for incorporating information about slide availability.

It is also important to consider what information about slide availability would be most beneficial to professors when they are makingthe decision of whether and when to post their lecture slides. Grabe’s (2005) study compared groups that were characterized by when stu-dents decided to access the lecture slides on their own. This may, in fact, reflect motivational or learning style differences, and is not nec-essarily something that professors can control. Instead, what is more informative is knowing whether posting the lecture slides onlinebefore class or after class contributes to differences in average exam performance for the class. If lecture slides are most beneficial for examperformance by acting as a guide for note-taking (the encoding and external storage function), classes that receive slides before classshould outperform classes who receive the notes after class. If simply having the lecture slides to use as a study tool is the main benefitof providing lecture slides (the external storage function), then the availability of slides should not affect exam performance.

1.4. Study overview

In this study, students in an introductory Research Methods course and a fourth-year Cognitive Development course, both taught in theFall and Winter semesters, were provided with PowerPoint lecture slides either before lecture or after lecture (see Fig. 1 for a summary ofthe lecture slide availability conditions and student characteristics for each course). Course material was held constant within each type ofclass. We collected outcome measures of attendance, class participation, and exam performance. At the end of the semester, students com-pleted surveys containing questions about how they used the slides and their perceptions about the slides. We also obtained informationabout students’ GPAs and their typical attendance in other classes during the semester. We then examined whether providing lecture slidesonline before class or after class contributed to differences in the outcome measures, as well as contributing to how students used andperceived the lecture slides.

Although other lecture slide studies have examined attendance, participation, and exam performance, separately, to our knowledge, nostudy has examined the effect of lecture slide availability on all three outcomes by comparing classes with identical material. Furthermore,to avoid some of the common limitations in this type of research, we used typical class attendance and GPA as covariates in order to controlfor pre-existing differences in attendance and exam performance. Finally, this study provided a unique comparison of the effects of lectureslide availability for classes with different attendance and participation course requirements in order to see if slide availability affects theseoutcomes, even when attendance and participation are mandatory.

Fall 2006 Winter 2007

Research Methods: • Slides available after lecture • 48 students • Level of students: 1st – 4th years

Research Methods: • Slides available before lecture • 53 students • Level of students: 1st – 4th years

Cognitive Development: • Slides available before lecture • 39 students • Level of students: 4th years

Cognitive Development: • Slides available after lecture • 35 students • Level of students: 4th years

Fig. 1. Summary of lecture slide availability condition and student characteristics for each type of course by semester.

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 871

1.5. Hypotheses

Our study was guided by three hypotheses. First, we hypothesized that students in classes that had slides available before lecture wouldshow a higher attendance rate compared to students in classes that had slides available only after lecture. Given that students often per-ceive having lecture slides before lecture as an advantage for their learning and exam performance, we would expect that this would moti-vate students to attend class in order to use this tool effectively. Second, we hypothesized that students in classes that had slides availablebefore lecture would participate more in class than students in classes that had slides available only after lecture. With less cognitive effortdirected toward taking notes, we would expect students who were able to use lecture slides as a note-taking guide to have more time togenerate and respond to questions in class than those who did not have access to the slides before lecture. Third, we hypothesized thatstudents in classes that had slides available before lecture would perform better on exams than students in classes that had slides availableonly after lecture. Given the findings that using notes for both encoding and external storage leads to better exam performance, studentswho had access to the lecture slides before class should have had more of an advantage for learning material for the exam. This advantagewould be reflected in higher exam scores.

2. Methods

2.1. Participants

One-hundred eighty-eight Social Science undergraduates from four classes at the University of Windsor in Ontario, Canada were giventhe opportunity to participate in this study. Of these students, 10 declined to participate in the study, and three students were dropped fromthe analysis because of both incomplete exam data and unusual circumstances that resulted in atypical class attendance. The remaining 175students’ demographic information by class is shown in Table 1. All students received extra credit for their participation in the study.

2.2. Courses

The study was conducted in four classes taught during the 2006–2007 academic year. There were two types of courses: an introductoryResearch Methods course, and a fourth-year Cognitive Development course. As a condition of the study’s approval, the University ResearchEthics Board requested that course requirements for these two classes were not altered for the sake of the study, except for the timing ofwhen the lecture slides were made available on the website.

The lecture portion of the Research Methods course met twice a week for 50 min each time. Students were told they were expected toattend all lectures and that attendance would be taken, but, attendance was not a part of their final course points. Class participation (e.g.,asking questions, volunteering examples) was not recorded during lecture. Exams for this class included a 40-question multiple-choicemidterm and an 80-question multiple-choice final exam. The remainder of students’ course points consisted of laboratory assignmentsand a quiz given during the lab portion of the course.

The Cognitive Development course was a combination lecture-seminar class that met twice a week for 80 min each time. Students weretold that attendance at every class was mandatory and that they were expected to participate at least once per class meeting. Studentsreceived points for attendance and participation that counted toward their final course grade. Exams included a 40-question multiple-choice and short essay midterm and a 50-question multiple-choice final exam. In addition to the exams and points for attendance and par-ticipation, students’ grades were also determined by a short thought paper, a group presentation, and a term paper.

2.3. Materials

2.3.1. Lecture slidesLecture slides shown during the lecture portion of these classes were created by the professor on Microsoft’s PowerPoint software

(Microsoft Corporation, 1998). These slides were also made available to students on the course website in electronic form in PowerPoint

Table 1Demographic characteristics by class type and slide availability condition.

Research methods Cognitive development

Before lecture After lecture Before lecture After lecture

n 53 48 39 35Gender (% females) 74% 75% 92% 91%Mean age (SD) 24.04 (8.02) 21.23 (3.02) 22.55 (2.79) 22.60 (3.88)Age range 19–51 19–37 21–35 21–44

EthnicityAsian 3 2 2 3Black 3 2 1 3Caucasian 46 43 34 25Hispanic 0 0 0 2Middle-eastern 1 0 1 0Other 0 1 1 2

Year at universityFirst 6 7 0 0Second 18 17 0 0Third 18 17 0 0Fourth and beyond 11 7 39 35

872 K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881

and PDF formats in order to ensure that students who did not have the PowerPoint program on their computers could still access them.Slides contained definitions, basic outlines of major points of the topics presented in lecture, and visual graphs or examples demonstratingkey concepts. On average, 15–20 slides were shown per lecture.

2.3.2. Lecture slide surveyA 50-question paper-and-pencil survey was used to assess students’ use of and attitudes toward the classroom technology used during

the semester, as well as to collect information about GPA and typical class attendance. On the front of the questionnaire packet was a placeto provide student identification numbers on a tear-off cover sheet that served as a means to provide students extra credit points and tolink their class performance with their responses on the questionnaire. A background information survey contained questions about demo-graphic information, as well as about students’ cumulative GPA prior to the semester and their percentage of attendance at other classesduring the same semester. Terminology used in the questionnaire was explained in the instructions (e.g., specifying that ‘‘lecture slides”referred to the projected slides in the class that were also available on the class website). In addition to questions about the use of lectureslides used in this study, other questions covered the use of videos in class, the use of the course website to download assignments, and theuse of the website message board. Only the questions pertaining to lecture slide usage were used in this study, however.

The target questions about lecture slides used for this study are presented in the Appendix. Part I of the questions examined how andwhen students used the lecture slides during the semester. Students were asked to indicate when they typically downloaded the lectureslides, how they typically made use of the downloaded slides, how often they downloaded slides prior to lecture, how often they used theminstead of attending class, and how often they used the slides as a review after lecture. We also asked students to report which format ofthe lecture slides they used (PowerPoint or PDF). Part II of the questions required students to rate their satisfaction with the content, deliv-ery, and availability of the lecture slides. Three additional questions assessed students’ perceptions of the helpfulness, thoroughness, andcomplexity of the slides. Part III of the questions included three free-response questions that allowed students to elaborate on their per-ceptions of the lecture slides. Finally, there was a permission form on which students indicated whether or not they would allow theresearchers to verify and use their GPA, course points, and class attendance in the study.

2.4. Design and procedure

This study used a 2 (slide availability condition) � 2 (course type) between-subjects design. In each semester during the academic year,the same professor (the first author) taught a Research Methods class and a Cognitive Development class. Each course had its own website,which was created on a learning management system developed specifically for the university using Lotus Notes/Domino software (IBMCorporation, 2006). Because all required course materials were only available in electronic form on the website, all students had to accessthe website with their university login name and had to learn how to obtain files from the website. Lecture slides were available for down-load in either PowerPoint or PDF format in a section on the website clearly labeled ‘‘Lectures.”

Two slide availability conditions – before-lecture and after-lecture – indicated when the lecture slides were made available on the web-site. For the before-lecture condition, each week’s slides were available to be downloaded from the website at approximately 12:00 p.m.the day before the first day of lecture for the week. For the after-lecture condition, each week’s slides were available on the website the dayafter the last day of the week’s lectures, also at approximately 12:00 p.m. Each type of class was matched with each availability conditiononce, but in a counterbalanced order. Specifically, in Fall 2006, the Cognitive Development course had slides posted before the lectures andthe Research Methods course slides were available after the week’s lectures. For Winter 2007, the slide availability conditions werereversed.

Every effort was made to keep the context (e.g., classroom layout, graduate teaching assistants) and materials (e.g., lecture slides, ex-ams) consistent between classes of the same type. Lecture slides were identical within each type of course, except for minor semester-spe-cific information (e.g., exam date information). Lectures were administered using scripted notes and any deviations from the script (e.g., abrief discussion arising from a student question) were noted and evaluated to ensure these deviations did not constitute enough of a dis-similar class experience to affect the results. Deviations from the script were judged to be minor and unlikely to be a factor in any groupdifferences in outcomes. Exams were identical across semesters for each type of course.

Because the start of classes each semester fell on different days of the week, the days of the Research Methods lecture had to be changedfor Winter semester in order to ensure each lab was taught after the topics were covered in the week’s lectures. As a result, slides wereposted before this class on Sunday. To ensure that this change was not affecting whether students downloaded slides before lecture, wecompared this class with the before-lecture Cognitive Development class from Fall semester that had slides posted on a Monday. The over-all percentage of students who downloaded slides ahead of class was comparable between the two classes (about 80%), therefore it wasdecided that this change did not affect students’ ability to download slides.

Another difference between semesters was that in the Winter semester, there was a one-week administrative break in between the sev-enth and eighth week. Midterms for each of the classes occurred before this break, and although there was one small lab assignment due onthe week following the break in the Research Methods class, this assignment was not used for the outcomes in this study. Attendance andparticipation points for the day following the break were excluded from the analyses.

Students were not aware that they would have the opportunity to participate in the study until the week before the survey was admin-istered in class. The study was described as a survey on classroom technology and learning outcomes, but students were not told the spe-cific nature of the slide availability conditions. On the last day of class, the professor left the room while a research assistant who was notaffiliated with the course read scripted instructions about how to complete the survey. Students were informed that their responses on thesurvey would not be viewed until after their final course grades were submitted and that a graduate student who was not affiliated withthe course would be collecting and entering the data. They also were told that they could opt-out of the study at any time, without penalty.Students who chose to participate in the study were then given packets that contained the consent form and the survey. Study materialswere administered on paper, rather than online, in order to conduct the study during the regularly-scheduled class time. This maximizedthe likelihood of student participation and assured that students completed the survey in a similar environment and could ask the researchassistant any clarification questions. The survey took approximately 30 min to complete, and all students who completed it in class turnedin their form before leaving. Students who missed class that day were allowed to complete the survey at a later date. Students who chose

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 873

not to participate in the study were given the opportunity to earn the same number of extra credit points as those who did participate bycompleting an alternative extra credit assignment.

At the completion of the semester, students’ exam scores, attendance, and participation points were matched with their survey re-sponses. To ensure confidentiality, students’ survey responses were entered separately from their course points and then matched by studyidentification number. Course information was removed from students who indicated on the permissions form that they did not want itused in the study, and GPAs were verified for only those who gave permission to do so. Only five students declined permission to use courseinformation and to allow GPA verification. These students’ questionnaire responses were retained for the analyses on the usage and sat-isfaction of lecture slides, however.

3. Results

3.1. Overview

The findings are presented in three parts. The first part describes how students from the different availability conditions reported usingthe class slides during the course of the semester. The second part presents group differences in students’ satisfaction with the content,delivery, and availability of the class slides. The third part presents the findings on differences between availability conditions within eachcourse type for the outcome measures of attendance, participation, and exam performance.

3.2. Students’ use of lecture slides

We first examined the question of when students typically downloaded slides for class. For the before-lecture classes (Fall CognitiveDevelopment class and Winter Research Methods class), 46% downloaded the slides the day before lecture when they became available,20% downloaded them on the day of lecture, 13% downloaded them just before going to lecture, and 18% usually or always downloadedthem after lecture. For the after-lecture classes (Fall Research Methods and Winter Cognitive Development) 74% usually or always down-loaded them after lecture. Despite the fact that slides were not posted prior to lecture, 11% of students in the after-lecture classes reporteddownloading them before class. Upon further inspection of their other responses related to slide use (e.g., answering ‘‘Never” to the ques-tion of ‘‘How often did you download slides before they were used in lecture?”), we suspected that these students were likely referring todownloading the slides from the previous lecture when they came to campus the following week. Nineteen percent of students from thetotal sample indicated that they never downloaded the slides. The large majority of these students’ answers on other questions about theirslide use indicated that they had used slides, and most likely obtained them in other ways. Only two of these students (1% of the total sam-ple) reported other answers consistent with not using slides at all. These students were therefore dropped from the remaining analyses.

Next, we examined mean ratings of how often students in the before-lecture classes were accessing the slides prior to lecture. On aver-age, both the Research Methods class (M = 4.49, SD = 1.65) and the Cognitive Development class (M = 4.51, SD = 1.72) downloaded the slidesbefore they were used in lecture between half to most of the lectures. Only four students from each class reported never downloading theslides before lecture. Taken together, these findings suggest that almost all students who had the option of downloading slides before com-ing to lecture did, in fact, download them, and they brought them to the majority of lectures.

Given that 99% of students did use the lecture slides in some way during the course of the semester, we then explored the way that thesestudents used them. Of the students who downloaded the slides, 68% used the PowerPoint format, whereas 32% used the PDF format. Table2 shows the percentages of responses given by students who downloaded the slides to the question, ‘‘Which of the following statementsbest describes the way in which you used the downloaded lecture slides?” For the classes that received slides before lecture, most studentsreported using the slides as a guide for note-taking. For the classes that received slides after lecture, most students in the Research Methodscourse used the slides as their main notes, whereas most students in the Cognitive Development class used them either as a double-checkfor their own notes or as a guide. Approximately one-tenth of students in the two after-lecture classes reported not using the slides much,whereas none of the students in the before-lecture classes reported this.

In addition to asking students to report the predominant way in which they used the slides, we also asked two questions about howoften students used slides instead of attending class and how often they used slides as a way of reviewing notes after lecture. We rantwo 2 (slide availability condition) � 2 (course type) ANOVAs using each of the questions as the dependent variables. For the questionabout how often students used slides instead of attending class, a significant main effect of class type was found, F(1,167) = 39.95,p < .001, g2

p = .19. Students in the Research Methods course used the slides instead of attending class more often (M = 2.58, SD = 1.32) thandid students in the Cognitive Development class (M = 1.56, SD = 0.71). In addition, a significant interaction was found, F(1,167) = 7.11,p = .008, g2

p = .04 (see Fig. 2). Post-hoc Tukey tests revealed that the Research Methods class in which slides were posted after class usedslides as a substitute for attending class most often, compared to the other classes (all ps < .05). On average, students in this class reportedusing the lecture slides as a substitute for attending ‘‘some of the lectures” (M = 2.91, SD = 1.38). No main effect of slide availability con-dition was found, however.

Table 2Percentages of slide usage by class type and slide availability condition.

Research methods Cognitive development

Before lecture (%) After lecture (%) Before lecture (%) After lecture (%)

I used them as my main notes – I added very little extra information 39 37 8 3I used them mostly as guides – I added a fair bit of extra information 47 19 68 28I downloaded them for reference – I had the slides but took separate notes 6 5 16 16I downloaded them after lecture – I used them to double-check my own notes 6 12 5 31I downloaded them after lecture – I did not use them much 0 12 0 9Other 2 16 3 13

0

0.5

1

1.5

2

2.5

3

3.5

Before-lecture After-lectureAvailability Condition

Mea

n R

atin

g

ResearchMethods

CognitiveDevelopment

Fig. 2. Mean ratings of how often students used lecture slides instead of attending class by slide availability condition and course type.

Table 3Means (and standard deviations) of satisfaction ratings by slide availability condition.

Slide availability condition F(1,169)

Before lecture After lecture

How satisfied were you with the availability of formats for lecture slides (PowerPoint, PDF)? 4.36 (0.72) 4.15 (0.90) 2.25How satisfied were you with when the lecture slides were posted on the website? 4.43 (0.75) 3.22 (1.23) 62.63***

How satisfied were you with the amount of material on the lecture slides? 4.08 (0.72) 3.81 (0.79) 5.21*

How satisfied were you with the way material was written on the slides? 4.12 (0.66) 4.05 (0.69) 0.39How satisfied were you with the number of slides provided for each lecture? 4.10 (0.60) 3.99 (0.63) 0.88How satisfied were you with the pacing of the lecture slides during the lecture? 4.04 (0.73) 4.04 (0.81) 0.01How satisfied were you with the way lecture slides tied in with the lecture

presentation (i.e., consistency of the slides with what was said in lecture)?4.33 (0.68) 4.20 (0.66) 1.88

How satisfied were you with the way the lecture slides represented material on the exams? 4.00 (0.88) 3.85 (0.74) 1.08How satisfied were you with the lecture slides, overall? 4.28 (0.62) 3.96 (0.77) 8.84**

Note: Judgments were made on 5-point scales (1 = Very dissatisfied, 5 = Very satisfied).* p < .05.

** p < .01.*** p < .001.

874 K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881

The ANOVA of how often students used slides as a way of reviewing notes after lecture showed a significant main effect of availabilitycondition, F(1,169) = 9.20, p = .003, g2

p = .05. On average, students in the classes where slides were posted before lecture reviewed notesafter lecture more often (M = 4.58, SD = 1.48), than did students in classes where slides were posted after lecture (M = 3.83, SD = 1.69).

3.3. Students’ satisfaction with lecture slides

In addition to looking at how students used PowerPoint lecture slides, we also examined students’ satisfaction with and attitudes to-ward the content, delivery, and availability of the downloadable slides. Table 3 contains the mean ratings of the questions assessing studentsatisfaction by availability condition. For each question, we conducted a 2 (slide availability condition) � 2 (course type) ANOVA. Overall,students were generally satisfied with the content and the delivery of the slides. Significant main effects showed that classes in whichslides were posted before lecture had greater satisfaction with the timing of slide availability, greater satisfaction with the amount of mate-rial on the slides, and greater overall satisfaction with the slides than classes in which slides were posted after lecture. Satisfaction with theavailability of slide formats and most questions about satisfaction with the content and delivery of the slides (i.e., the way the informationwas written, the number of slides, the pacing of slides, and how slides tied in with lecture material and exams) showed no significant dif-ferences between groups (all ps > .05).

Students also were asked to rate how much they perceived the lecture slides to be helpful, thorough, and complicated. Three 2 (slideavailability condition) � 2 (course type) ANOVAs were conducted using each rating as the dependent variable. A significant main effect ofavailability condition was found for helpfulness, F(1,167) = 13.32, p < .001, g2

p = .07. Students who had access to slides before class foundthe slides to be more helpful (M = 6.01, SD = 1.06) than those who had access to slides only after class (M = 5.30, SD = 1.36). Similarly, therewas a significant main effect of availability condition for thoroughness, F(1,168) = 9.21, p = .003, g2

p = .05. Those who had access to slidesbefore class also found the slides to be more thorough (M = 5.47, SD = 1.17) than did those who had access to slides only after class(M = 4.91, SD = 1.34). No significant main effects or interactions were found for students’ ratings of slide complexity.

3.4. Attendance, participation, and exam performance

Finally, we examined whether the timing of slide availability was related to attendance, class participation, and exam performance. Be-cause attendance and participation in lecture was a part of students’ overall grade for the Cognitive Development course, but not the Re-search Methods course, we chose to analyse the effects of slide availability condition within each course, separately.

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 875

3.4.1. AttendanceAttendance was measured by the percentage of days that students attended the lecture. Atypical days, such as the first day of class and

the day following holidays, were removed from this calculation. A one-factor ANCOVA was conducted for each of the analyses on percentattendance. Because each class contained different students, we used their responses on the question about how frequently they attendedlectures for their other classes as a covariate so that students’ typical attendance would not explain differences between availability con-ditions. The mean percentage of student attendance for all four classes is shown in Fig. 3. For the Research Methods classes, which did nothave an attendance requirement as part of students’ overall grade, a significant difference was found, F(1,87) = 5.78, p = .02, g2

p = .06. Onaverage, students in the class that had the slides posted before lecture attended approximately 77% of classes (M = 76.61, SD = 22.71),whereas the students who received slides only after class attended approximately 60% of classes (M = 59.74, SD = 26.09). For the CognitiveDevelopment classes, in which attendance was required, although the before-lecture class had a relatively higher average percentage ofattendance (M = 89.32, SD = 10.61) than the after-lecture class (M = 86.84, SD = 12.79), this difference was not significant, F(1,68) = 0.22,p = .64, g2

p = .003.To further explore whether actually downloading slides before lecture was associated with how often students attended class, we ran a

bivariate correlation for each of the before-lecture classes between percent attendance and how often they downloaded slides before theywere used in lectures. For the Research Methods course, there was a significant positive correlation indicating students who more oftendownloaded slides before attending lecture also were more likely to attend class, r = .31, p = .03. In contrast, no association was foundfor the Cognitive Development course, r = .001, p = .99.

3.4.2. Class participationParticipation was directly measured only in the Cognitive Development classes. For the dependent variable, we used a proportion cre-

ated from each student’s participation points divided by their attendance points for the days in which participation was recorded (partic-ipation points were not given on the first day, the day a film was shown, and on the days of the student presentations). This proportionrepresented the student’s average participation points per class. As seen in Fig. 4, when considering the participation of all students in these

0

0.25

0.5

0.75

1

1.25

1.5

All Students Participators Only

Mea

n P

ropo

rtio

n of

Par

ticip

atio

n

Before-lecture

After-lecture

Fig. 4. Mean proportions of daily student participation in the Cognitive Development classes by slide availability condition. The first group of bars represents all studentsfrom these classes, and the second group of bars represents only those students who participated one or more times during the semester.

0

10

20

30

40

50

60

70

80

90

100

Research Methods Cognitive DevelopmentCourse Type

Mea

n P

erce

nt A

tten

danc

e

Before-lecture

After-lecture

Fig. 3. Mean percentages of student attendance by slide availability condition and course type.

876 K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881

classes, the before-lecture class had a higher mean proportion (M = 0.83, SD = 1.12) than did the after-lecture class (M = 0.47, SD = 0.59).However, an independent samples t-test revealed that this difference did not reach traditional levels of significance, t(59) = 1.74, p = .09.

Austin et al. (2002) have speculated that providing note-taking materials (e.g., lecture slides) may only benefit participation forstudents already inclined to participate, but not the less vocal students. To see if this was the case, we ran an additional analysiscomparing participation levels of the two classes, excluding those who did not participate in class at all. First, we classified studentsas either participators (participated once or more) or non-participators (never participated). Then we ran a Chi-square that demonstratedthat the non-participation rate in the before-lecture class (26%) was not significantly different from the after-lecture class (21%),v2(1,N = 73) = 0.26, p = .61. Finally, we ran an independent samples t-test using just the data from the participators. A significant differ-ence was found between the two slide availability conditions, t(42) = 2.11, p = .04. As seen in Fig. 4, participators in the before-lectureclass had a significantly higher mean proportion of participation (M = 1.12, SD = 1.17) than did participators in the after-lecture class(M = 0.60, SD = 0.60).

3.4.3. Exam performanceExam performance was measured by the percentage of correct responses on the multiple-choice questions from the midterm and final

exam. One-factor ANCOVAs were conducted for each type of class, using exam percentage as the dependent variable and students’ cumu-lative GPA prior to the semester as a covariate. For the Research Methods classes, no significant difference in exam score was found(F[1,84] = 0.24, p = .63, g2

p = .003), however, it was noted that the mean exam percentage of the before-lecture class (M = 69.49,SD = 11.61) was higher than the after-lecture class (M = 66.75, SD = 11.35). Similarly, for the Cognitive Development class, the differencebetween availability conditions was not significant (F[1,64] = 0.98, p = .33, g2

p = .02), although the before-lecture class had a relatively high-er average exam percentage (M = 70.25, SD = 11.75) than the after-lecture class (M = 68.91, SD = 12.49).

Although slide availability condition differences in exam performance did not emerge as significant, we also were interested in whetherdifferences in slide use were related to exam percentage score. Therefore, we ran bivariate correlations on how often students downloadedslides before class and exam percentage for each of the before-lecture classes. For both the Research Methods course (r = .17, p = .26) andthe Cognitive Development course (r = �.11, p = .53), no significant associations were found.

We also examined whether exam percentage was associated with how often students used the slides instead of coming to class. Becauseof the differences between the types of classes in attendance and their use of the slides, we chose to conduct bivariate correlations for eachclass separately. For the Research Methods classes, a significant negative association was found for both the class that had slides postedbefore lecture (r = �.29, p = .05) and the class that had slides posted after lecture (r = �.41, p = .006). For the Cognitive Development classes,a significant negative association was found for the class that had slides posted after lecture (r = �.37, p = .04), but the negative associationfor the class that had slides posted before lecture was a nonsignificant trend (r = �.30, p = .08). Thus, for both Research Methods classes andthe Cognitive Development class that received slides after lecture, the more students used the slides instead of attending class, the lowertheir exam score.

4. Discussion

This study investigated how the timing of online lecture slide availability affects student attendance, participation, and exam perfor-mance. Students in two courses that were taught in both semesters over the course of an academic year either had access to slidesbefore lecture or had access to slides only after lecture. This made it possible to manipulate the time at which lecture slides were madeavailable to students while keeping constant the course material. Results were partially supportive of our hypotheses that students withaccess to lecture slides before class would attend class and participate more frequently; however, no differences in exam performancewere found.

4.1. Attendance

Class attendance was found to be considerably higher in the Research Methods class that had slides available before lecture (77%) thanin the Research Methods course that could only access lecture slides after class (60%). This difference was significant, even when taking intoaccount students’ attendance in other classes during the same semester. This suggests that these findings were not just differences in stu-dents’ typical class attendance. Furthermore, we also found that students who more often downloaded slides before attending lecture alsowere more likely to attend class. These results paint a different picture than other studies that have suggested either a decrease or no dif-ference in attendance rate when lecture slides are offered before lecture (e.g., Debevec et al., 2006; Frey & Birnbaum, 2002; Grabe, 2005;Grabe et al., 2005; Pardini et al., 2005). To our knowledge, this is the only study that has found more frequent attendance in a class that hasoffered slides before lecture.

One reason for this difference in attendance between the slide availability conditions could be that posting slides before class may alertstudents to material with which they expect to have difficulty and thus encourage them to attend lecture. This ‘‘forewarning” function mayalso help to explain why students were less likely to attend the Research Methods class when the slides were posted after lecture. Withouthaving access to the lecture slides, these students lacked cues to indicate that difficult material was going to be presented in class and mayhave been less motivated to attend.

Another possible explanation for our findings may be related to the way that students perceived the usefulness of the lecture slides as alearning tool. Students prefer having lecture slides to use as a note-taking guide because it helps direct their attention to key information inthe lecture (Austin et al., 2002; Frey & Birnbaum, 2002; Murphy & Cross, 2002; Pardini et al., 2005), and because they can add their ownideas to these critical points as the lecture progresses. Without this benefit, students must rely on their own note-taking skills, which mayinvolve only copying down the information on the lecture slides or may result in incomplete information for exam review purposes (Arm-bruster, 2000; Austin et al., 2004). If students perceive the professor’s lecture slides as more comprehensive than the notes they could gen-erate on their own, they may be lulled into a false sense of security, knowing that they will later have access to a seemingly complete set oflecture notes, and not feel the need to attend lecture.

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 877

In contrast to the findings with the Research Methods classes, the Cognitive Development classes showed no differences in attendancebetween the two availability conditions. Perhaps these more advanced students understood the importance of attending class, or had bet-ter note-taking skills, and thus were more motivated to attend class. A more likely explanation, however, is the difference in attendancerequirements for these two types of courses. Unlike the Research Methods course, the Cognitive Development course required attendanceas part of students’ course points. Required attendance has been shown to be a major factor in students’ decisions to attend classes (Deva-doss & Foltz, 1996), and this may override any effect that providing lecture slides before class has on attendance. As evidence of this, atten-dance was considerably higher for the Cognitive Development classes (89% and 87%) compared to the Research Methods classes (77% and60%). Future studies should explore the relative contributions of slide availability and required attendance in students’ decisions to attendlecture.

4.2. Class participation

Our study also demonstrated an availability condition difference in class participation. For the Cognitive Development classes, in whichparticipation was measured, the class that had access to lecture slides before lecture had a greater average participation rate per personthan did the class that could only access the slides after class. This finding is consistent with the idea that having lecture slides fornote-taking during class frees up students’ attention for other classroom activities (e.g., Austin et al., 2002). The difference between thetwo classes, however, was only statistically significant when we excluded students from the analysis who did not participate in class atall. Although we did not ask these students’ to report their reasons for not participating in class, we can speculate that other factors, suchas shyness or evaluation apprehension, may have played a role in their non-participation (Neer & Kircher, 1989). Thus, the benefit of in-creased participation associated with providing lecture slides before class may only extend to those already inclined to participate. Stu-dents who regularly do not participate in class may never choose to participate, regardless of how much their note-taking demands arereduced. Future research on lecture slide usage and class participation should include measures that assess students’ reasons for not par-ticipating in class.

Although participation was not directly measured in the Research Methods class, anecdotal evidence suggested that students engaged inmore discussion and asked more questions in the class for which lecture slides were available before class. Furthermore, students in thisclass (as well as the Cognitive Development class that had slides available before lecture) made comments in the free-response section ofthe questionnaire that were consistent with the explanation that having the lecture slides before class allowed them to pay more attentionto the lecture. For example, one student from this class commented, ‘‘[It’s] easier to pay attention and make my own notes rather thanfrantically copying overheads.”

4.3. Exam performance

Given that we observed differences between the lecture slide availability conditions for student attendance and participation, we wouldexpect to find differences in other outcomes traditionally affected by these classroom behaviours, such as exam performance. The findingsfrom this study, however, suggested that the timing of slide availability did not significantly affect students’ exam scores in either of thesetwo types of courses. This was surprising, especially because students reported that they felt their studying and exam performance wasbetter when they had the slides before lecture. For example, one student wrote, ‘‘It made studying easier and helped me get a better mark.”Although these results did not support our hypothesis, they are consistent with other research that found no difference between those whoused slides during lecture and those who accessed slides after lecture (Grabe, 2005). Furthermore, because no advantage was found forstudents in the before-lecture classes who could use the lecture slides for both encoding and external storage purposes, our findings sug-gest that the main benefit for exam performance of providing lecture slides to students is external storage for later review.

Providing lecture slides to students before class may directly affect attendance and participation via motivational or attentional factors,but exam performance is more likely to be determined by several different factors working in combination. Individual learning styles andstudying practices also contribute to how well students perform on exams. Having lecture slides for note-taking in lecture may provide anadvantage to some students, but this may not account for as much variance in test scores as does, for example, time spent studying the textor working in study groups. Students who are only able to access lecture slides after class may compensate for any learning disadvantageby increasing their effort in other effective studying practices. Therefore, future studies on the availability of lecture slides should also as-sess the type and amount of time that students engage in these other studying practices in order to evaluate the unique contribution ofslide availability on exam performance.

Another important finding from our study was that for both of the Research Methods courses and the Cognitive Development class whoreceived the slides after lecture, the more students used the slides as a substitute for attending class, the lower their exam performance.Because this association was found for both slide availability conditions, this further suggests that individual factors play a larger role inexam performance than whether or not the slides are made available before class. However, it is important to note that even though thedifference between slide availability conditions was nonsignificant, the before-lecture classes did have higher mean exam scores than theirafter-lecture counterparts. Taken together with the fact that other studies on exam performance and providing lecture slides have hadmixed results, the relationship between slide availability and exam performance is a future avenue of research that is worth pursuing.

4.4. Use of and satisfaction with lecture slides

The majority of participants downloaded the lecture slides, regardless of whether they were available before or after class. Therewere, however, some differences in slide usage that were associated with both class type and time of slide availability. When slideswere available before class, for both types of classes they were used primarily as a guide for note-taking. When slides were availableonly after class, students in the Research Methods class were more likely to use the slides as their main notes, adding little of theirown information, and were also more likely to use them as a substitute for attending class. In contrast, students in the CognitiveDevelopment class were more likely to supplement the slides after class with their own information or to use them as a double-checkof their own independent notes. This may illustrate a difference in the way that introductory- and advanced-level students make use of

878 K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881

online lecture slides after class. By using the lecture slides as their sole notes, the introductory-level students in the Research Methodsclass may be missing elaborative information. Although no differences were found for exam performance, it may be that exam score isa function of short-term learning that can be supplemented with cramming. To assess whether the way in which slides are used affectslong-term retention of material, future studies should consider using designs that use longitudinal measures, such as a six-monthposttest.

Other notable findings were how students in the different availability conditions used the lecture slides as a study tool. Students whohad access to slides before lecture were more likely to use the slides as a way of reviewing notes after lecture compared to students whoonly had access after lecture. Furthermore, when asked to categorize how they used the notes, one-tenth of the students who only hadaccess to lecture slides after class reported not using them much, whereas none of the students in the classes that received slides beforelecture reported this. These findings may simply reflect that these students preferred to use their own notes, however we feel these resultssuggest that students who do not have access to slides prior to lecture may view them as less effective for exam review. For the professorwho provides lecture slides for the purpose of enhancing students’ study tools, our findings indicate that they would be more effective ifoffered before lecture.

We also found differences in students’ satisfaction with the lecture slides. Consistent with the findings of other research (e.g., Appersonet al., 2006), students in this study reported higher overall satisfaction when lecture slides were posted before lecture. Students with accessto slides before lecture were also more satisfied with the timing of the slides’ posting and found them to be more helpful. Interestingly,despite the fact that slides were identical between semesters, students who had access to slides before class also perceived the slides tobe more thorough and were more satisfied with the amount of material on them. Perhaps these students felt that the combination ofthe professor’s notes and their own comments that they wrote on the slides during lecture produced a more thorough set of notes forstudying purposes. This also may explain why more students who had access to slides only after lecture were less likely to make use ofthem when studying for exams.

4.5. Limitations and future directions

The present study revealed differences between lecture slide availability conditions in class behaviour and also in how studentsused and perceived course slides. These findings are group tendencies, however, and should not be interpreted as indicators of howa single student’s score would change if he or she were given the slides before class. The design of this study was meant to comparethe impact of slide availability on class performance, as a whole – information that may be useful to professors when they are makingdecisions about what educational practices would benefit the majority of the students in the class. For the future, researchers maywant to examine how slide availability is likely to impact individual students with different learning styles. This can help professorsunderstand what kinds of recommendations they can give to students who are having difficulties with using the lecture slideseffectively.

Although we controlled for typical class attendance in our analysis of attendance, it is possible that other factors that we did not mea-sure could have contributed to the group differences we observed. A student’s motivation for learning class material, for example, may playa role in attendance, participation, and exam performance. It is possible that different motivation levels for the class material could haveaccounted for the differences that we saw in attendance for the Research Methods class and in participation in the Cognitive Developmentclass. If motivation were responsible for the effect, however, we would expect to see differences in all three outcome variables. This was notthe case. Even so, motivation for learning the class material remains an important factor that future investigations should examine whenlooking at outcomes of slide availability.

Our findings on the satisfaction with the lecture slides revealed some interesting patterns in the way that students perceived the slides,and one of our goals with the free-response questions was to further explore these perceptions. However, we were limited in our ability toanalyse these qualitative data because there was little elaboration and variability in students’ responses. For example, many of the re-sponses about the quality of the slides consisted of a single word, such as ‘‘Good.” Therefore, future research using free-response questionsshould take care in wording questions so that they are likely to elicit more than single-word responses. Furthermore, we recommend thatfuture studies include free-response questions about a broader range of topics related to lecture slide usage and other factors involved inclassroom behaviour and exam performance. Our findings provide a starting point for how the timing of slide availability affects these vari-ables, but additional qualitative studies can provide a richer picture of how students perceive and use lecture slides in their classroomexperiences.

Finally, there is a need to replicate these findings. To our knowledge, this study is the first to compare the effects of slide availabilitytiming, controlling for course content. It is important to use this design in studies with other types of classes done over multiple semesters.By replicating our findings in different contexts, this would allow us to make stronger claims about the benefits of providing slides to stu-dents before lecture.

4.6. Summary and conclusions

In recent years, there has been increased student demand for professors to use computer-based lecture slides and to make them avail-able online. Empirical studies, such as this one, can help professors make informed choices about whether and when to provide theseslides so that they can create the most adaptive learning environment for students. In our study, when slides were made available beforelecture, students not only expressed a more favorable view of the lecture slides, but also reported using them as a more effective note-taking and study tool, compared to when slides were not made available until after lecture. When attendance was not a required part ofstudents’ grades, the class that received slides before lecture had more frequent attendance. Furthermore, when examining the relativeparticipation rate of students who participated in class discussions, students in classes where slides were made available before lecturehad more frequent participation than those in classes that received slides after lecture. These findings are perhaps the most relevant forinstructors, especially for seminar-style courses. By posting slides before lecture, students have the opportunity to prepare in advance forclass and perhaps feel more comfortable in volunteering thoughts and opinions. When slides were only available after lecture, a lessadaptive pattern was found. Not only did these classes have lower attendance and participation, but they also used the slides less effec-

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 879

tively. In addition, when attendance was not mandatory, students were more likely to report using the slides as a substitute for attendingclass.

In contrast to the findings on attendance and participation, exam performance did not significantly differ, regardless of whether or notstudents had access to slides before lecture. This notable finding suggests that there is more to exam performance than simply whether ornot students have the lecture slides for note-taking. Although the quality of students’ notes may be improved by having the lecture slidesduring class, students who do not have access to slides prior to lecture may be able to compensate for their relatively poorer notes byengaging in other effective studying practices.

Taken together, our results have many important implications for both professors and students. Mandatory attendance and participa-tion may be one of the strongest predictors of whether students attend and are active participants in class (Devadoss & Foltz, 1996), butfor professors who choose not to include this course requirement, providing notes to students prior to lectures would likely make stu-dents happier and make them feel as if they have a better understanding of the material. Furthermore, professors would probably enjoythe benefit of better attendance and participation in the classroom. Professors who typically provide slides after lecture with the reason-ing that this will prevent students from using slides as a substitute for attending class may want to reconsider this policy. Our studyshowed the opposite effect. Students were more likely to use slides as a substitute for attending lecture if they received lecture slidesafter class.

If lecture slides are made available before class, students bear the responsibility for knowing how to use slides for note-taking so that they work best for their own learning style. This also includes understanding that not all lecture material willbe contained on the online lecture slides, and therefore they should not be using them as a substitute for attending class.Most importantly, it is essential that students realize that having access to the professor’s lecture slides before lecture doesnot always lead to better exam performance. Rather, slides are simply another tool that must be incorporated into effectivestudy strategies.

Appendix

880 K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881

References

Apperson, J. M., Laws, E. L., & Scepansky, J. A. (2006). The impact of presentation graphics on students’ experience in the classroom. Computers & Education, 47, 116–126.Armbruster, B. B. (2000). Taking notes from lectures. In R. F. Flippo & D. C. Caverly (Eds.), Handbook of college reading and study strategy research (pp. 175–199). Mawah, NJ:

Lawrence Erlbaum Associates.Austin, J. L., Lee, M., & Carr, J. P. (2004). The effects of guided notes on undergraduate students’ recording of lecture content. Journal of Instructional Psychology, 31, 314–320.Austin, J. L., Lee, M. G., Thibeault, M. D., Carr, J. E., & Bailey, J. S. (2002). Effects of guided notes on university students’ responding and recall of information. Journal of Behavioral

Education, 11, 243–254.Barbetta, P. M., & Skaruppa, C. L. (1995). Looking for a way to improve your behavior analysis lectures? Try guided notes. The Behavior Analyst, 18, 155–160.Brauer, J. (1994). Should class attendance be mandatory? Journal of Economic Perspectives, 8, 205–207.Debevec, K., Shih, M., & Kashyap, V. (2006). Learning strategies and performance in a technology integrated classroom. Journal of Research on Technology in Education, 38,

293–307.Devadoss, S., & Foltz, J. (1996). Evaluation of factors influencing student class attendance and performance. American Journal of Agricultural Economics, 78, 499–507.DiVesta, F. J., & Gray, S. G. (1972). Listening and note taking. Journal of Educational Psychology, 63, 8–14.Frey, B. A., & Birnbaum, D. J. (2002). Learners’ perceptions on the value of PowerPoint in lectures (ERIC Document Reproduction Services No. ED467192).Grabe, M. (2005). Voluntary use of online lecture notes: Correlates of note use and note use as an alternative to class attendance. Computers & Education, 44, 409–421.Grabe, M., Christopherson, K., & Douglas, J. (2005). Providing introductory psychology students access to online lecture notes: The relationship of note use to performance and

class attendance. Journal of Educational Technology Systems, 33, 295–305.IBM Corporation (2006). IBM Lotus Notes 7.0.2 [computer software]. Cambridge, MA: IBM Corporation.Kiewra, K. A. (1985a). Providing the instructor’s notes: An effective addition to student notetaking. Educational Psychologist, 20, 33–39.Kiewra, K. A. (1985b). Students’ note-taking behaviors and the efficacy of providing the instructor’s notes for review. Contemporary Educational Psychology, 10, 378–386.Kiewra, K. A., DuBois, N. F., Christensen, M., Kim, S., & Lindberg, N. (1989). A more equitable account of the note-taking functions in learning from lecture and from text.

Instructional Science, 18, 217–232.Kiewra, K. A., DuBois, N. F., Christian, D., McShane, A., Meyerhoffer, M., & Roskelley, D. (1991). Note-taking functions and techniques. Journal of Educational Psychology, 83,

240–245.

K.A. Babb, C. Ross / Computers & Education 52 (2009) 868–881 881

Knight, L. J., & McKelvie, S. J. (1986). Effects of attendance, note-taking, and review on memory for a lecture: Encoding vs. external storage functions of notes. Canadian Journalof Behavioural Science, 18, 52–61.

Microsoft Corporation (1998). Microsoft PowerPoint 1998 [computer software]. Redmond, WA: Microsoft Corporation.Murphy, T. M., & Cross, V. (2002). Should students get the instructor’s lecture notes? Journal of Biological Education, 36, 72–75.Neer, M. R., & Kircher, W. F. (1989). Apprehensives’ perception of classroom factors influencing their class participation. Communication Research Reports, 6, 70–77.Pardini, E. A., Domizi, D. P., Forbes, D. A., & Pettis, G. V. (2005). Parallel note-taking: A strategy for effective use of Webnotes. Journal of College Reading and Learning, 35, 38–55.Weatherly, J. N., Grabe, M., & Arthur, E. I. L. (2002–2003). Providing introductory psychology students access to lecture slides via Blackboard 5: A negative impact on

performance. Journal of Educational Technology Systems, 31, 463–474.