Lessons Learned using the Lessons Learned using the Classroom Experience Classroom Experience ProjectProject

How to fail at video conferenced How to fail at video conferenced teachingteaching

Jay Beavers, Microsoft ResearchJay Beavers, Microsoft ResearchRichard Anderson, Univ of WashingtonRichard Anderson, Univ of Washington

UW Professional Master's UW Professional Master's ProgramProgramFive year old program with established Five year old program with established

distance courses.distance courses.One course per quarter video One course per quarter video

conferenced between UW and Microsoft.conferenced between UW and Microsoft.One evening per weekOne evening per weekCommuting distanceCommuting distance

Before ClassroomXP Before ClassroomXP technologytechnology ISDN Based video conferencingISDN Based video conferencingNetmeeting for PowerPoint distributionNetmeeting for PowerPoint distributionElectronic white boardElectronic white boardLecture archiveLecture archiveContinual improvement in qualityContinual improvement in quality

Lighting, microphones, audio processing, Lighting, microphones, audio processing, camera management, etc.camera management, etc.

How to fail at video How to fail at video conferencing, Jim Gemmelconferencing, Jim Gemmel

Voice quality must be competitive with Voice quality must be competitive with telephonytelephony

Video should increase, not decrease Video should increase, not decrease ‘presence’‘presence’

Starting up a video conference should be Starting up a video conference should be as easy as making a telephone callas easy as making a telephone call

Video conferencing must be ubiquitousVideo conferencing must be ubiquitous

Potential advantages for Potential advantages for using ConferenceXPusing ConferenceXPHigher quality video and audioHigher quality video and audioEase of setup and installationEase of setup and installationAddress some known problemsAddress some known problems

WhiteboardWhiteboard

Friendly Environment for Friendly Environment for ClassroomXP trialsClassroomXP trials Substantial resources on both sidesSubstantial resources on both sides Established programEstablished program Near-locatedNear-located Existing relationshipExisting relationship

ExperimentExperiment Is higher quality video betterIs higher quality video better Better interactivity through ink on PPTBetter interactivity through ink on PPT

What we hoped to achieveWhat we hoped to achieve

Increased interaction between sitesIncreased interaction between sitesAbility of remote students to interact Ability of remote students to interact

with the instructorwith the instructorAbility of instructor to engage remote Ability of instructor to engage remote

studentsstudentsStudent interaction across sitesStudent interaction across sitesNo degradation of experience of local No degradation of experience of local

studentsstudentsNo System AdministratorNo System Administrator

What happenedWhat happened

Week 1Week 1 Used old system (for comparison)Used old system (for comparison)

Weeks 2-4Weeks 2-4 Bad patch cable caused 30% packet loss, maiming Bad patch cable caused 30% packet loss, maiming

Conferencing appConferencing app Weeks 5-9Weeks 5-9

Router incompatibilities caused intermittent Router incompatibilities caused intermittent multicast failure (~15 minutes between failure)multicast failure (~15 minutes between failure)

Weeks 10-12Weeks 10-12 Worked as expectedWorked as expected

How to fail at a distance How to fail at a distance coursecourseTransmission failuresTransmission failuresProduction qualityProduction quality

Lighting, room noise, camera managementLighting, room noise, camera management

Structured presentations limit activityStructured presentations limit activityClassroom issuesClassroom issues

Table layout, overhead positionningTable layout, overhead positionning

AttitudesAttitudes

Transmission failuresTransmission failures

No connection – if the bits don’t get No connection – if the bits don’t get through, there is no classthrough, there is no class

Interruptions – short failures Interruptions – short failures Degradation of performance (audio, Degradation of performance (audio,

video, signal and latency)video, signal and latency)

Production qualityProduction quality

MicrophonesMicrophones Not picking up soundNot picking up sound Picking up too muchPicking up too much

LightingLightingCamera qualityCamera qualityField of viewField of viewDistanceDistance

PresentationPresentation

Restrictions imposed by technologyRestrictions imposed by technologyLimitations on materialsLimitations on materialsLoss of fidelity of transmitted materialsLoss of fidelity of transmitted materials

Classroom issuesClassroom issues

Placement of projectorsPlacement of projectorsDispersal of audienceDispersal of audienceStudent seatingStudent seating

Conference rooms versus lecture hallConference rooms versus lecture hall

AttitudesAttitudes

Resentment of technologyResentment of technologyNot attempting to engage other siteNot attempting to engage other site

Instructor – not encouraging questionsInstructor – not encouraging questions Students – not asking questionsStudents – not asking questions

MulticastMulticast

Lack of reliabilityLack of reliabilityVender incompatibility issuesVender incompatibility issuesSubstantial time to localize problemsSubstantial time to localize problems Intermittent failuresIntermittent failures

Multicast test toolsMulticast test tools

Details on what is needed – it would be Details on what is needed – it would be great to create interest in thisgreat to create interest in this

SeatingSeating

Room ConfigurationRoom Configuration

Screen 1 Screen 2

Seating

Content IssuesContent Issues

Sound issues – difficulty of room(s). Sound issues – difficulty of room(s). Value of picking up background noise Value of picking up background noise

(sense of presence).(sense of presence).Camera issues in remote roomCamera issues in remote room

Configuration required students to sit at Configuration required students to sit at distancedistance

Some students avoided sitting in field of Some students avoided sitting in field of viewview

Student Reactions IStudent Reactions I

Repeated failures reduced students Repeated failures reduced students attempt to interact across sitesattempt to interact across sites

Even intermittent failures had significant Even intermittent failures had significant psychological impactpsychological impact

Students recognized that we were Students recognized that we were attempting attempting to do a good job (we were to do a good job (we were present in the remote classroom, and present in the remote classroom, and shared their pain)shared their pain)

Student Reactions IIStudent Reactions II

With our workarounds (high latency video, With our workarounds (high latency video, conference phone) students did not conference phone) students did not participate.participate.

In spite of technical difficulties many students In spite of technical difficulties many students chose to attend the remote site (commuting chose to attend the remote site (commuting 15 miles in traffic being an alternative)15 miles in traffic being an alternative)

Local students complained of intrusiveness of Local students complained of intrusiveness of interruptions. Had little sympathy for remote interruptions. Had little sympathy for remote students.students.

Faculty ReactionFaculty Reaction

With technological difficulties, taught With technological difficulties, taught primarily to local classprimarily to local class

Presentation tools readily acceptedPresentation tools readily accepted

Take 2Take 2

Network diagnostics & testingNetwork diagnostics & testing 7x24 test agents7x24 test agents Long term statistics gathering & web reportingLong term statistics gathering & web reporting

Concept of “Administrative Console”Concept of “Administrative Console” Diagnostics to quickly determine faultDiagnostics to quickly determine fault Over 20 points of potential failure in “I can’t hear the Over 20 points of potential failure in “I can’t hear the

professor”professor” Non-invasive reset, diagnostics, configuration changeNon-invasive reset, diagnostics, configuration change

Rooms dedicated to distance classesRooms dedicated to distance classes Lighting, wall color, ceiling mikes, projector & A/C noise, Lighting, wall color, ceiling mikes, projector & A/C noise,

projector positioning, table layoutprojector positioning, table layout

Ease of startup & shutdownEase of startup & shutdown