Tracker workshop ALT Conference 2016

Tracking students’ digital experience: development and use of a cross sector benchmarking toolHelen Beetham and Sarah Knight

ALT-C07/09/16

#digitalstudent https://digitalstudent.jiscinvolve.org

Workshop outline»Background: why a Digital Experience Tracker?»Insights from some pilot sites:› University of Westminster › Barton Peverill 6th Form College› University of Northampton

»Panel session: your chance to find out more»Try it for yourself: live access using your own device»Activity: help us make the Tracker better»Findings: using the Tracker to build sector intelligence»Round-up: where next?

03/05/2023Tracking students’ digital experience http://digitalstudent.jiscinvolve.org

http://digitalstudent.jiscinvolve.org

» Phase 1 study reviewed students’ expectations and experiences of the digital environment at university and we spoke to 500 staff and students during our consultation (2013-2014) http://ji.sc/Digital_ Student_Expectations

» We conducted a review of practice in schools to identify likely incoming expectations (2014)

» In phase 2 we focused on FE speaking to 220 learners and 300 staff from colleges across the UK (2014-2015) http://ji.sc/Digital_ Students_Expectations_FE

» Phase 3 Skills study speaking to adult and community learners, work based learners including apprentices and offender learners (2015-2016) http://ji.sc/Digital_Student_Skills

» Phase 4 Online learners study, speaking to students studying on online or partly online courses (2016)

Tracking students’ digital experience http://digitalstudent.jiscinvolve.org03/05/2023

http://digitalstudent.jiscinvolve.org/

http://digitalstudent.jiscinvolve.org/

http://ji.sc/Digital_%20Student_Expectations

http://ji.sc/Digital_%20Student_Expectations

http://ji.sc/Digital_%20Students_Expectations_FE

http://ji.sc/Digital_%20Students_Expectations_FE

http://ji.sc/Digital_Student_Skills

Digital student online learners study

Tracking students’ digital experience http://digitalstudent.jiscinvolve.org

»What makes a successful online learner?

»Findings of the Digital Student Online learners’ expectations and experiences of the digital environment

»Now available from http://ji.sc/onlinesurveyreport

03/05/2023

http://ji.sc/onlinesurveyreport

Why a student digital experience tracker?

»The Student digital experience Tracker supports universities, colleges and skills providers to:› gather evidence from learners about their digital experience,

and track changes over time› make better informed decisions about the digital environment› target resources for improving digital provision› plan other research, data gathering and student engagement

around digital issues› demonstrate quality enhancement and student engagement to

external bodies and to students themselves»See http://bit.ly/jisctracker


http://bit.ly/jisctracker


Piloting the tracker

» Survey implemented in BOS, a system developed for UK HE/FE and already used by many

» 50+ education providers applied: 24 chosen based on a spread of institutional sizes, types and locations

» Pilot sites required to involve stakeholders, consider how they would engage learners, and explore hoped-for benefits

» Teams at each pilot site responsible for: customising the survey, releasing it to learners, maximising completion rates and analysing their own data


Outcomes from pilot

»10,753 unique data sets»Case studies from 7

institutions http://bit.ly/trackercasestudies

»Full report is available from: http://bit.ly/student-tracker-report


http://bit.ly/trackercasestudies

http://bit.ly/trackercasestudies

http://bit.ly/student-tracker-report

http://bit.ly/student-tracker-report

Insights from three of our pilot sites

»Yanna Nedelcheva, University of Westminster»Andy Taggart, Barton Peverill 6th Form College»Rob Howe, University of NorthamptonEach will present briefly on:»Reasons for using the Tracker»Engaging students and other stakeholders»Response to the Tracker findings»There will be a chance to ask questions in the panel session immediately after!


Some feedback from pilot sites…


Questions to the Panel»Yanna Nedelcheva, University of Westminster»Andy Taggart, Barton Peverill College»Rob Howe, University of Northampton»Helen Beetham, project team»(Chair) Sarah Knight, Jisc Co-Design Manager

»Ask a question via Twitter use Q:#digitalstudent 03/05/2023Tracking students’ digital experience http://digitalstudent.jiscinvolve.org

Try it for yourself1. Access one of the two Tracker tools using the

URL:›HE Tracker 2016: bit.ly/TrackerHE16›FE&Skills Tracker 2016 bit.ly/TrackerFE16

2. Browse the survey questions. You can customise questions that are not locked. Download the full user guide here: bit.ly/TrackerGuide16 (some actions will not be relevant in the generic survey that you are using)

3. Discuss and be ready to feedback your thoughts about the questions and how you might use the results.


http://bit.ly/TrackerGuide16

Your ideas»We are already planning a number of changes thanks to the evidence we collected from the pilot process, e.g.›More customisation options ›Optional extra questions e.g. on teaching and learning, accessibility, attitudes to social media…

›Lose one or two free text questions›New question set for principally online learners

»Now is your chance to tell us http://bit.ly/trackerpadlet


http://bit.ly/trackerpadlet


On post-it notes…Please add to the A3 sheets:»How might findings from the existing questions be used at your institution?

»What new questions or question themes would you like to see included in the future?

»Or add to padlet: http://bit.ly/trackerpadlet



Headline findings from the Tracker pilot

»7,425 students from twelve HE and 3,328 students from twelve FE & Skills institutions completed the Tracker


Access and use»Students are more likely to use personal laptops, smartphones

and tablets than desktops to support their learning»90% of HE students use personal laptops: only 66% of FE & Skills

students»40% of FE & Skills students use personal desktops: only 30% of

HE students»FE & Skills students are significantly more likely to use

institutional technologies to support their learning»Significantly more FE & Skills students could frequently access

institutional computers and printers in comparison with HE students

»Significantly more HE students could frequently access institutional WiFi

»A significantly higher % of FE & Skills students said they could never access personal information online in comparison with HE students


Learning with technologyDuring the last 6 weeks of their course:»9 in every 10 students found information online»7 in 10 students produced work in a digital format»5 in every 10 students worked online with others»3 in every 10 students created a personal (digital) record of

their learning

»HE students were significantly more likely to have carried out all of these activities than FE students, with the exception of creating a personal record of their learning (no significant difference)


Guidance and support»Most students (63% HE, 82% FE) say they have received enough

guidance on behaving safely and respectfully online.»Less than half say they have received enough guidance on

modifying devices to suit their individual needs, or creating a positive online presence.

»More than half but less than two thirds say they have received enough guidance on bringing their own device, or developing digital skills relevant to their course.

»Significantly more FE and skills students than HE students say they had received enough guidance on all of these issues, except creating a positive online presence (about equal).


Guidance and support»Most students (63% HE, 82% FE) say they have received enough

guidance on behaving safely and respectfully online.»Less than half say they have received enough guidance on

modifying devices to suit their individual needs, or creating a positive online presence.

»More than half but less than two thirds say they have received enough guidance on bringing their own device, or developing digital skills relevant to their course.

»Significantly more FE and skills students than HE students say they had received enough guidance on all of these issues, except creating a positive online presence (about equal).


Overall experience»Approximately 7 in 10 students believe that when technology is

used by teaching staff it enhances their learning experience

»Around 6 in 10 students believe that digital assessments are delivered well

»Significantly less than half of all students know how their personal data is used by their provider, or say that they feel involved in decisions about the digital environment. In both cases the figure is significantly lower for HE students.

»Analysis of free text responses shows that most students want ‘more’ and better access to digital devices, networks, services and resources.

»HE students also want: recorded lectures, better use of VLE, less powerpoint, better digital activities and assessments, 24/7 access to all content

»FE&Skills students also want: more guidance on effective use (staff and students), no blocked sites, more accessible online resources, support for skills


Round-up and close

»Sign up now for open pilot from September 16: http://bit.ly/jisctracker and join mailing list http://www.jiscmail.ac.uk/jisc-digitalstudent-tracker

»Online digital student study http://ji.sc/onlinesurveyreport

»New online guide Enhancing the digital experience for skills learners with case studies launched early October 2016

»Learners’ journeys with technology



http://www.jiscmail.ac.uk/jisc-digitalstudent-tracker

http://ji.sc/onlinesurveyreport

Find out more…

Digital Student [email protected]@gmail.comhttp://digitalstudent.jiscinvolve.org#digitalstudent

Except where otherwise noted, this work is licensed under CC-BY-NC-ND

Jisc Digital Student http://digitalstudent.jiscinvolve.org.uk

mailto:[email protected]

Technology

Tracker workshop ALT Conference 2016