46
Quality Enhancement in Engineering Education (QEEE) Program Concept & Phase I Overview July 16, 2014, New Delhi

Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Embed Size (px)

Citation preview

Page 1: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Quality Enhancement

in Engineering

Education (QEEE)

Program Concept & Phase I Overview

July 16, 2014, New Delhi

Page 2: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Indian Education: Quantity, Equity, Quality

• Rapid expansion in number of schools / colleges /

technical education

• RTE, Affirmative action, accessibility – near equal

opportunities to all across demographics

• What about Quality?

Page 3: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

What about Quality??

Rapid growth in

numbers not

matched by quality

Infrastructure

Quality faculty

Lack of quality has led to:

Less equipped graduates who

are not employable

Students aspiring to study

further go abroad – ‘Brain

Drain’

Can ICT be leveraged in making in improving quality in education

available to all and bridge the gap between demand and supply?

Page 4: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Designed and implemented

at IIT Madras

• MHRD Committee set up in February 2013 under the chairmanship of Prof Ashok Jhunjhunwala

• Broadbased committee consisting of members from government, academia and industry

• Objective - suggest comprehensive reforms to improve quality of engineering education being delivered to students across the country

• Proposed intervention across 3 areas:

• Direct – to – Student

• Teacher training: Comprehensive ten year plan for teacher training (pedagogy and subject) and certification

• Policy changes focusing on governance, transparency, autonomy, accreditation

Quality Enhancement in Engineering

Education(QEEE)

Page 5: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Design of D2S recognizes Global

eLearning Trends

Advantages of ICT in education have been recognized globally:

• Taking limited resources – teachers, quality learning material etc. to many

• Enabling different pedagogical methods – video, animation, 2D/3D viewing, games, simulations…

• Enabling individualized any-time, any-where learning

• Interactive and two-way learning process

QEEE’s D2S designed to incorporate all the above advantages but aims at supplementing and empowering the local resources / teachers, rather than replacing them

Page 6: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Designed as distinct modules to cover all aspects

of engineering education

15 lectures (1/3rd of a course) delivered live from IIT Studio to 100

classrooms simultaneously

Faculty can use teaching aides like video, screen share, whiteboard; or

simply use the blackboard

2-way interaction made possible by suitable hardware / software

LIVE CLASSES

Central Server

at IITM

Institute

Server

Institute

Server

Institute

Server

Students&

Local

Faculty

NKN

D2S Methodology

Page 7: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

DTH

Live Classes - Delivery

IGNOU

Classroom at Engg. college

with two screens

Moderator Laptop

Institute

ServerSet top box

Live Class from IIT

Recording

Central server

hosted at IIT

Madras

At the college

D2S Methodology

Page 8: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Remote tutor or local tutor can conduct private sessions for a

batch of 30 students

Synced with Live Class – Problem solving emphasized

In case of remote tutor, software and infra communication

used for conducting online sessions

Institute ServerStudents&

Local Faculty

Broadband

Remote Tutor

TUTORIALS

D2S Methodology

Page 9: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Simulation based / remote trigger labs implemented at multiple

colleges simultaneously by remote tutors

Remote tutor logs in to facilitate labs in the participating college

LABS

Broadband

Institute ServerCollege 1:

Students&

Local Faculty

College: 2

College: 3

Remote

Tutor

D2S Methodology

Page 10: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Similar to MOOC offered

by MIT, Coursera

Live intervention through

3 to 4 live sessions

Proctored exams and

grading

MOOC

Training on non-

curriculum courses

Make students industry

ready / employable

BRIDGE COURSES

D2S Methodology

Page 11: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Delivery through infrastructure

specially designed and setup

Redundant heavy duty servers

with adequate bandwidth on

NKN

HARDWARE

Server with requird bandwidth

to connect to IITM server,

classroom with 2 projectors,

screens, AV/ recording devices

Dedicated computer /

headphones per student for labs

/ tutorials

Live class delivery in

partnership with AVIEW,

Amrita

Monitoring and Management

Web based interface for

delivering moduls developed at

IITM

Software for video interaction,

quiz etc. developed at IITM

SOFTWARE

LO

AL

CO

LL

EG

EII

TM

D2S Methodology

Page 12: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Pilot implementation of D2S

undertaken Jan – Apr 2014

12 Live Courses

1. Comp Arch and Org

2. EM Fields

3. Probability and Statistics

4. Linear Algebra

5. Comp Methods in TFE

6. Engg ThermoD

7. Geotech Analysis

8. Engg Mech

9. Engg Flu Mech

10. Operating Sys

11. Heat Transfer

12. Wireless Comm

1 Tutorial

1. Computer Arch & Org

2 Virtual Labs

1. Digital Signal Processing Lab (IITM)

2. Virtual Smart Structures Lab (IITD)

1 MOOCS

Algorithms (MSR, India)

Page 13: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Pilot Planning and

Implementation

• 100 colleges identified based on response to questionnaire

• Website created to serve as link between IITM and local colleges

• Timetable and infrastructure requirements put up

• Various stakeholders – head, local teachers, system admin, IIT teachers, tutors etc. orientated at specially designed workshops

• Program Management and Technical support teams put in place during implementation

• Qualitative and Quantitative feedback collected from all stakeholders

Page 14: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Total # of

Colleges

Registered

# actively

participated

Total # registered

in all courses# completing

105 73 603 527

• Colleges not ready

with required

infrastructure

• Alignment with

semester start date

• Syllabus mismatch

Pilot Launched on Jan 27 2014

• Colleges had made it

voluntary for students

• Mismatch with exam

timetable / vacation

• Syllabus mismatch

• Content mismatch with level

Page 15: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Overall Feedback

Stakeholders# of

respons

# of

college

av #/

course

Exceeds

expectations

(scores 4 or 5)

Below

expectations

(scores 1 or 2)

Neutral

(score 3)

QEEE Coordinator 70 70 53% 22% 26%

System Admin 57 57 55% 27% 17%

Local Teachers 56 16 4.3 63% 21% 16%

Students 4570 26 326.4 40% 35% 24%

Page 16: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Feedback considered stakeholder wise, student wise, course wise and college wise…

Detailed Analysis of feedback

Exceeds expectation

• Live classes very well received by

colleges

• Core concepts taught by IIT

faculty helped students in GATE

preparation and placement

interviews

• Tutorial module provided hands-

on and problem solving approach

to understanding concepts

• Need the program to offer more

number of courses across

semesters

Below Expectation

• Syllabus mismatch – Local faculty

be involved in finalizing course

content

• Start at 9:00 AM instead of 8:00

AM

• Suggested whiteboard /QEEE

software tools be used for lectures

rather than blackboard for better

clarity

• Need for uninterrupted network

connectivity for the smooth

functioning of the program

Page 17: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Early conclusions from Pilot

The D2S modules delivered involved active participation and

engagement.

This eLearning model appears to be well received

Colleges can easily absorb an engagement based model into

their offering as it involves “active” involvement

MHRD Committee gave Mandate to continue for 2 years

and collect, measure and analyse feedback in a more

comprehensive manner over a slightly longer time frame

Areas for improvement have been identified for Phase II (July 2014)

….

Page 18: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Learnings from Phase I

• Implementation issues to be addressed

• 8:00 am too early for start of live lectures

• Mid term break to be introduced for colleges to adjust their internal teaching schedule and exams

• Strengthen technology

• Platform to be upgraded to enable continued access to content

• Issues with audio / video, connectivity to be addressed - Colleges to be tested comprehensively for readiness and ratings provided for the same

• Local faculty involvement to be strengthened

• Local faculty to be involved in curriculum planning for the 15 QEEE sessions

• Increase interaction between local and IIT faculty

• Issues of “standard”, curriculum mismatch can be addressed

Page 19: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Ensure commitment from colleges

• Introduce attendance

• Introduce exams based on QEEE coursework

• Ensure Grading from QEEE test are integrated with overall grade

• Rating of colleges on infrastructure setup / extent of participation

• Periodic reviews and college participation reports

• Observers at colleges to assess program acceptance / compliance

• Address specific issues related to difficulty in English based

education

Learnings from Phase I cont.

Page 20: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Screenshots from phase I classes

Page 21: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Live Class using White Board

Page 22: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Live Class using Black/Physical Board

Page 23: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Tutorial Session in progress

Page 24: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading
Page 25: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Phase II

Program & Expectations

Page 26: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Phase II implementation

• Designed as a 2 year program

• Will aim to be a comprehensive and high quality learning

program

• Enhance basket of offerings to give the student multiple and

varied learning options

• IIT faculty and program implementation team to “include”

colleges / faculty as collaborators in program design

• Addresses issues from Phase I as well as focus on

continuous improvements based on feedback

Page 27: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Live Classes to start at 9:00 am

• Program to be designed to have a “Mid term break”

between the 15 lectures. This is in order for the colleges to

make adjustments to their teaching and exam schedules.

• Labs and tutorial to be synchronized and offered along with

a select set of live class courses

• Unlike phase I, tutorials to be handled by local faculty with

support from IIT faculty on content and delivery

Program modified based on Phase I

feedback…

Page 28: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Student attendance to be made compulsory.

• Local faculty to enter student-wise attendance details at the start of every class

• Observers to be sent to colleges to gauge program “acceptance” and to evaluate

the technical quality of the program received.

• Review meetings to be organized regularly with participant colleges

• College report cards and rating on college participation, interaction, quality of

infra set-up, local faculty involvement, student grades, observer reports

• Overall program feedback as well as course-specific feedback to be made

compulsory. Feedback to be collected across all stakeholders at college.

• QEEE certificates to be awarded to students based on participation and

performance

Increased emphasis on

accountability and compliance

Page 29: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• QEEE live class courses decided based on polling of colleges –

most wanted courses offered

• Local faculty to provide inputs to collaboratively decide the coursework

with the IIT faculty for 15 sessions

• Tutorials to be conducted by local faculty with support from

IIT faculty on content.

• Continuous interaction between local /IIT faculty through forum /

video sessions to be enabled

• Local faculty to be involved in grading/assessment of QEEE

related mid-term and end-term exams

Increased involvement of colleges in

course design and delivery …

Page 30: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Proctored Exams to be introduced as part of every live class

Mid-term exam (after 8 lectures) to consist of objective type

questions. Evaluation will be system automated.

End-term exam (After 15 lectures) to be a mix of objective and

subjective questions.

Answers to subjective questions to be scanned and uploaded question wise

at the college

To be evaluated by randomly chosen local faculty from other participating

institutes

answer key and grading strategy provided by the IIT faculty

Grades from QEEE mid-term and end-term exams to reflect in final

grade of student

Program Specific Enhancements –

Exams and Grading

Page 31: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Technology upgraded…

Satellite link to be added for video broadcast in addition to broadband

Comprehensive testing to ensure colleges are “ready” to receive the program

Software platform to host a course page for each course. - Lecture notes,

recorded video, assignments, quizzes and forum to be part of the course page

Page 32: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Two bridge programs being offered

1. Learning Python (In vernacular language)

9 week long program delivered as 3 hour sessions each on Saturdays

Offered in 6 Indian languages (Tamil, Telugu, Kannada, Oriya, Bengali and

Hindi)

Sessions to have a dedicated remote tutor logged in to interact with students

from each college through the QEEE software

Students to also perform exercises on their own in the lab post interactive

sessions

Quizzes to be conducted as par of course and certificate to be provided based

on performance

New modules introduced –

Bridge Programs

Page 33: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

2. Spoken English

10 week long program delivered as 4 hour sessions each on

Saturdays

First 2 hours to be interactive with a remote expert delivering the

session similar to the live class model followed by students

performing exercises on their own in class

In addition to the weekly practice sessions, there will be a pre-

assessment, mid-term and an end-term assessment which will be a

mix of objective and spoken exercises

Local faculty to be involved in evaluation of spoken exercises

Based on above assessments certificate to be provided

New modules introduced –

Bridge Programs cont..

Page 34: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• 15-18 sessions to be delivered by senior industry persons from a

variety of industry sectors including Aerospace, IT, Electronics,

Telecom, Auto, Chemical, Utilities, Consumer durables etc.

• hosted companies including TCS, CTS, Siemens, Flextronics, Ford, Hyundai, Saint

Gobain, Rolls Royce, Kirloskar, BPCL, ONGC, Cavinkare, etc. and others like

Microsoft

• 2 hour sessions to include a video on technology, talk by the industry

person, panel discussions and extensive interaction with students

• Aimed at exposing students to these industry sectors

• Ideal for 4th-5th and 6th-7th semester students

Industry Bridge – Technology

Trends in Industry

CII- QEEE program

Page 35: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

organized chapter-wise / topic wise

The learning material and evaluation components for a

course are sourced from the IIT Faculty delivering the live class

New modules introduced –

Course Pack

Digital collection of

Learning material - text, video,

animations, ppt

Evaluation components - quiz,

assignments,

Interactive components - forum,

chat,

Embedded with dictionary and

bookmark support.

MOOC+ module

Page 36: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Offerings for term starting Aug 1

LIVE CLASS

1. Math I (Tut)

2. Math III (Tut)

3. Physics (Tut)

4. Transportation & Traffic

Engg

5. Analog Circuits

6. Intro to DB

7. Mass Transfer

8. Indus Engg & OR (Tut)

9. DSP

10. Machine Design (Tut)

11. Data Struc & Algo

12. Chemical Reaction Engg

(Tut)

13. Smart Struc (Tut)

14. Software Engg

15. Fibre Optic Comm (Tut)

LABS

1. DSP

2. Smart Structures

Lab

3. Physics Lab BRIDGE &

INDUSTRY BRIDGE

1. Spoken English

2. Learning Python

3. Industry Bridge

sessions from CII

MOOCs

1. Basic Electric

Circuits, IITM

2. Theoretical

Computer

Science, MSR

Page 37: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading
Page 38: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Total : 146

Participants from Phase I: 80

New colleges: 66

Teqip:78

Non – Teqip: 68

Break up of colleges

Page 39: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Geographical

distribution

Page 40: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Roles & Responsibilities

of stakeholders at the

college

Page 41: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Single point of contact for all program related communication

• Ensure that all the colleges are “ready” and “tested” to receive the program

• Register college for courses offered

• Integrate the QEEE timetable/schedule into the college’s schedule, to ensure that there is minimum disruption to students and local faculty’s academic calendar

• Identify at least one local faculty for each live class, labs, MOOCs and bridge program that the college is enrolled for

• Work towards providing weightage for the student’s QEEE grade in the final grade

• Host the QEEE “observer” who will be assigned for 2-3 days at the college for collecting feedback

• Ensure that all reports, feedback and other requirements (attendance, grading, testing etc..) are complied with in a timely manner

• Take necessary action as indicated by the college report cards and periodic reviews

Coordinators are ambassadors of

the program at the college…

Page 42: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Ensure that the hardware / classroom / connectivity and QEEE software interface is set up as specified

• ensure that testing for each QEEE module (h/w & s/w) in conjunction with the QEEE-IITM team is done well before start of the classes

• Enrol local faculty, students for the courses opted for

• Ensure testing, software upgrades and sync with cloud is done whenever indicated

• Train all the users on the QEEE problems, as well as be the single point contact for any issues related to hardware and software

System Administrators ensure

effective running of the program

Page 43: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Work in collaboration with IIT faculty to finalize content for 15 live classes

• Integrate the 15 sessions into the overall course as typically offered by the college

• Conduct the quizzes as specified, as well as participate in the randomized grading methodology being adopted

• Enter and manage digital attendance records, quiz scores and compliance on assignment submission, providing feedback etc.

• Integrate Live class marks with grading for the course

• Be the interface between the students and IIT faculty both during the live class, as well as offline on the forum

• To cover course topics in sync with the Live Class course topics (handling topics between lectures, covering missed out topics, replaying recorded videos of unattended live class sessions etc)

Local faculty deliver QEEE at the

college

Page 44: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

• Participate in video sessions with IIT faculty before each lab / tutorial

• Be familiar with the tutorial/ lab experiments, and ensure students are ready for the class

• Teach the tutorial class, using inputs provided by the IIT faculty

• Ensure students comply with the requirements of the tutorial / lab as regards submission of problem sets, lab records etc.

• Provide support and guidance to students during the lab sessions

Additional responsibility for

tutorial, lab faculty

Page 45: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Spoken English

• Participate as evaluators for pre, mid and end term spoken language assessment of students from the college

• Participate in Workshops on assessment methodology and guidelines to be conducted by bridge program provider

• moderate the sessions and ensure student participation.

Learning Python / Industry-Bridge Sessions

• Facilitate the sessions locally and ensure student attendance and participation

MOOCs

• Guide students through the program and monitor progress

Additional responsibility for

faculty for other modules

Page 46: Quality Enhancement in Engineering Education (QEEE) · Quality Enhancement in Engineering Education (QEEE) ... Quality Enhancement in Engineering Education ... answer key and grading

Website: www.pilot.edureform.iitm.ac.in

Program related quries: [email protected]

Web App Support queries: [email protected]

Sys Admin related queries: [email protected]

-------------------------------------------------------------------------

Program related quries : 08939266567

Web App Support queries: 08939260084, 08939260065

Sys Admin related queries: 07299006887

Contact Us