JAIPUR ENGINEERING COLLEGE & RESEARCH CENTREJAIPUR

Rubrics Methodology for Project Development Work Evaluation

This rubric of 21st century learning represents an important skill for students for developing:

1.     Real-world problem-solving and innovation

2.     Knowledge construction

3.     Collaboration

4.     Skilled communication

Two different aspects in evaluating the students’ performance in Project Work, namely, Project Development and Soft Skills will be used. As per RTU guidelines, Project Development Work carries 200 Marks.

The Project Development aspect focuses on the deliverables, quality of development work and the technology features. For this only specialized model consisting of four phases namely, Analysis, Designing, Coding & Testing is considered.

On the other hand, Soft Skills concentrates on the life skills of the team members and demonstration of the same during Project Development Work.

For Assessment purpose, Project Development is divided into following buckets:

Project Analysis

Design Work Code Development Project Deployment

Twenty- One evaluation parameters for Project Development and Five evaluation parameters for Soft skills aspects have been formulated. The consolidated list of these parameters with the weight-age associated with each is described in the following figure:

 Project Work Evaluation – RubricsEvaluation Buckets Weight-age

Proj

ect A

naly

sis

Clear Problem Statement 5

Clear Project Objective 5

Objective of Project Scope in Sync with Problem Statement 5

Sufficient Literature Review 5

Requirement Analysis Document 10

Des

ign

Wor

k

Clarity in Hardware & Software Requirement Specifications 5

Suitable Application of Methodology, Approach and Technique 10

Design Documents - Low Level & High Level 10

Acceptability of User Interface designed 10

Cod

e D

evel

opm

ent

Source Code Development 10

Coding Standards 10

Code Review - Self & Peer 10

Unit Test Plan 10

Proj

ect T

estin

g

System Integration Test Plan 10

Design of User Acceptance Test 5

Defect Tracking System 5

Proj

ect D

eplo

ymen

t

System Integration 5

Built 5

Project Execution 20

Bugs and Crashes 5

Meets SRS 10So

ft S

kills

Team Work 5

Leadership Quality 5

Team Interaction 5

Tracking Team Activities 5

Project Presentation 10

  Total 200

The rubric methodology has four levels: Excellent, Competent, Scope for Improvement and Needs Efforts. These levels apply to the several evaluation parameters and expected deliverables in the Project Work. For each parameter there is a brief written description of the different levels of performance based on performance criteria. They are constructed by combining descriptions of different qualities of performance. Each set of descriptions reflects a different level of performance on that evaluation parameter.

Project assessors and / or Faculty members will use these descriptions to determine their level of accomplishment on each evaluation parameter. The scale ratings are as –

1. Needs Efforts ( No Efforts taken) 2. Scope for Improvement (0-50 percent results achieved) 3. Competent (50-75 percent results achieved) 4. Excellent (75-100 percent results achieved)

Evaluation Buckets  Outcome Expected from Students

Proj

ect A

naly

sis

A clear Problem Statement The problem is stated and the project has addressed the stated problem statement.

A clear Project Objectives The project objective is stated and the project has addressed the stated problem statement.

Objective of Project Scope in Sync with Problem Statement The objective stated is suitable and matches with the project statement.

Sufficient Literature ReviewLiterature review accompanying complete references list.

Requirement Analysis Document Capturing both FUNCTIONAL and NON-FUNCTIONAL requirements.

Des

ign

Wor

k

Clarity in Hardware & Software Requirement Specifications

Hardware and software requirements need to be clearly specified to meet project objectives.

Suitable Application of Methodology, Approach and Technique

Design required to be complies expectation and all project objectives.

Design Documents - Low Level & High Level

All the modules are identified with description of input/output parameters and algorithm design.

Acceptability of User Interface designed User friendly Interfaces are required to be designed.

Cod

e D

evel

opm

ent

Source Code DevelopmentFunctionality is required to be implemented capturing all the validations; whether code is optimized as per code tuning techniques or not; Code Re-usability is applied or not.

Coding Standards followed Naming variables, Header-footer for file and for every function, proper documentation and Indentation is required to be followed.

Code Review - Self & Peer COMPLETE code review is expected along with ALL considerations.

Unit Test Plan Capture all the test cases for both functional and non-functional as identified in RA document.

Proj

ect T

estin

g

System Integration Test Plan Capture all the test cases for both functional and non-functional as identified in RA document.

Design of User Acceptance Test Well designed User Acceptance tests for all input as well as output sets is required.

Defect Tracking System All test cases written in UTP and ITP are tested and fixed the defects; Defect tracking sheet is required to be maintained to log all defects and defects are fixed

Proj

ect D

eplo

ymen

t

Integration and built Front end connects with back end and exe is generated; without any errors.

Project Execution Output is perfect with no errors or warnings.

Bugs and Crashes NO Bugs and Crash Free project development is expected.

Meets SRS Project implementing both functional and non-functional requirements as captured in RA document is required to be checked.

Soft

Ski

lls

Team Work Better quality work than expected with significant and in time contribution.

Leadership Quality For students demonstrating EXCELLENT leadership qualities.

Team Interaction Students possess Listening Skills and communication among teammates, Participates in brainstorming, Open for new ideas and feedback

Tracking Team Activities Keeps the team on track by giving specific, timely, and constructive feedback

Project Presentation EXCELLENT documentation (as per given format), communication and presentation Skills.

Using Rubrics

1. Rubrics chart is to be used for three different types of evaluations Self Evaluation – Each student will self assess the scores as per the

evaluation parameters Peer Evaluation – One student in a project group assesses the

performance of other student in the same group. Expert Evaluation – Faculty members assess the students as per the

Rubrics

2. The Self and Peer evaluation is to be done to understand how individual’s work has contributed to Project Development Work.

3. Final Score to be calculated as per the Expert/Faculty Assessment scores.

Rubrics for performing evaluation

MS Excel 2010 version has been used for designing Project Development Work Evaluation template. It has pre-defined evaluation parameters and scale ratings defined as per the tabular representation above. The evaluation contains some calculated cell as per the evaluation parameter weight-ages and student ratings.

The evaluation sheet has following columns: Evaluation Parameter, Parameter Weight-age, Student Rating and Student Score. Out of these, Evaluation Parameter & Parameter Weight-age contains pre-defined values as per the evaluation parameter. The Student Score column is auto calculated and hence is non-editable. The evaluator has to select the rating from the drop down list for the respective evaluation parameter on the basis of the match with Parameter Description.

The evaluator has to rate each student for all the evaluation parameters as per the above scale. The chart auto-calculates the final score at the bottom of the sheet only after all parameters are rated.

Advantages of using Rubrics for Project Evaluation There are comprehensive advantages of using Rubric methodology for Project Development Work Evaluation chart. These are as follows:

The sheet is designed in such a way that it provides minimum key-presses. Hence provides Ease of Usage.

Auto-calculation of score is provided. This reduces the time required to generate final report significantly.

The User Interface is clean and extensible. The sheets can be easily extended to accommodate large number of

scores. Usage of these sheets ensures appropriate usage of evaluation

framework.