QUESTION BANK PREPARATION, VALIDATION, MODERATION OF PANEL

QUESTION BANK PREPARATION

INTRODUCTION:

Question paper is an instrument which is used in theory examination. It has four characteristics – relevance, objectivity, reliability and validity. Without adequate preparation of question paper will be an unless tool in summative evaluation.

TERMINOLOGY:

Validity :

Extent of a currency in a test in measuring whatever it has to measure.

Halo effect:

A know idea of an examiner that a student performance in previous test is known which results in information effect.

Multiple response items:

When two or more answers are correct in M.C.Q code given for answer is to be selected.

Reliability :

Extent of consistency in a test in measuring whatever it has to measure.

Secrecy:

A method of achieving something that is not generally known by others.

Pictorial:

To do with pictures.

Viva-voce:

Oral examination tool to test the thinking power of a student rather than assessing the depth of knowledge.

DEFINITION:

A question bank is a planned library of test items designed to fulfill certain predetermined purposes. Question bank should be prepared with atmost care so as to cover the entire prescribed text. Question bank should be exhaustive and cover entire content with different types.

PURPOSES:

To improve the teaching learning process Through instructional efforts the pupil’s growth will be obtained To improve evaluation process A pool of test items can be used for formative and summative

evaluation of the pupil’s performance It is a pool of readymade quality question is made available to teachers

and examiners. So that they may select appropriate questions to assess predetermined objectives.

SPECIFICATION OF PAPER SETTINGS:

This is a two dimensional tables by concerned university given quantum of questions where objective tested are also noted.

Paper setting should have a model answer where marks for the points specified. Estimated time should be sufficient for answering all questions.

Objective / content Long essay, short essay, short answer

Marks

Recall type Long essay, short essay, short answer

Marks

Interpretation type Long essay, short essay, short answer

Marks

Problem solving type Long essay, short essay, short answer

Marks

Area Question type Marks MODEL QUESTION PAPER:

This is usually supplied by universities to question paper setter which specifies the requirement. This is also called item card to its contains of items.

PROCEDURE OF QUESTION PAPER SETTING:

a) Plan, design for question paperb) Make list of specificationc) View model question paper sent by the universityd) Specify types of questions, marking and possible model answere) Read again for any correctionsf) Give final review of question paperg) Write, dispatch and maintain confidentiality

Planning and design:

This needs syllabus review, duration of question paper, marks allotted scheme of examination and objectivity of recall, interpretation as well as problem solving, weighing for all types of questions and for content topic given. Guideline and instruction are noted.

Specification:

Objectives sorted out to elicit knowledge, understanding and application.

Model question paper:

After view of model question paper sent by university, tally with your design and specifications, at this stage we can rectify our design and specification suiting to affiliated universities.

Types of questions and marking:

By reforming sample U.G and P.G question paper you can give this information.

Corrections:

This helps in refining, editing to question paper. Clarify and spelling mistakes are got corrected.

Review:

This helps in checking options, sections, difficulty level of the paper, grouping, numbering and instructions are checked.

Confidentiality:

All precautions for maintaining confidentiality as required. Suggested checklist to review the question paper.

Within curriculum Syllabus covered Weightage to topics Not too easy Not difficult Performance possible by category of learners What is the format What about clarify Any repetition Answerable in given time duration Standardized

Above lines of approach, systematically done, definitely improve question paper setting in the examination.

ESSAY TYPE QUESTIONSWe have come across one single question to be answered in 3

hours which used to be of essay type of question. Invariably even today many question paper are encounted containing 3 questions to be answered in 3 hours either for grading or for marking. There is a change of traditional essay type to answer with reasoning and for lucid expression.1. Traditional style:

Write an essay on health for all by 2000 AD Write an essay on family planning

2. Modern style: Explain the concept of health for all by 2000 AD and ways and

means of achieving it in India. How would you organize in a taluk head quarters of your

district. It is easy to construct Framing is not a difficult task allows free expression May allow effective expressions It tests knowledge gained by the learner It brings out learners reasoning capacity It brings out learners organize ideas and planning.

ESSAY TYPE QUESTIONS SHOWS DISADVANTAGES:

Range of application of knowledge is limited questions lack objectives They may not be consistent time allotted like 1 hour, 3 hours etc is too much and is

improper for scoring system Teacher may not get feedback If there is no in-depth knowledge, whole answer will be just

a guess work.

DESIGNING ESSAY QUESTIONS:

Have syllabus on hand and view it fully Select a few topic, in random to have good coverage Have a checklist and specific points for a good marking system suggest no options Avoid few question of long answer Prefer many questions requiring short answers No ambiguous definitions in questions questions should be completed in stipulated time.

STRUCTURE OF ESSAY QUESTIONS:

Modified essay questions:

Modified essay questions are another face of answer questions. certain amount of data is provided and a question is asked to elicit the answer.

Physical examination of patient Investigation of disease Line of management of case

Patient management problem:

This is similar to simulated patient management problemsw in the teaching learning process, along with illustrations.

MULTIPLE CHOICE QUESTIONS ( M.C.Q)

In every field M.C.Qs are more commonly used method of evaluation for some response.

That M.C.Qs are becoming popular That M.C.Q are more available for reliable evaluations system. M.C.Qs are more valid system

M.C.Q accepted norms in evaluation easy for mass scale evaluation easy for examiner.

PRINCIPLES IN M.C.Q PREPARATIONS:

No overlapping items should be selected. It must be an independent item

Item should be such that it should be possible to correctly answer by student with good preparation and analytical skills

item must be such that it should be wrongly answered by students despite good preparations but with lower analytical skill

Design should be measured a major learning outcome the standard of M.C.Q should be appropriate to the level of students

learning.

KEY ELEMENTS IN M.C.Q:

Precise and proper direction for item use of clear and simple language Stem should have one formulated problem Alternatives should be grammatically consistent with the skill Should have a clear answer Word like expert not always etc are made easily visible As far as possible negative form of stem is avoided A compact item is prepared out of common elements Length of response and distracters should be same No clue should be given Distracters should have meaning and should be related to

question extra care should be used when words like “all of the above” and

“none of the above” are used double positive and double negative and abbreviations are

avoided when numbers are answers they should appear either in

ascending order or in descending order. Item should be homogenous in matching, better if more response

options are given.TYPES OF MCQ:

SINGLE ANSWER TYPE:

This format calls for recalling of facts .if there is a component of interpretation , analysis and problem solving , then it really serves the purpose examiners should find proper plausible alternatives.

MULTIBLE ANSWER TYPE QUESTION: This is an improved version of type of single answer type . it requires higher level of cognition . this contain two statement.A-statement are true and related.B- statement are true but not related.C- first statement are true , the second is false.D-first statement is false. second is true.E-Both statements are false.NILL TO FIVE TYPE: In multiple true false , any combination is possible starting from 0true or false to all true to all false. To each of the alternatives of the item given below indicate true or false in appropriate bracket.PARAMETERS MATCHING TYPE: The direction given to candidate shall be to match list A by writing appropriate letter against numbered headings.PICTORIAL TYPE: Any picture with delineated pathology marking does the job of assessing the knowledge of the candidate about structure, function, course of clinical situation or date interpretation.

MULTIBLE FACET TYPE: It is method to assessing multiple abilities about one topic for testing higher order of intellectual ability , multiple facets M.C.Q is very useful.

VALIDATION:DEFINITION: It is defined as make or declare legally valid.

PREVALIDATION: It starts even before the construction of M.C.Q what educational outcome in terms objectivity required is answered.

USES OF PRE VALIDATION: Relevance is obtained . Grammatical correction done. Plausibility of distracters checked.

USES OF POST VALIDATION: development of M.C.Q question bank. Can be used as effective tool in class room teaching. Avoids dangerous situations. A feed back to teachers . Create better learning process.

OBJECTIVES STRUCTURED CLINICAL EXAMINATION:

DEFINITION:

Objective structured clinical examination is methods of assessment in clinical and practical examinations. where predetermined decisions are made on the competencies being tested , where check lists are prepare for a good rating.

ADVANTAGES :

Valid Well predetermined objective . Standardized problem , patient. Interest maintained. Feed back obtained.

DISADVANTAGES:

Compartment wise. time consuming Low acceptance by examiners. Boredom to examiners.

ESSENTIAL STEPS IN PLANNING OF VIVA VOCE:

Tasks and abilities to be tested should be listed . Specific domain is identified such as cognitive , affective or

communication. usual question are listed before hand . Pre validation of such questions are done.

Questions made clear –cut questions.

MODERATION OF PANEL:

DEFINITION :

Moderation is the process of controlling topics and its associated information .in zoho discussions , administrators can assign moderation and configure the required moderation permission to manage every forum in the portal.

GUIDELINES FOR MODERATING A PANEL:

BEFORE THE EVENT:

After reviewing information on the event , sponsoring organization, and attendees ., determine the purpose of the panel presentation.

Invite individual presenters based on the following criteria, standing in the company or industry , ability to speak on the topic , and complement perspectives to speak with in the designated time limit.

once an individual has accepted your invitation to speak , confirm his or her participation in writing , providing information regarding the day , time, and place of the panel, with instructions on how they can get to the facility.

Confirm spelling and pronunciation of speakers names, titles and affiliations request biographies, background information, and visual equipment required.

After confirming individual speakers and before the presentation, follow up to answer questions and as necessary, assist with presentation development.

Ask if the speakers will have materials distribute to attendees , before the event .

Write your introduction for the panel . which relates the panel presentation to the event as a whole.

write your introductions for the speakers .its recommended that each speakers be introduced briefly at the beginning of the event then more detail, before the actual presentation.

A day or two before the event call panelist to confirm time and place of a meeting on the day of the event to meet each other and review panel logistics.ON THE DAY OF THE EVENT:

Check the set up of the room , and make sure that microphones and audio visual equipment work.

Conduct a final briefing with panelist review the flow of panel , speaking order.

Time the individual speakers establish a signal that informs speakers when they should conclude their remarks.

Introduce the panel . Introduce the individual speakers , as outlined . At the conclusion of the prepared remarks ,solicit questions. It a

microphone is available for attendees to use , it may be wise to repeat questions .

At conclusion on the question and answer period , thank the speakers . mention that each will be available to answer additional questions immediately after the event. or in the future.

As soon as possible after the conclusion of the event , send thank you notes to the individual panelists.

MEETINGS:

Moderation panel meet 12 times a year normally for around 3 hours . if more than 12 cases are due to be considered . then moderation panel may meet for up to a full day.

During August each year ,dates are fixed for the following years meetings .panel members are sent the relevant papers prior to each meetings.

CONCLUSION:

Evaluation is the process of judging the value or worth of an individuals achievements or characteristics. validity , reliability and us ability are the three main characteristics of an achievement test. internal assessment should be in corporated wisely into the total nursing educational programme and should supplement the university examinations.

BIBLIOGRAPHY:

1. B.T. Basavanthappa 2003 “TEXT BOOK OF NURSING EDUCATION” I edition , Newdelhi jaypee brothers publications , page no:473-476, 537-539.2. K.P. Neeraja (2003) “ TEXT BOOK OF NURSING EDUCATION” I edition ,NewDelhi jaypee brothers publications page no: 419-426.

3. Loretta.E. Heidgerken (1997) “TEACHING AND LEARNING IN SCHOOL OF NURSING” 3 edition NewDelhi , Jaypee brothers publications, page no: 446 448.4. B. Sankaranayan etal (2003) LEARNING AND TEACHING NURSING” I EDITION, Calicut Brainful publications page no: 239-255.