A pilot study comparing the effectiveness of conventional training and virtual reality simulation in the skills acquisition of junior dental students

Embed Size (px)

Text of A pilot study comparing the effectiveness of conventional training and virtual reality simulation in...

  • A pilot study comparing the effectiveness of conventional

    training and virtual reality simulation in the skills

    acquisition of junior dental students

    Frank Quinn1, Paul Keogh1, Ailbhe McDonald2 and David Hussey3

    1Dublin Dental School and Hospital, Lincoln Place, Dublin 2, Republic of Ireland; 2Eastman Dental Institute for Oral Healthcare Sciences, 256 Grays InnRoad, London WC1X 8LD, UK; 3Royal Victoria Dental School and Hospital, Royal Victoria Hospital Group Trust, Grosvenor Road, Belfast BT12 6BP, UK

    The use of virtual reality (VR) in the training of operative dentistry isa recent innovation and little research has been published on itsefficacy compared to conventional training methods. To evaluatepossible benefits, junior undergraduate dental students wererandomly assigned to one of three groups: group 1 as taughtby conventional means only; group 2 as trained by conventionalmeans combined with VR repetition and reinforcement (withaccess to a human instructor for operative advice); and group3 as trained by conventional means combined with VR repetitionand reinforcement, but without instructor evaluation/advice,which was only supplied via the VR-associated software. Atthe end of the research period, all groups executed two class1 preparations that were evaluated blindly by expert trainers,under traditional criteria (outline, retention, smoothness, depth,wall angulation and cavity margin index). Analyses of resultingscores indicated a lack of significant differences between thethree groups except for scores for the category of outlineform, for group 2, which produced significantly lower (i.e. better)scores than the conventionally trained group. A statisticalcomparison between scores from two expert examiners

    indicated lack of agreement, despite identical written and visualcriteria being used for evaluation by both. Both examiners,however, generally showed similar trends in evaluation. An anon-ymous questionnaire suggested that students recognized thebenefits of VR training (e.g. ready access to assessment, erroridentification and how they can be corrected), but the majorityfelt that it would not replace conventional training methods(95%), although participants recognized the potential for devel-opment of VR systems in dentistry. The most common reasonscited for the preference of conventional training were excessivecritical feedback (55%), lack of personal contact (50%) andtechnical hardware difficulties (20%) associated with VR-basedtraining.

    Key words: virtual reality; skill acquisition; self-directed and self-paced learning; real-time feedback; objective evaluation.

    Blackwell Munksgaard, 2003Accepted for publication 6 March 2002

    FOR many decades, mechanical simulation deviceshave been used in training exercises, such as inaerial and marine aviation. They have also been

    employed for the rehearsal of reaction protocols in

    hazardous or potentially hazardous situations, thereby

    eliminating the risk of injury, loss of life or damage to

    expensive equipment. The earliest widespread use of

    this technology was in competitive or hazardous

    arcade games, e.g. aerial combat and car racing.

    Associated with the rapid increase in computing

    speeds and miniaturization of components (1), the

    application of virtual reality (VR) has increased dra-

    matically, particularly due to the ubiquitous presence of

    the home computer. In the healthcare area, VR has had

    limited integration into the acquisition of surgical skills

    (e.g. suturing and keyhole surgery) and planning of

    individual surgical procedures, particularly implant,

    craniofacial and neurosurgical procedures (2, 3). With

    respect to skills acquisition, VR-based training has been

    utilized for the repeated use of a standardized simu-

    lated patient (4).

    Dental students are expected to be competent at a

    large array of procedures on certification; indeed, in

    many countries, no further training is compulsorily

    required. This is very different from medical graduates

    who are required to undergo extensive postgraduation

    vocational training. The large number of undergradu-

    ate dental procedures, which must be mastered, have

    traditionally been tested by practical examinations. The

    subjective nature of these tests, and their associated

    stress, has led to many dental faculties replacing them

    with competence tests (5, 6), which are organized,

    within certain limits, at the students convenience

    and assessed under objective or semiobjective criteria

    Eur J Dent Educ 2003; 7: 1319Printed in Denmark. All rights reserved

    13

  • (7, 8). The use of standardized VR scenarios may be

    beneficial in the preparation and reinforcement of

    required procedures (9). There may be additional appli-

    cations for postgraduate students, to revise operative

    and fixed prosthodontic procedures, and continuing

    dental education. Once assessment criteria have been

    universally accepted within the faculty, VR prepara-

    tions and evaluations may be used to standardize

    teachers and improve conventional teaching.

    Computing speeds and costs have remained a con-

    straining factor for the widespread use of specialized

    systems to relatively small consumer groups, such as

    dental undergraduates. In the last 5 years, however, a

    dental patient simulator has been developed and

    marketed for the training of undergraduate dental

    students. This simulator consists of a conventional

    torso and movable head, with integral maxillary and

    mandibular jaws, which carry conventional plastic

    teeth. There is an operatory-type light, suction and a

    bracket table, carrying an ultra-high speed handpiece

    and air/water syringe. With these components, train-

    ing in operative dentistry can be undertaken in a

    manner identical to conventional methods.

    The novel components are light emitting diodes on

    both the head and the handpiece and a tracking camera

    that monitors head and handpiece movements (Fig. 1).

    There are two personal computers: one to collate track-

    ing information and the second to integrate all data and

    execute the associated VR software. Finally, there is a

    video screen which presents real-time virtual images to

    the operator (Fig. 2).

    At the time of this project, the systems software

    allowed several operative and fixed prosthodontic pro-

    cedures. It is postulated that the use of these options

    would be superior to conventional training, with plastic

    teeth, as the individual layers of the natural tooth are

    represented in the virtual tooth, including dentinal

    carious lesions. Preparations may be viewed from

    many angles and at varying magnification; these fea-

    tures may improve student understanding and self-

    assessment (10, 11). The image of the virtual mouth and

    tooth provide real-time information feedback of the

    actual preparation cut on the tooth analogue. The

    operator-controlled magnification may improve visua-

    lization of cavity detail (12).

    The software has an integrated database of theoretical

    information, ranging from conventional principles of

    cavity preparation to the pathology of the carious

    lesion. This database is continuously accessible during

    training sessions. In addition, there is a glossary of

    dental terms, with associated multimedia explanations.

    A final, and perhaps most important, benefit of this

    simulation unit is that the software will analyze the

    preparation, on request, and provide detailed written

    and two-dimensional graphic evaluation of the pre-

    paration (Fig. 3). Alterations may then be made and

    the preparation re-evaluated. This encourages self-

    directed and deep learning and self-paced skills

    Fig. 1. Operator, torso with handpiece and display of VR mouth.

    Fig. 2. The real-time display with magnified virtual tooth pre-paration.

    Fig. 3. VR-based analysis of cavity preparation, compared to presetideal parameters.

    Quinn et al.

    14

  • acquisition (11, 13, 14). It is postulated that thesebenefits will aid the different styles and rates of learning

    (15). This self-direction and self-pacing has been advo-

    cated by many authorities due to the overloaded nature

    of modern dental curricula and the bulimic nature of

    conventional teaching methods (16). This term refers to

    the cramming of large amounts of theoretical informa-

    tion, in excessive detail and regurgitating it for an all

    or nothing assessment. All too often, the information

    is then discarded and never reviewed again. This

    approach favours shallow or poorly retained learning.

    The system administrator/course coordinator can

    control access to specific, appropriate lessons. This

    is managed via a programmable user database and

    unique passwords. Operator access to lessons may

    be limited to specific groups or during a particular time

    frame. The duration allowed per individual procedure

    may also be limited, if so desired. The procedures, once

    selected, present clinical details and radiograph(s) for

    perusal by the student; they may then proceed to the

    virtual mouth and operative procedures completed.

    This integration of clinical information and procedures

    is believed to lead to improved knowledge acquisition

    and retention.

    Individual sessions for students may be stored for

    later review, either by the student or by an instructor.

    The review is in the form of a real-time video playback,