CYBERPSYCHOLOGY & BEHAVIORVolume 3, Number 1, 2000Mary Ann Liebert, Inc.
Designing a Better Learning Environment with the Web:Problems and Prospects
ANDREW DILLON, Ph.D.
The virtual university looms inevitably on the horizon, and Web-based education requireshypermedia technologies to be designed and implemented in a learner-centered fashion. Todate, the technology has not been well designed and the evidence for learning advantages isvirtually nonexistent. In the present article, two claims about web-based educational tech-nologies are made and defended: that the technology is poorly designed from a users per-spective, and that the theories of instructional design that we require to build better learningenvironments do not exist. The field of educational technology is thus presented as both theculprit and the victim of these shortcomings. Suggestions for improving this scenario are pre-sented.
IN A RECENT REVIEW of the empirical findingson hypermedia and learning outcomes, Dil-lon and Gabbard1 concluded that contrary tomany peoples assumptions, the use of hyper-media-based instructional systems in educa-tion had not produced significant learninggains. Indeed, their review concluded that suchinstructional technologies rarely showed anybenefit for learners over existing paper- or lec-ture-based instructions. Although it is com-monplace these days to dismiss as irrelevantany media comparison study, the Dillon andGabbard review went further, also examiningcomparisons made between alternative hy-permedia implementations (a within-mediacomparison) and between single and grouplearners employing this technology. Becausehypermedia is the underlying technology of theWorld Wide Web, their findings made de-pressing reading for those of us who believe
that this technology is important and could beput to powerful instructional use.
The present issue contains papers from manyleading theorists who advocate the use and ex-ploitation of information technologies such ashypermedia and the World-Wide Web in ourclassrooms, and I am not completely in dis-agreement with them. However, I wish to ques-tion the very assumptions on which the use ofthe Web and standalone hypermedia applica-tions are based. What I aim to provide in thisarticle is a sense of the gaps in our knowledge,and to speculate on why education is so poorlyserved by the wonderful technologies that arewithin our grasp.
Two major claims are made: (1) the applica-tion of educational technology is poorly servedby the fields weak analysis and limited un-derstanding of the basic human engineering is-sues of usability and user-centered design; and(2) the theoretical analysis of learning is un-necessarily partitioned into competing grand
HIC Laboratory, SLIS, Indiana University, Bloomington, IN.
views, or paradigms, that place less emphasison empirical analysis of learning and more onreifying the field of education.
This is no Luddite treatise. It is a call to arms;a request for proponents to challenge assump-tions about learning technologies, to test theclaims made for them, to design instructionaltechnologies in a learner-centered manner.
WHY THE WORLD WIDE WEB?
On one hand it is easy to get caught up inthe hype of the Web. After all, it is a marvel ofinformation access, worldwide connectivity,and even, in some rare cases, ease-of-use. Therehas never been an information technologyquite like it, and it is tempting to dismiss thenay-sayers as ignorant stick-in-the-muds,clinging to outdated views of computers, teach-ing, and learning. But a closer look at the Weband variant hypermedia-based technologiesthat aim to support education through cyber-space throws up some interesting questionsthat require more serious consideration.
One such question is why the Web shouldoffer us anything special for instruction? Afterall, since when did information access and presentation equate to instruction? We can in-corporate more information for learners to ex-plore, navigable by link structures, and this cer-tainly can enable greater and faster access tomore information than most educational li-braries provide, but is this enough to ensurelearning? We can communicate over a distance,allowing isolated individuals to form groups,to contact experts, and to share information inreal-time and off-line. Again, this could all bedone by older technologies but that is not mymajor concern because the Web is surely a moreattractive, powerful, and responsive environ-ment for these activities. My concern is the rel-evance of such capabilities to learning.
In my view, while these features are certainlymajor drivers toward acceptance of Web tech-nology by a large user population, none of theabove advantages are in themselves major dri-vers of learning outcome. This is crucial be-cause, if true, it seems that the lure of the Webhas little or anything to do with learning. If wetry to understand why educationalists are so
enamoured of links and nodes then we need tolook elsewhere. Consider, for example, the typeof claim made for Web technology in the learn-ing context. It is seen as a breakthrough in cognitive compatibility, more natural, morelearner-centric, more adaptable, and more flex-ible than any previous technology (see Dillon2
for a review of the claims). Each of these claimsought to be examined critically by education-alists but too often they are assumed, taken forgranted as obvious or self-evident truths. Evi-dence in their favor is normally anecdotal,rarely, if ever, derived from well-controlledstudies. After more than 50 years of existenceas a field of enquiry, this is a poor state of af-fairs for educational technology.
Unintended consequences of technologies al-ways follow any implementation (e.g., the easeof communication afforded by E-mail has theeffect of swamping some experts with innu-merable requests, frequently trivial ones thatcould be answered with existing resources).Technologies are frequently designed with lit-tle consideration of usability, yet it is good hu-man factors design that at least ensures the pri-mary advantages of technology (mentionedabove) can be exploited. Perhaps even moreworrying, there is little consideration of themeasurable learning advantages that might ac-crue from Web use, greater emphasis beingplaced on preference than performance, de-spite evidence that these two variables maycontradict each other in interactive tasks.3
Does the Web have a place in education? Ofcourse it does but to gain that place requires ef-fort to be spent on design, testing, and refine-ment of resources that are targeted appropri-ately at the learning contexts most likely tobenefit. You cannot develop a reasoned case orargument by merely stringing words together,yet it appears that just offering information viaweb links is all that is needed to make an on-line learning environment. Just as the thesisneeds to refine, build, and sequence ideas, us-ing words and figures as bricks in a planned,meaningful fashion to construct a case, so doesa Web environment require planning, organi-zation, and revision in order to convey struc-ture and offer instruction. Web-based instruc-tion has a long way to go before it can compete.Any headlong rush to embrace the technology
as a panacea for instructional design is flawedand fanatical.
BUILDING FOR USETHE HUMANFACTORS OF INTERACTION
The Web is here and it will not go away. Sohow can we best exploit it? In the first instance,any interactive technology must be designedfor usability by which I mean we must considerthe effectiveness, efficiency, and satisfactionwith which the intended users can employ thetechnology. To do this we must design forlearning contexts, meaning we must analyzeour learners, their instructors, the tasks to besupported and the physical and social envi-ronment in which the learning is to occur.Twenty years of research into humancom-puter interaction (HCI) has shown that withoutsuch analyses, the chances of ever developinga technology that is accepted by users andyields the desired benefits are significantly re-duced. While I suspect few instructional tech-nologists would disagree with the paragraphabove, I contend that too few of them will havestudied the human factors findings on interac-tion deeply enough to learn the lessons it mightimpart. It surprises many to find that there isan extensive empirical literature on usabilityand usefulness that explains, for example, whypeople read up to 30% slower on screen, whyusers experience significantly greater disorien-tation with hypermedia than with paper, thatusers tend to imbue human characteristics tosoftware, or what determines long-term useracceptance of new technologies. This literatureis not largely the work of instructional tech-nologists, but its relevance to their goals is un-deniable. Too often it seems, learning tech-nologies are designed without any properaddressing of the factors that are important tousable and useful design and implementation.Some times these technologies are even de-signed in contradiction to such factors. This ar-ticle is not the appropriate vehicle for a reviewof that literature, but the interested readerwould do well to consult such resources as He-lander et al.4 or Dillon5 for basic reviews.
An interaction analysis makes us focus firstand foremost on the activities a learner will per-
form and I believe this is a key reason for thefailure of HCI findings to break into the in-structional domain where current conceptionsof learning are attempting to move away fromtraditional instructional models predicated onnarrow tasks or prescribed task sequences. In-deed, there is at least a superficial similarity be-tween the HCI approach to design analysis andthe behavioral objectives tradition of 1960s in-structional design. However, I would