8
Linking Laboratory and Pharmacy Opportunities for Reducing Errors and Improving Care Gordon D. Schiff, MD; David Klass, MD; Josh Peterson, MD; Gaurav Shah, MD; David W. Bates, MD, MSc A myriad of errors and lost improvement opportunities result from failure of clinical laboratory and pharmacy information systems to effectively communicate. Pharma- cotherapy could benefit from enhanced laboratory-pharmacy linkage with respect to (1) drug choice (laboratory-based indications and contraindications), (2) drug dos- ing (renal or hepatic, blood level–guided adjustments), (3) laboratory monitoring (laboratory sig- nals of toxicity, baseline and ongoing monitoring), (4) laboratory result interpretation (drug in- terfering with test), and (5) broader quality improvement (surveillance for unrecognized toxicity, monitoring clinician response delays). Linkages can be retrospective or real-time. Many organi- zations could benefit now by linking existing pharmacy and laboratory data. Greater improve- ment is possible through implementation of electronic order entry with real-time decision support incorporating linked laboratory and pharmacy data. While many guidelines, admonitions, and rules exist regarding drugs and the laboratory, substantial new knowledge and evidence in this area are needed. Focusing on these unmet needs and accompanying logistical challenges is a priority. Arch Intern Med. 2003;163:893-900 A physician prescribes potassium supple- mentation for a patient who is hyperka- lemic, fails to adjust the dose of gentami- cin in a patient with impaired renal function, continues a theophylline infu- sion in a patient who has toxic theophyl- line levels, continues an antibiotic for a pa- tient whose blood cultures show an organism resistant to that drug, or fails to perform recommended monitoring of liver or muscle enzyme tests in patients taking troglitazone or cerivastatin sodium. These are examples of errors that have oc- curred commonly, yet could have been prevented if laboratory and pharmacy in- formation systems communicated more ef- fectively. 1-7 Drug errors related to laboratory is- sues commonly injure patients, both in- side and outside the hospital. One study found that adverse drug events occurred in 6.5 of 100 admissions; 28% of these ad- verse drug events were judged prevent- able. Errors were most often due to drug dosing and selection problems related to laboratory parameters. 8 Using computer- ized screening, Hulse et al 9 found that 5% of 13 727 patients had potential drug prob- lems, with drug-laboratory issues repre- senting the leading reason (44.9% of the positive screens). In another inpatient study of more than 2100 pharmacist- detected medication errors, the leading type of error identified (13.9% of all er- rors) was excessive dosing for patients with impaired renal and hepatic function. 10 Ad- verse drug events also occur frequently in From the Department of Medicine, Cook County Hospital (Drs Schiff and Shah), Rush Medical College (Dr Schiff), Chicago, Ill; State of Illinois Department of Mental Health, University of Chicago Medical School (Dr Klass); Center for Health Services Research, Vanderbilt University Medical Center, Nashville, Tenn (Dr Peterson); and Division of General Internal Medicine, Brigham and Women’s Hospital and Partners Healthcare Information Systems, Boston, Mass (Dr Bates). Dr Klass is now with VigiLanz Corporation, St Paul, Minn. Dr Bates has received honoraria for speaking from the Eclipsys Corporation, Boca Raton, Fla, and from Automated Healthcare; is a coinventor on patent No. 6029138 held by Brigham and Women’s Hospital on the use of decision support software for medical management, licensed to the Medicalis Corporation, Waterloo, Ontario; holds a minority equity position in Medicalis Corporation; is a consultant and serves on the advisory board for McKesson MedManagement, Brooklyn Park, Minn; is on the clinical advisory boards for Zynx Inc, Beverly Hills, Calif, and SoCurious Inc, San Francisco, Calif; and is a consultant for Alaris, San Diego, Calif. Drs Schiff, Peterson, and Shah have no relevant financial interest in this article. REVIEW ARTICLE (REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM 893 ©2003 American Medical Association. All rights reserved. Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

PharmLab

Embed Size (px)

Citation preview

Page 1: PharmLab

Linking Laboratory and Pharmacy

Opportunities for Reducing Errors and Improving Care

Gordon D. Schiff, MD; David Klass, MD; Josh Peterson, MD; Gaurav Shah, MD; David W. Bates, MD, MSc

A myriad of errors and lost improvement opportunities result from failure of clinicallaboratory and pharmacy information systems to effectively communicate. Pharma-cotherapy could benefit from enhanced laboratory-pharmacy linkage with respect to(1) drug choice (laboratory-based indications and contraindications), (2) drug dos-

ing (renal or hepatic, blood level–guided adjustments), (3) laboratory monitoring (laboratory sig-nals of toxicity, baseline and ongoing monitoring), (4) laboratory result interpretation (drug in-terfering with test), and (5) broader quality improvement (surveillance for unrecognized toxicity,monitoring clinician response delays). Linkages can be retrospective or real-time. Many organi-zations could benefit now by linking existing pharmacy and laboratory data. Greater improve-ment is possible through implementation of electronic order entry with real-time decision supportincorporating linked laboratory and pharmacy data. While many guidelines, admonitions, and rulesexist regarding drugs and the laboratory, substantial new knowledge and evidence in this area areneeded. Focusing on these unmet needs and accompanying logistical challenges is a priority.

Arch Intern Med. 2003;163:893-900

A physician prescribes potassium supple-mentation for a patient who is hyperka-lemic, fails to adjust the dose of gentami-cin in a patient with impaired renalfunction, continues a theophylline infu-sion in a patient who has toxic theophyl-line levels, continues an antibiotic for a pa-tient whose blood cultures show anorganism resistant to that drug, or fails toperform recommended monitoring of liveror muscle enzyme tests in patients taking

troglitazone or cerivastatin sodium. Theseare examples of errors that have oc-curred commonly, yet could have beenprevented if laboratory and pharmacy in-formation systems communicated more ef-fectively.1-7

Drug errors related to laboratory is-sues commonly injure patients, both in-side and outside the hospital. One studyfound that adverse drug events occurredin 6.5 of 100 admissions; 28% of these ad-verse drug events were judged prevent-able. Errors were most often due to drugdosing and selection problems related tolaboratory parameters.8 Using computer-ized screening, Hulse et al9 found that 5%of 13727 patients had potential drug prob-lems, with drug-laboratory issues repre-senting the leading reason (44.9% of thepositive screens). In another inpatientstudy of more than 2100 pharmacist-detected medication errors, the leadingtype of error identified (13.9% of all er-rors) was excessive dosing for patients withimpaired renal and hepatic function.10 Ad-verse drug events also occur frequently in

From the Department of Medicine, Cook County Hospital (Drs Schiff and Shah), RushMedical College (Dr Schiff), Chicago, Ill; State of Illinois Department of Mental Health,University of Chicago Medical School (Dr Klass); Center for Health Services Research,Vanderbilt University Medical Center, Nashville, Tenn (Dr Peterson); and Division ofGeneral Internal Medicine, Brigham and Women’s Hospital and Partners HealthcareInformation Systems, Boston, Mass (Dr Bates). Dr Klass is now with VigiLanzCorporation, St Paul, Minn. Dr Bates has received honoraria for speaking from theEclipsys Corporation, Boca Raton, Fla, and from Automated Healthcare; is a coinventoron patent No. 6029138 held by Brigham and Women’s Hospital on the use of decisionsupport software for medical management, licensed to the Medicalis Corporation,Waterloo, Ontario; holds a minority equity position in Medicalis Corporation; is aconsultant and serves on the advisory board for McKesson MedManagement, BrooklynPark, Minn; is on the clinical advisory boards for Zynx Inc, Beverly Hills, Calif, andSoCurious Inc, San Francisco, Calif; and is a consultant for Alaris, San Diego, Calif.Drs Schiff, Peterson, and Shah have no relevant financial interest in this article.

REVIEW ARTICLE

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM893

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 2: PharmLab

nursing homes, where an evengreater proportion are prevent-able.11 In this setting, insufficientlaboratory monitoring, especially foranticoagulation therapy, is a lead-ing cause of error.11 Although fewerdata are available for outpatients,medication-related problems arecommon outside the hospital, anddeficiencies in monitoring are espe-cially prominent.12 One recent studyfound that 79% of adverse drugevents detected by linking drugswith laboratory “signals” went rou-tinely unrecognized.13

Laboratory information is criti-cal to selecting and managing medi-cations, yet the clinical laboratory andpharmacy are remarkably discon-nected.1,13,14 While the pharmacy is re-sponsible for filling orders and dis-pensing medications, the laboratorymonitors various effects of these ad-ministered chemicals. Despite thiscomplementary relationship be-tween the clinical laboratory and thepharmacy, these 2 departments, theirpersonnel, their work processes, andparticularly their information sys-tems rarely communicate.14,15 This isespecially true in the outpatient set-ting, where the vast majority of drugsand tests are ordered.12

This disconnect even carriesover to quality improvement ef-forts, which often fail to leveragelaboratory and pharmacy data to re-duce errors and improve care.16-19

For example, at the laboratory end,recent symposia on improving theclinical use of laboratory informa-tion fail to even mention linkageswith medications,20-23 and an other-wise comprehensive pharmacist-edited book from the Institute forSafe Medication Practices on pre-venting medication errors barelytouches on the subject of better con-nection to the laboratory.24

LINKING LABORATORYAND PHARMACY:

RATIONALE AND MODEL

Many medication errors could beprevented if laboratory and phar-macy information systems “talkedwith each other.”16,25 However, frankerrors are just the tip of the ice-berg. Communication between these2 systems, linked with appropriateknowledge-based rules, has broadpotential to improve the quality ofmedical care.9,26-29 With such link-ages, drug toxicity can be more re-liably prevented and more promptly

recognized and addressed when itdoes occur.

Linking tests and treatmentscan improve the utilization and qual-ity of both laboratory testing andpharmacotherapy, as well as createopportunities for improved out-comes and learning. Such linkagescan either be retrospective, linkingdownloaded laboratory and phar-macy files, or real-time via emerg-ing intelligent order-entry systems.Although most hospitals and healthsystems do not currently have the ca-pability for real-time linkage, virtu-ally all could, but fail to, retrospec-tively tap into existing systems tolink laboratory and pharmacy data,thereby missing improvement op-portunities residing in existing datasystems.

In this article, we describe 10ways in which laboratory and phar-macy data can be related to im-prove patient care (Table 1).

Drug Selection

Powerful software has been devel-oped to check whether a patient’sdrug prescription conflicts with hisor her insurance company’s formu-lary, although the benefits of this (if

Table 1. Ten Ways Lab and Pharmacy Can Be Linked to Improve Care

Category Concept Examples (Drug—Lab Pair)*Special Role for theComputer/Linkages

Drug selection 1. Lab finding contraindicates drug + Pregnancy test—ACE inhibitor↑SUN/Cr—metformin hydrochloride

Prevents prescription writing ordispensing

2. Lab finding suggests indication for drug ↑ TSH—levothyroxine sodium↑ Cholesterol—lipid-lowering treatment

Generates timely reminders,tracking intervention

Dosing 3. Lab finding affecting drug dose ↑ Creatinine—digoxin, vancomycinhydrochloride

Performs dose calculations basedon age, sex, lab value, weight

4. Drug requiring lab measure for titration Warfarin sodium—PT/INRAnticonvulsants—drug levels

Statistical process control dosingadjustment charts

Monitoring 5. Abnormal lab value signaling toxicity Liver enzymes—isoniazid, glitazones↓ HCT, WBC—chloramphenicol

Triggers alert, assesses likelihood

6. Drug warranting lab value monitoring for toxicity Clozapine—WBCAmphotericin B—creatinine

Oversees scheduling of both baselineand serial monitoring tests

Lab interpretation 7. Drug influencing or interfering with lab finding Carbamazepine—free thyroxineQuinolones—false-positive urine opiates

Warns against/interpretsfalse-positives and false-negatives

8. Drug impacting on response to lab finding Insulin—↓ or ↑ glucosePenicillin— + RPR

Resets alarm threshold for treatedpatients

Improvement 9. Drug toxicity/effects surveillance Detects signals of previouslyundocumented reaction (eg,hepatotoxicity)

Data mining of lab and drug data togenerate new hypotheses of drugeffects

10. Quality oversight Treatment delay after abnormal results(↑ TSH, ↑ K+, + blood culture) andinitiation of appropriate treatment

Monitors time interval between labtesting and prescription change,adequacy/appropriateness of labmonitoring

Abbreviations: ACE, angiotensin-converting enzyme; Cr, creatinine; HCT, hematocrit; INR, international normalized ratio; K+, potassium; lab, laboratory;PT, prothrombin time; RPR, rapid plasma reagin; SUN, serum urea nitrogen; TSH, thyrotropin; WBC, white blood cell count.

*Plus sign indicates positive.

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM894

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 3: PharmLab

any) are largely financial.30,31 Incontrast, despite its proven clinicalbenefit,26 few institutions have thecapability of checking laboratory-based safety contraindications. Forinstance, a recent survey showed thatno major hospital or clinic in Chi-cago, Ill, had mechanisms in placeto automatically prevent prescrib-ing potassium in the setting of anelevated serum potassium level,an angiotensin-converting enzymeinhibitor when a positive preg-nancy test has been recorded, ormetformin hydrochloride when azo-temia is present (G.D.S., unpub-lished survey, February 2001).

On the other hand, certainclinical laboratory abnormalities rep-resent indications for a particulardrug treatment. A markedly el-evated thyrotropin (TSH) level with-out a subsequent order for levothy-roxine sodium (or a repeat test), ora repeatedly elevated glucose or he-moglobin A1c level with no hypogly-cemic drug prescription, repre-sents a laboratory abnormalitymandating pharmacy actions andshould generate alerts in their ab-sence.32,33

Dosing

A review of patients with digoxintoxicity showed that 32% had renalinsufficiency, in most cases with-out proper dosing adjustment.34 Re-cently, we studied medication or-ders for patients with decreasedcreatinine clearance. Among drugsthat were renally excreted or neph-rotoxic, 70% of orders were writ-ten for an inappropriately high doseor frequency.2 Thus, despite de-cades of published guidelines35

supplementing the explicit instruc-tions on each drug’s package label,physicians clearly need more reli-able tools to ensure proper renal dos-ing.4 It is not realistic to expect cli-nicians to remember the hundredsof drugs requiring altered doses aswell as to think through which pa-tients need such adjustments and towhat degree. Any systematic effortto translate dosing guidelines into ac-tual practice must automate the cal-culation of both creatinine clear-ance (which requires knowledge ofpatient’s serum creatinine level, age,and weight) and the adjusted dos-

age. Although there is no analo-gous method to calculate hepaticclearance, elevated aminotransfer-ase levels, high bilirubin level, or lowalbumin levels suggest that a lowerdose of hepatically cleared medica-tions is needed.36,37

In addition to initial dose se-lection, many drugs, such as anti-convulsants, anticoagulants, andendocrine or hormonal drugs (eg, in-sulin, thyroxine, erythropoietin),require ongoing titration based onmeasurement of serum drug levelsor other clinical laboratory indi-cators of their biological effects.Currently, there are wide varia-tions in testing frequency, appro-priateness, and achievement oftarget levels.38,39

How often should such testsbe done, and how should dosing beadjusted on the basis of the results?Drug-laboratory–linked computer-ized data facilitate graphic flowcharting of laboratory results anddrug dosing. Using statistical pro-cess control, a proven tool in otherindustries, clinicians could more sci-entifically respond to changes in thetest results.40 This method can helpclinicians and even patients graphlaboratory results (such as glucoseor anticoagulation tests) in relationto drug dosages over time. Suchcharts can help determine when tomodify drug dose by determiningwhether variation in levels is ran-dom (and drug dose should not be“tampered” with) or truly out of con-trol (necessitating a change).41-43 Us-ing statistical process control meth-ods, diabetic patients have beenmore successful at achieving targetcontrol levels than the current phy-sician hit-and-miss approach, withone practice showing a drop in av-erage fasting blood glucose levelfrom 187 to 110 mg/dL (10.4 to 6.1mmol/L) and a decrease in hemo-globin A1c concentration from 10.5%to 7.2%.44

Monitoring

A laboratory test result could be“smarter” if it “knew” which drugsa patient was taking. For example,apparently minor liver abnormali-ties assume greater importance if apatient is receiving a hepatotoxicdrug.37,45,46 Similarly, hypokalemia

has special meaning for a patient tak-ing digoxin.47-49 Drug-laboratory in-terconnections need to couple in-formation on the starting time anddate of a prescription with the in-telligence to interpret changes inlaboratory results over time. Thus,patients’ previous laboratory re-sults become important to detectchanges (not just normal or abnor-mal) in laboratory parameters—subtle changes that otherwise mightbe ignored.50

Certain drugs require baselineor scheduled laboratory monitor-ing. Troglitazone was removed fromthe US market because of infre-quent (1.9/100) but potentially fa-tal hepatotoxicity.51 The drug’smanufacturer and the US Food andDrug Administration initially ar-gued that troglitazone was safe if pa-tients were properly monitored.However, despite a series of 4 in-creasingly strong warnings for livertest monitoring added to the drug’sofficial label, a study at one aca-demic hospital showed that less than5% of the patients actually receivedthe monthly testing the Food andDrug Administration warned was aprecondition for safe use of thedrug.7 Similar failure to monitor wasrecently documented for statin cho-lesterol-lowering agents.52 Consid-ering the logistics of coordinatingsuch drug-related laboratory moni-toring, integrated computerizedscheduling and tracking would ap-pear to be a prerequisite for a safesystem.53

Laboratory Interferenceand Interpretation

Earlier work by Friedman et al54 andYoung55 and more recent studies byFinnish investigators56-59 (includ-ing Gronroos et al56 and Forsstromet al57) have shown the importanceof the laboratory knowing whichdrugs the patient is taking to avoidmisinterpreting results in instanceswhere drugs interfere with labora-tory measurement. One survey ofspecimens sent for hormone stud-ies found that 11% were from pa-tients currently taking one or morepotentially interfering drugs, andnearly 40% of the patients tested forTSH had such conflicts.58,60 This is-sue looms sufficiently large that the

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM895

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 4: PharmLab

Finnish laboratory scientists cre-ated a database cataloging their pa-tients’ drug profiles, and demon-strated improved accuracy ininterpretation of their laboratory’stest results.61 Elsewhere, most drug-laboratory conflicts go undetected,while others are simply unknownbecause of scant research on in vitrolaboratory interference or in vivobiologic effects.62 Where conflictshave been identified, we generallylack evidence about their magni-tude and clinical significance.

Even simple laboratory fol-low-up questions such as, “Does thisglucose level of 300 mg/dL requireurgent follow-up?” could be moreeasily answered if it was knownwhether the patient was taking glu-cose-lowering medication (ie, was aknown diabetic). The response toanemia in a patient taking erythro-poietin should be different from thatfor a falling hematocrit in a patienttaking a nonsteroidal anti-inflam-matory drug.63 Knowing not onlywhat drugs a patient is taking butwhen they were taken is importantfor the laboratory to interpret druglevels as well as to ensure properlytimed specimen collection.39

Learning and Improvement

Data mining with the use of power-ful search algorithms and massivelinked databases represents a newmodel for scientific research thatpromises to substantially improveclinical care.19,64-68 Advances emerg-ing from the Human Genome Projectillustrate the enormous potential ofwhat previously might have been con-sidered unsystematic data collectionbut, when linked to phenotype data,permits discovery of new knowl-edge.69 Similar advances in knowl-edge of drug effects and outcomes canresult from the linking of laboratoryto pharmacy. While associations be-tween a clinical laboratory abnormal-ity and pharmaceutical agents shouldbe considered hypotheses for futuretesting, these signals can be invalu-able for earlier detection of adversedrug effects.64,70

On a more mundane improve-ment level, laboratory-pharmacy link-ages can help evaluate the timelinessof responses to abnormal laboratoryresults, or the adequacy or appropri-

ateness of monitoring patients tak-ing a particular drug. This quality as-surance role has been deployed touncover inappropriate laboratory test-ing (orders for drug levels for pa-tients not taking or not in a steadystate for a drug, or excessively re-peated levels without dose change) orto document failure to obtain recom-mended monitoring.7 1 - 7 3 Mis-matches in microbiology data and an-tibiotic prescriptions have identifiedpatients given antibiotics to whichtheir infections were resistant orbeing treated without proper cul-tures having been obtained.67 Popu-lation diabetic outcomes can betracked by using pharmacy records toidentify diabetic patients taking hy-poglycemic medications and thenlinking records to serial renal func-tion.74-76 Given properly linked labo-ratory-pharmacy databases, suchquestions could be evaluated for a par-ticular drug, laboratory test, physi-cian, or time frame (to establish his-torical quality trends).

LINKING LABORATORYAND PHARMACY:

CURRENT APPROACHES

Retrospective Linkage

Retrospective electronic data havebeen used to perform many of the 10functions we describe in Table 1. Evenwhen laboratory and pharmacy datareside in separate systems and are notconcurrently interfaced, these datacan be retrospectively linked to bet-ter treat and protect patients.

At the simplest level, some hos-pitals generate reports for patients re-ceiving prescribed drugs that re-quire renal adjustment, thenmanuallylook up their creatinine values.77 Thistype of drug-laboratory “bridging”function has been an invaluable con-tribution of clinical pharmacists, al-though it is labor intensive and re-quires “rework” that could be avoidedwith a prospective system. Althoughsuch reports are by definition retro-spective, they have played a valuablerole in identifying problem orders andimproving care.78,79

A more powerful and efficientretrospective linkage involves themerging and screening of files fromlaboratory and pharmacy informa-tion systems. One of us (D.K.) down-

loads more than 1 million drug andlaboratory records annually from the19 Illinois state psychiatric hospi-tals and links them to evaluate a se-ries of quality indicators.71 “Clean-ing” the data to make it usable forsuch screening has required exten-sive programming, particularly forpharmacy data. An important in-sight emerging from this experi-ence is that pharmacy data files aremuch more complex and unstand-ardized than laboratory data. For ex-ample, 37 steps are required to con-vert the inpatient pharmacy data ofthe Illinois mental health phar-macy database into a standardizeddosing, frequency, and durationtable (laboratory data require fewerthan half that number).

Outpatient pharmacy files are of-ten less complex. Because widelyavailable programs such as Micro-soft Excel or Access can now easilyimport data files downloaded by in-formation technology staff, any phy-sician, pharmacist, or quality assur-ance nurse can create spreadsheets ordatabases that link pharmacy rec-ords with laboratory values for a givenpatient by means of simple sorting, fil-tering, and query tools. When bothlaboratory and pharmacy use a com-mon patient identifying number,matching the 2 datasets is straight-forward. A quality analyst can flag allrecords for patients meeting speci-fied criteria and create tables thatchronologically display merged labo-ratory and drug prescription data(Figure). Using this method, we un-covered more than 500 prescrip-tions in a single year for oral potas-sium supplementation (2.4% of allpotassium prescriptions) written anddispensed for patients with preexist-ing elevated serum potassium values(�5.3 mEq/L).1

Real-Time Linkage

Compared with retrospective ef-forts, implementation of physicianorder entry systems and electronicintegration of laboratory and phar-macy data that allow real-time de-cision support can have even greaterbenefits in each of our 10 concep-tual realms.80

When a laboratory test affectsa drug dose, displaying key labora-tory information at the time a drug

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM896

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 5: PharmLab

is ordered or when a pharmacist en-ters the order into the computer (eg,showing last phenytoin level whenphenytoin is ordered) can help cli-nicians make better decisions.81 Thecomputer can calculate an appro-priate dose based on the patient’s re-nal function, age, sex, and weight.One study evaluating the impact ofrenally adjusted dosing in hospital-ized patients found that such deci-sion support improved dosing ap-propriateness from 54% before theintervention to 67% afterward.2

Titrating medications with theresults of laboratory testing is one ofthe domains in which computer-ized decision support has been foundto be particularly helpful.82 For ex-ample, interactive computerized as-sistance with warfarin dosing hasbeen shown to improve the propor-tion of time a patient spends withinthe therapeutic range.83 In addi-tion, for many medications for whichdrug level monitoring can be per-formed, these results can be used tomake suggestions about when an-other level should be checked. De-cision support can reduce the num-ber of redundant levels by estimatingthe appropriate monitoring inter-val.38,84,85 In one study, more than80% of antiepileptic drug levels werefound to be inappropriate, and manywould have been avoided if real-time warnings had been presentedat the time the test was being or-dered.39,81

When laboratory tests signaldrug toxicity, studies have shownthat the computerized alerts can beused to limit the extent of an ad-verse drug event and enhance thetimeliness of interventions to mini-mize its harm.86,87 As the computerdetects a critical laboratory result fora patient receiving a particular drug,warnings are generated for a phar-macist to intervene or, more pow-erfully, such results are being com-municated immediately to providerselectronically by means of tools suchas 2-way pagers.88

Computerized decision sup-port has also been shown to increasethe likelihood that appropriate moni-toring will occur. Overhage and co-workers’ study89 of “corollary or-ders”—situations in which one orderimplies another—demonstrated thatdecision support dramatically in-

creases the likelihood that recom-mended laboratory monitoring or-ders were written. Compliance ratesof indicated monitoring (baseline andfollow-up platelet count and acti-vated partial thromboplastin time) forpatients receiving heparin increasedfrom 40.2% (control subjects) to77.4% in patients whose physicianswere presented with reminderscoupled with streamlined orderingscreens for laboratory tests linked todrug orders.89

Decision support can be criti-cal when a laboratory test contrain-dicates a certain medication. Whena patient is pregnant, angiotensin-converting enzyme inhibitors arecontraindicated. However, most sys-tems do not capture a positive preg-nancy test, especially if performedby the patient at home. Such infor-mation would also need to be en-hanced with simple rules (eg, preg-nancy does not last longer than 10months; after a delivery a woman isno longer pregnant) to keep it dy-namically updated.

Some situations are more com-plex to handle electronically be-cause they are asynchronous.90 Forexample, while a high TSH level of-ten indicates that an action shouldbe taken (eg, adding or increasingthe dose of levothyroxine), it oftenregisters after (rather than during)

an outpatient encounter. Implemen-tation of one inpatient ordering sys-tem linking medications and labo-ratory resulted in a 38% decrease inthe median time interval to act oncritical laboratory results.91

Finally, combined elements ofretrospective and real-time decisionsupporthaveprovedusefulforprovid-ingqualityoversightandimprovement.Severalstudieshavedemonstratedthatdrug-laboratorycombinationsareoneofthebesttools for identifyingadversedrugevents, inboth the inpatientandoutpatient settings.92-95 Relying to alargeextentonlaboratorysignalssug-gestinganadverseevent,Classenetal92

demonstratedan800%increase inthenumber of adverse drug events iden-tifiedcomparedwith thestandardap-proach (spontaneous reporting). Be-cause such an approach to screeningfor adverse drug events is so muchmoreefficient(moreproblemsdetectedwith less effort), it has made continu-ousmonitoring,previouslyunsustain-able, possible.93

Development of systems that en-sure appropriate follow-up of a spe-cific abnormality or laboratory-pharmacy signal is critical forachieving error-free tracking and ac-countability. Many studies demon-strate that abnormal results often donot receive timely or appropriate fol-low-up.3,91,96 Linked systems facili-

NAME UNITNO DATE RESULT GENERIC_NM QUANTITY

JONES, BILLJONES, BILLSMITH, MARYSMITH, MARYSMITH, MARYSTOKES, WILLSTOKES, WILLCULLEN, CORACULLEN, CORACULLEN, CORACULLEN, CORAPABST, POLLYPABST, POLLYKENNEDY, JOEKENNEDY, JOEKENNEDY, JOEKENNEDY, JOEKENNEDY, JOEKENNEDY, JOEKENNEDY, JOE

122441122441125565125565125565137995137995148341148341148341148341155103155103156828156828156828156828156828156828156828

03/11/9503/20/9505/16/9505/16/9511/19/9501/03/9501/03/9503/30/9504/01/9504/12/9506/14/9501/11/9504/12/9502/22/9503/06/9504/05/9505/09/9505/10/9505/23/9505/24/95

6.0

5.3

7.0

5.35.3

5.3

5.6

4.96.6

5.2

POTASSIUM CHLORIDE

POTASSIUM CHLORIDE

POTASSIUM CHLORIDE

POTASSIUM CHLORIDEPOTASSIUM CHLORIDEPOTASSIUM CHLORIDE

POTASSIUM CHLORIDE

POTASSIUM CHLORIDE

POTASSIUM CHLORIDE

POTASSIUM CHLORIDE

60

30

30

146030

240

240

20

30

Examples of actual errors disclosed when pharmacy records and laboratory data were merged and thensorted by patient and date. For example, the first record/row is from the laboratory computer, and thesecond is from the pharmacy database (patient names and clinic numbers changed).

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM897

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 6: PharmLab

tate both review by an individual pro-vider and systemwide qualityoversight by enabling organized sys-tems for intervention when clini-cians fail to follow up.

WHAT TO LINK:NEED FOR STANDARDS

AND RESEARCH

The current evidence base is thin re-garding which tests to link and atwhat thresholds. While many of theexamples we discuss appear to bereasonable starting places, our tax-onomy is merely an entry point forfuture research.

One information source for pre-scribers to consider is the officialFood and Drug Administration druglabeling—warnings to which, intheory, they are legally obliged to payheed. These “labeled” instructions ap-pear on the prescriber package in-serts and are reprinted in the Physi-cians’ Desk Reference.97 In Table 2we summarize laboratory-phar-macy interactions listed in the Phy-sicians’ Desk Reference for the mostcommonly prescribed, and the re-cently approved, oral medications.There are more than 500 laboratory-pharmacy interactions—an averageof 6.6 per drug. These interactions,with their associated requirementsand warnings, are so numerous thatit is unlikely that any unaided phy-sician could remember and manu-ally track all of them simulta-neously for all the drugs prescribedfor his or her patients.

However, linked alerts will notbe effective if users are overloaded

with a “blizzard” of poorly vali-dated warnings. This point has beenillustrated by pharmacists’ experi-ence of being deluged with a largenumber of computerized warningsof drug-drug interactions, many ofwhich are not evidence-based orconsistent among different commer-cial software products.98 As a re-sult, important warnings are over-looked, and pharmacists inactivatemany of the alerts.99,100 Indiscrimi-nantly adding hundreds of drug-laboratory interactions could fur-ther lead pharmacists and physiciansto ignore or inactivate many of thewarnings. A research agenda is verymuch needed to help sort out theusefulness of various tests, thresh-olds, and actions.101

FUTURE CHALLENGES

Paraphrasing Donabedian’s triad,102

(1) setting up the electronic infra-structure, (2) creating standard-ized laboratory-pharmacy linkageprocesses and clinical rules, and (3)demonstrating the benefit of suchlinkages on patient outcomes all posemajor challenges.

Progress in real-time orderingand feedback has been inhibited bythe cost of implementing full-scalelinked information systems. Manyphysicians have been reluctant to in-vest in the additional dollars and havefurther concerns about perceivedadded time burdens. Even wherecomputerized ordering is in place,building and maintaining the knowl-edge base is challenging, especially asincreasingly complex decision sup-

port is attempted. A recent survey ofinstitutions that have installed com-mercial systems with order entryfound that less than 10% were using“intelligent” rules that linked infor-mation from different systems suchas laboratory and pharmacy.103

A major problem has been that,lacking standardized and testeddrug-laboratory interaction rules,each institution finds itself reinvent-ing the wheel. Although vendors ad-vertise packages of ready-to-userules, none of these (either indi-vidual rules or rule sets) has beensubjected to formal testing or peerreview. The effort associated withmaintenance must be underscored,especially given the large numbersof medications being introducedeach year. Thus, a public compen-dium of evidence-based rules wouldbe extremely valuable.

In the future, pharmacogeno-mics, laboratory’s newest emergingdomain, will add a further level ofchallenge and complexity.104 Evi-dence suggests, for example, that cer-tain genotypes, such as allelic vari-ants of cytochrome P450, cansubstantially alter patients’ re-sponse to warfarin or the likelihoodof having a hypersensitivity reac-tion to phenytoin. This pushes theboundaries of laboratory-pharmacyinteractions, potentially redefining as“preventable errors” more and morereactions currently deemed to be “id-iosyncratic,” as well as moving us to-ward patient-specific targeting of drugactions.105,106

CONCLUSIONS

While much has been written about“managed care,” effectively manag-ing clinical care for both inpatientsand outpatients demands better in-tegration of clinical laboratory andpharmacy data. The evidence thatexisting data are not being opti-mally used is substantial, and acces-sible solutions exist today that cansignificantly improve care. Whilemore advanced technologies in thefuture hold great promise, given thedemonstrated and potential ben-efits for the laboratory, pharmacy,clinician, and patient, the case forimmediate efforts to link labora-tory and pharmacy information iscompelling.

Table 2. Labeled Laboratory-Pharmacy Interactions*

Laboratory Result

Top 40 Drugs New Drugs (n = 37)

TotalWarnings

No. of DrugsWith Warning

TotalWarnings

No. of DrugsWith Warning

Contraindication for drug 11 9 20 14Indication for drug 7 7 3 3Dose adjustment 40 31 28 23Indicating toxicity 169 39 161 32Baseline monitoring 16 11 12 8Follow-up monitoring 20 11 16 10Interfered with by drug 5 3 2 2Total 268 40 242 37

*As listed in the 2000 Physicians’ Desk Reference.97 Official Food and Drug Administration labeling fororal dosage medications was evaluated. Top 40 drugs were based on 2000 IMS data. New drugs werebased on new molecular entities newly approved by the Food and Drug Administration and marketed in1999 and 2000.

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM898

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 7: PharmLab

Accepted for publication August 1,2002.

This study was supported in partby grant 11552 from the Agency forHealthcare Research and Quality, De-velopmental Centers for Research inPatient Safety Initiative, Rockville, Md.

Corresponding author and re-prints: Gordon D. Schiff, MD, Depart-ment of Medicine, Cook County Hos-pital, 1900 W Polk St, Room 901-AX,Chicago, IL 60612 (e-mail: [email protected]).

REFERENCES

1. Schiff GD, Aggarwal HC, Kumar S, McNutt RA.Prescribing potassium despite hyperkalemia:medication errors uncovered by linking labora-tory and pharmacy information systems. Am JMed. 2000;109:494-497.

2. Chertow GM, Lee J, Kuperman GJ, et al. Guidedmedication dosing for inpatients with renal in-sufficiency. JAMA. 2001;286:2839-2844.

3. Schiff GD, Hegde HK, LaCloche L, HryhorczukDO. Inpatient theophylline toxicity: preventablefactors. Ann Intern Med. 1991;114:748-753.

4. Falconnier AD, Haefeli WE, Schoenenberger RA,Surber C, Martin-Facklam M. Drug dosage in pa-tients with renal failure optimized by immediateconcurrent feedback. J Gen Intern Med. 2001;16:369-375.

5. Arbo MD, Snydman DR. Influence of blood cul-ture results on antibiotic choice in the treat-ment of bacteremia. Arch Intern Med. 1994;154:2641-2645.

6. Evans RS, Pestotnik SL, Classen DC, Burke JP.Evaluation of a computer-assisted antibiotic-dose monitor. Ann Pharmacother. 1999;33:1026-1031.

7. Graham DJ, Drinkard CR, Shatin D, Tsong Y, Bur-gess MJ. Liver enzyme monitoring in patientstreated with troglitazone. JAMA. 2001;286:831-833.

8. Bates DW, Cullen D, Laird N, et al. Incidence ofadverse drug events and potential adverse drugevents: implications for prevention. JAMA. 1995;274:29-34.

9. Hulse RK, Clark SJ, Jackson JC, Warner HR,Gardner RM. Computerized medication moni-toring system. Am J Hosp Pharm. 1976;33:1061-1064.

10. Lesar TS, Briceland L, Stein DS. Factors relatedto errors in medication prescribing. JAMA. 1997;277:312-317.

11. Gurwitz JH, Field TS, Avorn J, Bates DW. Inci-dence and preventability of adverse drug eventsin nursing homes. Am J Med. 2000;109:87-94.

12. Gandhi TK, Burstin HR, Cook EF, et al. Drug com-plications in outpatients. J Gen Intern Med. 2000;15:149-154.

13. Tegeder I, Levy M, Muth-Selbach U, et al. Ret-rospective analysis of the frequency and recog-nition of adverse drug reactions by means of au-tomatically recorded laboratory signals. Br J ClinPharmacol. 1999;47:557-564.

14. Schiff GD, Rucker TD. Computerized prescrib-ing: building the electronic infrastructure for bet-ter medication usage. JAMA. 1998;279:1024-1029.

15. President’s Advisory Committee on ConsumerProtection and Quality in Healthcare. Building thecapacity to improve quality: investing in infor-mation systems. In: Quality First: Better HealthCare for All Americans. Silver Spring, Md: Agencyfor Healthcare Research and Quality Publica-tions Clearinghouse; 1998:chap 14.

16. Bates DW, Leape LL, Cullen DJ, et al. Effect of

computerized physician order entry and a teamintervention on prevention of serious medica-tion errors. JAMA. 1998;280:1311-1316.

17. Balas EA, Austin SM, Mitchell JA, Ewigman BG,Bopp KD, Brown GD. The clinical value of com-puterized information services: a review of 98 ran-domized clinical trials. Arch Fam Med. 1996;5:271-278.

18. Berwick DM, Nolan TW. Overview: cooperatingfor improvement. Jt Comm J Qual Improv. 1995;21:573-577.

19. McDonald CJ, Overhage JM, Dexter P, TakesueBY, Dwyer DM. A framework for capturing clini-cal data sets from computerized sources. AnnIntern Med. 1997;127:675-682.

20. Maibach H, Keenlyside R, Fitzmaurice D, Bro-gan D, Essien J. Future directions for researchin laboratory medicine: the findings of a Delphisurvey of stakeholders. Clin Leadersh ManageRev. 1998;12:221-230.

21. Becich MJ. Information management: movingfrom test results to clinical information. Clin Lead-ersh Manag Rev. 2000;14:296-300.

22. Miller WG. The changing role of the medical tech-nologist from technologist to information spe-cialist. Clin Leadersh Manag Rev. 2000;14:285-288.

23. Forsman R. The electronic medical record: im-plications for the laboratory. Clin Leadersh ManagRev. 2000;14:292-295.

24. Cohen MR. Medication Errors. Washington, DC:American Pharmaceutical Association; 1999.

25. Evans RS, Pestotnik SL, Classen DC, Bass SB,Burke JP. Prevention of adverse drug eventsthrough computerized surveillance. Proc AnnuSymp Comput Appl Med Care. 1992:437-441.

26. Bates DW, Teich JM, Lee J, et al. The impact ofcomputerized physician order entry on medica-tion error prevention. J Am Med Inform Assoc.1999;6:313-321.

27. Institute of Medicine. Crossing the Quality Chasm:A New Health System for the 21st Century. Wash-ington, DC: National Academy Press; 2001.

28. Gilmet GP, Mallon RP, Griffin BT, LewandowskiJJ. The use of an integrated clinical laboratoryand pharmacy diabetes database to provide phy-sician performance feedback in an IPA-modelHMO. J Ambulatory Care Manage. 1998;21:12-23.

29. Edelman D. Outpatient diagnostic errors: unrec-ognized hyperglycemia. Eff Clin Pract. 2002;5:11-16.

30. Glabman M. Hold the phone! going online withprescription. ACP-ASIM Observer. October 1996.Available at: http://www.acponline.org/journals/news/oct96/presconl.htm. Accessed January 25,2003.

31. Spicer J. Making patient care easier under mul-tiple managed care plans. Fam Pract Manage.1998;5(2):38-53.

32. Helfand M, Redfern CC, for the American Col-lege of Physicians. Clinical guideline, part 2.Screening for thyroid disease: an update. Ann In-tern Med. 1998;129:144-158.

33. Stratton IM, Adler AI, Neil HA, et al. Associationof glycaemia with macrovascular and microvas-cular complications of type 2 diabetes (UKPDS35): prospective observational study. BMJ. 2000;321:405-412.

34. Marik PE, Fromm L. A case series of hospital-ized patients with elevated digoxin levels. Am JMed. 1998;105:110-115.

35. Aronoff GR, Bennett WM. eds. Drug Prescrib-ing in Renal Failure: Dosing Guidelines for Adults.4th ed. Philadelphia, Pa: ACP-ASIM; 1999.

36. Rodighiero V. Effects of liver disease on phar-macokinetics: an update. Clin Pharmacokinet.1999;37:399-431.

37. Centers for Disease Control and Prevention. Drug-induced liver injury: a national and global prob-lem. Westfields Conference Center, Chantilly, Va,February 12-13, 2001. Available at: http://www.fda.gov/cder/livertox/default.htm. Ac-cessed January 25, 2003.

38. Bates DW, Boyle DL, Rittenberg E, et al. What

proportion of common diagnostic tests appearredundant? Am J Med. 1998;104:361-368.

39. Schoenenberger RA, Tanasijevic MJ, Jha A, BatesDW. Appropriateness of antiepileptic drug levelmonitoring. JAMA. 1995;274:1622-1626.

40. Blumenthal D. Total quality management andphysicians’ clinical decisions. JAMA. 1993;269:2775-2778.

41. Benneyan JC. Use and interpretation of statisti-cal quality control charts. Int J Qual Health Care.1998;10:69-73.

42. Kahn MG, Bailey TC, Steib SA, Fraser VJ, Duna-gan WC. Statistical process control methods forexpert system performance monitoring. J AmMed Inform Assoc. 1996;3:258-269.

43. Berwick DM. Controlling variation in health care:a consultation from Walter Shewhart. Med Care.1991;29:1212-1225.

44. Staker LV. Changing clinical practice by improv-ing systems: the pursuit of clinical excellencethrough practice-based measurement for learn-ing and improvement. Qual Manage Health Care.2000;9:1-13.

45. Pratt DS, Kaplan MM. Evaluation of abnormalliver-enzyme results in asymptomatic patients.N Engl J Med. 2000;342:1266-1271.

46. Kaplowitz N. Drug-induced liver disorders: im-plications for drug development and regula-tion. Drug Saf. 2001;24:483-490.

47. Sundar S, Burma DP, Vaish SK. Digoxin toxic-ity and electrolytes: a correlative study. Acta Car-diol. 1983;38:115-123.

48. Hall RJ, Gelbart A, Billingham M, Snidow G, Gold-man RH. Effect of chronic potassium depletionon digitalis-induced inotropy and arrhythmias.Cardiovasc Res. 1981;15:98-107.

49. Steiner JF, Robbins LJ, Hammermeister KE, RothSC, Hammond WS. Incidence of digoxin toxic-ity in outpatients. West J Med. 1994;161:474-478.

50. Skendzel LP, Barnett RN, Platt R. Medically use-ful criteria for analytic performance of labora-tory tests. Am J Clin Pathol. 1985;83:200-205.

51. Gale EA. Lessons from the glitazones: a story ofdrug development. Lancet. 2001;357:1870-1875.

52. Abookire SA, Karson AS, Fiskio J, Bates DW. Useand monitoring of “statin” lipid-lowering drugscompared with guidelines. Arch Intern Med.2001;161:53-58.

53. Schumacher GE, Barr JT. Total testing processapplied to therapeutic drug monitoring: impacton patients’ outcomes and economics. ClinChem. 1998;44:370-374.

54. Friedman RB, Young DS, Beatty ES. Automatedmonitoring of drug-test interactions. Clin Phar-macol Ther. 1978;24:16-21.

55. Young DS. Effects of Preanalytical Variables onClinical Lab Tests. 2nd ed. Washington, DC:American Assocation for Clinical Chemistry Press;1997.

56. Gronroos PE, Irjala KM, Huupponen RK, Schei-nin H, Forsstrom J, Forsstrom JJ. A medicationdatabase: a tool for detecting drug interactionsin hospital. Eur J Clin Pharmacol. 1997;53:13-17.

57. Forsstrom JJ, Gronroos P, Irjala K, HeiskanenJ, Torniainen K. Linking patient medication datawith laboratory information system. Int J BiomedComput. 1996;42:111-116.

58. Kailajarvi M, Takala T, Gronroos P, et al. Re-minders of drug effects on laboratory test re-sults. Clin Chem. 2000;46:1395-1400.

59. Sonntag O, Scholer A. Drug interference in clini-cal chemistry: recommendation of drugs and theirconcentrations to be used in drug interferencestudies. Ann Clin Biochem. 2001;38(pt 4):376-385.

60. Gronroos PE, Irjala KM, Selen GP, Forsstrom JJ.Computerized monitoring of potentially interfer-ing medication in thyroid function diagnostics.Int J Clin Monit Comput. 1997;14:255-259.

61. Gronroos P, Irjala K, Heiskanen J, Torniainen K,Forsstrom JJ. Using computerized individualmedication data to detect drug effects on clini-

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM899

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014

Page 8: PharmLab

cal laboratory tests. Scand J Clin Lab InvestSuppl. 1995;222:31-36.

62. Narayanan S. The preanalytic phase: an impor-tant component of laboratory medicine. Am J ClinPathol. 2000;113:429-452.

63. Hernandez-Diaz S, Rodriguez LA. Associationbetween nonsteroidal anti-inflammatory drugsand upper gastrointestinal tract bleeding/per-foration: an overview of epidemiologic studiespublished in the 1990s. Arch Intern Med. 2000;160:2093-2099.

64. Bagheri H, Michel F, Lapeyre-Mestre M, et al. De-tection and incidence of drug-induced liver in-juries in hospital: a prospective analysis fromlaboratory signals. Br J Clin Pharmacol. 2000;50:479-484.

65. Classen DC, Burke JP, Pestotnik SL, Evans RS,Stevens LE. Surveillance for quality assessment,IV: surveillance using a hospital information sys-tem. Infect Control Hosp Epidemiol. 1991;12:239-244.

66. Tierney WM, McDonald CJ. Practice databasesand their uses in clinical research. Stat Med. 1991;10:541-557.

67. Brossette SE, Sprague AP, Jones WT, MoserSA. A data mining system for infection controlsurveillance. Methods Inf Med. 2000;39:303-310.

68. Brossette SE, Sprague AP, Hardin JM, Waites KB,Jones WT, Moser SA. Association rules and datamining in hospital infection control and publichealth surveillance. J Am Med Inform Assoc.1998;5:373-381.

69. Lowrance WW. The promise of human geneticdatabases. BMJ. 2001;322:1009-1010.

70. Jha AK, Kuperman GJ, Rittenberg E, Teich JM,Bates DW. Identifying hospital admissions dueto adverse drug events using a computer-based monitor. Pharmacoepidemiol Drug Saf.2001;10:113-119.

71. Luchins DJ, Klass D, Hanrahan P, et al. Com-puterized monitoring of valproate and physi-cian responsiveness to laboratory studies as aquality indicator. Psychiatr Serv. 2000;51:1179-1181.

72. van Wijk MA, van der Lei J, Mosseveld M, BohnenAM, van Bemmel JH. Assessment of decisionsupport for blood test ordering in primary care:a randomized trial. Ann Intern Med. 2001;134:274-281.

73. Wetzler HP, Snyder JW. Linking pharmacy andlaboratory data to assess the appropriateness ofcare in patients with diabetes. Diabetes Care.2000;23:1637-1641.

74. Zhang Q, Safford M, Ottenweller J, et al. Perfor-mance status of health care facilities changes withrisk adjustment of HbA1c. Diabetes Care. 2000;23:919-927.

75. Centers for Disease Control Diabetes in Man-aged Care Work Group. Diabetes mellitus in man-aged care: complications and resource utiliza-tion. Am J Manage Care. 2001;7:501-508.

76. Pogach LM, Hawley G, Weinstock R, et al. Dia-betes prevalence and hospital and pharmacy usein the Veterans Health Administration (1994): useof an ambulatory care pharmacy-derived data-base. Diabetes Care. 1998;21:368-373.

77. Abel SR, Guba EA. Evaluation of an imipenem/cilastatin target drug program. DICP. 1991;25:348-350.

78. Harrison JH Jr, Rainey PM. Identification of pa-tients for pharmacologic review by computeranalysis of clinical laboratory drug concentra-tion data. Am J Clin Pathol. 1995;103:710-717.

79. Schentag JJ, Ballow CH, Fritz AL, et al. Changesin antimicrobial agent usage resulting from inter-actions among clinical pharmacy, the infectiousdisease division, and the microbiology labora-tory. Diagn Microbiol Infect Dis. 1993;16:255-264.

80. Hunt DL, Haynes RB, Hanna SE, Smith K. Ef-fects of computer-based clinical decision sup-port systems on physician performance and pa-tient outcomes: a systematic review. JAMA. 1998;280:1339-1346.

81. Teich JM, Merchia PR, Schmiz JL, Kuperman GJ,Spurr CD, Bates DW. Effects of computerizedphysician order entry on prescribing practices.Arch Intern Med. 2000;160:2741-2747.

82. Johnston ME, Langton KB, Haynes RB, Ma-thieu A. Effects of computer-based clinical de-cision support systems on clinician perfor-mance and patient outcome: a critical appraisalof research. Ann Intern Med. 1994;120:135-142.

83. Poller L, Shiach CR, MacCallum PK, et al. Mul-ticentre randomised study of computerised an-ticoagulant dosage: European Concerted Ac-tion on Anticoagulation. Lancet. 1998;352:1505-1509.

84. Canas F, Tanasijevic MJ, Ma’Luf N, Bates DW.Evaluating the appropriateness of digoxin levelmonitoring. Arch Intern Med. 1999;159:363-368.

85. Bates DW, Kuperman GJ, Rittenberg E, et al. Arandomized trial of a computer-based interven-tion to reduce utilization of redundant labora-tory tests. Am J Med. 1999;106:144-150.

86. Rind DM, Safran C, Phillips RS, et al. Effect ofcomputer-based alerts on the treatment and out-comes of hospitalized patients. Arch Intern Med.1994;154:1511-1517.

87. Raschke RA, Gollihare B, Wunderlich TA, et al.A computer alert system to prevent injury fromadverse drug events: development and evalua-tion in a community teaching hospital. JAMA.1998;280:1317-1320.

88. Shabot MM, LoBue M, Chen J. Wireless clinicalalerts for physiologic, laboratory and medica-tion data. Proc AMIA Symp. 2000:789-793.

89. Overhage JM, Tierney WM, Zhou XH, McDonaldCJ. A randomized trial of “corollary orders” toprevent errors of omission. J Am Med Inform As-soc. 1997;4:364-375.

90. Bates DW, Cohen M, Leape LL, Overhage JM,Shabot MM, Sheridan T. Reducing the fre-quency of errors in medicine using informationtechnology. J Am Med Inform Assoc. 2001;8:299-308.

91. Kuperman GJ, Boyle D, Jha A, et al. How promptlyare inpatients treated for critical laboratory re-sults? J Am Med Inform Assoc. 1998;5:112-119.

92. Classen DC, Pestotnik SL, Evans RS, Burke JP.Computerized surveillance of adverse drug eventsin hospital patients. JAMA. 1991;266:2847-2851.

93. Jha AK, Kuperman GJ, Teich JM, et al. Identify-ing adverse drug events: development of a com-puter-based monitor and comparison with chartreview and stimulated voluntary report. J Am MedInform Assoc. 1998;5:305-314.

94. Dormann H, Muth-Selbach U, Krebs S, et al. In-cidence and costs of adverse drug reactions dur-ing hospitalisation: computerised monitoring ver-sus stimulated spontaneous reporting. Drug Saf.2000;22:161-168.

95. Honigman B, Lee J, Rothchild J, et al. Using com-puterized data to identify adverse drug events inoutpatients. J Am Med Inform Assoc. 2001;8:254-266.

96. Tate KE, Gardner RM. Computers, quality, andthe clinical laboratory: a look at critical value re-porting. Proc Annu Symp Comput Appl Med Care.1993:193-197.

97. Physicians’ Desk Reference. 54th ed. Montvale,NJ: Medical Economics Press; 2000.

98. Fulda TR. Computer-based drug-utilization re-view. N Engl J Med. 1995;333:1290-1291.

99. Peterson JF, Bates DW. Preventable medica-tion errors: identifying and eliminating seriousdrug interactions [abstract]. J Am Pharm As-soc. 2001;41:159-160.

100. Cavuto NJ, Woosley RL, Sale M. Pharmacies andprevention of potentially fatal drug interactions.JAMA. 1996;275:1086-1087.

101. Schiff GD, Bates DW. Electronic point-of-care pre-scribing: writing the script. Dis Manage HealthOutcomes. 2000;7:297-304.

102. Schiff GD, Rucker TD. Beyond structure-process-outcome: Donabedian’s seven pillars and elevenbuttresses of quality. Jt Comm J Qual Improv.2001;27:169-174.

103. Marietti C. Report from HIMSS 2001: medical er-rors. Healthcare Informatics. April 2001;20-22.

104. Roses AD. Pharmacogenetics and the practiceof medicine. Nature. 2000;405:857-865.

105. Aithal GP, Day CP, Kesteven PJ, Daly AK. Asso-ciation of polymorphisms in the cytochromeP450 CYP2C9 with warfarin dose requirementand risk of bleeding complications. Lancet. 1999;353:717-719.

106. Edeki TI, Brase DA. Phenytoin disposition andtoxicity: role of pharmacogenetic and intereth-nic factors. Drug Metab Rev. 1995;27:449-469.

(REPRINTED) ARCH INTERN MED/ VOL 163, APR 28, 2003 WWW.ARCHINTERNMED.COM900

©2003 American Medical Association. All rights reserved.

Downloaded From: http://archinte.jamanetwork.com/ on 03/05/2014