37
1 Translating CER Evidence into Practice, Policy and Public Health: The Science of Implementation and Dissemination Henry Lee, MD, MS Ralph Gonzales, MD, MSPH University of California, San Francisco Henry Lee, MD, MSHS Assistant Professor of Pediatrics, Division of Neonatology Associate Director of Data Analysis, California Perinatal Quality Care Collaborative Scholar, UCSF Clinical and Translational Science Career Development Program Ralph Gonzales, MD, MSPH Professor of Medicine, Epidemiology & Biostatistics Director, Program in Implementation and Dissemination Sciences (IDS) Associate Director, Clinical and Translational Science Career Development Program We spend so much… The Translation Imperative in the US This figure can be viewed in Murray, C & Frenk,J, NEJM, 2010; 362:99. The figure shows the amount of healthcare spending as a percent of GDP for different countries. The United States spends the most with approximately 15% of its GDP spent on healthcare. The next highest is Switzerland at approximately 11%, followed by France at just under 11%. The lowest is Turkey at just under 6%.

Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

1

Translating CER Evidence into Practice, Policy and Public Health:

The Science of Implementation and Dissemination

Henry Lee, MD, MSRalph Gonzales, MD, MSPH

University of California, San Francisco

Henry Lee, MD, MSHS• Assistant Professor of Pediatrics, Division of

Neonatology

• Associate Director of Data Analysis, California Perinatal Quality Care Collaborative

• Scholar, UCSF Clinical and Translational Science Career Development Program

Ralph Gonzales, MD, MSPH• Professor of Medicine, Epidemiology &

Biostatistics

• Director, Program in Implementation and Dissemination Sciences (IDS)

• Associate Director, Clinical and Translational Science Career Development Program

We spend so much…

The Translation Imperative in the US

This figure can be viewed in Murray, C & Frenk,J, NEJM, 2010; 362:99.

The figure shows the amount of healthcare spending as a percent of GDP for different countries. The United States spends the most with approximately 15% of its GDP spent on healthcare. The next highest is pp y p gSwitzerland at approximately 11%, followed by France at just under 11%. The lowest is Turkey at just under 6%.

Page 2: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

2

We spend so much… We get so little…World Health Rankings-infant mortality 39th-female mortality 43rd

-male mortality 42nd

-life expectancy 36th

The Translation Imperative in the US

This figure can be viewed in Murray, C & Frenk,J, NEJM, 2010; 362:99.

The figure shows the amount of healthcare spending as a percent

Murray C, Frenk J, NEJM 2010;362:99

p g pof GDP for different countries. The United States spends the most with approximately 15% of its GDP spent on healthcare. The next highest is Switzerland at approximately 11%, followed by France at just under 11%. The lowest is Turkey at just under 6%.

We spend so much… We get so little…World Health Rankings-infant mortality 39th-female mortality 43rd

-male mortality 42nd

-life expectancy 36th

The Translation Imperative in the US

This figure can be viewed in Murray, C & Frenk,J, NEJM, 2010; 362:99.

The figure shows the amount of healthcare spending as a percent This graph can be viewed inp g pof GDP for different countries. The United States spends the most with approximately 15% of its GDP spent on healthcare. The next highest is Switzerland at approximately 11%, followed by France at just under 11%. The lowest is Turkey at just under 6%.

This graph can be viewed in Murray, C & Frenk,J, NEJM, 2010; 362:99.

This graph shows the probability of death for boys and men 15-60 years of age in Sweden, Australia and the United States from 1970-2007. Death rates decreased in all countries during this time frame. The US consistently had the highest rate of death.

NIH Roadmap Initiative-translating discoveries into health

“I think that we have to ask ourselves whether much of the output of biomedical science is getting

lost in translation?”–C.Lenfant, NEJM 2003;349:868-74. Former Director NHLBI.

Page 3: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

3

T1 T2

NIH Roadmap Initiative-translating discoveries into health

Image Removed:

Image Description: Picture of three 24K gold leaf capsules

“I think that we have to ask ourselves whether much of the output of biomedical science is getting

lost in translation?”–C.Lenfant, NEJM 2003;349:868-74. Former Director NHLBI.

gold leaf capsules

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidence

A

Selecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

Page 4: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

4

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidence

BSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

C

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

D

Page 5: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

5

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidence

A

Selecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

“T2” Taxonomy and BeyondThis figure can be viewed in Dougherty, Conway, JAMA , May 21, 2008, vol299, no 19.

This figure represents the 3T’s Road Map of translational steps proposed to reform health care. Across the top of the figure are various research domains: basic biomedical science, clinical efficacy knowledge, clinical effectiveness knowledge and improved health care quality and value and population health. T1 asks what care works and represents clinical efficacy research. This takes place between basic biomedical science and clinical efficacy knowledge. T2 k h b fit f i i d t t hT2 asks who benefits from promising care and represents outcomes research, comparative effectiveness research and health services research. This takes place between clinical efficacy knowledge and clinical effectiveness knowledge. T3 asks how to deliver high quality care reliably and in all setting and represents measurement accountability, implementation of interventions and health care system redesign, scaling and spread of effective interventions, and research in these domains. This takes place between clinical effectiveness knowledge and improved health care quality and value and population health.

Page 6: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

6

“T2” Taxonomy and Beyond

This figure can be viewed in Dougherty, Conway, JAMA , May 21, 2008, vol 299, no 19.

T3 asks how to deliver high quality care reliably and in all setting and represents measurement accountability, implementation of interventions and health care system redesign, scaling and spread of effective interventions, and research in these domains. This takes place between clinical effectiveness knowledge and improved health care quality and value and population health.

“T2” Taxonomy and Beyond

This figure can be viewed in Dougherty, Conway, JAMA , May 21, 2008, vol 299, no 19.

This figure focuses on T1 which asks what care works and represents clinical efficacy research. This takes place between basic biomedical science and clinical efficacy knowledge.

“T2” Taxonomy and Beyond

This figure can be viewed in Dougherty, Conway, JAMA , May 21, 2008, vol 299, no 19.

This figure focuses on T2 which asks who benefits from promising careThis figure focuses on T2 which asks who benefits from promising care and represents outcomes research, comparative effectiveness research and health services research. This takes place between clinical efficacy knowledge and clinical effectiveness knowledge.

Page 7: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

7

“T2” Taxonomy and Beyond

This figure can be viewed in Dougherty, Conway, JAMA , May 21, 2008, vol 299, no 19.

T3 asks how to deliver high quality care reliably and in all setting and represents measurement accountability, implementation of interventions and health care system redesign, scaling and spread of effective interventions, and research in these domains. This takes place between clinical effectiveness knowledge and improved health care quality and value and population health.

“T2” Taxonomy and Beyond

This figure can be viewed in Dougherty, Conway, JAMA , May 21, 2008, vol299, no 19.

This figure represents the 3T’s Road Map of translational steps proposed to reform health care. Across the top of the figure are various research domains: basic biomedical science, clinical efficacy knowledge, clinical effectiveness knowledge and improved health care quality and value and population health. T1 asks what care works and represents clinical efficacy research. This takes place between basic biomedical science and clinical efficacy knowledge

Caveat: CER can also be used to compare specific health care interventions and system redesigns…

between basic biomedical science and clinical efficacy knowledge. T2 asks who benefits from promising care and represents outcomes research, comparative effectiveness research and health services research. This takes place between clinical efficacy knowledge and clinical effectiveness knowledge. T3 asks how to deliver high quality care reliably and in all setting and represents measurement accountability, implementation of interventions and health care system redesign, scaling and spread of effective interventions, and research in these domains. This takes place between clinical effectiveness knowledge and improved health care quality and value and population health.

Translating Evidence Into Practice--an evolving language

• T4 (public sector)

• T5 (global health)

Szilagyi - Acad Pediatrics 2009Kon – Am J Bioeth 2008

Page 8: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

8

Translating Evidence Into Practice--an evolving language

• T4 (public sector)

• T5 (global health)

• Knowledge Translation

• Dissemination and Implementation Science

• Implementation and Dissemination Science

Szilagyi - Acad Pediatrics 2009Kon – Am J Bioeth 2008

NIH Definitions

• Implementation =– “the use of strategies to adopt and integrate

evidence-based health interventions and change practice patterns within specific g p p psettings”

NIH PAR 07-086

NIH Definitions

• Implementation =– “the use of strategies to adopt and integrate

evidence-based health interventions and change practice patterns within specific g p p psettings”

• Dissemination =– “the targeted distribution of information and

intervention materials to a specific public health or clinical practice audience”

NIH PAR 07-086

Page 9: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

9

Implementation and Dissemination Science is a Fusion of Disciplines

PUBLIC HEALTH & CLINICAL SCIENCES

DentistryMedicineNursingPharmacy

Copyright Gonzales R; 2011

Implementation and Dissemination Science is a Fusion of Disciplines

PUBLIC HEALTH & CLINICAL SCIENCES

DentistryMedicine

POPULATIONSCIENCES

EpidemiologyBiostatisticsHealth Policy

NursingPharmacy

Copyright Gonzales R; 2011

Implementation and Dissemination Science is a Fusion of Disciplines

IDS DISCIPLINESBehavioral Sciences

EconomicsEducation

PUBLIC HEALTH & CLINICAL SCIENCES

DentistryMedicine

EngineeringSocial Sciences

POPULATIONSCIENCES

EpidemiologyBiostatisticsHealth Policy

NursingPharmacy

Copyright Gonzales R; 2011

Page 10: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

10

ICE

TH

An Ecological View of Translating Evidence into Practice (and Health)

NC

E

PR

AC

T

HE

ALT

EV

IDE

N

Individuals• Providers• Patients• Public

Copyright Gonzales R; 2011

CER Translation Examples

• Individual Patient/Community Level– How do we increase patient adoption of

evidence-based weight loss/dietary strategies?g

CER Translation Examples

• Individual Patient/Community Level– How do we increase patient adoption of

evidence-based weight loss/dietary strategies?g

• Individual Physician Level– How do we increase physician counseling and

recommendations of evidence-based strategies for weight loss?

Page 11: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

11

ICE

TH

An Ecological View of Translating Evidence into Practice (and Health)

NC

E

D li • Hospitals

PR

AC

T

HE

ALT

EV

IDE

N Delivery Systems

Individuals

• Hospitals• Clinic/Practices• Health Depts

• Providers• Patients• Public

Copyright Gonzales R; 2011

ICE

TH

An Ecological View of Translating Evidence into Practice (and Health)

NC

E Stakeholders• Government• Payors/Insurers• Societies

• Hospitals

PR

AC

T

HE

ALT

EV

IDE

N Delivery Systems

Individuals

• Hospitals• Clinic/Practices• Health Depts

• Providers• Patients• Public

Copyright Gonzales R; 2011

CER Translation Examples

• Health Care Delivery System Level– How do we get clinical delivery systems to

offer comprehensive dietary and weight management programs?g p g

• Stakeholder/Policy Level– How do we convince payors to provide

reimbursement for weight loss programs?

Page 12: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

12

Principles Guiding Implementation Design

1. Behavior change is inherent in the translation of evidence into practice, policy and public health.

Principles Guiding Implementation Design

1. Behavior change is inherent in the translation of evidence into practice, policy and public health.

2. Key components of behavior change strategies include the intervention (stimulus), a response, and feedback to intervention stakeholder.

Principles Guiding Implementation Design

1. Behavior change is inherent in the translation of evidence into practice, policy and public health.

2. Key components of behavior change strategies include the intervention (stimulus), a response, and feedback to intervention stakeholder.

3. Successful implementation of behavior change strategies are iterative, favoring cycles and bidirectional relationships.

Page 13: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

13

Principles Guiding Implementation Design

1. Behavior change is inherent in the translation of evidence into practice, policy and public health.

2. Key components of behavior change strategies include the intervention (stimulus), a response, and feedback to intervention stakeholder.

3. Successful implementation of behavior change strategies are iterative, favoring cycles and bidirectional relationships.

4. Community engagement is imperative to achieving meaningful and sustained behavior change.

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidence

BSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

What CER Evidence Do you Want to Translate?

Types of Evidence

• Health Related Behaviors

• Tests

• Treatments

• Procedures

• Interventions

• Programs

Page 14: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

14

IOM Report Brief – June 2009

Is the CER Evidence Ready for Translation?

Levels of Evidence

• Efficacy

Is the CER Evidence Ready for Translation?

Levels of Evidence

• Efficacy

• Effectiveness

Page 15: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

15

Is the CER Evidence Ready for Translation?

Levels of Evidence

• Efficacy

• Effectiveness

• Systematic Reviews

• Meta-analysis

Is the CER Evidence Ready for Translation?

Levels of Evidence

• Efficacy

• Effectiveness

• Systematic Reviews

• Meta-analysis

• Consensus Statements

• Practice Guidelines

Is the CER Evidence Ready for Translation?

Levels of Evidence

• Efficacy

• Effectiveness

Less Readiness

• Systematic Reviews

• Meta-analysis

• Consensus Statements

• Practice Guidelines Greater Readiness

Page 16: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

16

Efficacy vs. Effectiveness

Levels of Evidence

• Efficacy – positive results in a controlled experimental trial in very specific (optimal) setting / patientssetting / patients

• Effectiveness – positive results in a wide variety of settings in usual practice conditions – “the real world”

Effectiveness vs. efficacy - example

• Premature birth results in respiratory distress syndrome due to surfactant deficiency.

• Antenatal steroids are given to accelerate lung maturity in preterm birth -

Image from: http://www.flickr.com/photos/hudsonthego/157033260/sizes/l/in/photostream/ hudsonthego

Effectiveness vs. efficacy - example

• Pediatrics 1972

Page 17: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

17

Effectiveness vs. efficacy - example

• Pediatrics 1972

• 282 mothers – non-antenatal steroid group had 4x more mortality and 2.5x more respiratory distress syndrome.

• Average gestational age 32 weeks / birth weight 2300 grams

Effectiveness vs. efficacy - example

• Subsequent clinical trials showed efficacy in other populations.

• Observational studies showed effectiveness in the general population of premature infants, including those b l 24 t 26 kborn as early as 24 to 26 weeks.

Jobe AH. Prenatal Corticosteroids: A Neonatologist's Perspective. Neoreviews. 2006;7(5):e259-267.

Effectiveness vs. efficacy - example

• Subsequent clinical trials showed efficacy in other populations.

• Observational studies showed effectiveness in the general population of premature infants, including those b l 24 t 26 kborn as early as 24 to 26 weeks.

• Observational studies also showed effectiveness outside of clinical trial setting.

• NIH recommendations since 1994 that mothers delivering between 24 and 34 weeks gestational age should receive antenatal steroids.

Jobe AH. Prenatal Corticosteroids: A Neonatologist's Perspective. Neoreviews. 2006;7(5):e259-267.

Page 18: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

18

Effectiveness vs. efficacy

• Efficacy may not always translate to effectiveness.

• Efficacy studies Does the treatment work• Efficacy studies – Does the treatment work under ideal circumstances?

• Effectiveness – Does the target population adhere to treatment? Is it safe in non-experimental setting?

Bronchiolitis

• Viral disease of small airways in infants often caused by RSV (respiratory syncytial virus)

Put picture of baby with mask

Image: H Lee 2011

• A Randomized Trial of Nebulized Epinephrine vs. Albuterol in the Emergency Department Treatment of Bronchiolitis

(Mull Arch Pediatr Adolesc Med. 2004;158)

• Comparison of nebulized epinephrine to albuterol in bronchiolitis. (Walsh Acad Emerg Med. 2008;15)

• Racemic epinephrine compared to salbutamol in hospitalized young children with bronchiolitis; a randomized controlled clinical trial. (Langley BMC Pediatr. 2005;5) ( g y ; )

• Randomized, placebo-controlled trial of albuterol and epinephrine at equipotent beta-2 agonist doses in acute bronchiolitis. (Ralston Pediatr Pulmonl. 2005;40)

• A randomized, controlled trial of the effectiveness of nebulized therapy with epinephrine compared with albuterol and saline in infants hospitalized for acute viral bronchiolitis.

(Patel J Pediatr. 2002;141)

Page 19: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

19

The Evidence-Based Medicine Movement (1990 → )

Rating the Evidence: Systematic Reviews

• The Cochrane Collaboration (www.cochrane.org)

The Evidence-Based Medicine Movement (1990 → )

Rating the Evidence: Systematic Reviews

• The Cochrane Collaboration (www.cochrane.org)

• Cochrane Effective Practice and Organisation• Cochrane Effective Practice and Organisation of Care (EPOC) Group (www.epoc.cochrane.org)

– Systematic reviews of health care interventions

• National Cancer Institute (www.cancer.gov)

Meta-analyses• Hartling et al. A meta-

analysis of randomized controlled trials evaluating the efficacy of epinephrine for the treatment of acute viral bronchiolitis. Arch Pediatr Adolesc Med

• AHRQ. Management of Bronchiolitis in Infants an Children. Evidence Report / Technology Assessment No. 69. 2003. 03-E014

• Flores G, Horwitz RI. Efficacy of beta2-agonists in bronchiolitis: a reappraisal and meta-analysised at do esc ed

2003;157:957-67.

• Cochrane Review. Epinephrine for bronchiolitis. 2004;(1): CD003123

reappraisal and meta analysis. Pediatrics. 1997;l00:233–239

Page 20: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

20

Meta-analyses• Hartling et al. A meta-

analysis of randomized controlled trials evaluating the efficacy of epinephrine for the treatment of acute viral bronchiolitis. Arch Pediatr Adolesc Med

• AHRQ. Management of Bronchiolitis in Infants an Children. Evidence Report / Technology Assessment No. 69. 2003. 03-E014

• Flores G, Horwitz RI. Efficacy of beta2-agonists in bronchiolitis: a reappraisal and meta-analysisPediatr Adolesc Med

2003;157:957-67.

• Cochrane Review. Epinephrine for bronchiolitis. 2004;(1): CD003123

reappraisal and meta analysis. Pediatrics. 1997;l00:233–239

At most, 1 in 4 patients may have transient improvement with unclear clinical benefit.

Potential adverse effects and cost.

Making Recommendations:Practice Guidelines

• USPSTF (www.ahrq.gov/CLINIC/uspstfix.htm)

• CDC (www.cdc.gov)

• Professional Societies

• GRADE

• “Clinicians should not routinely order laboratory and radiologic studies for diagnosis

Pediatrics 2006

Page 21: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

21

• “Clinicians should not routinely order laboratory and radiologic studies for diagnosis

• Bronchodilators should not be used routinely in the management of bronchiolitis(…preponderance of harm of use over benefit).

• A carefully monitored trial of -adrenergic or –adrenergic medication is an option.

Pediatrics 2006

Making Recommendations:Practice Guidelines

• National Guidelines Clearinghouse (US)

–www.guideline.gov

• National Institute for Health and Clinical Excellence (UK)

–http://www.nice.org.uk

• The Guidelines International Network

–http://www.g-i-n.net

www.guideline.gov

Page 22: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

22

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

C

Quality of Health Care-c. 1980s

• Donabedian A. JAMA 1988;260:1743-8

Structure Process Outcomes

Quality of Health Care-c. 1980s

• Donabedian A. JAMA 1988;260:1743-8

Structure Process Outcomes

Community Characteristics Health Care Providers

T h i l P

Health Status

Functional StatusDelivery System Characteristics

Provider Characteristics

Population Characteristics

-Technical Processes-Interpersonal Processes

Public & Patients-Access-Acceptance-Adherence

Functional Status

Satisfaction

Mortality

Cost

Page 23: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

23

“Quality Indicators”The Many Faces of Quality 

• Outcomes

• Structure

– Access to care, tests, treatments, procedures

“Quality Indicators”The Many Faces of Quality 

• Outcomes

• Structure

– Access to care, tests, treatments, procedures

• Processes… Things you can influence!

– Performance Measures

• System and Clinician Oriented

– Testing; treatment; referrals; counseling; communication

• Patient and Public Oriented– Adherence; testing; self‐care; office visits; lifestyle; healthy behaviors

McGlynn EA. NEJM 2005

Page 24: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

24

Condition (n=25) Recommended Care, %Senile Cataract 79%Breast Cancer 76%Prenatal Care 73%….Dyspepsia/Ulcer Disease 33%Atrial Fibrillation 25%Hip Fracture 23%Alcohol Dependence 11%Overall Average 55%

McGlynn EA. NEJM 2005

NCQA 2007

NCQA 2007

Page 25: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

25

Hospital Comparewww.hospitalcompare.hhs.gov

Hospitalcompare.hhs.gov – accessed May 2011

Hospital Comparewww.hospitalcompare.hhs.gov

Hospitalcompare.hhs.gov – accessed May 2011

CMS/JCAHO & Hospital Compare-Hospital Quality Measures

Patient Hospital Experiences• Communication• Pain Control• Explanation of Treatments and Recovery• Cleanliness & Quietness• Overall Rating and Recommendation to OthersProcess of Care Measures• Surgical Care Improvement Project Measures• Heart Attack & Chest Pain• Pneumonia• Heart Failure• Childhood AsthmaOutcome Measures• Risk-Adjusted Condition-Specific 30-day Mortality; Readmissions

Use of Medical Imaging

Page 26: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

26

Medical imaging

Hospitalcompare.hhs.gov – accessed May 2011

Measure Quality Yourself-National Surveys/Reports

Behavior Data Sources

–Public/Patient BRFSS; NHIS; NHANES; MEPS

Measure Quality Yourself-National Surveys/Reports

Behavior Data Sources

–Public/Patient BRFSS; NHIS; NHANES; MEPS

–Provider NAMCS; NHAMCS

–Delivery System NHDS

Page 27: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

27

Measure Quality Yourself-Administrative Claims Data

Administrative data collected as a result of “claims” submitted by physicians/practices for reimbursement.

• Medicare (UB-92)– No pharmacy data

Measure Quality Yourself-Administrative Claims Data

Administrative data collected as a result of “claims” submitted by physicians/practices for reimbursement.

• Medicare (UB-92)– No pharmacy data

• Medicaid (Drug Utilization Review; OSHPD)• Medicaid (Drug Utilization Review; OSHPD)– Enrollment rollercoaster

Measure Quality Yourself-Administrative Claims Data

Administrative data collected as a result of “claims” submitted by physicians/practices for reimbursement.

• Medicare (UB-92)– No pharmacy data

• Medicaid (Drug Utilization Review; OSHPD)• Medicaid (Drug Utilization Review; OSHPD)– Enrollment rollercoaster

• Integrated Delivery Systems (Kaiser; Geisinger; etc)– Generalizability

• Hospital Networks (Premier)

Page 28: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

28

Measure Quality Yourself-Administrative Claims Data

Administrative data collected as a result of “claims” submitted by physicians/practices for reimbursement.

• Medicare (UB-92)– No pharmacy data

• Medicaid (Drug Utilization Review; OSHPD)• Medicaid (Drug Utilization Review; OSHPD)– Enrollment rollercoaster

• Integrated Delivery Systems (Kaiser; Geisinger; etc)– Generalizability

• Hospital Networks (Premier)

Computerized health records are becoming a new resource for quality and outcome measurement…

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

D

Making Your Case…

Determine the Quality Gap

Page 29: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

29

• Implementation of evidence-based management of acute bronchiolitis. – (Barben J Paeditr. Child Health 2000)

Antenatal steroids for premature infants –California Perinatal Quality Care Collaborative

• Wide variability in hospital’s antenatal steroid administrationadministration rates.

• 2005 – 2007.

Lee Obstet Gynecol 2011

Quality Indicators and Benchmarks

• When guidelines exist– HEDIS

• When guidelines don’t exist– Dartmouth Atlas

Page 30: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

30

National Committee for Quality Assurancewww.ncqa.org

HEDIS Effectiveness of Care Measures 2003, comm• Beta-blocker post MI 94%

• Cancer screening– Breast 75%– Cervical 82%

Colorectal 47%– Colorectal 47%• Chlamydia screening 30%

• Cholesterol screening 79%

• HbA1c testing 85%

• Eye exams in diabetes 49%

• Controlling hypertension (<140/90) 62%

• LDL < 100 after 60 days of MI 48%

When Guidelines Don’t ExistCABG Rates per 1000 Medicare enrollees, 1999

-from Dartmouth Atlas Quick Report for California, 2002

Dartmouth Atlas Quick Report for California 2002

Dartmouth Atlas AreasMedical Discharges• Discharges for COPD• Bacterial Pneumonia Discharges• Discharges for CHF• Kidney/Urinary Infection Discharges• Dehydration Discharges• Non-ACS Medical Discharges• Discharges for ACS Conditions

All M di l Di h

Surgical Discharges• Coronary Angiography

• All Surgical Discharges

• Back Surgery

• CABG

• Cholecystectomy

• Hospitalization for Hip Fracture• All Medical Discharges• High Variation Medical Discharges• Low/Mod. Variation Medical Discharges• Discharges for Respiratory Infections• Acute Myocardial Infarction Discharges• Cerebrovascular Discharges (except TIA)• Cardiac Arrhythmia Discharges• Syncope and Collapse Discharges• Chest Pain Discharges• Gastro-Intestinal Hemorrhage Discharges• Nutritional and Metabolic Disorders• Septicemia Discharges

• Knee Replacement

• Percutaneous Coronary Interventions

End-of-Life Care (last 6 mo)

ICU Care

Page 31: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

31

http://www.dartmouthatlas.org/

www.dartmouthatlas.org

http://www.dartmouthatlas.org/

Overuse

Underuse

Misusewww.dartmouthatlas.org

Making Your Case…

Link Quality Gap to

O t GOutcome Gap

Page 32: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

32

ENCE

COMMUNITY

Health Care Delivery Systems

GovernmentPayors

Prof. SocietiesAcademia

Linking Quality Gap to Outcome Gap

STAKEHOLDERS

-Safe

-Effective

-Efficient

-Equitable

EVIDE

QUALITY OF CARE OUTCOME

Health Care Delivery Systems

Providers

Patients

Public

qu tab e

-Patient-Centered

-Timely

The Public Health and Business Case

The State of Health Care Quality 2008 - NCQAhttp://www.ncqa.org/portals/0/newsroom/sohc/SOHC_08.pdf

Not a No-BrainerLinking Quality Gap with Outcomes…Werner R, 2006

Werner R. JAMA 2006

Page 33: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

33

Not a No-BrainerCMS P4P Evaluation.Glickman SW, 2007

Adapted from Glickman SW. JAMA 2007.

Outline

– Taxonomy of translation

– Conceptual framework for translation

– Making the case for translation• Selecting the evidenceSelecting the evidence

• Measure quality and its determinants

• Quality gap

• Outcome gap

– Making change happen…

Continuous Quality

Improvementand PDSA

ACT PLAN

Cycles

Don Berwick; Institute for Healthcare Improvement

STUDY DO

Page 34: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

34

Making Change Happen…

• Impact of a Bronchiolitis Guideline – A Multisite Demonstration Project. Chest 2002

M t f t b hi liti• Management of acute bronchiolitis: can evidence based guidelines alter clinical practice? Thorax 2008

• Promoting antenatal steroid use for fetal maturation: results from the California Perinatal Quality Care Collaborative. J Pediatr 2006

Readings

• Dougherty D, Conway PH. The “3Ts” Road Map to Transform US Health Care. The “How” of High Quality Care. JAMA 2008;299:2319-21.

• Donabedian A. The Quality of Care How Can It Be Assessed? JAMA 1988;260:1743-8Assessed? JAMA 1988;260:1743 8.

• Auerbach AD, Landefeld CS, Shojania KG. The Tension between Needing to Improve Care and Knowing How to Do it. NEJM 2007;357:608-13.

• Berwick DM. The Science of Improvement. JAMA 2008;299:1182-4.

• Initial National Priorities for Comparative Effectiveness Research. Institute of Medicine Report Brief June 2009.

• Institute of Medicine Crossing the Quality• Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Executive Summary (pp 1-20)

Page 35: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

35

The translational toolbox

Summary

• Translating evidence into practice, policy and public health depends on aligning behaviors of stakeholders, delivery systems, providers, patients and the public.

• Stakeholders, health care providers and the public need to monitor health care quality, and inform the development of new evidence and translational activities.

Summary

• Quality of care is a function of the structure, processes and outcomes of care

– Changes to the structure and processes of care can lead to improved outcomes of care…p

• Improving the quality of health care should maximize safety, effectiveness, efficiency, patient-centeredness, and/or timeliness of care; and reduce disparities in care.

Page 36: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

36

Summary

• To Make Your Case for translating evidence into practice for a specific topic– Measure its quality, determine the quality gap,

and link the quality gap to an outcome gapand link the quality gap to an outcome gap

NCQA. The State of Health Care Quality 2007

NCQA. The State of Health Care Quality 2007

Page 37: Translating CER Evidence into Practice, and The Science of ...€¦ · evidence into practice, policy and public health. 2. Key components of behavior change strategies include the

37

References & Resources1. Anderson GF, Frogner BK. Health spending in OECD countries: obtaining value per dollar. Health

Affairs (Millwood). 2008;27(6):1718-27.

2. Barben JU, Robertson CF, Robinson PJ. Implementation of evidence-based management of acute bronchiolitis. Journal of Paediatrics and Child Health. 2000;36:491–497.

3. Department of Health and Human Services. NIH PAR 07-086. Available athttp://grants.nih.gov/grants/guide/pa-files/PAR-07-086.html. Accessed January 19, 2012.

4. Subcommittee on Diagnosis and Management of Bronchiolitis. Diagnosis and management of Bronchiolitis. Pediatrics .2006;118;1774. doi: 10.1542/peds.2006-2223.

5. Donabedian A. The quality of care how can it be assessed? JAMA. 1988;260:1743-8.

6. Dougherty D, Conway PH. The “3Ts” road map to transform US health care. The “how” of high quality care. JAMA. 2008;299:2319-21.

7. Glickman SW et al. Pay for performance, quality of care, and outcomes in myocardial infarction. JAMA. 2007;297:2373–2380.

8. IOM Report Brief. June 2009 Initial National Priorities for Comparative Effectiveness Research.Available at http://www.iom.edu/~/media/Files/Report%20Files/2009/ComparativeEffectivenessResearchPriorities/CER%20report%20brief%2008-13-09.pdf. Accessed January 19, 2012.

9. Jobe AH. Prenatal corticosteroids: A neonatologist’s perspective. Neoreviews. 2006;7(5): 259 267. US Department of Health and Human Services. Hospitals Compare. Available at http://www.hospitalcompare.hhs.gov/. Accessed May 2011.

10. Lenfant C. Clinical research to clinical practice — Lost in translation? N Engl J Med. 2003;349:868-874.

References & Resources11. Lee HC, Lyndon A, Blumenfeld YJ, Dudley RA, Gould JB. Antenatal steroid administration for

premature neonates in California. Obstetrics & Gynecology. 2011;117(3).

12. Liggins GC, Howie RN. A controlled trial of antepartum glucocorticoid treatment for prevention of the respiratory distress syndrome in premature infants. Pediatrics. 1972;50(4):515-525.

13. McGlynn EA et al. The quality of healthcare delivered to adults in the United States. N Engl JMed. 2003;348:2635-45.

14. Murray C, Frenk J. Ranking 37th — Measuring the performance of the U.S. health care system. N Engl J Med. 2010;362:99.

15. Szilagyi PG. Translational research and pediatrics. Academic Pediatrics. 2009;9(2):71-80.

16. The Dartmouth Atlas of Healthcare. The Dartmouth Atlas Quick Report for California 2002. Available at http://www.dartmouthatlas.org/. Accessed January 19, 2012.

17. The State of Healthcare Quality 2007. National Committee for Quality Assurance Washington,DC. Available at http://www.ncqa.org/Portals/0/Publications/Resource%20Library/SOHC/SOHC_07.pdf. Accessed January 19, 2012.

18. The State of Healthcare Quality 2008. National Committee for Quality Assurance Washington,DC. Available at http://www.ncqa.org/portals/0/newsroom/sohc/SOHC_08.pdfDC.Accessed January 19, 2012.

19. Werner R, Bradlow ET. Relationship between medicare’s hospital compare performance measures and mortality rates. JAMA .2006; 296(22).