Pragmatic Trials: What the Heck Are They and Why Should You Care?

Transcription

1 Pragmatic Trials: What the Heck Are They and Why Should You Care? Jerry Jarvik, M.D., M.P.H. Professor of Radiology, Neurological Surgery and Health Services Adjunct Professor Orthopedic Surgery & Sports Medicine and Pharmacy Director, Comparative Effectiveness, Cost and Outcomes Research Center (CECORC)

2 Acknowledgements NIH: UH2 AT ; UH3 AT AHRQ: R01HS ; 1R01HS PCORI: CE Disclosures (Jarvik) Physiosonix (ultrasound company) Founder/stockholder Healthhelp (utilization review) Consultant Evidence-Based Neuroimaging Diagnosis and Treatment (Springer) Co-Editor

3 Clinical Trials- The Big Picture

4

5

6 The Big Picture Comparative Effectiveness Evidence Based Practice Health Policy

7

8 So we need to generate evidence

9 Challenge #1: Clinical research is slow Traditional RCTs are slow and expensive and rarely produce findings that are easily put into practice. In fact, it takes an average of 17 years before research findings lead to widespread changes in care. How pragmatic clinical trials can improve practice & policy

10 Challenge #1: Clinical research is slow rarely produce findings that are easily put into practice.

11 Efficacy vs. Effectiveness

12 Efficacy vs. Effectiveness Efficacy: can it work under ideal conditions Effectiveness: does it work under real-world conditions

13 Challenge #2: Clinical research is not relevant to practice Traditional RCTs study efficacy of txsfor carefully selected populations under ideal conditions. Difficult to translate to real world. When implemented into everyday clinical practice, often see a voltage drop dramatic decrease policyfrom efficacy to effectiveness. How pragmatic clinical trials can improve practice & If we want more evidencebased practice, we need more practice-based evidence. Green, LW. American Journal of Public Health, 2006.

14 Challenge #3: The evidence paradox >18,000 RCTs published each year plus tens of thousands of other clinical studies. Yet systematic reviews consistently find not enough evidence to effectively inform clinical decisions providers How pragmatic clinical trials and patients must make. can improve practice & policy

15 The solution? A solution? An approach?

16 The solution? A solution? An approach? Pragmatic Trials

17 Pragmatic vs. Explanatory Trial Explanatory trials Examine efficacy Conducted under ideal conditions Explain mechanisms Pragmatic trials Determine comparative effectiveness (CER) Routine practice Aim to help providers, patients, and policy makers choose between interventions

18 Pragmatic Trials Large Simple Trials Effectiveness Trials

19 Explanatory Trials If and how an intervention works Control for as many biases and confounders as possible Maximize intervention s effect

20 Pragmatic vs. Explanatory Trials Patsopoulos et al. Dialogues Clin Neurosci Jun; 13(2):

21 Pragmatic Trials Size: huge n robust estimates, heterogeneity Endpoints: patient oriented with minimal adjudication Setting: integrated into real world Non-academic centers Leverage digital data Patients as partners

22 Key features of most PCTs Use of electronic health records (EHRs) EHRs allow efficient and cost-effective, recruitment, participant communication & monitoring, data collection, and follow up How pragmatic clinical trials can improve practice & policy Randomization at clinic or provider level Protocols can be tailored to local sites and can adapt to changes in a dynamic health care environment

23 EMRs Have Their Limitations

24 Data Quality Issues with Death Unambiguous-should be easy

25 Data Quality Issues with Death Unambiguous-should be easy Ptsdied prior to index visit Ptshad visits after death

26 Data Quality Issues with Death Unambiguous-should be easy Ptsdied prior to index visit Ptshad visits after death 1.4% of those who died subsequently had visits

27 Kaiser should be happy about 1.4% resurrection rate

28 Key features of most PCTs Use of electronic health records (EHRs) EHRs allow efficient and cost-effective, recruitment, participant communication & monitoring, data collection, and follow up How pragmatic clinical trials can improve practice & policy Randomization at clinic or provider level Protocols can be tailored to local sites and can adapt to changes in a dynamic health care environment

29 Pragmatic vs. Explanatory Trials

30

31 Pragmatic vs. Explanatory 1. Eligibility 2. Recruitment 3. Setting 4. Organization 5. Flexibilityintervention 6. Flexibilityadherence 7. Follow-up 8. Primary outcome 9. Primary analysis (?includes all data?)

32 Examplefrom: Little P, Moore M, Kelly J, Williamson I, Leydon G, McDermott L, Mullee M, Stuart B: Ibuprofen, paracetamol, and steam for patients with respiratory tract infections in primary care: pragmatic randomised factorial trial. BMJ 2013, 347:f6041.

33 Example of Pragmatic Trial- Lumbar Imaging with Reporting of Epidemiology (LIRE)

34 LIRE (pronounced leer)- From the French verb, To Read

35 LIRE Funded by NIH Health Care Systems Collaboratory Supported by the NIH Common Fund Goal: improve the way (pragmatic) clinical trials conducted Build infrastructure for CER

36 nihcollaboratory.org

37 Demonstration Projects

38

39 Background and Rationale Lumbar spine imaging frequently reveals incidental findings These findings may have an adverse effect on: Subsequent healthcare utilization Patient health related quality of life

40 Disc Degeneration in Asx

41 Hypothesis The benchmark information will influence subsequent management of primary care patients with LBP Fewer subsequent imaging tests Fewer referrals for minimally invasive pain treatment Fewer referrals to surgery Less narcotic use

42 LIRE PRECIS

43 The Intervention: GHC Test Template

44 The Intervention: GHC Test Template

45 Participating Systems Name # Primary Care Clinics (Original) # Primary Care Clinics (Randomized) # PCPs (Original) # PCPs (Randomized) Kaiser Perm , N. California Henry Ford Health System, MI Group Health Coop of Puget Sound Mayo Health System Total

46 LIRE: Enrollment

47 LIRE- Primary Outcome What we want to know: how patient s back pain is doing Back pain-related disability: Roland- Morris Disability Questionnaire Back and leg pain: pain NRS HRQoL How do we get this data? Ask the patient: Pt Reported Outcome

48 Are PROs Pragmatic? Barriers: Time to get # of personnel Finding and contacting $$ For 100s- For 1,000s- For >100,000s-

49 LIRE- Primary Outcome A single metric of overall intensity of resource utilization for spine care based on CPTs converted to RVUs Passively collected from EHR

50 All Data Passively Collected (from EHR and VDW) CPT codes ICD10 codes Unique patient ID Unique provider ID Unique clinic ID Dates of service Limited patient demographics Imaging test results (text) Pharmacy data (medications, dose, etc)

51 Key Pragmatic Aspects of LIRE Broad inclusion criteria Waiver of consent/minimal risk Simple, easily implementable intervention Passive collection of outcomes Stepped wedge for implementation

52 Stepped Wedge RCT

53 Advantages of SW Design Controls for external temporal trends More efficient than parallel design since have both between and within group comparisons Assures all sites receive intervention Participation more palatable for interventions viewed as desirable

54 Patient-Centered Outcomes Research Institute

55 PCORI Independent non-governmental organization Goal to help patients, clinicians, purchasers and policy makers make better informed health decisions Spearheading CER and pragmatic trials

56 PCOR Trust Fund : $210 million 2013: ~$320 million $150 million general revenues $1/Medicare beneficiary + private plans : ~$650 million/yr $150 million general revenues $2/beneficiary PCORTF not authorized after 2019

57 PCORI National Priorities Comparative Assessments of Prevention, Diagnosis, and Treatment Options Improving Healthcare Systems Addressing Disparities Accelerating Patient-Centered and Methodological Research

58 Stakeholder Engagement Essential

59 Stakeholder Engagement Essential Patients Patient-advocacy groups Community groups Caregivers Health care providers Relevant professional associations Others who can bring insights on the patient perspective

60 What Is Stakeholder Engagement? Participation in formulation of research questions Defining essential characteristics of study participants, comparators, and outcomes Monitoring of study conduct and progress Interpretation/dissemination of results

61 Take Home Points Pragmatic vs. Explanatory trials and the PRECIS tool NIH Health Care Systems Collaboratory PCOR and PCORI

62 Explanatory vs. Pragmatic Trials