Large simple randomized trials and therapeutic decisions
|
|
- Gregory Chapman
- 5 years ago
- Views:
Transcription
1 Large simple randomized trials and therapeutic decisions Adam La Caze November 3, 2011 Contents 1 Background 1 2 Large simple randomized trials The argument for large simple trials The assumptions regarding Type S errors are unmotivated Accurate estimation of effects are important for therapeutic decisions. 8 3 Alternative approaches Rothwell s rules Model-based approaches Background Large simple randomized trials Salim Yusuf, Rory Collins and Richard Peto (1984) argue large and simple randomized trials are the best way to determine small to modest benefits in important endpoints such as death The simple trials: Simple inclusion and exclusion criteria Simple intervention 1
2 Focus on single important endpoint, e.g. mortality Collect minimal prognostic data Yusuf et al. argue that such trials are reliable and clinically relevant Not all randomized trials are simple randomized trials, but there are numerous examples of large and simple trials Yusuf et al. have conducted (and continue to conduct) many. (See, for instance Population Health Research Institute and the POISE study (2008)) I focus on the arguments given for large simple randomized trials and the limitations of these arguments especially in terms of therapeutic decisions. Much of my focus is negative, but I will sketch an alternative approach (after all, whatever the limitations of large simple randomized trials, we would be stuck with them if they provided the only feasible approach). I don t suggest that large simple trials are not clinically relevant on the contrary they can answer an important therapeutic question (a population question) quite well. Rather, I suggest (i) that large simple trials don t do as well on certain (individual) therapeutic decisions are Yusuf et al. argue, and (ii), somewhat more speculatively, that alternative methods can do better on these individual therapeutic decisions. Examples Example 1 (ISIS-2). ISIS-2 (1988) randomized 17,187 patients suffering acute myocardial infarction from 16 countries to treatment with either streptokinase, aspirin, streptokinase and aspirin, or placebo ISIS-2 resolved important clinical controversies about the use of aspirin and thrombotics in patients suffering an acute myocardial infarction. It changed practice and, when compared to what was then standard practice, it has saved lives. Peto et al. (1995, 25) quotes a survey showing that routine use of aspirin in acute coronary care went from under 10% in 1987 to over 90% in Example 2 (POISE). POISE (2008) randomized 8351 patients undergoing non-cardiac surgery to peri-operative metoprolol Perioperative metoprolol reduced the primary endpiont (cardiovascular death, non-fatal myocardial infarction, non-fatal cardiac arrest): 5.8% c.f. 6.9%, p= But, increased total mortality: 3.1% c.f. 2.3%, p=0.0317; and stroke 1.0% c.f. 0.5%, p= Example 3 (POISE-2). POISE-2 is currently enrolling patients undergoing non-cardiac surgery to test the effects of aspirin (or placebo) and clonidine (or placebo) on mortality and non-fatal myocardial infarction 2
3 The function of randomized trials 1. Regulatory approval for the marketing of medicines Are the benefits of the drug likely to outweigh the harms in a population of patients? 2. Inform therapeutic decisions Are the benefits of the drug likely to outweigh the harms in an individual patient? The subgroup problem In the hope of individualising therapy, matching the characteristics of the individual to a relevant group of patients within the trial is tempting. But the statistical properties of subgroup analyses are often (very) poor Brookes et al. (2001) conducted a simulation study to quantify the risks of falsepositive and false-negative results in subgroup analyses. When there was no overall effect from treatment, 7 26% of trials showed one subgroup analysis gave a statistically significant result; When there was an overall effect from treatment, only one of the two subgroup analyses gave statistically significant results in 41 66% of trials. There are statistical approaches to improve inferences about subgroup effects, but none resolve the problem: formal tests of subgroup interactions reduce the false positives (but most trials are underpowered to assess). Responses to the subgroup problem: Alvan Feinstein (1984, p. 421) made the following comment in discussion of (Yusuf et al., 1984) The main problem, it seems to me, is again the question of whether we are evaluating two treatments or are we evaluating treatments for the care of patients? The different kinds of patient that are being lumped together into these heterogenous pastiches under the name of the same disease or under the name of the same therapeutic agents may produce results with excellent statistical ability to compare two treatments, but will be relatively worthless when people try to use the consequences in practice. What is required in a degree of humility in the face of an issue for which there is no statistical or clinical solution. [... ] The development of randomised clinical trials since Mackenzie s time has provided a much sounder 3
4 basis for making decisions about abstract patients and if representative samples of patients are included in the trials for deciding if the overall effect on population health of a treatment is beneficial or harmful. Randomised trials have not, however, answered the question of which individuals actually benefit from medical interventions. This, surely, is the key issue in clinical research in for the next millennium. (Smith and Egger, 1998) Rothwell (2007c, 142) comments on the logic of the argument that what matters is overall benefits and harms: The need for reliable data on risks and benefits in subgroups and individuals is greatest for potentially harmful interventions, such as warfarin or carotid endarterectomy, which are of overall benefit but which kill or disable a significant proportion of patients. yet, evidence-based guidelines usually recommend these treatments in all cases similar to those in the relevant RCTs. IN considering this approach, it is useful to draw an analogy with the criminal justice system. Suppose that research showed that individuals charged by the police with certain crimes were usually guilty. Few would argue that they should therefore be sentenced without trial. Automatic sentencing would, on average, do more good than harm, with most criminals correctly convicted, but any avoidable miscarriages of justice are widely regarded as unacceptable. In contrast, relatively high rates of treatment-related death or disability ( miscarriages of treatment ) are tolerated by the medical scientific community precisely on the basis that, on average, treatment will do more good than harm. Model-based drug development Model-based drug development uses mathematical models to account for and predict variation in pharmacological, pharmacokinetic and pharmacodynamic relationships over time: Dose P K Exposure : Exposure P D Biomarker response Sheiner (1997) made the argument that a key source for inefficiency in drug development was the insufficient use of the right kind of methodological tools in the learning phases of drug development. Additional relationships that are modelled include: Target Drug activity and Biomarker response Clinical outcome. 4
5 2 Large simple randomized trials 2.1 The argument for large simple trials Outline of the argument in Yusuf et al. (1984) 1. Effects of an intervention on an important endpoint (e.g. death) are likely to be modest 2. Well-conducted large randomized trials are more reliable in testing the modest effects of an intervention than observational studies 3. To be feasible large trials have to be simple 4. Large simple trials are clinically relevant Simple = broad and practical enrolment; little prognostic data collected; focus on single endpoint Relevant = relevance of overall effect c.f. subgroups Well-conducted randomised trials have to be large to reliably test for modest effects This can be illustrated by a hypothetical trial that is actually quite inadequate... in which a 20 per cent reduction in mortality is supposed to be detected among 2000 patients (1000 treated and 1000 not).... Even if exactly this difference were observed, however, it would not be conventionally significant (P = 0.1).... Yusuf et al. (1984, 412) Hence, reliable is construed within the context of a frequentist hypothesis test. Large simple trials are clinically relevant A key principle underlying the argument that clinical trials can be simple and yet provide medically relevant conclusions involves careful distinction between quantitative interactions and qualitative interactions. Yusuf et al. (1984, 413) 5
6 Quantitative and qualitative interactions Quantitative interactions: different magnitude, same direction Qualitative interactions: different direction, i.e. benefit in one subgroup, harm in another Andrew Gelman 1 calls the errors that can arise from undetected interactions: Type M (measurement) errors and Type S (signal) errors. Unanticipated qualitative interactions (Type S errors)... unanticipated qualitative interactions (whereby treatment is of substantial benefit among one recognizable category of patients in a trial and not among another) are probably extremely rare, even though in retrospective subgroup analysis they may seem extremely common. Our expectation is not that all qualitative interaction are unlikely, but merely that unanticipated qualitative interactions are unlikely... Yusuf et al. (1984, 413) Qualitative interactions are either (i) unanticipated and unlikely, or (ii) anticipated and incorporated into the specification of the trial. Shorter Yusuf et al Conduct large simple trials because frequentist statistical approaches require them for identifying small to modest effect sizes 2. Individual therapeutic decisions can be based on the overall trial results because: (a) Frequentist statistical analyses of subgroup data unreliable or infeasible (b) Unanticipated Type S errors are rare (c) Anticipated Type S errors are avoided in trial design (d) Type M errors are common but unimportant to decisions Quotes representing this view: 1 See for instance, Gelman and Tuerlinckx (2000) 6
7 The treatment that is appropriate for one patient may be inappropriate for another. Ideally, therefore, what is wanted is not only an answer to the question Is this treatment helpful on average for a wide range of patients?, but also an answer to the question For which recognisable categories of patient is this treatment helpful? This ideal is, however, difficult to attain, for the direct use of clinical trial results in particular subgroups of patients is surprisingly unreliable. (Peto et al., 1995, p. 35) There are two main remedies for this unavoidable conflict between the reliable subgroup-specific conclusions that doctors want and the unreliable findings that direct subgroup analyses can usually offer. But, the extent to which these remedies are helpful in particular instances is one on which informed judgements differ. The first is to emphasise chiefly the overall results for particular outcomes as a guide (or at least a context for speculation) as to the qualitative results in various specific subgroups of patients, and to give proportionally less weight to the actual results in that subgroup than to extrapolation of the overall results. The second is to be influenced, in discussing the likely effects on mortality in specific subgroups, not only on the mortality in these subgroups, but also by the analyses of recurrence-free survival or some other surrogate outcome. (Peto et al., 1995, p. 35) 2.2 Problems with the argument for clinical relevance Clinically important differences in response are the norm Rothwell (2007c) provides numerous examples where clinically important differences in treatment effect arise Heterogeneity related to risk (risk of treatment and risk without treatment) Heterogeneity related to pathophysiology Heterogeneity related to stage of disease and timing of intervention Heterogeneity related to comorbidity Not all of these sources or heterogeneity are known to occur in specific cases and so can not be anticipated. And even when a difference in treatment effect can be anticipated, it can t always be incorporated when specifying the trial. Examples: Risk: difference in absolute risk without treatment (hypertension and stroke) Pathophysiology: genetic variation (response to treatment); aspirin in cardiovascular disease (CRP) 7
8 Timing: thrombolytics; lipid agents with differing LDL level Comorbidity: thiazides and betablockers in hypertensive patients with diabetes Type S errors are to be expected Progress in clinical science continuously identifies groups of patients who are particularly benefited or harmed by a therapy Example 4 (ISIS-2). Since ISIS-2 much of the progress in the use of thrombolytic therapy is in being able to identify groups of patients who respond differently based on their ECG (e.g ST interval depression) and area of infarct. Therapeutic decisions depend on effect sizes Therapeutic decisions in individuals requires weighing likely benefits with potential risks it is not just the overall direction of the effect, the estimating the magnitude is critical for decisions Effect sizes vary in different patient subgroups, hence the risk of Type M errors is high Trial RR 95% CI ARR 95% CI MRC STOP Heterogen. p=0.90 Heterogen. p=0.009 Example 5 (Antihypertensives). Table 1: Rothwell (2007c, 141) Table 1 compares two antihypertensive trials (MRC and STOP). MRC was conducted on relatively young (otherwise healthy) patients. STOP was conducted in elderly patients with multiple comorbidities. Despite providing effects in the same direction Estimates of effect size separate two treatments that provide benefits overall. And estimates are critical when weighing up the risks and benefits. Yusuf et al. agree that quantitative interactions in subgroups are common (i.e. the possibility of Type M errors), but don t seem to recognise the importance of this point for therapeutic decision makers. The importance of accurately estimating treatment effects undermines the clinical relevance of large simple trials. 8
9 Errors based on subgroup interactions are to be expected Errors are particularly difficult to identify when: The intervention is new Trials recruit heterogenous patient populations (i.e. large simple trials) The endpoint has multiple causes, e.g. death a variation on effect sizes on nonfatal MI or bleeding rates may create Type S errors on mortality. Weaker Yusuf et al Conduct large simple trials because frequentist statistical approaches require them for identifying small to modest effect sizes 2. Individual therapeutic decisions can be based on the overall trial results when the following assumptions hold: (a) An unanticipated Type S error is considered unlikely (b) All anticipated Type S errors are avoided in trial design (c) Type M errors of a clinically important magnitude are considered unlikely 3 Alternative approaches 3.1 Rothwell s rules Rothwell s rules (2007a) Trial design Subgroups analyses should be defined a priori and limited to a small number focussing on the primary endpoint. Direction and magnitude should be predicted (and reported). Obtain expert clinical input in design Test with formal subgroup interaction test Analysis and reporting Adjust for multiple subgroup analyses Report as absolute and relative risks 9
10 Check for comparability of prognostic factors in subgroups Interpretation Ignore statistical significance of effect of treatment in individual subgroups Reproducibility is the best test for subgroup-treatment effects The false-negative rate for formal subgroup interaction tests is high (due to lack of power) Rules for subgroup analysis (Rothwell, 2007a, Panel 11.2) Rothwell provides rules for approaching subgroup analyses for trial design, analysis and reporting and interpretation. Essentially, the rules provide best practice given the subgroup problem and the use of Neyman-Pearson hypothesis testing Focusses solely on anticipated subgroup interactions Provides advice for setting up trials to better identify subgroups that respond differently 3.2 Model-based approaches Model-based drug development Model-based drug development Key criticisms of traditional drug development approaches (i.e. hypothesis testing in early drug development): 1. Inefficient use of information (both prior information and data collected during early studies) 2. provides a dichotomous answer when what is needed is an understanding of the relationship between dose and exposure (pharmacokinetic models) and exposure and response Model-based drug development incorporates a range of approaches, including: modelling, simulation, and adaptive designs 10
11 Figure 1: Sheiner (1997, 276) Model-based drug development 1. Build model: based on understanding of the target phenomena and available data A range of different models are used. May be placed in a hierarchy and make predictions about populations, groups, individual or observations. Include population parameters (clearance, volume of distribution), experimentally controllable variables (dose), and independent variables (time). Often incorporate stochastic variability (within-subject variability, measurement error) 2. Model criticism using data collected Test assumptions; select from a family of models 3. Conduct analyses Extending model-based approaches Large-scale simple (confirmatory) trials are open the same criticisms made of traditional early-stage drug trials: inefficient use of information, dichotomised results c.f. understanding variation Model-based approaches can make some therapeutic decisions tractable: what key prognostic factors influence outcomes? and, by how much? 11
12 Example 6 (Holford and Nutt (2011)). Standard descriptive analyses are unable to identify disease-modifying effects of treatments of Parkinson s disease it is difficult to separate disease progression, symptomatic effects and disease modifying effects Holford and Nutt (2011) use a modelling approach to better assess diseasemodifying effects from three large Parkinson s disease trials S(t) = S(0) + (α + β C e (t)) t + E max C e (t) EC 50 + C e (t) Where: S(t) is disease state at time = t; S(0) is the disease state at time = 0 (without treatment); α is disease progression; β represents disease-modifying effects; C e (t) plasma concentration of drug at time = t; E max is the maximum pharmacological effect, and EC 50 is the plasma concentration of the drug producing half the maximum drug effect. Figure 2: Holford and Nutt (2011) Concluding remarks 12
13 Questions/criticisms for the model-based approach What is the respective role of theory and data in specifying and evaluating the model? What role (if any) can model-based approaches play in confirming efficacy/effectiveness? Large simple randomized trials versus large randomized trials References Brookes, S., Whitely, E., Peters, T., Mulheran, P. A., Egger, M., and Davey Smith, G. (2001). Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives. Health Technology Assessment, 5(33): Feinstein, A. R. (1984). Why do we need some large, simple randomized trials? Discussion. In Yusuf et al. (1984), pages Gelman, A. and Tuerlinckx, F. (2000). Type s error rates for classical and bayesian single and multiple comparison procedures. Computational Statistics, 15(3): Group, I.-. C. (1988). Randomised trial of intravenous streptokinase, oral aspirin, both, or neither among cases of suspected acute myocardial infarction: Isis-2. The Lancet, 332(8607): Holford, N. H. G. and Nutt, J. G. (2011). Interpreting the results of Parkinson s disease clinical trials: Time for a change. Movement disorders : official journal of the Movement Disorder Society, 26(4): Peto, R., Collins, R., and Gray, R. (1995). Large-scale randomized evidence: Large, simple trials and overviews of trials. Journal of Clinical Epidemiology, 48(1): , 6 POISE Study Group (2008). Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial. The Lancet, 371(9627): Rothwell, P. M. (2007a). Reliable estimation and interpretation of the effects of treatment in subgroups. In Rothwell (2007b). 8, 9 Rothwell, P. M., editor (2007b). Treating Individuals: From randomised trials to personalised medicine. Elsevier, Philadelphia. 13 Rothwell, P. M. (2007c). When should we expect clinically important differences in response to treatment? In Rothwell (2007b). 4, 7, 8 Sheiner, L. B. (1997). Learning versus confirming in clinical drug development. Clin Pharmacol Ther, 61(3): , 10 13
14 Smith, G. D. and Egger, M. (1998). Incommunicable knowledge? Interpreting and applying the results of clinical trials and meta-analyses. Journal of Clinical Epidemiology, 51(4): Yusuf, S., Collins, R., and Peto, R. (1984). Why do we need some large, simple randomized trials? Statistics in Medicine, 3: , 3, 4, 5, 6, 12 4 Additional examples of large simple trials Examples Example 7 (POISE). POISE (2008) randomized 8351 patients undergoing non-cardiac surgery to peri-operative metoprolol Perioperative metoprolol reduced the primary endpiont (cardiovascular death, non-fatal myocardial infarction, non-fatal cardiac arrest): 5.8% c.f. 6.9%, p= But, increased total mortality: 3.1% c.f. 2.3%, p=0.0317; and stroke 1.0% c.f. 0.5%, p= Example 8 (POISE-2). POISE-2 is currently enrolling patients undergoing non-cardiac surgery to test the effects of aspirin (or placebo) and clonidine (or placebo) on mortality and non-fatal myocardial infarction 5 Quotes regarding the subgroup problem Alvan Feinstein (1984, p. 421) made the following comment in discussion of (Yusuf et al., 1984) The main problem, it seems to me, is again the question of whether we are evaluating two treatments or are we evaluating treatments for the care of patients? The different kinds of patient that are being lumped together into these heterogenous pastiches under the name of the same disease or under the name of the same therapeutic agents may produce results with excellent statistical ability to compare two treatments, but will be relatively worthless when people try to use the consequences in practice. What is required in a degree of humility in the face of an issue for which there is no statistical or clinical solution. [... ] The development of randomised clinical trials since Mackenzie s time has provided a much sounder basis for making decisions about abstract patients and if representative 14
15 samples of patients are included in the trials for deciding if the overall effect on population health of a treatment is beneficial or harmful. Randomised trials have not, however, answered the question of which individuals actually benefit from medical interventions. This, surely, is the key issue in clinical research in for the next millennium. (Smith and Egger, 1998) Rothwell (2007c, 142) comments on the logic of the argument that what matters is overall benefits and harms: The need for reliable data on risks and benefits in subgroups and individuals is greatest for potentially harmful interventions, such as warfarin or carotid endarterectomy, which are of overall benefit but which kill or disable a significant proportion of patients. Yet, evidence-based guidelines usually recommend these treatments in all cases similar to those in the relevant RCTs. In considering this approach, it is useful to draw an analogy with the criminal justice system.... Suppose that research showed that individuals charged by the police with certain crimes were usually guilty. Few would argue that they should therefore be sentenced without trial. Automatic sentencing would, on average, do more good than harm, with most criminals correctly convicted, but any avoidable miscarriages of justice are widely regarded as unacceptable. In contrast, relatively high rates of treatment-related death or disability ( miscarriages of treatment ) are tolerated by the medical scientific community precisely on the basis that, on average, treatment will do more good than harm. Rothwell (2007c, 142) 15
Regulatory Hurdles for Drug Approvals
Regulatory Hurdles for Drug Approvals William R. Hiatt, MD Professor of Medicine/Cardiology University of Colorado School of Medicine President, CPC Clinical Research 25 min Conflicts CPC Clinical Research
More informationReflection paper on assessment of cardiovascular safety profile of medicinal products
25 February 2016 EMA/CHMP/50549/2015 Committee for Medicinal Products for Human Use (CHMP) Reflection paper on assessment of cardiovascular safety profile of medicinal products Draft agreed by Cardiovascular
More informationReflection paper on assessment of cardiovascular risk of medicinal products for the treatment of cardiovascular and metabolic diseases Draft
1 2 3 21 May 2015 EMA/CHMP/50549/2015 Committee for Medicinal Products for Human Use (CHMP) 4 5 6 7 Reflection paper on assessment of cardiovascular risk of medicinal products for the treatment of cardiovascular
More informationNATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE
NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE QUALITY AND OUTCOMES FRAMEWORK (QOF) INDICATOR DEVELOPMENT PROGRAMME Briefing paper QOF indicator area: Peripheral arterial disease Potential output:
More informationImproving Medical Statistics and Interpretation of Clinical Trials
Improving Medical Statistics and Interpretation of Clinical Trials 1 ALLHAT Trial & ALLHAT Meta-Analysis Critique Table of Contents ALLHAT Trial Critique- Overview p 2-4 Critique Of The Flawed Meta-Analysis
More informationSafeguarding public health Subgroup Analyses: Important, Infuriating and Intractable
Safeguarding public health Subgroup Analyses: Important, Infuriating and Intractable The views expressed herein are not necessarily those of MHRA, EMA, EMA committees or their working parties. Rob Hemmings
More informationCritical Review Form Therapy Objectives: Methods:
Critical Review Form Therapy Clinical Trial Comparing Primary Coronary Angioplasty with Tissue-Plasminogen Activator for Acute Myocardial Infarction (GUSTO-IIb), NEJM 1997; 336: 1621-1628 Objectives: To
More informationSafeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines
Safeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines Rob Hemmings Statistics Unit Manager, MHRA CHMP member Chair, CHMP Scientific Advice Working Party Biostatistics
More informationIntroduzione al metodo GRADE
Introduzione al metodo GRADE Atto Billio MD, MSc EBHC Ematologia e TMO-Bolzano Gruppo linee guida SIE Critique of EBM De-emphasizes patient values Doesn t account for individual variation Devalues clinical
More informationAn introduction to Quality by Design. Dr Martin Landray University of Oxford
An introduction to Quality by Design Dr Martin Landray University of Oxford Criteria for a good trial Ask an IMPORTANT question Answer it RELIABLY Quality Quality is the absence of errors that matter to
More informationDRAFT (Final) Concept Paper On choosing appropriate estimands and defining sensitivity analyses in confirmatory clinical trials
DRAFT (Final) Concept Paper On choosing appropriate estimands and defining sensitivity analyses in confirmatory clinical trials EFSPI Comments Page General Priority (H/M/L) Comment The concept to develop
More informationJournal Club Critical Appraisal Worksheets. Dr David Walbridge
Journal Club Critical Appraisal Worksheets Dr David Walbridge The Four Part Question The purpose of a structured EBM question is: To be directly relevant to the clinical situation or problem To express
More informationThe problem of uncontrolled hypertension
(2002) 16, S3 S8 2002 Nature Publishing Group All rights reserved 0950-9240/02 $25.00 www.nature.com/jhh The problem of uncontrolled hypertension Department of Public Health and Clinical Medicine, Norrlands
More informationSafeguarding public health Subgroup analyses scene setting from the EU regulators perspective
Safeguarding public health Subgroup analyses scene setting from the EU regulators perspective The views expressed herein are not necessarily those of MHRA, EMA, EMA committees or their working parties.
More informationBeta-blockers: Now what? Annemarie Thompson, MD Assistant Professor of Anesthesia and Medicine Vanderbilt University Medical Center
Beta-blockers: Now what? Annemarie Thompson, MD Assistant Professor of Anesthesia and Medicine Vanderbilt University Medical Center Beta-blockers: What s known 30 Years 30 Careers Physician clarity regarding
More informationRobert Temple, MD Deputy Center Director for Clinical Science Center for Drug Evaluation and Research Food and Drug Administration
Robert Temple, MD Deputy Center Director for Clinical Science Center for Drug Evaluation and Research Food and Drug Administration USE OF REAL WORLD DATA ( BIG DATA ) FOR REGULATORY PURPOSES ISCTM Meeting
More informationEvidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co.
Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co. Meta-Analysis Defined A meta-analysis is: the statistical combination of two or more separate studies In other words: overview,
More informationDesign and analysis of clinical trials
Design and analysis of clinical trials Lecture 3 1.Basic Design Considerations 2.Sample Size determinationa 3.Randomization 2018-01-31 Previous Lectures Definition of a clinical trial The drug development
More informationRole of evidence from observational studies in the process of health care decision making
Role of evidence from observational studies in the process of health care decision making Jan van der Meulen Health Services Research Unit London School of Hygiene and Tropical Medicine Clinical Effectiveness
More informationIs a Mediterranean diet best for preventing heart disease?
Is a Mediterranean diet best for preventing heart disease? By Peter Attia, M.D. This week an article titled Primary Prevention of Cardiovascular Disease with a Mediterranean Diet was featured in the New
More informationClinical Trials and Clinical Practice: Surrogates at the Clinician/Patient Interface
Clinical Trials and Clinical Practice: Surrogates at the Clinician/Patient Interface Linda Lévesque, BScPhm, MSc, PhD Associate Professor, Department of Community Health and Epidemiology Queen s University
More informationDavid M Kent, MD, MS
David M Kent, MD, MS 2 While RCTs can determine the better treatment on average, they do not answer the practicing doctor's question: what is the most likely outcome when this particular drug is given
More informationRegulatory Experience in Reviewing CV Safety for Diabetes
Regulatory Experience in Reviewing CV Safety for Diabetes Drugs Kristina Dunder MD, PhD, Alternate CHMP member MPA, Sweden Disclaimer The views and opinions expressed in the following PowerPoint slides
More informationShould beta blockers remain first-line drugs for hypertension?
1 de 6 03/11/2008 13:23 Should beta blockers remain first-line drugs for hypertension? Maros Elsik, Cardiologist, Department of Epidemiology and Preventive Medicine, Monash University and The Alfred Hospital,
More informationCLINICAL DECISION USING AN ARTICLE ABOUT TREATMENT JOSEFINA S. ISIDRO LAPENA MD, MFM, FPAFP PROFESSOR, UPCM
CLINICAL DECISION USING AN ARTICLE ABOUT TREATMENT JOSEFINA S. ISIDRO LAPENA MD, MFM, FPAFP PROFESSOR, UPCM Principles of Decision Making Knowing the patient s true state is often unnecessary Does my patient
More informationE11(R1) Addendum to E11: Clinical Investigation of Medicinal Products in the Pediatric Population Step4
E11(R1) Addendum to E11: Clinical Investigation of Medicinal Products in the Step4 October 2017 International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use 1 Legal
More informationHypertension Update Clinical Controversies Regarding Age and Race
Hypertension Update Clinical Controversies Regarding Age and Race Allison Helmer, PharmD, BCACP Assistant Clinical Professor Auburn University Harrison School of Pharmacy July 22, 2017 DISCLOSURE/CONFLICT
More informationEstimating risk from underpowered, but statistically significant, studies: Was
Title: Estimating risk from underpowered, but statistically significant, studies: Was APPROVe on TARGET? Short Title: Estimating risk in underpowered studies Authors: Adam La Caze BPharm, BA(Hons), PhD.
More informationUpdates in Therapeutics 2015: The Pharmacotherapy Preparatory Review & Recertification Course
Updates in Therapeutics 2015: The Pharmacotherapy Preparatory Review & Recertification Course Study Designs: Fundamentals and Interpretation Kevin M. Sowinski, Pharm.D., FCCP Purdue University, College
More informationFundamental Clinical Trial Design
Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003
More informationACR OA Guideline Development Process Knee and Hip
ACR OA Guideline Development Process Knee and Hip 1. Literature searching frame work Literature searches were developed based on the scenarios. A comprehensive search strategy was used to guide the process
More informationAcute myocardial infarction. Cardiovascular disorders. main/0202_new 02/03/06. Search date August 2004 Nicholas Danchin and Eric Durand
main/0202_new 02/03/06 Acute myocardial infarction Search date August 2004 Nicholas Danchin and Eric Durand QUESTIONS Which treatments improve outcomes in acute myocardial infarction?...4 Which treatments
More informationDrug Class Review Newer Oral Anticoagulant Drugs
Drug Class Review Newer Oral Anticoagulant Drugs Final Original Report May 2016 The purpose of reports is to make available information regarding the comparative clinical effectiveness and harms of different
More informationAntiplatelet Therapy in Primary CVD Prevention and Stable Coronary Artery Disease. Καρακώστας Γεώργιος Διευθυντής Καρδιολογικής Κλινικής, Γ.Ν.
Antiplatelet Therapy in Primary CVD Prevention and Stable Coronary Artery Disease Καρακώστας Γεώργιος Διευθυντής Καρδιολογικής Κλινικής, Γ.Ν.Κιλκίς Primary CVD Prevention A co-ordinated set of actions,
More information03/30/2016 DISCLOSURES TO OPERATE OR NOT THAT IS THE QUESTION CAROTID INTERVENTION IS INDICATED FOR ASYMPTOMATIC CAROTID OCCLUSIVE DISEASE
CAROTID INTERVENTION IS INDICATED FOR ASYMPTOMATIC CAROTID OCCLUSIVE DISEASE Elizabeth L. Detschelt, M.D. Allegheny Health Network Vascular and Endovascular Symposium April 2, 2016 DISCLOSURES I have no
More informationJNC 8 -Controversies. Sagren Naidoo Nephrologist CMJAH
JNC 8 -Controversies Sagren Naidoo Nephrologist CMJAH Joint National Committee (JNC) Panel appointed by the National Heart, Lung, and Blood Institute (NHLBI) First guidelines (JNC-1) published in 1977
More informationAn introduction to power and sample size estimation
453 STATISTICS An introduction to power and sample size estimation S R Jones, S Carley, M Harrison... Emerg Med J 2003;20:453 458 The importance of power and sample size estimation for study design and
More informationDual Antiplatelet duration in ACS: too long or too short?
Dual Antiplatelet duration in ACS: too long or too short? Leonardo Bolognese, MD, FESC, FACC Cardiovascular Department, Arezzo, Italy Paradigm Shift the ideal duration of DAPT: a moving target Early (stent-related)
More informationGuidance Document for Claims Based on Non-Inferiority Trials
Guidance Document for Claims Based on Non-Inferiority Trials February 2013 1 Non-Inferiority Trials Checklist Item No Checklist Item (clients can use this tool to help make decisions regarding use of non-inferiority
More informationPeer Review Report #2. Novel oral anticoagulants. (1) Does the application adequately address the issue of the public health need for the medicine?
20 th Expert Committee on Selection and Use of Essential Medicines Peer Review Report #2 vel oral anticoagulants (1) Does the application adequately address the issue of the public health need for the
More informationReflection paper on the use of extrapolation in the development of medicines for paediatrics
7 October 2018 EMA/189724/2018 Reflection paper on the use of extrapolation in the development of medicines for paediatrics Final Draft agreed by Biostatistics Working Party, Modelling and Simulation September
More informationNATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE
NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE QUALITY AND OUTCOMES FRAMEWORK (QOF) INDICATOR DEVELOPMENT PROGRAMME Briefing paper QOF indicator area: Primary prevention of CVD Potential output:
More information2013 Cholesterol Guidelines. Anna Broz MSN, RN, CNP, AACC Adult Certified Nurse Practitioner North Ohio Heart, Inc.
2013 Cholesterol Guidelines Anna Broz MSN, RN, CNP, AACC Adult Certified Nurse Practitioner North Ohio Heart, Inc. Disclosures Speaker Gilead Sciences NHLBI Charge to the Expert Panel Evaluate higher quality
More informationLearning Objectives 9/9/2013. Hypothesis Testing. Conflicts of Interest. Descriptive statistics: Numerical methods Measures of Central Tendency
Conflicts of Interest I have no conflict of interest to disclose Biostatistics Kevin M. Sowinski, Pharm.D., FCCP Last-Chance Ambulatory Care Webinar Thursday, September 5, 2013 Learning Objectives For
More informationFurther data analysis topics
Further data analysis topics Jonathan Cook Centre for Statistics in Medicine, NDORMS, University of Oxford EQUATOR OUCAGS training course 24th October 2015 Outline Ideal study Further topics Multiplicity
More informationHow to weigh the strength of prior information and clarify the expected level of evidence?
How to weigh the strength of prior information and clarify the expected level of evidence? Martin Posch martin.posch@meduniwien.ac.at joint work with Gerald Hlavin Franz König Christoph Male Peter Bauer
More informationValue of troponin measurements in carotid artery revascularization
Value of troponin measurements in carotid artery revascularization Gert J de Borst Department of Vascular Surgery Postoperative myocardial infarction after NCS: Magnitude of the problem POISE-1: 367 /8,351=
More informationIntroduction to Clinical Trials - Day 1 Session 2 - Screening Studies
Introduction to Clinical Trials - Day 1 Session 2 - Screening Studies Presented July 23, 2018 Susanne J. May Department of Biostatistics University of Washington Daniel L. Gillen Department of Statistics
More informationAspirin to Prevent Heart Attack and Stroke: What s the Right Dose?
The American Journal of Medicine (2006) 119, 198-202 REVIEW Aspirin to Prevent Heart Attack and Stroke: What s the Right Dose? James E. Dalen, MD, MPH Professor Emeritus, University of Arizona, Tucson
More informationDavid M. Kent, MD, MSc Professor of Medicine, Neurology, Clinical and Translational Science, Director, Predictive Analytics and Comparative
David M. Kent, MD, MSc Professor of Medicine, Neurology, Clinical and Translational Science, Director, Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research
More informationCritical Appraisal. Dave Abbott Senior Medicines Information Pharmacist
Critical Appraisal Dave Abbott Senior Medicines Information Pharmacist Aims Identify key components of clinical trial design and apply these to a critical appraisal of the literature Be able to work out
More information95% 2.5% 2.5% +2SD 95% of data will 95% be within of data will 1.96 be within standard deviations 1.96 of sample mean
Efficient Clinical Trials John H. Powers, MD Senior Medical Scientist SAIC in support of Clinical Collaborative Research Branch NIAID/NIH Introduction Definitions what is a small clinical trial? Review
More informationBayesian and Frequentist Approaches
Bayesian and Frequentist Approaches G. Jogesh Babu Penn State University http://sites.stat.psu.edu/ babu http://astrostatistics.psu.edu All models are wrong But some are useful George E. P. Box (son-in-law
More informationNew Hypertension Guidelines: Why the change? Neil Brummond, M.D. Avera Medical Group Internal Medicine Sioux Falls, SD
New Hypertension Guidelines: Why the change? Neil Brummond, M.D. Avera Medical Group Internal Medicine Sioux Falls, SD None Disclosures Objectives Understand trend in blood pressure clinical practice guidelines
More informationDr Julia Hopyan Stroke Neurologist Sunnybrook Health Sciences Centre
Dr Julia Hopyan Stroke Neurologist Sunnybrook Health Sciences Centre Objectives To learn what s new in stroke care 2010-11 1) Acute stroke management Carotid artery stenting versus surgery for symptomatic
More information9/4/2013. Decision Errors. Hypothesis Testing. Conflicts of Interest. Descriptive statistics: Numerical methods Measures of Central Tendency
Conflicts of Interest I have no conflict of interest to disclose Biostatistics Kevin M. Sowinski, Pharm.D., FCCP Pharmacotherapy Webinar Review Course Tuesday, September 3, 2013 Descriptive statistics:
More informationCholesterol lowering intervention for cardiovascular prevention in high risk patients with or without LDL cholesterol elevation
TrialResults-center.org www.trialresultscenter.org Cholesterol lowering intervention for cardiovascular prevention in high risk patients with or without LDL cholesterol elevation A systematic review and
More informationAntihypertensive Trial Design ALLHAT
1 U.S. Department of Health and Human Services Major Outcomes in High Risk Hypertensive Patients Randomized to Angiotensin-Converting Enzyme Inhibitor or Calcium Channel Blocker vs Diuretic National Institutes
More informationClinical Controversies in Perioperative Medicine
Clinical Controversies in Perioperative Medicine Hugo Quinny Cheng, MD Division of Hospital Medicine University of California, San Francisco Cardiac Evaluation: New Guidelines A 70-y.o. man with progressive
More informationMyocardial Infarction In Dr.Yahya Kiwan
Myocardial Infarction In 2007 Dr.Yahya Kiwan New Definition Of Acute Myocardial Infarction The term of myocardial infarction should be used when there is evidence of myocardial necrosis in a clinical setting
More informationAndrew Cohen, MD and Neil S. Skolnik, MD INTRODUCTION
2 Hyperlipidemia Andrew Cohen, MD and Neil S. Skolnik, MD CONTENTS INTRODUCTION RISK CATEGORIES AND TARGET LDL-CHOLESTEROL TREATMENT OF LDL-CHOLESTEROL SPECIAL CONSIDERATIONS OLDER AND YOUNGER ADULTS ADDITIONAL
More informationCardiovascular Disease and Commercial Motor Vehicle Driver Safety. Physical Qualifications Division April 10, 2007
Federal Motor Carrier Safety Administration Executive Summary Cardiovascular Disease and Commercial Motor Vehicle Driver Safety Presented to Physical Qualifications Division April 10, 2007 Prepared by:
More informationEvidence Supporting Post-MI Use of
Addressing the Gap in the Management of Patients After Acute Myocardial Infarction: How Good Is the Evidence Supporting Current Treatment Guidelines? Michael B. Fowler, MB, FRCP Beta-adrenergic blocking
More information4/7/ The stats on heart disease. + Deaths & Age-Adjusted Death Rates for
+ Update on Lipid Management Stacey Gardiner, MD Assistant Professor Division of Cardiovascular Medicine Medical College of Wisconsin + The stats on heart disease Over the past 10 years for which statistics
More informationCarotid Artery Stenosis
Evidence-Based Approach to Carotid Artery Stenosis Seong-Wook Park, MD Division of Cardiology, Asan Medical Center University of Ulsan College of Medicine, Seoul, Korea Carotid Artery Stenosis Carotid
More informationHow to use research to lead your clinical decision
] 6 How to use research to lead your clinical decision ASK ACQUIRE ANALYZE ANSWER APPLY ASSESS making.] Phil Page PhD, PT, ATC, CSCS, FACSM 1) ASK What is your question? Be very specific in what you want
More information! Parallels with clinical studies.! Two (of a number of) concerns about data from trials.! Concluding comments
TRIAL-BASED ECONOMIC EVALUATIONS: CAN THEY STAND ALONE? Henry Glick Division of General Internal Medicine University of Pennsylvania www.uphs.upenn.edu/dgimhsr International Health Economics Association
More informationThe CARI Guidelines Caring for Australians with Renal Impairment. Cardiovascular Risk Factors
Cardiovascular Risk Factors ROB WALKER (Dunedin, New Zealand) Lipid-lowering therapy in patients with chronic kidney disease Date written: January 2005 Final submission: August 2005 Author: Rob Walker
More informationThe Latest Generation of Clinical
The Latest Generation of Clinical Guidelines: HTN and HLD Dave Brackett Clinical Guideline Purpose Uniform approach Awareness of key details Diagnosis Treatment Monitoring Evidence based approach Inform
More informationJAMA. 2011;305(24): Nora A. Kalagi, MSc
JAMA. 2011;305(24):2556-2564 By Nora A. Kalagi, MSc Cardiovascular disease (CVD) is the number one cause of mortality and morbidity world wide Reducing high blood cholesterol which is a risk factor for
More informationDyslipidemia in women: Who should be treated and how?
Dyslipidemia in women: Who should be treated and how? Lale Tokgozoglu, MD, FACC, FESC Professor of Cardiology Hacettepe University Faculty of Medicine Ankara, Turkey. Cause of Death in Women: European
More informationCADTH Therapeutic Review
Canadian Agency for Drugs and Technologies in Health Agence canadienne des médicaments et des technologies de la santé CADTH Therapeutic Review August 2012 Volume 1, Issue 1A Antithrombotic Therapy for
More informationISPOR Task Force Report: ITC & NMA Study Questionnaire
INDIRECT TREATMENT COMPARISON / NETWORK META-ANALYSIS STUDY QUESTIONNAIRE TO ASSESS RELEVANCE AND CREDIBILITY TO INFORM HEALTHCARE DECISION-MAKING: AN ISPOR-AMCP-NPC GOOD PRACTICE TASK FORCE REPORT DRAFT
More information5/2/2016. Outpatient Stroke Management Sheila Smith MD May 5, 2016
Outpatient Stroke Management Sheila Smith MD May 5, 2016 1 Management of Outpatient Stroke Objectives Review blood pressure management post stroke Review antithrombotic therapy Review statin therapy Discuss
More informationInterested parties (organisations or individuals) that commented on the draft document as released for consultation.
23 June 2016 EMA/CHMP/345847/2015 Committee for Medicinal products for Human Use Overview of comments received on ''Guideline on clinical investigation of medicinal products in the treatment of hypertension'
More informationTrial designs fully integrating biomarker information for the evaluation of treatment-effect mechanisms in stratified medicine
Trial designs fully integrating biomarker information for the evaluation of treatment-effect mechanisms in stratified medicine Dr Richard Emsley Centre for Biostatistics, Institute of Population Health,
More informationSystematic Reviews and Meta- Analysis in Kidney Transplantation
Systematic Reviews and Meta- Analysis in Kidney Transplantation Greg Knoll MD MSc Associate Professor of Medicine Medical Director, Kidney Transplantation University of Ottawa and The Ottawa Hospital KRESCENT
More informationEuropean Federation of Statisticians in the Pharmaceutical Industry (EFSPI)
Page 1 of 14 European Federation of Statisticians in the Pharmaceutical Industry (EFSPI) COMMENTS ON DRAFT FDA Guidance for Industry - Non-Inferiority Clinical Trials Rapporteur: Bernhard Huitfeldt (bernhard.huitfeldt@astrazeneca.com)
More informationVarenicline and cardiovascular and neuropsychiatric events: Do Benefits outweigh risks?
Varenicline and cardiovascular and neuropsychiatric events: Do Benefits outweigh risks? Sonal Singh M.D., M.P.H, Johns Hopkins University Presented by: Sonal Singh, MD MPH September 19, 2012 1 CONFLICTS
More informationPost Operative Troponin Leak: David Smyth Christchurch New Zealand
Post Operative Troponin Leak: Does It Really Matter? David Smyth Christchurch New Zealand Life Was Simple Once Transmural Infarction Subendocardial Infarction But the Blood Tests Were n t Perfect Creatine
More informationAspirin for cardiovascular disease prevention
POSITION STATEMENT Aspirin for cardiovascular disease prevention Joseph Hung, for the Medical Issues Committee of the National Heart Foundation of Australia RANDOMISED CONTROLLED TRIALS have proven that
More informationPerioperative Infarcts: Epidemiology, predictors and post-op monitoring
Friday Nov 3rd, 2017 1pm Perioperative Infarcts: Epidemiology, predictors and post-op monitoring Dr Carol Chong Geriatrician Northern Health, Epping, Victoria, Australia How I became interested in this
More informationDiscussion Meeting for MCP-Mod Qualification Opinion Request. Novartis 10 July 2013 EMA, London, UK
Discussion Meeting for MCP-Mod Qualification Opinion Request Novartis 10 July 2013 EMA, London, UK Attendees Face to face: Dr. Frank Bretz Global Statistical Methodology Head, Novartis Dr. Björn Bornkamp
More informationCARDIOVASCULAR RISK and NSAIDs
CARDIOVASCULAR RISK and NSAIDs Dr. Syed Ghulam Mogni Mowla Assistant Professor of Medicine Shaheed Suhrawardy Medical College, Dhaka INTRODUCTION NSAIDs are most commonly prescribed drugs Recent evidence
More informationA Case Study: Two-sample categorical data
A Case Study: Two-sample categorical data Patrick Breheny January 31 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/43 Introduction Model specification Continuous vs. mixture priors Choice
More informationSubgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives
Health Technology Assessment 2001; Vol. 5: No. 33 Methodology Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives ST Brookes E Whitley TJ Peters
More informationStatistical reports Regression, 2010
Statistical reports Regression, 2010 Niels Richard Hansen June 10, 2010 This document gives some guidelines on how to write a report on a statistical analysis. The document is organized into sections that
More informationThe Effect of Statin Therapy on Risk of Intracranial Hemorrhage
The Effect of Statin Therapy on Risk of Intracranial Hemorrhage JENNIFER HANIFY, PHARM.D. PGY2 CRITICAL CARE RESIDENT UF HEALTH JACKSONVILLE JANUARY 23 RD 2016 Objectives Review benefits of statin therapy
More informationHow to Interpret a Clinical Trial Result
How to Interpret a Clinical Trial Result Edward V. Loftus, Jr., M.D. Professor of Medicine Division of Gastroenterology and Hepatology Mayo Clinic College of Medicine Rochester MN CP123456-1 Are results
More informationQuantitative benefit-risk assessment: An analytical framework for a shared understanding of the effects of medicines. Patrick Ryan 21 April 2010
Quantitative benefit-risk assessment: An analytical framework for a shared understanding of the effects of medicines Patrick Ryan 21 April 2010 Challenges in understanding the effects of medicines Benefit
More informationEuropean Statistical Meeting on Non-Inferiority. Non-inferiority trials are unethical
European Statistical Meeting on Non-Inferiority Non-inferiority trials are unethical Methodological requirements for clinical trials Ask important questions answer them reliably The objective is the patient,
More informationPROCORALAN MAKING A STRONG ENTRY TO THE NEW ESC GUIDELINES FOR THE MANAGEMENT OF HEART FAILURE
Press Release Issued on behalf of Servier Date: June 6, 2012 PROCORALAN MAKING A STRONG ENTRY TO THE NEW ESC GUIDELINES FOR THE MANAGEMENT OF HEART FAILURE The new ESC guidelines for the diagnosis and
More informationThe Role of Basic Science in Evidence-Based Medicine
The Role of Basic Science in Evidence-Based Medicine Adam La Caze The University of Queensland a.lacaze@uq.edu.au Abstract Proponents of Evidence-based medicine (EBM) do not provide a clear role for basic
More informationModeling & Simulation to support evaluation of Safety and Efficacy of Drugs in Older Patients
Modeling & Simulation to support evaluation of Safety and Efficacy of Drugs in Older Patients Eva Bredberg, Director Global Clinical Pharmacology, AstraZeneca On behalf of EFPIA EMA Geriatrics Workshop
More informationSecretary-General of the European Commission, signed by Mr Jordi AYET PUIGARNAU, Director
COUNCIL OF THE EUROPEAN UNION Brussels, 13 February 2014 (OR. en) 6438/14 COVER NOTE From: date of receipt: 3 February 2014 To: No. Cion doc.: PHARM 14 SAN 72 MI 161 COMPET 107 DELACT 29 Secretary-General
More informationESC Geoffrey Rose Lecture on Population Sciences Cholesterol and risk: past, present and future
ESC Geoffrey Rose Lecture on Population Sciences Cholesterol and risk: past, present and future Rory Collins BHF Professor of Medicine & Epidemiology Clinical Trial Service Unit & Epidemiological Studies
More informationHistory of FDA Encouragement to Consider Subgroup Variability. Robert Temple, MD JHU-CERSI Symposium Heterogeneity
History of FDA Encouragement to Consider Subgroup Variability Robert Temple, MD JHU-CERSI Symposium Heterogeneity 1 History A Little There is long-standing recognition that responses to treatment (both
More informationALLHAT Role of Diuretics in the Prevention of Heart Failure - The Antihypertensive and Lipid- Lowering Treatment to Prevent Heart Attack Trial
1 ALLHAT Role of Diuretics in the Prevention of Heart Failure - The Antihypertensive and Lipid- Lowering Treatment to Prevent Heart Attack Trial Davis BR, Piller LB, Cutler JA, et al. Circulation 2006.113:2201-2210.
More informationMeasurement and meaningfulness in Decision Modeling
Measurement and meaningfulness in Decision Modeling Brice Mayag University Paris Dauphine LAMSADE FRANCE Chapter 2 Brice Mayag (LAMSADE) Measurement theory and meaningfulness Chapter 2 1 / 47 Outline 1
More informationRetrospective power analysis using external information 1. Andrew Gelman and John Carlin May 2011
Retrospective power analysis using external information 1 Andrew Gelman and John Carlin 2 11 May 2011 Power is important in choosing between alternative methods of analyzing data and in deciding on an
More information