Estimands in clinical trials
|
|
- Bruno Norman
- 6 years ago
- Views:
Transcription
1 Statistical Methodology Novartis Basel, Switzerland Estimands in clinical trials Heinz Schmidli BIAS, Parma, Sep 2017
2 Disclaimer The views and opinions expressed in this presentation and on the slides are solely those of the presenter and not necessarily those of Novartis. Novartis does not guarantee the accuracy or reliability of the information provided herein. 2
3 Outline ICH E9(R1) Addendum on Estimands and Sensitivity Analysis in Clinical Trials Estimands and their role in clinical trials Acknowledgements o Frank Bretz, Mouna Akacha o Dan Scharfstein 3
4 Outline ICH E9(R1) Addendum History and Motivation Content Examples Outlook 4
5 ICH E9(R1) Addendum History and Motivation ICH ( International Council for Harmonisation of technical requirements for pharmaceuticals for human use Joint discussions on scientific and technical aspects of drug registration: Regulatory authorities (EU, US, Japan,...) Pharmaceutical industry (EFPIA, PhRMA, JPMMA,...) ICH E9 (1998) STATISTICAL PRINCIPLES FOR CLINICAL TRIALS Clinical trial design, conduct and analysis Very strong focus on intention-to-treat (ITT) principle: effect of assigning patients to test and control 5
6 ICH E9(R1) Addendum History and Motivation Shortcomings of ITT principle often not targeting scientific question of interest Some events after randomization ( intercurrent events ) complicate description and interpretation of treatment effects Despite what you may have heard, randomized trials are not always free of confounding and selection bias. Hernán, Hernández-Diaz, Robins (2013) Annals of Internal Medicine See also: Sheiner & Rubin (1995) Clin Pharm Ther, Sheiner (2002) Br J Clin Pharm 6
7 ICH E9(R1) Addendum History and Motivation Patients differ in response to treatment due to events after randomization ( intercurrent events ) Treatment switch 7
8 ICH E9(R1) Addendum History and Motivation How to define treatment effect in population of interest for primary variable in presence of intercurrent events? Treatment switch 8
9 ICH E9(R1) Addendum History and Motivation More than one treatment effect can be described and estimated, raising questions like: What is of interest for regulatory decision making? What and how to communicate to prescribers? Can these be estimated? 9
10 ICH E9(R1) Addendum History and Motivation US NAS report (2010) The Prevention and Treatment of Missing Data in Clinical Trials Commissioned by FDA (NAS: National Academy of Sciences) NAS report - Recommendation 1 The trial protocol should explicitly define a) the objective(s) of the trial; b) the associated primary outcome or outcomes; c) how, when, and on whom the outcome or outcomes will be measured; d) the measures of intervention effects, that is, the causal estimands of primary interest. These measures should be meaningful for all study participants, and estimable with minimal assumptions. 10
11 ICH E9(R1) Addendum Content ICH concept paper (2014) proposal ICH E9(R1) Addendum (2017) draft 1. Purpose and Scope 2. A Framework to Align Planning, Design, Conduct, Analysis and Interpretation 3. Estimands 4. Impact on Trial Design and Conduct 5. Impact on Trial Analysis 6. Documenting Estimands and Sensitivity Analysis 7. A Generic Example Glossary 11
12 ICH E9(R1) Addendum Content Structured framework to align trial objectives with analysis methods 12
13 ICH E9(R1) Addendum Content Estimand description A Population Patients targeted by scientific question B Variable Endpoint(s) to be obtained for each patient to address the scientific question C Intercurrent events - Specification of how to account for these to reflect the scientific question D Summary - Population-level summary for the variable which provides a basis for a comparison between treatments 13
14 ICH E9(R1) Addendum Content Five strategies for handling each intercurrent event discussed in ICH E9 Addendum. Treatment policy (ITT): Occurrence of intercurrent event irrelevant; Composite: Intercurrent event is component of variable; Hypothetical: Scenario is envisaged in which the intercurrent event would not happen; Principal stratum: Target population is subpopulation for which intercurrent event would not occur; While on treatment: Response to treatment prior to the occurrence of the intercurrent event is of interest. 14
15 ICH E9(R1) Addendum Example - Dapagliflozin Dapagliflozin case: RCT experimental vs control Diabetes patients, Change in HbA1c, rescue medication allowed Sponsor proposal: Exclude data after initiation of rescue medication, and use LOCF. However, FDA: While FDA has implicitly endorsed LOCF imputation for diabetes trials in the past, there is now more awareness in the statistical community of the limitations of this approach. Instead I have included a sensitivity analysis in which the primary HbA1c outcomes are used regardless of rescue treatment, and no statistical adjustment is made for rescue. This approach is also imperfect, but it comes closer to being a true intent-to-treat (ITT) analysis... 15
16 ICH E9(R1) Addendum Example - Dapagliflozin Focus on analysis/ missing data /statistics, rather than on trial objective/target of estimation Implied scientific questions of interest : Sponsor: Attempt to establish the treatment effect of the initially randomized treatments had rescue medication not been allowed; FDA: Compare treatment policies experimental plus rescue versus control plus rescue. Disagreement on estimand 16
17 ICH E9(R1) Addendum Example chronic heart failure EMA (2016) Guideline on clinical investigation of medicinal products for the treatment of chronic heart failure (draft) a) Heart Failure Hospitalisation (HFH) b) Terminal events: all-cause death, heart transplant, LVAD implant... recurrent HFH events may better characterise the prognosis analysis and interpretation are complicated by [...] terminal events terminal events will usually need to be addressed explicitly in the statistical analysis since certain naïve approaches to the analysis of hospitalisation rate data will not reflect the true effect it is strongly recommended to seek Scientific Advice, when recurrent HFH is to be used as a part of a primary endpoint [...]. 17
18 ICH E9(R1) Addendum Example chronic heart failure Tendency to start with selection of primary analysis among the many (complex) methods proposed, based on power and type I error However: Reverse-engineering the implied target of estimation often very difficult Further complicated by ad-hoc choices which may change the target of estimation (e.g. handling intercurrent event of non-cv-death) Communication of treatment effect can be very challenging Some approaches implicitly rely on assumptions which seem scientifically meaningless (e.g. possibilty of hospitalization after death) Causal interpretation of treatment effect sometimes not possible Better starting point: What is an appropriate estimand? 18
19 ICH E9(R1) Addendum Outlook Addendum is draft comments to EMA until Feb 2018! However, regulatory authorities already use Addendum framework/language: "... provide an extended discussion on appropriate estimands and how they are supposed to be estimated..."; Addendum aims to improve interaction between sponsor and regulators. So hopefully we will see Better designs by sponsors Better assessments by regulators 19
20 Outline Estimands and their role in clinical trials Causal estimands Strategies Design Discussion Conclusions 20
21 Estimands Causal estimands NAS report revisited... Recommendation 1: "... the causal estimands..." "Estimation of the primary (causal) estimand, with an appropriate estimate of uncertainty, is the main goal of a clinical trial. " Many authors of NAS report experts on causal inference Little RJ, D'Agostino R, Cohen ML, Dickersin K, Emerson SS, Farrar JT, Frangakis C, Hogan JW, Molenberghs G, Murphy SA, Neaton JD, Rotnitzky A, Scharfstein D, Shih WJ, Siegel JP, Stern H. Term "causal" not used in ICH E9(R1) Addendum, but framework/language aligned with causal reasoning 21
22 Estimands Causal estimands Causal inference well established science Neyman (1923) Agricultural experiments Extended by Rubin (1974) to non-randomized studies Important contributions by: Robins, Pearl,... Not well known among biostatisticians in the pharmaceutical industry (... I think...) 22
23 Estimands Causal estimands RCT Experimental (E) vs Control (C) treatment Population: patients with cancer Variable: time-to-death Y [years], from time of randomization Intercurrent events ignored (...as a starting point...) Potential outcome framework* # Patient Y(E) Y(C) 1 Adam Bruce Y(E): how long a patient would live if randomized to E Y(C): how long a patient would live if randomized to C *Neyman (1923), Rubin (1974) 23
24 Estimands Causal estimands Potential outcome framework # Patient Y(E) Y(C) Y(E)-Y(C) 1 Adam Bruce Y(E): how long a patient would live if randomized to E Y(C): how long a patient would live if randomized to C Population causal estimand, e.g. average(y(e) Y(C)) = average(y(e)) average(y(c)) 24
25 Estimands Causal estimands # Patient Y(E) Y(C) 1 Adam Bruce Examples of population causal estimands: average( Y(E) ) average( Y(C) ) average( Y(E) ) / average( Y(C) ) average( log{y(e)} ) - average( log{y(c)} ) Accelerated Life Time median( Y(E) ) - median( Y(C) ) prop( Y(E) > 3years) ) - prop( Y(C) > 3years) ) RMST 3 years ( Y(E) ) RMST 3 years ( Y(C) ) Restricted Mean Survival Time Prob( Y i (E) > Y j (C) )... 25
26 Estimands Causal estimands Is the hazard ratio a causal estimand? Short answer: No! Aalen et al. (2015) Does Cox analysis of a randomized survival study yield a causal treatment effect? Lifetime Data Anal Hernan (2010) The Hazards of Hazard Ratios. Epidemiology... another issue is the physical or substantive basis for the proportional hazards model. I think that s one of his weaknesses, [and] that accelerated life models are in many ways more appealing because of their quite direct physical interpretation... Cox, 1994 If, however, the objective is more modestly summarization for largely descriptive purposes a formulation directly in terms of hazard functions has attractions... Cox,
27 Estimands Causal estimands Potential outcomes Observed # Patient Y(E) Y(C) Assignment A Y Y(E) Y(C) 1 Adam 2 1 E 2 2? 2 Bruce 5 7 C 7? Estimation: Y(E), Y(C) independent of Assignment A for RCT s average( Y A=E) average( Y A=C) unbiased estimate of average( Y(E) ) average( Y(C) ) Testing: Strict null hypothesis: Y i (E)=Y i (C) i=1,2,... Fisher s randomization-based testing Frequentist and Bayesian approches available for inference 27
28 Estimands Strategies ICH E9 Addendum strategies for intercurrent events Treatment policy (ITT): Occurrence of intercurrent event irrelevant; Composite: Intercurrent event is component of variable; Hypothetical: Scenario is envisaged in which the intercurrent event would not occur; Principal stratum: Target population is subpopulation for which intercurrent event would not occur; While on treatment: Response to treatment prior to the occurrence of the intercurrent event is of interest. Illustration in RCT setting: Experimental (E) vs Control (C) treatment 28
29 Estimands Strategies Population: Patients with diabetes Variable: Y=Change in HbA1c from baseline to 24 weeks [mmol/mol] Intercurrent event: R=intake of rescue medication # Patient Y(E) R(E) Y(C) R(C) 1 John 2 no 5 yes 2 Brian -8 yes 0 yes Strategies a) Treatment-policy/ITT: Y(E) vs Y(C) e.g. average( Y(E) ) average( Y(C) ) 29
30 Estimands Strategies # Patient Y(E) R(E) Y(E,R=no) Y(C) R(C) Y(C,R=no) 1 John 2 no 2 5 yes 7 2 Brian -8 yes -1 0 yes 1 Hypothetical Y(E,R=no): if rescue medication would not have been allowed Strategies a) Treatment-policy/ITT: Y(E) vs Y(C) b) Hypothetical: Y(E,R=no) vs Y(C,R=no) Dapagliflozin case Discussion between FDA and sponsor on technical level (whether to remove data after rescue medication), rather than on strategy level 30
31 Estimands Strategies Population: cancer patients with weight loss Variable: Y=Change in lean body mass from baseline to 12 weeks [kg] Intercurrent event: D=death (0=no, 1=yes) # Y(E) D(E) Y(C) D(C) If a patient dies before 12 weeks, the value of variable Y does not exist 31
32 Estimands Strategies Population: cancer patients with weight loss Variable: Y=Change in lean body mass from baseline to 12 weeks [kg] Intercurrent event: D=death (0=no, 1=yes) # Y(E) D(E) Y(C) D(C) Z(E) Z(C) If a patient dies before 12 weeks, the value of variable Y does not exist Strategies: a) Composite: new variable Z = (1-D) x Y - D x 100 [kg] Causal estimand median( Z(E) ) - median( Z(C) ) See also: Permutt & Li (2017) Pharm Stat, Wang et al. (2017) Biometrics 32
33 Estimands Strategies # Y(E) D(E) Y(C) D(C) Principal Stratum Strategies: b) Principal stratum estimand: average( Y(E) D(E)=D(C)=0 ) - average( Y(C) D(E)=D(C)=0 ) Effect in subgroup with D(E)=D(C)=0 i.e. patients which would survive regardless of treatment received See also: Frangakis & Rubin (2002) Biometrics 33
34 Estimands Strategies # Y(E) D(E) Y last (E) D time (E) Z(E) >12 3/ /8 Strategies: c) While alive: slope Z Causal estimand e.g. average( Z(E) ) - average( Z(C) ) 34
35 Estimands Design Estimand can sometimes be better estimated using non-standard trial designs run-in, enrichment, randomized withdrawal, titration,... Example: Patients with heart failure LCZ696 (test) vs enalapril (control) 1st run-in phase: all patients on control, Followed by 2nd run-in phase: all remaining patients on test, 9419 Followed by randomization of remaining patients 8442 McMurray et al. (2014) NEJM 35
36 Estimands Design Primary endpoint: composite of CV death & hospitalization for heart failure McMurray et al. (2014) NEJM 36
37 Estimands Discussion Traditional estimand (Complex) model including treatment effect parameter θ Testing, with null hypothesis H0: θ=0 Causal estimand Marginal comparison of potential outcomes: Y(E) vs Y(C) Testing, with strict null hypothesis H0: Y i (E)=Y i (C) i=1,2,... Advantages of causal estimand formulation Potential outcome framework natural for medical doctors What happens to my patient if I give him treatment E vs treatment C No statistical model needed to discuss with clinicans Easier to think about how to account for intercurrent events 37
38 Estimands Discussion Role of statistical models Traditional estimand is model parameter, which is not interpretable if model is not adequate Causal estimand is model-free However, models can/should be used for inference! Example Y=time-to-death Causal estimand median( Y(E) ) - median( Y(C) ) To obtain point estimates/ci/p-value/posterior distribution, one could use e.g. a Weibull model 38
39 Estimands Discussion Causal reasoning Provides guidance on which estimands make sense No causation without manipulation Holland and Rubin, 1986 Example hypothetical estimand Diabetes patients, change in HbA1c Intercurrent event: R=intake of rescue medication Y(E,R=no): if rescue medication would not have been allowed OK Intercurrent event: R=Discontinuation due to AE Y(E,R=no): if patients would not have had AEs? Intercurrent event: R=Death Y(E,R=no): if patients would not die??? 39
40 Estimands Conclusions ICH E9(R1) Addendum should lead to more transparent discussions between sponsor and regulators on trial objectives and target of estimation Causal reasoning key for appropriate choice of estimand Potential outcome framework useful for interactions between statisticians, clinicians... and patients. 40
41 References Akacha M, Bretz F, Ohlssen D, Rosenkranz G, Schmidli H (2017) Estimands and Their Role in Clinical Trials. Statistics in Biopharmaceutical Research, 9:3, Akacha M, Bretz F, Ruberg S (2017) Estimands in clinical trials - broadening the perspective. Stat Med 36:5-19. Phillips A, Abellan-Andres J, Soren A, Bretz F, Fletcher C, France L, Garrett A, Harris R, Kjaer M, Keene O, Morgan D, O'Kelly M, Roger J (2017) Estimands: discussion points from the PSI estimands and sensitivity expert group. Pharm Stat. 16(1):6-11 Holzhauer B, Akacha M, Bermann G (2015) Choice of Estimand and Analysis Methods in Diabetes Trials with Rescue Medication. Pharm Stat, 14, Leuchs A, Zinserling J, Brandt A, Wirtz D, Benda N (2015) Choosing Appropriate Estimands in Clinical Trials. Ther Inn & Reg Sci 49, Permutt T (2016) A Taxonomy of Estimands for Regulatory Clinical Trials with Discontinuations. Stats Med, 35,
42 References Imbens GW, Rubin DB (2015) Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press Hernán MA, Robins JM (2018). Causal Inference. Boca Raton: Chapman & Hall/CRC, forthcoming Little RJ, Rubin DB (2000) Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches. Annu Rev Health, 21: Pearl (2009) Causal inference in statistics: An overview. Statistics Surveys 3, Dawid (2000) Causal inference without counterfactuals (with comments and rejoinder). J American Statistical Association, 95:
How the ICH E9 addendum around estimands may impact our clinical trials
Danish Society for Biopharmaceutical Statistics Copenhagen October 26, 2017 How the ICH E9 addendum around estimands may impact our clinical trials Frank Bretz (Novartis) ICH E9(R1) Expert Working Group
More informationICH E9 (R1) Addendum on Estimands and Sensitivity Analysis
ICH E9 (R1) Addendum on Estimands and Sensitivity Analysis Rob Hemmings Mouna Akacha MHRA + ICH E9 (R1) Expert Working Group Novartis 1 Disclaimer (I) Not a statistical topic This impacts every clinical
More informationEstimands and Their Role in Clinical Trials
Estimands and Their Role in Clinical Trials Frank Bretz (Novartis) EFSPI/PSI UK September 28, 2015 Acknowledgements ICH E9(R1) Expert Working Group M Akacha, D Ohlssen, H Schmidli, G Rosenkranz (Novartis)
More informationEstimands: PSI/EFSPI Special Interest group. Alan Phillips
Estimands: PSI/EFSPI Special Interest group Alan Phillips 1 Agenda PSI/EFSPI Special Interest Group Discussion Framework What is the real problem we are trying to solve? Case study Key messages Definition
More informationTreatment changes in cancer clinical trials: design and analysis
Treatment changes in cancer clinical trials: design and analysis Ian White Statistical methods and designs in clinical oncology Paris, 9 th November 2017 Plan 1. Treatment changes
More informationImplementation of estimands in Novo Nordisk
Implementation of estimands in Novo Nordisk Søren Andersen Helle Lynggaard Biostatistics, Novo Nordisk A/S DSBS meeting 26 October 2017 2 Agenda Overview of implementation process Cross-functional working
More informationEstimands. EFPIA webinar Rob Hemmings, Frank Bretz October 2017
Estimands EFPIA webinar Rob Hemmings, Frank Bretz October 2017 Why estimands? To explain which treatment effect is described to prescribers and other stakeholders. To align objectives with (design and)
More informationA (Constructive/Provocative) Critique of the ICH E9 Addendum
A (Constructive/Provocative) Critique of the ICH E9 Addendum Daniel Scharfstein Johns Hopkins University dscharf@jhu.edu April 18, 2018 1 / 28 Disclosures Regularly consult with pharmaceutical and device
More informationDraft ICH Guidance on Estimands and Sensitivity Analyses: Why and What?
Draft ICH Guidance on Estimands and Sensitivity Analyses: Why and What? Devan V. Mehrotra Merck Research Laboratories Acknowledgement: ICH E9/R1 Expert Working Group Conference on Statistical Issues in
More informationEstimands in klinischen Studien: was ist das und geht mich das was an?
Estimands in klinischen Studien: was ist das und geht mich das was an? CTU Lecture 03.04.2018 Sven Trelle Mention > ICH E9(R1) Statistical Principles for Clinical Trials "Addendum to focus on statistical
More informationCausal versus Casual Inference
ASA Biopharmaceutical Section Workshop Washington, DC 13 Sep 2018 Causal versus Casual Inference What Happens When I Take This Medication? Stephen J. Ruberg, PhD President Analytix Thinking, LLC AnalytixThinking@gmail.com
More informationEstimands and Sensitivity Analysis in Clinical Trials E9(R1)
INTERNATIONAL CONCIL FOR HARMONISATION OF TECHNICAL REQUIREMENTS FOR PHARMACEUTICALS FOR HUMAN USE ICH HARMONISED GUIDELINE Estimands and Sensitivity Analysis in Clinical Trials E9(R1) Current Step 2 version
More informationInternational Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use
Final Concept Paper E9(R1): Addendum to Statistical Principles for Clinical Trials on Choosing Appropriate Estimands and Defining Sensitivity Analyses in Clinical Trials dated 22 October 2014 Endorsed
More informationEU regulatory concerns about missing data: Issues of interpretation and considerations for addressing the problem. Prof. Dr.
EU regulatory concerns about missing data: Issues of interpretation and considerations for addressing the problem Prof. Dr. Karl Broich Disclaimer No conflicts of interest Views expressed in this presentation
More informationUsing principal stratification to address post-randomization events: A case study. Baldur Magnusson, Advanced Exploratory Analytics PSI Webinar
Using principal stratification to address post-randomization events: A case study Baldur Magnusson, Advanced Exploratory Analytics PSI Webinar November 2, 2017 Outline Context Principal stratification
More informationICH E9(R1) Technical Document. Estimands and Sensitivity Analysis in Clinical Trials STEP I TECHNICAL DOCUMENT TABLE OF CONTENTS
ICH E9(R1) Technical Document Estimands and Sensitivity Analysis in Clinical Trials STEP I TECHNICAL DOCUMENT TABLE OF CONTENTS A.1. Purpose and Scope A.2. A Framework to Align Planning, Design, Conduct,
More informationTransmission to CHMP July Adoption by CHMP for release for consultation 20 July Start of consultation 31 August 2017
1 2 3 30 August 2017 EMA/CHMP/ICH/436221/2017 Committee for Human Medicinal Products 4 ICH E9 (R1) addendum on estimands and sensitivity 5 analysis in clinical trials to the guideline on statistical 6
More informationA journey towards estimand specification in pain: motivation and challenges
Biostatistics Neuroscience Franchise A journey towards estimand specification in pain: motivation and challenges Francesca Callegari, PhD PSI Meeting Reading, UK Sep 27 th, 2017 pdated Slide Quote We shall
More informationPharmaceutical Statistics Journal Club 15 th October Missing data sensitivity analysis for recurrent event data using controlled imputation
Pharmaceutical Statistics Journal Club 15 th October 2015 Missing data sensitivity analysis for recurrent event data using controlled imputation Authors: Oliver Keene, James Roger, Ben Hartley and Mike
More informationDecision Making in Confirmatory Multipopulation Tailoring Trials
Biopharmaceutical Applied Statistics Symposium (BASS) XX 6-Nov-2013, Orlando, FL Decision Making in Confirmatory Multipopulation Tailoring Trials Brian A. Millen, Ph.D. Acknowledgments Alex Dmitrienko
More informationEstimands in Chronic Symptomatic Diseases. Martin Jenkins Statistical Science Director, AstraZeneca, Cambridge September 2017
Estimands in Chronic Symptomatic Diseases Martin Jenkins Statistical Science Director, AstraZeneca, Cambridge September 2017 Symptomatic Diseases These are my views and do not necessarily represent the
More informationDRAFT (Final) Concept Paper On choosing appropriate estimands and defining sensitivity analyses in confirmatory clinical trials
DRAFT (Final) Concept Paper On choosing appropriate estimands and defining sensitivity analyses in confirmatory clinical trials EFSPI Comments Page General Priority (H/M/L) Comment The concept to develop
More informationEstimands, Missing Data and Sensitivity Analysis: some overview remarks. Roderick Little
Estimands, Missing Data and Sensitivity Analysis: some overview remarks Roderick Little NRC Panel s Charge To prepare a report with recommendations that would be useful for USFDA's development of guidance
More informationEstimand in China. - Consensus and Reflection from CCTS-DIA Estimand Workshop. Luyan Dai Regional Head of Biostatistics Asia Boehringer Ingelheim
Estimand in China - Consensus and Reflection from CCTS-DIA Estimand Workshop Luyan Dai Regional Head of Biostatistics Asia Boehringer Ingelheim Disclaimer The views and points expressed herein represent
More informationICH E9(R1): terminology, taxonomy, systematic approach. Reflections on trimmed means and undilution. Jay P. Siegel, MD April, 2018 Philadelphia, PA
ICH E9(R1): terminology, taxonomy, systematic approach. Reflections on trimmed means and undilution Jay P. Siegel, MD April, 2018 Philadelphia, PA, General comments ICH E9 is an important document, but
More informationAnalysis Strategies for Clinical Trials with Treatment Non-Adherence Bohdana Ratitch, PhD
Analysis Strategies for Clinical Trials with Treatment Non-Adherence Bohdana Ratitch, PhD Acknowledgments: Michael O Kelly, James Roger, Ilya Lipkovich, DIA SWG On Missing Data Copyright 2016 QuintilesIMS.
More informationEstimands in oncology
Estimands in oncology Steven Teerenstra 1,2 1 Radboud university Nijmegen medical center, NL 2 Statistical assessor at Medicines Evaluation Board (MEB), NL Disclaimer 2 Views expressed my own, based on
More informationEstimands for time to event endpoints in oncology and beyond
Estimands for time to event endpoints in oncology and beyond Kaspar Rufibach, Hans Ulrich Burger Methods, Collaboration & Outreach Group (MCO) Department of Biostatistics, Roche Basel Context and problem
More informationBeyond the intention-to treat effect: Per-protocol effects in randomized trials
Beyond the intention-to treat effect: Per-protocol effects in randomized trials Miguel Hernán DEPARTMENTS OF EPIDEMIOLOGY AND BIOSTATISTICS Intention-to-treat analysis (estimator) estimates intention-to-treat
More informationPropensity Score Analysis Shenyang Guo, Ph.D.
Propensity Score Analysis Shenyang Guo, Ph.D. Upcoming Seminar: April 7-8, 2017, Philadelphia, Pennsylvania Propensity Score Analysis 1. Overview 1.1 Observational studies and challenges 1.2 Why and when
More informationEstimand and analysis considerations of phase 3 clinical trials involving CAR-T A case study in lymphoma
Estimand and analysis considerations of phase 3 clinical trials involving CAR-T A case study in lymphoma Michael Yiyun Zhang, on behalf of Novartis Team 2018 ASA Biopharmaceutical Section Regulatory-Industry
More informationSample-size re-estimation in Multiple Sclerosis trials
Novartis Basel, Switzerland Sample-size re-estimation in Multiple Sclerosis trials Heinz Schmidli PSI Meeting on Sample Size Re-Estimation London, November 2, 2016 Outline Multiple Sclerosis Sample size
More informationStatistics in Medicine The Prevention and Treatment of Missing Data in Clinical Trials
Author: This file is the accepted version of your manuscript, and it shows any changes made by the Editor-in-Chief and the Deputy Editor since you submitted your last revision. This is the version that
More informationStatistical, clinical and ethical considerations when minimizing confounding for overall survival in cancer immunotherapy trials
Statistical, clinical and ethical considerations when minimizing confounding for overall survival in cancer immunotherapy trials Dominik Heinzmann, PhD Global Development Team Leader HER2 Associate Director
More informationMissing data in clinical trials: making the best of what we haven t got.
Missing data in clinical trials: making the best of what we haven t got. Royal Statistical Society Professional Statisticians Forum Presentation by Michael O Kelly, Senior Statistical Director, IQVIA Copyright
More informationSupplement 2. Use of Directed Acyclic Graphs (DAGs)
Supplement 2. Use of Directed Acyclic Graphs (DAGs) Abstract This supplement describes how counterfactual theory is used to define causal effects and the conditions in which observed data can be used to
More informationSome Thoughts on Estimands in a Chronic Pain Indication
Some Thoughts on Estimands in a Chronic Pain Indication 1 st EFSPI-Workshop on Regulatory Statistics 12 SEP 2016 / PD Dr. Christoph Gerlinger; Dr. Michael Kunz / Basel Agenda Medical Background Problem
More informationE11(R1) Addendum to E11: Clinical Investigation of Medicinal Products in the Pediatric Population Step4
E11(R1) Addendum to E11: Clinical Investigation of Medicinal Products in the Step4 October 2017 International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use 1 Legal
More informationKaspar Rufibach Methods, Collaboration, and Outreach Group (MCO) Department of Biostatistics, Roche Basel
Construction of an Estimand in a Clinical Trial on Progressive Multiple Sclerosis Kaspar Rufibach Methods, Collaboration, and Outreach Group (MCO) Department of Biostatistics, Roche Basel Acknowledgments
More informationLecture 2. Key Concepts in Clinical Research
Lecture 2 Key Concepts in Clinical Research Outline Key Statistical Concepts Bias and Variability Type I Error and Power Confounding and Interaction Statistical Difference vs Clinical Difference One-sided
More informationKaspar Rufibach (F. Hoffmann-La Roche) Joint work with Mouna Akacha (Novartis)
Treatment effect measures for time-to-event endpoints - Estimands and beyond Kaspar Rufibach (F. Hoffmann-La Roche) Joint work with Mouna Akacha (Novartis) Frankfurt, June 13 th, 2017 Problem statement
More informationTitle:Bounding the Per-Protocol Effect in Randomized Trials: An Application to Colorectal Cancer Screening
Author's response to reviews Title:Bounding the Per-Protocol Effect in Randomized Trials: An Application to Colorectal Cancer Screening Authors: Sonja A Swanson (sswanson@hsph.harvard.edu) Oyvind Holme
More informationICH M4E(R2): Revised Guideline on Common Technical Document -- Efficacy
ICH M4E(R2): Revised Guideline on Common Technical Document -- Efficacy International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use 1 Background Regulatory authorities
More informationBeyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies
September 27, 2018 Beyond Controlling for Confounding: Design Strategies to Avoid Selection Bias and Improve Efficiency in Observational Studies A Case Study of Screening Colonoscopy Our Team Xabier Garcia
More informationBioequivalence Requirements: USA and EU
Bioequivalence Requirements: USA and EU Dr. Nicholas Cappuccino Chair, IGPA Science Committee Global Head of Quality, Dr. Reddy s Laboratories Ltd. 15 th Annual IGPA Conference Kyoto, Japan December 6,
More informationCareful with Causal Inference
Careful with Causal Inference Richard Emsley Professor of Medical Statistics and Trials Methodology Department of Biostatistics & Health Informatics Institute of Psychiatry, Psychology & Neuroscience Correlation
More informationAdjusting overall survival for treatment switch
Adjusting overall survival for treatment switch Recommendations of a crossinstitutional statistical working group Claire Watkins Director and Consultant Statistician, Clarostat Consulting Ltd Cytel East
More informationThe Prevention and Treatment of Missing Data in Clinical Trials
T h e n e w e ngl a nd j o u r na l o f m e dic i n e s p e c i a l r e p o r t The Prevention and Treatment of Missing Data in Clinical Trials Roderick J. Little, Ph.D., Ralph D Agostino, Ph.D., Michael
More informationGeneralizing the right question, which is?
Generalizing RCT results to broader populations IOM Workshop Washington, DC, April 25, 2013 Generalizing the right question, which is? Miguel A. Hernán Harvard School of Public Health Observational studies
More informationComplier Average Causal Effect (CACE)
Complier Average Causal Effect (CACE) Booil Jo Stanford University Methodological Advancement Meeting Innovative Directions in Estimating Impact Office of Planning, Research & Evaluation Administration
More informationThe prevention and handling of the missing data
Review Article Korean J Anesthesiol 2013 May 64(5): 402-406 http://dx.doi.org/10.4097/kjae.2013.64.5.402 The prevention and handling of the missing data Department of Anesthesiology and Pain Medicine,
More informationStrategies for handling missing data in randomised trials
Strategies for handling missing data in randomised trials NIHR statistical meeting London, 13th February 2012 Ian White MRC Biostatistics Unit, Cambridge, UK Plan 1. Why do missing data matter? 2. Popular
More informationMeta-analysis of safety thoughts from CIOMS X
CIOMS Working Group X Meta-analysis of safety thoughts from CIOMS X Stephen.Evans@Lshtm.ac.uk Improving health worldwide www.lshtm.ac.uk Evans: ENCePP CIOMS Meta Analysis 1 Acknowledgements, conflicts,
More informationUsing Statistical Principles to Implement FDA Guidance on Cardiovascular Risk Assessment for Diabetes Drugs
Using Statistical Principles to Implement FDA Guidance on Cardiovascular Risk Assessment for Diabetes Drugs David Manner, Brenda Crowe and Linda Shurzinske BASS XVI November 9-13, 2009 Acknowledgements
More informationQuantitative challenges of extrapolation
Quantitative challenges of extrapolation Michael Looby, Frank Bretz (Novartis) EMA workshop on extrapolation of efficacy and safety in medicine development across age groups May 17-18, 2016 Extrapolation
More informationControlled multiple imputation methods for sensitivity analyses in longitudinal clinical trials with dropout and protocol deviation
Controlled multiple imputation methods for sensitivity analyses in longitudinal clinical trials with dropout and protocol deviation Sensitivity analyses are commonly requested as part of the analysis of
More informationDichotomizing partial compliance and increased participant burden in factorial designs: the performance of four noncompliance methods
Merrill and McClure Trials (2015) 16:523 DOI 1186/s13063-015-1044-z TRIALS RESEARCH Open Access Dichotomizing partial compliance and increased participant burden in factorial designs: the performance of
More informationEvaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_
Journal of Evaluation in Clinical Practice ISSN 1356-1294 Evaluating health management programmes over time: application of propensity score-based weighting to longitudinal datajep_1361 180..185 Ariel
More informationPropensity scores: what, why and why not?
Propensity scores: what, why and why not? Rhian Daniel, Cardiff University @statnav Joint workshop S3RI & Wessex Institute University of Southampton, 22nd March 2018 Rhian Daniel @statnav/propensity scores:
More informationPSI Missing Data Expert Group
Title Missing Data: Discussion Points from the PSI Missing Data Expert Group Authors PSI Missing Data Expert Group 1 Abstract The Points to Consider Document on Missing Data was adopted by the Committee
More informationResearch in Real-World Settings: PCORI s Model for Comparative Clinical Effectiveness Research
Research in Real-World Settings: PCORI s Model for Comparative Clinical Effectiveness Research David Hickam, MD, MPH Director, Clinical Effectiveness & Decision Science Program April 10, 2017 Welcome!
More informationMissing data in clinical trials: a data interpretation problem with statistical solutions?
INTERVIEW SERIES Clin. Invest. (2012) 2(1), 11 17 Missing data in clinical trials: a data interpretation problem with statistical solutions? Robert Hemmings and David Wright speak to Laura Harvey, Assistant
More informationInterested parties (organisations or individuals) that commented on the draft document as released for consultation.
10 February 2017 EMA/605292/2017 Overview of comments received by EMA on 'ICH guideline E17 on general principles for planning and design of multi-regional clinical trials - Step 2b' (EMA/CHMP/ICH/453276/2016)
More informationOn the Utility of Subgroup Analyses in Confirmatory Clinical Trials
On the Utility of Subgroup Analyses in Confirmatory Clinical Trials EMA Expert Workshop on Subgroup Analyses 7-Nov-2014 Brian A. Millen, Ph.D. Outline Classification of Subgroup Analyses from Confirmatory
More informationQuantifying the clinical measure of interest in the presence of missing data:
Quantifying the clinical measure of interest in the presence of missing data: choosing primary and sensitivity analyses in neuroscience clinical trials Sept 26, 2016 Elena Polverejan, Ph.D. Statistical
More informationThe Roles of Short Term Endpoints in. Clinical Trial Planning and Design
The Roles of Short Term Endpoints in Clinical Trial Planning and Design Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj Roche, Welwyn Garden
More informationSelection and estimation in exploratory subgroup analyses a proposal
Selection and estimation in exploratory subgroup analyses a proposal Gerd Rosenkranz, Novartis Pharma AG, Basel, Switzerland EMA Workshop, London, 07-Nov-2014 Purpose of this presentation Proposal for
More informationDynamic borrowing of historical data: Performance and comparison of existing methods based on a case study
Introduction Methods Simulations Discussion Dynamic borrowing of historical data: Performance and comparison of existing methods based on a case study D. Dejardin 1, P. Delmar 1, K. Patel 1, C. Warne 1,
More informationEUROPEAN COMMISSION HEALTH AND FOOD SAFETY DIRECTORATE-GENERAL. PHARMACEUTICAL COMMITTEE 21 October 2015
EUROPEAN COMMISSION HEALTH AND FOOD SAFETY DIRECTORATE-GENERAL Health systems and products Medicinal products authorisations, European Medicines Agency PHARM 689 PHARMACEUTICAL COMMITTEE 21 October 2015
More informationBayesian Joint Modelling of Benefit and Risk in Drug Development
Bayesian Joint Modelling of Benefit and Risk in Drug Development EFSPI/PSDM Safety Statistics Meeting Leiden 2017 Disclosure is an employee and shareholder of GSK Data presented is based on human research
More informationXP23829 PHASE 2 PSORIASIS TRIAL PRELIMINARY TOPLINE DATA PRESENTATION SEPTEMBER 15, 2015 COPYRIGHT 2015 XENOPORT, INC. ALL RIGHTS RESERVED.
XP23829 PHASE 2 PSORIASIS TRIAL PRELIMINARY TOPLINE DATA PRESENTATION SEPTEMBER 15, 2015 COPYRIGHT 2015 XENOPORT, INC. ALL RIGHTS RESERVED. SAFE HARBOR DISCLAIMER These slides and the accompanying oral
More informationDiscussion Meeting for MCP-Mod Qualification Opinion Request. Novartis 10 July 2013 EMA, London, UK
Discussion Meeting for MCP-Mod Qualification Opinion Request Novartis 10 July 2013 EMA, London, UK Attendees Face to face: Dr. Frank Bretz Global Statistical Methodology Head, Novartis Dr. Björn Bornkamp
More informationThe update of the multiplicity guideline
The update of the multiplicity guideline Norbert Benda and Medical Devices (BfArM), Bonn Disclaimer: Views expressed in this presentation are the author's personal views and not necessarily the views of
More informationCOMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO CONSIDER ON MISSING DATA
The European Agency for the Evaluation of Medicinal Products Evaluation of Medicines for Human Use London, 15 November 2001 CPMP/EWP/1776/99 COMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO
More informationEPF s response to the European Commission s public consultation on the "Summary of Clinical Trial Results for Laypersons"
EPF s response to the European Commission s public consultation on the "Summary of Clinical Trial Results for Laypersons" August 2016 This document received funding under an operating grant from the European
More informationOverview of Perspectives on Causal Inference: Campbell and Rubin. Stephen G. West Arizona State University Freie Universität Berlin, Germany
Overview of Perspectives on Causal Inference: Campbell and Rubin Stephen G. West Arizona State University Freie Universität Berlin, Germany 1 Randomized Experiment (RE) Sir Ronald Fisher E(X Treatment
More informationCommunity-acquired pneumonia (CAP)
Community-acquired pneumonia (CAP) Keith F Barker, MD GlaxoSmithKline 1 CAP: Key issues Definitions and patient population Use of prior antibiotics Microbiologically Evaluable population Efficacy endpoints
More informationStatistical challenges of meta-analyses of randomised clinical trials in a regulatory setting
Statistical challenges of meta-analyses of randomised clinical trials in a regulatory setting Frank Pétavy ISCTM 14th Annual Scientific Meeting, Washington D.C. Presented by Frank Pétavy on 21 February
More informationMissing Data in Longitudinal Studies: Strategies for Bayesian Modeling, Sensitivity Analysis, and Causal Inference
COURSE: Missing Data in Longitudinal Studies: Strategies for Bayesian Modeling, Sensitivity Analysis, and Causal Inference Mike Daniels (Department of Statistics, University of Florida) 20-21 October 2011
More informationFundamental Clinical Trial Design
Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003
More informationReflection paper on assessment of cardiovascular safety profile of medicinal products
25 February 2016 EMA/CHMP/50549/2015 Committee for Medicinal Products for Human Use (CHMP) Reflection paper on assessment of cardiovascular safety profile of medicinal products Draft agreed by Cardiovascular
More informationThe Logic of Causal Inference. Uwe Siebert, MD, MPH, MSc, ScD
The Logic of Causal Inference Uwe Siebert, MD, MPH, MSc, ScD (1) Dept. of Public Health, Health Services Research and Health Technology Assessment, UMIT - University for Health Sciences, Medical Informatics
More informationAccounting for treatment switching/discontinuation in comparative effectiveness studies
Global Medical Affairs RWE and Digital Accounting for treatment switching/discontinuation in comparative effectiveness studies Melvin Skip Olson, PhD Global Head, Real World Data Strategy and Innovation
More informationRisk Assessment Terminology, Expression of Nature and level of Risk and Uncertainties
Risk Assessment Terminology, Expression of Nature and level of Risk and Uncertainties Professor Tony Hardy, Chair of EFSA PPR Panel Brussels 13 th November 2008 Comparative Review of Risk Terminology of
More informationDesign and analysis of clinical trials
Design and analysis of clinical trials Lecture 3 1.Basic Design Considerations 2.Sample Size determinationa 3.Randomization 2018-01-31 Previous Lectures Definition of a clinical trial The drug development
More informationAccess to newly licensed medicines. Scottish Medicines Consortium
Access to newly licensed medicines Scottish Medicines Consortium Modifiers The Committee has previously been provided with information about why the SMC uses modifiers in its appraisal process and also
More informationStatistical Analysis Plans
Statistical Analysis Plans PROFESSOR CARROL GAMBLE UNIVERSITY OF LIVERPOOL Clinical Trials Lots of different types of clinical trials Various interventions Pharmaceutical/drugs regulated Regulated environment
More informationThe ICHS1 Regulatory Testing Paradigm of Carcinogenicity in rats - Status Report
INTERNATIONAL COUNCIL FOR HARMONISATION OF TECHNICAL REQUIREMENTS FOR PHARMACEUTICALS FOR HUMAN USE The ICHS1 Regulatory Testing Paradigm of Carcinogenicity in rats - Status Report Introduction The ICH
More informationControlled Trials. Spyros Kitsiou, PhD
Assessing Risk of Bias in Randomized Controlled Trials Spyros Kitsiou, PhD Assistant Professor Department of Biomedical and Health Information Sciences College of Applied Health Sciences University of
More informationRandomized Experiments with Noncompliance. David Madigan
Randomized Experiments with Noncompliance David Madigan Introduction Noncompliance is an important problem in randomized experiments involving humans Includes e.g. switching subjects to standard therapy
More informationGuselkumab (plaque psoriasis)
IQWiG Reports Commission No. A18-24 Guselkumab (plaque psoriasis) Addendum to Commission A17-60 1 Addendum Commission: A18-24 Version: 1.0 Status: 27 April 2018 1 Translation of addendum A18-24 Guselkumab
More informationCausal Validity Considerations for Including High Quality Non-Experimental Evidence in Systematic Reviews
Non-Experimental Evidence in Systematic Reviews OPRE REPORT #2018-63 DEKE, MATHEMATICA POLICY RESEARCH JUNE 2018 OVERVIEW Federally funded systematic reviews of research evidence play a central role in
More informationSafeguarding public health Subgroup analyses scene setting from the EU regulators perspective
Safeguarding public health Subgroup analyses scene setting from the EU regulators perspective The views expressed herein are not necessarily those of MHRA, EMA, EMA committees or their working parties.
More informationarxiv: v1 [stat.ot] 4 May 2018
On estimands and the analysis of adverse events in the presence of varying follow-up times within the benefit assessment of therapies S. Unkel 1, M. Amiri 2, N. Benda 3, J. Beyersmann 4, D. Knoerzer 5,
More informationPractical Statistical Reasoning in Clinical Trials
Seminar Series to Health Scientists on Statistical Concepts 2011-2012 Practical Statistical Reasoning in Clinical Trials Paul Wakim, PhD Center for the National Institute on Drug Abuse 10 January 2012
More informationCAN EFFECTIVENESS BE MEASURED OUTSIDE A CLINICAL TRIAL?
CAN EFFECTIVENESS BE MEASURED OUTSIDE A CLINICAL TRIAL? Mette Nørgaard, Professor, MD, PhD Department of Clinical Epidemiology Aarhus Universitety Hospital Aarhus, Denmark Danish Medical Birth Registry
More informationClinical Study Synopsis
Clinical Study Synopsis This Clinical Study Synopsis is provided for patients and healthcare professionals to increase the transparency of Bayer's clinical research. This document is not intended to replace
More informationEMA Workshop on Multiplicity Issues in Clinical Trials 16 November 2012, EMA, London, UK
EMA Workshop on Multiplicity Issues in Clinical Trials 16 November 2012, EMA, London, UK (http://www.ema.europa.eu/ema/index.jsp?curl=pages/news_and_events/events/2012/06/event_detai l_000589.jsp). Summary
More informationApproaches to Integrating Evidence From Animal and Human Studies in Chemical Assessments
Approaches to Integrating Evidence From Animal and Human Studies in Chemical Assessments Kris Thayer, National Center for Environmental Assessment (NCEA) Integrated Risk Information System (IRIS) Division
More information