Further data analysis topics
|
|
- Jessie Young
- 5 years ago
- Views:
Transcription
1 Further data analysis topics Jonathan Cook Centre for Statistics in Medicine, NDORMS, University of Oxford EQUATOR OUCAGS training course 24th October 2015
2 Outline Ideal study Further topics Multiplicity Subgroups Missing data Summary 2
3 Ideal study An ideal clinical study is where Every participant was eligible for the study All receive the intervention exactly as desired All outcomes are obtained for all participants Participants directly map into a definable population and clinical decision Analysis of such a study is (reasonably) straightforward, reliable, interpretable and applicable In reality? 3
4 Man et al., BMJ 2004
5 Who do we analyse? Statistical analysis premised upon having a representative sample (or that we can get back to such a thing in our analysis) Patients may though be unideal Got another treatment before, during or afterwards? Might be quite abnormal? What about important factors (e.g. age)? May have incomplete data Who should be included in the analysis? What do we do when the outcome is missing? 5
6 Multiplicity The more you look, the more you will find 6
7 Dangers of multiplicity Each statistical test typically has a 5% probability of being significant when in reality there is no real difference A false positive finding With multiple tests the probability of at least one false positive finding rises With many tests something is likely to be significant May be misinterpreted Danger of selective reporting (i.e. publish only the significant results) 7
8 Probability of at least one significant result Multiple tests Number 31 41of tests
9 Sources of multiplicity in RCTs DESIGN Multiple treatment groups Multiple outcome measures Multiple follow-up time points CONDUCT Multiple looks at accumulating data PRE-SPECIFY ANALYSIS Grouping of continuous or categorical data Adjusted or unadjusted Subgroups Do these all generate the same concerns? 9
10 Multiple treatments, multiple time-points 3 groups = 7 comparisons: Global: A1 vs A2 vs B Pairwise: A1 vs A2; A1 vs B; A2 vs B; A1+A2 vs B; A1+B vs A2; A2 + B vs A1 3 time-points: 1 month; 3 months; 6 months 21 possible comparisons The trial reported a global analysis of variance at each time-point and a post-hoc multiple comparison test between groups. Could take account of all time-points using a more complex model (e.g. multilevel model) 10
11 Adjusting for multiple testing Formal adjustment to control overall significance level ( ) to desired level (e.g. 0.05) is possible Under Bonferroni procedure divide the by the number of tests Overly conservative (as usually outcome/time points are correlated) Considers all analyses of equivalent importance More complex approach are available but still somewhat simplistic Better approach is to think about hierarchy of testing and take a p-value with a good pinch of salt 11 11
12 Dealing with multiplicity Limit the number of analyses Consider analyses which all testing of multiple groups Prioritise key analyses over others Primary versus secondary outcomes Hypothesis testing versus hypothesis generating Distinguish between planned and posthoc (after the event) analyses Interpret similar analyses together not in isolation If only one of 11 analyses on a single outcome is significant 12
13 Why Examine subgroups? To confirm an observed treatment effect is consistent across all major subgroups We suspect in advance that certain features may alter the magnitude of the effect, e.g. age, severity of disease, histological type of tumour To identify those for which the treatment does not work To identify groups who benefit from the treatment even when the overall result is not significant To generate hypotheses for future studies 13
14 Subgroup analyses What is the question? Main analysis (e.g. RCT looks for a difference in treatments) give an overall finding Subgroup analysis asks if there is evidence that result (e.g. the treatment effect in a RCT) varies across subgroups Examining each subgroup is misleading Separate tests do not address the right question Multiple tests results in a raised false positive rate Commonly done! Should compare subgroups directly Interaction test 14
15 Example: HIV Vaccine Trial Placebo Vaccine Relative Risk Reduction (95%CI) All volunteers 98/1679 (5.8%) 191/3330 (5.7%) 3.8% (-22.9 to 24.7%) White & Hispanic 81/1508 (5.4%) 179/3003 (6.0%) % (-42.8 to 15.7) Black/Asian/Other 17/171 (9.9%) 12/327 (3.7%) 66.8% (30.2 to 84.2) Black 9/111 (8.1%) 4/203 (2.0%) 78.3% (29.0 to 93.3) Asian 2/20 (10.0%) 2/53 (3.8%) 68.0% ( to 95.5) Other 6/40 (15.0%) 6/71 (8.5%) 46.2% (-67.8 to 82.8)
16 HIV Vaccine Trial This is the first time we have specific numbers to suggest that a vaccine has prevented HIV infection in humans, said Phillip Berman, inventor of the vaccine and senior vice president of Research and Development at VaxGen (Brisbane, CA), the company that is developing the vaccine. We're not sure yet why certain groups have a better immune response, but these preliminary results indicate that a surface protein vaccine that stimulates neutralising antibodies correlates with prevention of infection
17 JAMA headline Lancet headline
18 Missing data & why it occurs Patients lost to follow up are very unlikely to be a random subset of all those randomised as they may fail to return because they feel much better or worse they failed to comply and feel guilty etc. Missing data may introduce bias (and undermine the benefit of randomisation if we have do so) Also leads to a loss of statistical precision 18
19 Missing data & its impact Impact depends on the amount missing Can be large in some contexts, e.g. smoking cessation Credibility will be weakened if many participants are lost to follow up Hence the need to know how complete follow up was Credibility will particularly suffer if loss to follow up is greater in one group 19
20 Missing data in trials Wood et al. Clin Trials 2004
21 Dealing with missing data No fully satisfactory solution Assumptions are needed beyond those needed to analyse full data set All approaches make important assumptions Those assumptions are largely uncheckable Can investigate sensitivity to those assumptions Main options Ignore & conduct complete case analysis Impute 21
22 Imputing Simple imputation All missing values set to the same outcome (e.g. best or worst) Leads to optimistic or pessimistic results for binary outcomes Difficult for continuous data (can use mean or median) Leads to overly-precise results Common simple imputation approaches Best case - worst case Generally not helpful Last value carried forward Popular but problematic More complex regression methods Assume a relationship between missing and observed data Valid analysis if underlying assumptions are correct 22
23 LOCF (1) We have a trial with longitudinal follow-up Observations at 2 or more different times With no dropouts analysis is straightforward Under last observation carried forward (LOCF) Where patients have partial (e.g. dropped out) data we fill in all their missing observations with their last observation We analyse this completed data set as if it was the real data set Simple and popular, but 23
24 LOCF (2) We make the strong assumption that unseen observations equal the last observation seen How plausible? We also ignore uncertainty associated with that assumption Imputed data should show more uncertainty than real data, not less! Method has bad properties Gives biased treatment estimates Direction and size of bias depends on (unknown) true effect Tests are biased (over-optimistic)/confidence intervals wrong coverage 24
25 LOCF (3) Pittler et al. Br J Dermatol 2003
26 The best solutions to missing data Don t have any! Design the trial to maximise completeness of data collection e.g. systems for chasing people Anticipate possibility of missing data when preparing protocol and analysis plan Pre-specify statistical methods Assess sensitivity of result to assumptions 26
27 Analysis General strategy analysis & reporting Decisions about which analyses to do and who to include should be made (AFAP) before viewing data Document reasons for missing data and quantify it Advisable to do analysis on everyone relevant even if good reasons for look at a specific subpopulation Less analysis is more (consider the threat of multiple comparisons) Reporting Always clarify who was included in each analysis Depict key inclusion decisions in a flow diagram Report posthoc as posthoc Interpret similar tests together 27
28 Summary What gets into the analysis affects the validity & credibility of the findings Studies should be designed to minimise missing data Statistical analyses need careful planning Be choosey about analyses (less is more) Report what you did clearly, fully and accurately as intended Not in relation to chance findings 28
29 References Man WD-C, et al. BMJ 2004 Community pulmonary rehabilitation after hospitalisation for acute exacerbations of chronic obstructive pulmonary disease: randomised controlled study. doi: /bmj a. Molnar F, et al. Does analysis using "last observation carried forward" introduce bias in dementia research?, CMAJ (8) Pittler MH, et al. Randomized, double-blind, placebo-controlled trial of autologous blood therapy for atopic dermatitis. Br J Dermatol Feb;148(2): Bender R, Lange S. Adjusting for multiple testing--when and how? J Clin Epidemiol Apr;54(4): Dmitrienko A, et al. General Guidance on Exploratory and Confirmatory Subgroup Analysis in Late-Stage Clinical Trials J Biopharm Stat [Epub ahead of print] 29
Strategies for handling missing data in randomised trials
Strategies for handling missing data in randomised trials NIHR statistical meeting London, 13th February 2012 Ian White MRC Biostatistics Unit, Cambridge, UK Plan 1. Why do missing data matter? 2. Popular
More informationCOMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO CONSIDER ON MISSING DATA
The European Agency for the Evaluation of Medicinal Products Evaluation of Medicines for Human Use London, 15 November 2001 CPMP/EWP/1776/99 COMMITTEE FOR PROPRIETARY MEDICINAL PRODUCTS (CPMP) POINTS TO
More informationMaking comparisons. Previous sessions looked at how to describe a single group of subjects However, we are often interested in comparing two groups
Making comparisons Previous sessions looked at how to describe a single group of subjects However, we are often interested in comparing two groups Data can be interpreted using the following fundamental
More informationAVOIDING BIAS AND RANDOM ERROR IN DATA ANALYSIS
AVOIDING BIAS AND RANDOM ERROR IN DATA ANALYSIS Susan S. Ellenberg, Ph.D. Perelman School of Medicine University of Pennsylvania FDA Clinical Investigator Course Silver Spring, MD November 14, 2018 OVERVIEW
More informationThe role of Randomized Controlled Trials
The role of Randomized Controlled Trials Dr. Georgia Salanti Lecturer in Epidemiology University of Ioannina School of Medicine Outline Understanding study designs and the role of confounding Observational
More informationEvidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co.
Evidence-Based Medicine and Publication Bias Desmond Thompson Merck & Co. Meta-Analysis Defined A meta-analysis is: the statistical combination of two or more separate studies In other words: overview,
More informationShould individuals with missing outcomes be included in the analysis of a randomised trial?
Should individuals with missing outcomes be included in the analysis of a randomised trial? ISCB, Prague, 26 th August 2009 Ian White, MRC Biostatistics Unit, Cambridge, UK James Carpenter, London School
More informationCritical Appraisal. Dave Abbott Senior Medicines Information Pharmacist
Critical Appraisal Dave Abbott Senior Medicines Information Pharmacist Aims Identify key components of clinical trial design and apply these to a critical appraisal of the literature Be able to work out
More informationAssessing risk of bias
Assessing risk of bias Norwegian Research School for Global Health Atle Fretheim Research Director, Norwegian Institute of Public Health Professor II, Uiniversity of Oslo Goal for the day We all have an
More informationSafeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines
Safeguarding public health CHMP's view on multiplicity; through assessment, advice and guidelines Rob Hemmings Statistics Unit Manager, MHRA CHMP member Chair, CHMP Scientific Advice Working Party Biostatistics
More informationSafeguarding public health Subgroup Analyses: Important, Infuriating and Intractable
Safeguarding public health Subgroup Analyses: Important, Infuriating and Intractable The views expressed herein are not necessarily those of MHRA, EMA, EMA committees or their working parties. Rob Hemmings
More informationRecent developments for combining evidence within evidence streams: bias-adjusted meta-analysis
EFSA/EBTC Colloquium, 25 October 2017 Recent developments for combining evidence within evidence streams: bias-adjusted meta-analysis Julian Higgins University of Bristol 1 Introduction to concepts Standard
More informationThresholds for statistical and clinical significance in systematic reviews with meta-analytic methods
Jakobsen et al. BMC Medical Research Methodology 2014, 14:120 CORRESPONDENCE Open Access Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods Janus Christian
More informationModule 14: Missing Data Concepts
Module 14: Missing Data Concepts Jonathan Bartlett & James Carpenter London School of Hygiene & Tropical Medicine Supported by ESRC grant RES 189-25-0103 and MRC grant G0900724 Pre-requisites Module 3
More informationHelp! Statistics! Missing data. An introduction
Help! Statistics! Missing data. An introduction Sacha la Bastide-van Gemert Medical Statistics and Decision Making Department of Epidemiology UMCG Help! Statistics! Lunch time lectures What? Frequently
More informationCONSORT 2010 Statement Annals Internal Medicine, 24 March History of CONSORT. CONSORT-Statement. Ji-Qian Fang. Inadequate reporting damages RCT
CONSORT-Statement Guideline for Reporting Clinical Trial Ji-Qian Fang School of Public Health Sun Yat-Sen University Inadequate reporting damages RCT The whole of medicine depends on the transparent reporting
More informationCONSORT 2010 checklist of information to include when reporting a randomised trial*
CONSORT 2010 checklist of information to include when reporting a randomised trial* Section/Topic Title and abstract Introduction Background and objectives Item No Checklist item 1a Identification as a
More informationTreatment changes in cancer clinical trials: design and analysis
Treatment changes in cancer clinical trials: design and analysis Ian White Statistical methods and designs in clinical oncology Paris, 9 th November 2017 Plan 1. Treatment changes
More informationBiostatistics 3. Developed by Pfizer. March 2018
BROUGHT TO YOU BY Biostatistics 3 Developed by Pfizer March 2018 This learning module is intended for UK healthcare professionals only. Job bag: PP-GEP-GBR-0986 Date of preparation March 2018. Agenda I.
More informationCHAMP: CHecklist for the Appraisal of Moderators and Predictors
CHAMP - Page 1 of 13 CHAMP: CHecklist for the Appraisal of Moderators and Predictors About the checklist In this document, a CHecklist for the Appraisal of Moderators and Predictors (CHAMP) is presented.
More informationPractical Statistical Reasoning in Clinical Trials
Seminar Series to Health Scientists on Statistical Concepts 2011-2012 Practical Statistical Reasoning in Clinical Trials Paul Wakim, PhD Center for the National Institute on Drug Abuse 10 January 2012
More informationExperimental and Quasi-Experimental designs
External Validity Internal Validity NSG 687 Experimental and Quasi-Experimental designs True experimental designs are characterized by three "criteria for causality." These are: 1) The cause (independent
More informationGlossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha
Glossary From Running Randomized Evaluations: A Practical Guide, by Rachel Glennerster and Kudzai Takavarasha attrition: When data are missing because we are unable to measure the outcomes of some of the
More informationRevised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials
Revised Cochrane risk of bias tool for randomized trials (RoB 2.0) Additional considerations for cross-over trials Edited by Julian PT Higgins on behalf of the RoB 2.0 working group on cross-over trials
More informationSystematic Reviews. Simon Gates 8 March 2007
Systematic Reviews Simon Gates 8 March 2007 Contents Reviewing of research Why we need reviews Traditional narrative reviews Systematic reviews Components of systematic reviews Conclusions Key reference
More informationCHL 5225 H Advanced Statistical Methods for Clinical Trials. CHL 5225 H The Language of Clinical Trials
CHL 5225 H Advanced Statistical Methods for Clinical Trials Two sources for course material 1. Electronic blackboard required readings 2. www.andywillan.com/chl5225h code of conduct course outline schedule
More informationThe Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016
The Logic of Data Analysis Using Statistical Techniques M. E. Swisher, 2016 This course does not cover how to perform statistical tests on SPSS or any other computer program. There are several courses
More informationDesigning and Analyzing RCTs. David L. Streiner, Ph.D.
Designing and Analyzing RCTs David L. Streiner, Ph.D. Emeritus Professor, Department of Psychiatry & Behavioural Neurosciences, McMaster University Emeritus Professor, Department of Clinical Epidemiology
More informationMaintenance of weight loss and behaviour. dietary intervention: 1 year follow up
Institute of Psychological Sciences FACULTY OF MEDICINE AND HEALTH Maintenance of weight loss and behaviour change Dropouts following and a 12 Missing week healthy Data eating dietary intervention: 1 year
More informationGLOSSARY OF GENERAL TERMS
GLOSSARY OF GENERAL TERMS Absolute risk reduction Absolute risk reduction (ARR) is the difference between the event rate in the control group (CER) and the event rate in the treated group (EER). ARR =
More informationChapter 5: Field experimental designs in agriculture
Chapter 5: Field experimental designs in agriculture Jose Crossa Biometrics and Statistics Unit Crop Research Informatics Lab (CRIL) CIMMYT. Int. Apdo. Postal 6-641, 06600 Mexico, DF, Mexico Introduction
More informationCochrane Pregnancy and Childbirth Group Methodological Guidelines
Cochrane Pregnancy and Childbirth Group Methodological Guidelines [Prepared by Simon Gates: July 2009, updated July 2012] These guidelines are intended to aid quality and consistency across the reviews
More informationSurveillance report Published: 6 April 2016 nice.org.uk. NICE All rights reserved.
Surveillance report 2016 Chronic obstructive pulmonary disease in over 16s: diagnosis and management (2010) NICE guideline CG101 Surveillance report Published: 6 April 2016 nice.org.uk NICE 2016. All rights
More informationThe comparison or control group may be allocated a placebo intervention, an alternative real intervention or no intervention at all.
1. RANDOMISED CONTROLLED TRIALS (Treatment studies) (Relevant JAMA User s Guides, Numbers IIA & B: references (3,4) Introduction: The most valid study design for assessing the effectiveness (both the benefits
More informationCEU screening programme: Overview of common errors & good practice in Cochrane intervention reviews
CEU screening programme: Overview of common errors & good practice in Cochrane intervention reviews Since September 2013, the CEU has been responsible for pre-publication screening of new intervention
More informationFundamental Clinical Trial Design
Design, Monitoring, and Analysis of Clinical Trials Session 1 Overview and Introduction Overview Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington February 17-19, 2003
More informationPLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity
PLS 506 Mark T. Imperial, Ph.D. Lecture Notes: Reliability & Validity Measurement & Variables - Initial step is to conceptualize and clarify the concepts embedded in a hypothesis or research question with
More informationLecture 5 Conducting Interviews and Focus Groups
Lecture 5 Conducting Interviews and Focus Groups Talking to participants enables in-depth information about the experiences of health and illness; and of factors that influence health and illness behaviour
More informationINTERVAL trial Statistical analysis plan for principal paper
INTERVAL trial Statistical analysis plan for principal paper 8 January 2016, final agreed version Compiled by Simon Thompson, on behalf of the INTERVAL Trial Steering Committee 1. Aim The purpose of this
More informationAppendix 1. Sensitivity analysis for ACQ: missing value analysis by multiple imputation
Appendix 1 Sensitivity analysis for ACQ: missing value analysis by multiple imputation A sensitivity analysis was carried out on the primary outcome measure (ACQ) using multiple imputation (MI). MI is
More informationDRAFT (Final) Concept Paper On choosing appropriate estimands and defining sensitivity analyses in confirmatory clinical trials
DRAFT (Final) Concept Paper On choosing appropriate estimands and defining sensitivity analyses in confirmatory clinical trials EFSPI Comments Page General Priority (H/M/L) Comment The concept to develop
More informationProtocol Development: The Guiding Light of Any Clinical Study
Protocol Development: The Guiding Light of Any Clinical Study Susan G. Fisher, Ph.D. Chair, Department of Clinical Sciences 1 Introduction Importance/ relevance/ gaps in knowledge Specific purpose of the
More informationModels for potentially biased evidence in meta-analysis using empirically based priors
Models for potentially biased evidence in meta-analysis using empirically based priors Nicky Welton Thanks to: Tony Ades, John Carlin, Doug Altman, Jonathan Sterne, Ross Harris RSS Avon Local Group Meeting,
More informationP values From Statistical Design to Analyses to Publication in the Age of Multiplicity
P values From Statistical Design to Analyses to Publication in the Age of Multiplicity Ralph B. D Agostino, Sr. PhD Boston University Statistics in Medicine New England Journal of Medicine March 2, 2017
More informationAn introduction to power and sample size estimation
453 STATISTICS An introduction to power and sample size estimation S R Jones, S Carley, M Harrison... Emerg Med J 2003;20:453 458 The importance of power and sample size estimation for study design and
More informationHow to craft the Approach section of an R grant application
How to craft the Approach section of an R grant application David Elashoff, PhD Professor of Medicine and Biostatistics Director, Department of Medicine Statistics Core Leader, CTSI Biostatistics Program
More informationWhy published medical research may not be good for your health
Why published medical research may not be good for your health Doug Altman EQUATOR Network and Centre for Statistics in Medicine University of Oxford 2 Reliable evidence Clinical practice and public health
More informationICH E9(R1) Technical Document. Estimands and Sensitivity Analysis in Clinical Trials STEP I TECHNICAL DOCUMENT TABLE OF CONTENTS
ICH E9(R1) Technical Document Estimands and Sensitivity Analysis in Clinical Trials STEP I TECHNICAL DOCUMENT TABLE OF CONTENTS A.1. Purpose and Scope A.2. A Framework to Align Planning, Design, Conduct,
More informationSafeguarding public health Subgroup analyses scene setting from the EU regulators perspective
Safeguarding public health Subgroup analyses scene setting from the EU regulators perspective The views expressed herein are not necessarily those of MHRA, EMA, EMA committees or their working parties.
More informationMeasuring impact. William Parienté UC Louvain J PAL Europe. povertyactionlab.org
Measuring impact William Parienté UC Louvain J PAL Europe povertyactionlab.org Course overview 1. What is evaluation? 2. Measuring impact 3. Why randomize? 4. How to randomize 5. Sampling and Sample Size
More informationExperimental Design. Terminology. Chusak Okascharoen, MD, PhD September 19 th, Experimental study Clinical trial Randomized controlled trial
Experimental Design Chusak Okascharoen, MD, PhD September 19 th, 2016 Terminology Experimental study Clinical trial Randomized controlled trial 1 PHASES OF CLINICAL TRIALS Phase I: First-time-in-man studies
More informationLive WebEx meeting agenda
10:00am 10:30am Using OpenMeta[Analyst] to extract quantitative data from published literature Live WebEx meeting agenda August 25, 10:00am-12:00pm ET 10:30am 11:20am Lecture (this will be recorded) 11:20am
More informationClinical Trials. Susan G. Fisher, Ph.D. Dept. of Clinical Sciences
Clinical Trials Susan G. Fisher, Ph.D. Dept. of Clinical Sciences When to Do a RCT Exposure of interest is modifiable and individuals are willing to relinquish control Legitimate uncertainty exists about
More informationINTRODUCTION TO EPIDEMIOLOGICAL STUDY DESIGNS PHUNLERD PIYARAJ, MD., MHS., PHD.
INTRODUCTION TO EPIDEMIOLOGICAL STUDY DESIGNS PHUNLERD PIYARAJ, MD., MHS., PHD. 1 OBJECTIVES By the end of this section, you will be able to: Provide a definition of epidemiology Describe the major types
More informationDiscussion Meeting for MCP-Mod Qualification Opinion Request. Novartis 10 July 2013 EMA, London, UK
Discussion Meeting for MCP-Mod Qualification Opinion Request Novartis 10 July 2013 EMA, London, UK Attendees Face to face: Dr. Frank Bretz Global Statistical Methodology Head, Novartis Dr. Björn Bornkamp
More informationVALIDITY OF QUANTITATIVE RESEARCH
Validity 1 VALIDITY OF QUANTITATIVE RESEARCH Recall the basic aim of science is to explain natural phenomena. Such explanations are called theories (Kerlinger, 1986, p. 8). Theories have varying degrees
More informationBiases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University
Biases in clinical research Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Learning objectives Describe the threats to causal inferences in clinical studies Understand the role of
More informationChecklist for appraisal of study relevance (child sex offenses)
Appendix 3 Evaluation protocols. [posted as supplied by author] Checklist for appraisal of study relevance (child sex offenses) First author, year, reference number Relevance Yes No Cannot answer Not applicable
More informationCritical Appraisal Practicum. Fabio Di Bello Medical Implementation Manager
Critical Appraisal Practicum Fabio Di Bello Medical Implementation Manager fdibello@ebsco.com What we ll talk about today: DynaMed process for appraising randomized trials and writing evidence summaries
More informationThis article is the second in a series in which I
COMMON STATISTICAL ERRORS EVEN YOU CAN FIND* PART 2: ERRORS IN MULTIVARIATE ANALYSES AND IN INTERPRETING DIFFERENCES BETWEEN GROUPS Tom Lang, MA Tom Lang Communications This article is the second in a
More informationPlacebo and Belief Effects: Optimal Design for Randomized Trials
Placebo and Belief Effects: Optimal Design for Randomized Trials Scott Ogawa & Ken Onishi 2 Department of Economics Northwestern University Abstract The mere possibility of receiving a placebo during a
More informationBayesian and Frequentist Approaches
Bayesian and Frequentist Approaches G. Jogesh Babu Penn State University http://sites.stat.psu.edu/ babu http://astrostatistics.psu.edu All models are wrong But some are useful George E. P. Box (son-in-law
More informationPatrick Breheny. January 28
Confidence intervals Patrick Breheny January 28 Patrick Breheny Introduction to Biostatistics (171:161) 1/19 Recap Introduction In our last lecture, we discussed at some length the Public Health Service
More informationMissing data in clinical trials: making the best of what we haven t got.
Missing data in clinical trials: making the best of what we haven t got. Royal Statistical Society Professional Statisticians Forum Presentation by Michael O Kelly, Senior Statistical Director, IQVIA Copyright
More informationBEST PRACTICES FOR IMPLEMENTATION AND ANALYSIS OF PAIN SCALE PATIENT REPORTED OUTCOMES IN CLINICAL TRIALS
BEST PRACTICES FOR IMPLEMENTATION AND ANALYSIS OF PAIN SCALE PATIENT REPORTED OUTCOMES IN CLINICAL TRIALS Nan Shao, Ph.D. Director, Biostatistics Premier Research Group, Limited and Mark Jaros, Ph.D. Senior
More informationMethods of Randomization Lupe Bedoya. Development Impact Evaluation Field Coordinator Training Washington, DC April 22-25, 2013
Methods of Randomization Lupe Bedoya Development Impact Evaluation Field Coordinator Training Washington, DC April 22-25, 2013 Content 1. Important Concepts 2. What vs. Why 3. Some Practical Issues 4.
More informationThe ROBINS-I tool is reproduced from riskofbias.info with the permission of the authors. The tool should not be modified for use.
Table A. The Risk Of Bias In Non-romized Studies of Interventions (ROBINS-I) I) assessment tool The ROBINS-I tool is reproduced from riskofbias.info with the permission of the auths. The tool should not
More informationStatistical Analysis Plans
Statistical Analysis Plans PROFESSOR CARROL GAMBLE UNIVERSITY OF LIVERPOOL Clinical Trials Lots of different types of clinical trials Various interventions Pharmaceutical/drugs regulated Regulated environment
More informationThe QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews
The QUOROM Statement: revised recommendations for improving the quality of reports of systematic reviews David Moher 1, Alessandro Liberati 2, Douglas G Altman 3, Jennifer Tetzlaff 1 for the QUOROM Group
More informationMeasurement and meaningfulness in Decision Modeling
Measurement and meaningfulness in Decision Modeling Brice Mayag University Paris Dauphine LAMSADE FRANCE Chapter 2 Brice Mayag (LAMSADE) Measurement theory and meaningfulness Chapter 2 1 / 47 Outline 1
More informationDetermining the size of a vaccine trial
17th Advanced Vaccinology Course Annecy 26 th May 2016 Determining the size of a vaccine trial Peter Smith London School of Hygiene & Tropical Medicine Purposes of lecture Introduce concepts of statistical
More informationHIV Vaccine Trials. 1. Does vaccine prevent HIV infection? Vaccine Efficacy (VE) = 1 P(infected vaccine) P(infected placebo)
HIV Vaccine Trials 1. Does vaccine prevent HIV infection? Vaccine Efficacy (VE) = 1 P(infected vaccine) P(infected placebo) 2. What is vaccine s impact on post-infection outcomes? Viral load, CD4 count,
More informationThe RoB 2.0 tool (individually randomized, cross-over trials)
The RoB 2.0 tool (individually randomized, cross-over trials) Study design Randomized parallel group trial Cluster-randomized trial Randomized cross-over or other matched design Specify which outcome is
More informationSTATISTICAL CONCLUSION VALIDITY
Validity 1 The attached checklist can help when one is evaluating the threats to validity of a study. VALIDITY CHECKLIST Recall that these types are only illustrative. There are many more. INTERNAL VALIDITY
More informationMethods for Computing Missing Item Response in Psychometric Scale Construction
American Journal of Biostatistics Original Research Paper Methods for Computing Missing Item Response in Psychometric Scale Construction Ohidul Islam Siddiqui Institute of Statistical Research and Training
More informationTypes of Data. Systematic Reviews: Data Synthesis Professor Jodie Dodd 4/12/2014. Acknowledgements: Emily Bain Australasian Cochrane Centre
Early Nutrition Workshop, December 2014 Systematic Reviews: Data Synthesis Professor Jodie Dodd 1 Types of Data Acknowledgements: Emily Bain Australasian Cochrane Centre 2 1 What are dichotomous outcomes?
More informationClinical research in AKI Timing of initiation of dialysis in AKI
Clinical research in AKI Timing of initiation of dialysis in AKI Josée Bouchard, MD Krescent Workshop December 10 th, 2011 1 Acute kidney injury in ICU 15 25% of critically ill patients experience AKI
More informationAnalysis methods for improved external validity
Analysis methods for improved external validity Elizabeth Stuart Johns Hopkins Bloomberg School of Public Health Department of Mental Health Department of Biostatistics www.biostat.jhsph.edu/ estuart estuart@jhsph.edu
More informationEFFECTIVE MEDICAL WRITING Michelle Biros, MS, MD Editor-in -Chief Academic Emergency Medicine
EFFECTIVE MEDICAL WRITING Michelle Biros, MS, MD Editor-in -Chief Academic Emergency Medicine Why We Write To disseminate information To share ideas, discoveries, and perspectives to a broader audience
More informationHealth authorities are asking for PRO assessment in dossiers From rejection to recognition of PRO
UNDERSTANDING AND ADDRESSING POTENTIAL BIAS IN PATIENT-REPORTED OUTCOMES FROM CLINICAL TRIALS ISPOR Barcelona Workshop Tuesday 13 November 14:00-15:00 Prof. Olivier Chassany EA 7334, Patient-Centered Outcomes
More informationAdvanced IPD meta-analysis methods for observational studies
Advanced IPD meta-analysis methods for observational studies Simon Thompson University of Cambridge, UK Part 4 IBC Victoria, July 2016 1 Outline of talk Usual measures of association (e.g. hazard ratios)
More informationReporting and dealing with missing quality of life data in RCTs: has the picture changed in the last decade?
Qual Life Res (2016) 25:2977 2983 DOI 10.1007/s11136-016-1411-6 REVIEW Reporting and dealing with missing quality of life data in RCTs: has the picture changed in the last decade? S. Fielding 1 A. Ogbuagu
More informationPrinciples and Methods of Intervention Research
Principles and Methods of Intervention Research NVVO, February 2, 2009 Jan G.P. Tijssen, Ph.D. Academic Medical Center - University of Amsterdam Introduction Pathophysiologic and pharmacological insight
More informationTo evaluate a single epidemiological article we need to know and discuss the methods used in the underlying study.
Critical reading 45 6 Critical reading As already mentioned in previous chapters, there are always effects that occur by chance, as well as systematic biases that can falsify the results in population
More informationStatistical Power Sampling Design and sample Size Determination
Statistical Power Sampling Design and sample Size Determination Deo-Gracias HOUNDOLO Impact Evaluation Specialist dhoundolo@3ieimpact.org Outline 1. Sampling basics 2. What do evaluators do? 3. Statistical
More informationLecture Outline. Biost 590: Statistical Consulting. Stages of Scientific Studies. Scientific Method
Biost 590: Statistical Consulting Statistical Classification of Scientific Studies; Approach to Consulting Lecture Outline Statistical Classification of Scientific Studies Statistical Tasks Approach to
More informationFixed Effect Combining
Meta-Analysis Workshop (part 2) Michael LaValley December 12 th 2014 Villanova University Fixed Effect Combining Each study i provides an effect size estimate d i of the population value For the inverse
More informationSupplementary Online Content
Supplementary Online Content Chang AK, Bijur PE, Esses D, Barnaby DP, Baer J. Effect of a single dose of oral opioid and nonopioid analgesics on acute extremity pain in the emergency department: a randomized
More informationFrom single studies to an EBM based assessment some central issues
From single studies to an EBM based assessment some central issues Doug Altman Centre for Statistics in Medicine, Oxford, UK Prognosis Prognosis commonly relates to the probability or risk of an individual
More informationEvidence Informed Practice Online Learning Module Glossary
Term Abstract Associations Attrition Bias Background and Significance Baseline Basic Science Bias Blinding Definition An abstract is a summary of a research article. It usually includes the purpose, methods,
More informationCritical Appraisal Istanbul 2011
Critical Appraisal Istanbul 2011 The Conviction with which many Nephrologists hold an opinion varies inversely with the Evidence Ed Lewis The Good Old Times. The Google Generation. ASN Kidney Daily LEADING
More informationEvaluating and Interpreting Clinical Trials
Article #2 CE Evaluating and Interpreting Clinical Trials Dorothy Cimino Brown, DVM, DACVS University of Pennsylvania ABSTRACT: For the practicing veterinarian, selecting the best treatment for patients
More informationBios 6648: Design & conduct of clinical research
Bios 6648: Design & conduct of clinical research Section 1 - Specifying the study setting and objectives 1. Specifying the study setting and objectives Where will we end up?: (a) The treatment indication
More informationGuidelines for Reporting Non-Randomised Studies
Revised and edited by Renatus Ziegler B.C. Reeves a W. Gaus b a Department of Public Health and Policy, London School of Hygiene and Tropical Medicine, Great Britain b Biometrie und Medizinische Dokumentation,
More information10 Intraclass Correlations under the Mixed Factorial Design
CHAPTER 1 Intraclass Correlations under the Mixed Factorial Design OBJECTIVE This chapter aims at presenting methods for analyzing intraclass correlation coefficients for reliability studies based on a
More informationSTUDIES OF THE ACCURACY OF DIAGNOSTIC TESTS: (Relevant JAMA Users Guide Numbers IIIA & B: references (5,6))
STUDIES OF THE ACCURACY OF DIAGNOSTIC TESTS: (Relevant JAMA Users Guide Numbers IIIA & B: references (5,6)) Introduction: The most valid study design for assessing the accuracy of diagnostic tests is a
More informationEPSE 594: Meta-Analysis: Quantitative Research Synthesis
EPSE 594: Meta-Analysis: Quantitative Research Synthesis Ed Kroc University of British Columbia ed.kroc@ubc.ca March 14, 2019 Ed Kroc (UBC) EPSE 594 March 14, 2019 1 / 39 Last Time Synthesizing multiple
More informationRapid appraisal of the literature: Identifying study biases
Rapid appraisal of the literature: Identifying study biases Rita Popat, PhD Clinical Assistant Professor Division of Epidemiology Stanford University School of Medicine August 7, 2007 What is critical
More informationGetting ready for propensity score methods: Designing non-experimental studies and selecting comparison groups
Getting ready for propensity score methods: Designing non-experimental studies and selecting comparison groups Elizabeth A. Stuart Johns Hopkins Bloomberg School of Public Health Departments of Mental
More informationLecture Outline Biost 517 Applied Biostatistics I
Lecture Outline Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 2: Statistical Classification of Scientific Questions Types of
More information