Some Recent OMOP Research Results
|
|
- Robyn Payne
- 5 years ago
- Views:
Transcription
1 OBSERVATIONAL Some Recent OMOP Research Results William DuMouchel on behalf of the OMOP research team MidWest Biopharmaceutical Statistics Workshop Muncie, IN 21 May 2013
2 Agenda Overview of OMOP publications of the last year with focus on three papers Explanation and Example of OMOP Proposal: An Empirical Approach to Measuring and Calibrating for Error in Observational Analyses 2
3 OMOP Publications ( ) Madigan D, Ryan PB, Schuemie M, Stang PE, Overhage JM, Hartzema AG, et al. Evaluating the Impact of Database Heterogeneity on Observational Study Results. American journal of epidemiology. May 5, Fox BI, Hollingsworth JC, Gray MD, Hollingsworth ML, Gao J, Hansen RA. Developing an expert panel process to refine health outcome definitions in observational data. Journal of Biomedical Informatics. 2013: In press. Ryan PB, Suchard MA, Schuemie M & Madigan D (2013): Learning from Epidemiology: Interpreting Observational Database Studies for the Effects of Medical Products, Statistics in Biopharmaceutical Research, DOI: / Madigan D, Ryan PB, Schuemie M. Does design matter? Systematic evaluation of the impact of analytical choices on effect estimates in observational studies. Therapeutic Advances in Drug Safety. February 25, Hansen RA, Gray M, Fox BI, Hollingsworth J, Gao J, Hollingsworth M, Carpenter DM. Expert panel assessment of acute liver injury identification in observational data. Research in Social and Administrative Pharmacy 2012 (in press). Statistical Methods in Medical Research. February 2013; 22 (1). Special Issue: Effectiveness Research. Guest editors: Xiaochun Li, Lingling Li and Patrick Ryan. Suchard MA, Simpson SE, Zorych I, Ryan P, Madigan D. Massive Parallelization of Serial Inference Algorithms for a Complex Generalized Linear Model. ACM Trans Model Comput Simul. 2013;23(1):1-17. Ryan, P. B. (2012). Using exploratory visualization in the analysis of medical product safety in observational healthcare data. In A. Krause & M. O Connell (Eds.), A picture is worth a thousand tables: Graphics in life sciences (pp ). New York, New York: Springer-Verlag. Ryan PB, Madigan D, Stang PE, Overhage JM, Racoosin JA and Hartzema AG. (2012), Empirical assessment of methods for risk identification in healthcare data: results from the experiments of the Observational Medical Outcomes Partnership. Statist. Med. doi: /sim Reich C, Ryan PB, Stang PE, Rocca M. Evaluation of alternative standardized terminologies for medical conditions within a network of observational healthcare databases. Journal of Biomedical Informatics 2012; 45: Page D, Santos Costa V, Natarajan S, Barnard A, Peissig P, and Caldwell M. Identifying adverse drug events by relational learning. In AAAI-12, pages , Toronto, Harpaz R, DuMouchel W, Shah NH, Madigan D, Ryan P, Friedman C. Novel Data-Mining Methodologies for Adverse Drug Event Discovery and Analysis. Clinical Pharmacology & Therapeutics (2 May 2012) 3
4 Publications of Interest ( ) Zhou, X., Murugesan, S., Bhullar, H., Liu, Q., Cai, B., Wentworth, C., Bate A. (2013) An Evaluation of the Thin Database in the Omop Common Data Model for Active Drug Safety Surveillance. Drug Safety: DOI: /s DeFalco F, Ryan P, Soledad Cepeda M (2012) Applying standardized drug terminologies to observational healthcare databases: a case study on opioid exposure. Health Services and Outcomes Research Methodology: DOI /s Harpaz R, Vilar S, DuMouchel W, Salmasian H, Haerian K, et al. (2013) Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactions. J Am Med Inform Assoc 2013;20: Kahn MG, Batson D, Schilling LM (2012) Data model considerations for clinical effectiveness researchers. Med Care 50 Suppl: S Kahn MG, Raebel MA, Glanz JM, Riedlinger K, Steiner JF (2012) A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. Med Care 50 Suppl: S Schuemie MJ, Coloma PM, Straatman H, Herings RM, Trifiro G, et al. (2012) Using Electronic Health Care Records for Drug Safety Signal Detection: A Comparative Evaluation of Statistical Methods. Med Care. Platt, R. and Carnahan, R. (2012), The U.S. Food and Drug Administration's Mini-Sentinel Program. Pharmacoepidem. Drug Safe., 21: doi: /pds.3230 Robb, M. A., Racoosin, J. A., Sherman, R. E., Gross, T. P., Ball, R., Reichman, M. E., Midthun, K. and Woodcock, J. (2012), The US Food and Drug Administration's Sentinel Initiative: Expanding the horizons of medical product safety. Pharmacoepidem. Drug Safe., 21: doi: /pds.2311 Curtis, L. H., Weiner, M. G., Boudreau, D. M., Cooper, W. O., Daniel, G. W., Nair, V. P., Raebel, M. A., Beaulieu, N. U., Rosofsky, R., Woodworth, T. S. and Brown, J. S. (2012), Design considerations, architecture, and use of the Mini-Sentinel distributed data system. Pharmacoepidem. Drug Safe., 21: doi: /pds
5 Review Paper: Harpaz R, DuMouchel W, Shah NH, Madigan D, Ryan P, Friedman C. Novel Data-Mining Methodologies for Adverse Drug Event Discovery and Analysis. Clinical Pharmacology & Therapeutics (2 May 2012) Growth of Pharmaco- Vigilance Data Mining Literature 5
6 Analyses of Spontaneous Reports Enhancements: Bayesian Shrinkage Covariate Adjustments Drug Interactions Concomitant Drugs 6
7 Claims Records and EHRs Designs: Cohort, Case-Control, Self-Controlled, Many variations on each basic design 7
8 Non-Standard Data Sources Quantitative Structure Activity Relationship (QSAR) models Matthews et al. from the FDA CDER Commercial QSAR software applied to drug candidates from AERS DPAs Separate QSAR models for several Cardiac, Liver and Urinary ADRs Reported 78% Specificity and 56% Sensitivity PubChem Assays: National Center for Biotechnology Information 487,000 drug activity screens vs Canadian ADR database Pouliot, Chiang and Butte (Clin. Pharm. Ther. 90) Use Logistic Regression Reported 75% Specificity when compared to literature or drug labels Biomedical Literature: NLP Analyses Focusing on Drug-AE Pairs Shetty and Dalal, J. Am. Med. Inf. Ass. 18 report 70% sensitivity, 40% PPV User-Generated Content in Health Forums Leaman et al, Proc 2010 Wkshp Biomed Nat Lang Process Web crawler, NLP extracts ADR clinical concepts: 78% precision, 70% recall 8
9 Harpaz R, Vilar S, DuMouchel W, Salmasian H, Haerian K, et al. (2013) Combining signals from spontaneous reports and electronic health records for detection of adverse drug reactions. J Amer Med Inform Assoc Objective Data-mining algorithms that can produce accurate signals of potentially novel adverse drug reactions (ADRs) are a central component of pharmacovigilance. We propose a signaldetection strategy that combines the adverse event reporting system (AERS) of the Food and Drug Administration and electronic health records (EHRs) by requiring signaling in both sources. We claim that this approach leads to improved accuracy of signal detection when the goal is to produce a highly selective ranked set of candidate ADRs. Materials and methods Our investigation was based on over 4 million AERS reports and information extracted from 1.2 million EHR narratives. Well-established methodologies were used to generate signals from each source. The study focused on ADRs related to three high-profile serious adverse reactions. A reference standard of over 600 established and plausible ADRs was created and used to evaluate the proposed approach against a comparator. Results The combined signaling system achieved a statistically significant large improvement over AERS (baseline) in the precision of top ranked signals. The average improvement ranged from 31% to almost threefold for different evaluation categories. Using this system, we identified a new association between the agent, rasburicase, and the adverse event, acute pancreatitis, which was supported by clinical review. Conclusions The results provide promising initial evidence that combining AERS with EHRs via the framework of replicated signaling can improve the accuracy of signal detection for certain operating scenarios. The use of additional EHR data is required to further evaluate the capacity and limits of this system and to extend the generalizability of these results. 9
10 Comparing the Top K Signals from 2 Methods AERS alone using MGPS Minimum of AERS and EHR Signal Scores Using both gives much better Positive Predictive Values 10
11 Empirical Bayes to Combine Signals Outcome AERS Relative Healthcare Combined Improvement Acute Renal Failure % Upper GI Bleed % Acute Liver Injury % Acute Myocardial Infarction % Average %
12 Madigan, Ryan, Schuemie, Stang, Overhage, Hartzema et al. Evaluating the Impact of Database Heterogeneity on Observational Study Results. American journal of epidemiology. May 5, 2013 Studies of the same issue in different databases can and do generate different results, sometimes with strikingly different clinical implications. Relative risk estimates for 53 drug-outcome pairs 2 study designs (cohort studies and self-controlled case series) 10 observational databases Wildly discordant estimates across the 10 databases Statistically significant decreased risk to a statistically significant increased risk 11 of 53 (21%) of drug-outcome pairs that use a cohort design 19 of 53 (36%) of drug-outcome pairs that use a self-controlled case series design Consistent estimates (both direction and significance) across the 10 DBs 9 of 53 drug-outcome pairs (17%) for cohort studies 5 of 53 drug-outcome pairs (9%) for self-controlled case series Observational studies can be sensitive to the choice of database. More attention needs to be paid to this issue! 12
13 An Empirical Approach to Measuring and Calibrating for Error in Observational Analyses A proposal based on the 2012 OMOP experiments Initial review established a gold standard of 400 drug-event pairs with established positive or negative standing as to causality Restricted to four health outcomes of interest Acute kidney injury Acute liver injury Acute myocardial infarction GI bleed Extensive methodological experimentation Study bias and variability of estimation across drug-event pairs, estimation methods, real databases and simulations 13
14 OMOP 2012 Experiments
15 Consider a typical observational database study: Exploring clopidogrel and upper gastrointestinal bleeding Error = distance from the point estimate to the true effect How far away from truth is RR=2.07? Bias = expected value of the error distribution When applying this type of analysis to this type of data for this type of outcome, how far on average is the estimate from the true value? Coverage = probability that true effect is contained within confidence interval When applying this type of analysis to this type of data for this type of outcome, do the 95% confidence intervals (1.66 to 2.58 in this case) actually contain the true relative risk 95% of the time? p<
16 Learning from what's already known Their recommendation: Use 3-4 negative controls, in addition to target outcome, as a means of assessing the plausibility of an observational analysis result Our recommendation: Use a large sample of negative (and positive) controls to empirically measure analysis operating characteristics and use them to calibrate your study finding 16
17 OMOP approach to methodological research Develop a standardized implementation of the analysis strategy Study design: Case-control Nesting within indication (unstable angina) Case definition: First episode of upper GI hemorrhage 10 controls per case, matched on age, gender, and index date Exposure definition: Length of exposure + 30d Exclusion criteria: <180d of observation before case Systematically apply the analysis across a network of databases, consistently for a large sample of positive and negative controls GI Bleeding: 24 positive controls, 67 negative controls Standard approach yields similar results as initial study: Opatrny 2008 in CRPD: 2.07 (1.66, 2.58) OMOP 2012 in CCAE: 1.86 (1.79, 1.93) Criteria for negative controls: Event not listed anywhere in any section of active FDA structured product label Drug not listed as causative agent in Tisdale et al, 2010: Drug-Induced Diseases Literature review identified no evidence of potential positive association Record all effect estimates (RR, CI) from all analysis-database-drugoutcome combinations and summarize analysis*database performance If we assume drugs identified as negative controls truly have no effect on outcome, then we can assume true RR = 1 as a basis for measuring error 17
18 Case-control estimates for GI bleed negative controls CC: , CCAE, GI Bleed If 95% confidence interval was properly calibrated, then 95%*65 = 62 of the estimates should cover RR = 1 We observed 29 of negative controls did cover RR=1 Estimated coverage probability = 29 / 65 = 45% Positive tendency: 74% of estimates have RR>1 Error distribution demonstrates positive bias (expected value > 1) and substantial variability 18
19 Measures of accuracy used in OMOP s evaluations Bias expected difference between true RR and estimated RR Mean squared error sum of variance and squared bias of the estimated RR Coverage probability - % of drugs where true RR is contained within estimated 95% confidence interval Real data: negative controls, assume true RR = 1 Can t use positive controls in real data if you don t know true RR Simulated data: positive controls, inject true RR = 1, 1.25, 1.5, 2, 4, 10 Discrimination (AUC) probability that estimate can distinguish between no effect and positive effect AUC can use any rank-order statistic (RR, p-value) AUC only assumes true RR should be bigger for positive controls than negative controls Can be/has been studied in both real and simulated data Sensitivity/specificity expected operating characteristics of a procedure at a defined decision threshold Decision threshold can be any dichotomous criteria (ex: RR>2, p<0.05, LBRR>1.5) Sensitivity - % of positive controls that meet decision threshold Specificity - % of negative controls that do not meet decision threshold Can set desired sensitivity or specificity to determine decision threshold Can be/has been studied in both real and simulated data 19
20 Comparing accuracy of cohort and self-controlled designs Data: MarketScan Medicare Supplemental Beneficiaries (MDCR) HOI: GI Bleeding broad definition Discrimination Error Coverage CM: New user cohort, propensity score stratification, with active comparator (drugs known to be negative controls for outcome) Bias: MSE: 0.31 Mean SE: 0.10 SCCS: Multivariate selfcontrolled case series, including all events, and defining time-at-risk as all-time post-exposure Observation: Analyses have different error distributions, but all methods have low coverage probability OS: Self-controlled cohort design, including all exposures and outcomes, defining time-at-risk and control time as length of exposure + 30d Potential solution: empirical calibration to adjust estimate/standard error for observed bias and residual error Bias: MSE: 0.31 Mean SE: 0.03 Bias: MSE: 0.22 Mean SE: 0.05
21 Case-control estimates for GI bleed negative controls Using theoretical null: 55% have p <.05 Using empirical null: 6% have p <.05 CC: , CCAE, GI Bleed Intuition for empirical calibration: You can use empirical null to adjust original estimate by shifting for bias and stretching for variance in error distribution at each true effect size Ex: Clopidogrel-bleeding: Pre-calibration: ( ) Post-calibration: ( ) 21
22 Applying case-control design and calibrating estimates of positive controls in simulated data, RR= original estimates that did not contain true RR=1 After calibration, only 1 estimate does not contain true RR = 1 Original coverage probability = 75% Calibrated coverage probability = 96%
23 Applying case-control design and calibrating estimates of positive controls in simulated data, RR=1.25 Original coverage probability = 54% Calibrated coverage probability = 96%
24 Applying case-control design and calibrating estimates of positive controls in simulated data, RR=1.50 Original coverage probability = 46% Calibrated coverage probability = 92%
25 Applying case-control design and calibrating estimates of positive controls in simulated data, RR=2.00 Original coverage probability = 42% Calibrated coverage probability = 92%
26 Comparing accuracy of cohort and self-controlled designs, after empirical calibration Data: MDCR; HOI: GI Bleeding broad Discrimination Error Coverage CM: New user cohort, propensity score stratification, with active comparator (drugs known to be negative controls for outcome) Bias: MSE: 0.38 Mean SE: 0.36 SCCS: Multivariate selfcontrolled case series, including all events, and defining time-at-risk as all-time post-exposure Bias: 0.04 MSE: 0.33 Mean SE: 0.67 Observation: Calibration does not influence discrimination, but tends to improve bias, MSE, and coverage OS: Self-controlled cohort design, including all exposures and outcomes, defining time-at-risk and control time as length of exposure + 30d Bias: 0.00 MSE: 0.11 Mean SE: 0.25
27 Concluding Thoughts Systematic exploration of negative and positive controls can be used to augment observational studies to measure analysis operating characteristics Errors in observational studies were observed to be differential by analysis design, data source, and outcome Magnitude and direction of bias varied, but all analyses had error distributions far from nominal Traditional interpretation of 95% confidence interval, that the CI covers the true effect size 95% of the time, may be misleading in the context of observational database studies Coverage probability was much lower across all methods and all outcomes Sampling variability is small portion of the true uncertainty in any study Empirical calibration is one approach to attempt to account for residual error that should be expected within any observational analysis 27
28 Observational Medical Outcomes Partnership Fourth Annual Symposium November 5 6, 2013 Hyatt Regency Bethesda Bethesda, Maryland OMOP holds an annual symposium to publicly share insights from the partnership's ongoing research with all stakeholders. Day 1 is a hands on tutorial designed for data users interested in analysis and engagement in the OMOP community. Day 2 is a research meeting to hear and discuss new OMOP research findings. Join us for two days and be a part of an exciting and growing community! DATE & TIME: November 5 6, :00 a.m. - 5:00 p.m. Eastern Time Opening Poster Session Evening of November 5 th LOCATION: Hyatt Regency Bethesda One Bethesda Metro Center Bethesda, MD 20814, USA POSTER APPLICATIONS and ONLINE REGISTRATION COMING SOON! For questions contact Emily Welebob, welebob@omop.org
OBSERVATIONAL MEDICAL OUTCOMES PARTNERSHIP
An empirical approach to measuring and calibrating for error in observational analyses Patrick Ryan on behalf of the OMOP research team 25 April 2013 Consider a typical observational database study: Exploring
More informationOBSERVATIONAL MEDICAL OUTCOMES PARTNERSHIP
OBSERVATIONAL Patient-centered observational analytics: New directions toward studying the effects of medical products Patrick Ryan on behalf of OMOP Research Team May 22, 2012 Observational Medical Outcomes
More informationA Method to Combine Signals from Spontaneous Reporting Systems and Observational Healthcare Data to Detect Adverse Drug Reactions
Drug Saf (2015) 38:895 908 DOI 10.1007/s40264-015-0314-8 ORIGINAL RESEARCH ARTICLE A Method to Combine Signals from Spontaneous Reporting Systems and Observational Healthcare Data to Detect Adverse Drug
More informationTuning Epidemiological Study Design Methods for Exploratory Data Analysis in Real World Data
Tuning Epidemiological Study Design Methods for Exploratory Data Analysis in Real World Data Andrew Bate Senior Director, Epidemiology Group Lead, Analytics 15th Annual Meeting of the International Society
More informationOHDSI Tutorial: Design and implementation of a comparative cohort study in observational healthcare data
OHDSI Tutorial: Design and implementation of a comparative cohort study in observational healthcare data Faculty: Martijn Schuemie (Janssen Research and Development) Marc Suchard (UCLA) Patrick Ryan (Janssen
More informationThe journey toward Clinical Characterization. Patrick Ryan, PhD Janssen Research and Development Columbia University Medical Center
The journey toward Clinical Characterization Patrick Ryan, PhD Janssen Research and Development Columbia University Medical Center Odyssey (noun): \oh-d-si\ 1. A long journey full of adventures 2. A series
More informationReliable and reproducible effect size estimates at scale
Reliable and reproducible effect size estimates at scale Marc A. Suchard, M.D., Ph.D. Departments of Biomathematics and Human Genetics David Geffen School of Medicine at UCLA, and Department of Biostatistics
More informationLarge scale analytics for electronic health records: Lessons from Observational Health Data Science and Informatics (OHDSI)
Large scale analytics for electronic health records: Lessons from Observational Health Data Science and Informatics (OHDSI) Patrick Ryan, PhD on behalf of OHDSI team 15 November 2016 Odyssey (noun): \oh-d-si\
More informationObservational Medical Outcomes Partnership
Implications of Health Outcomes of Interest Definitions: Acute Liver Injury Case Study Judy Racoosin, Patrick Ryan on behalf of OMOP Research Team Observational Medical Outcomes Partnership Established
More informationUsing negative control outcomes to identify biased study design: A self-controlled case series example. James Weaver 1,2.
Using negative control outcomes to identify biased study design: A self-controlled case series example James Weaver 1,2 1Janssen Research & Development, LLC, Raritan, NJ, USA 2 Observational Health Data
More informationEvolution of Active Surveillance: An Industry Perspective
Evolution of Active Surveillance: An Industry Perspective Midwest Biopharmaceutical Statistics Workshop May 21, 2013 Stephen Motsko, PharmD, PhD Ken Hornbuckle, DVM, PhD Office of Risk Management and Pharmacoepidemiology
More informationApplying Hill's criteria as a framework for causal inference in observational data
Applying Hill's criteria as a framework for causal inference in observational data Patrick Ryan, PhD Janssen Research and Development Columbia University Medical Center 10 June 2015 Perspectives on the
More informationUse of electronic health data to support a Learning Health System: Lessons from several distributed networks in the US
Use of electronic health data to support a Learning Health System: Lessons from several distributed networks in the US Jeffrey Brown, PhD Department of Population Medicine Harvard Medical School and Harvard
More informationOBSERVATIONAL MEDICAL OUTCOMES PARTNERSHIP
OBSERVATIONAL Large-scale regularized regression for identifying appropriate treatment comparisons for comparative effectiveness research Patrick Ryan, Alec Walker, Paul Stang, Martijn Schuemie, David
More informationBiases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University
Biases in clinical research Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Learning objectives Describe the threats to causal inferences in clinical studies Understand the role of
More informationINTERPRETATION OF STUDY FINDINGS: PART I. Julie E. Buring, ScD Harvard School of Public Health Boston, MA
INTERPRETATION OF STUDY FINDINGS: PART I Julie E. Buring, ScD Harvard School of Public Health Boston, MA Drawing Conclusions TRUTH IN THE UNIVERSE Infer TRUTH IN THE STUDY Infer FINDINGS IN THE STUDY Designing
More informationHow CDER is Using Mini-Sentinel Tools and Resources for Post-Marketing Safety Issues
How CDER is Using Mini-Sentinel Tools and Resources for Post-Marketing Safety Issues Marsha E. Reichman, Ph.D. Scientific Lead for Surveillance Programs CDER Lead for the Sentinel Initiative OSE/CDER/FDA
More informationDesign and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare data
Journal of the American Medical Informatics Association, 25(8), 2018, 969 975 doi: 10.1093/jamia/ocy032 Advance Access Publication Date: 27 April 2018 Research and Applications Research and Applications
More informationDesign and implementation of a standardized framework to generate and evaluate patient-level prediction models using observational healthcare data
Journal of the American Medical Informatics Association, 0(0), 2018, 1 doi: 10.1093/jamia/ocy032 Research and Applications Research and Applications Design and implementation of a standardized framework
More informationIntegrating Effectiveness and Safety Outcomes in the Assessment of Treatments
Integrating Effectiveness and Safety Outcomes in the Assessment of Treatments Jessica M. Franklin Instructor in Medicine Division of Pharmacoepidemiology & Pharmacoeconomics Brigham and Women s Hospital
More informationA Comparison of Collaborative Filtering Methods for Medication Reconciliation
A Comparison of Collaborative Filtering Methods for Medication Reconciliation Huanian Zheng, Rema Padman, Daniel B. Neill The H. John Heinz III College, Carnegie Mellon University, Pittsburgh, PA, 15213,
More informationOHDSI: Drawing reproducible conclusions from observational clinical data
Biomedical Informatics discovery and impact OHDSI: Drawing reproducible conclusions from observational clinical data George Hripcsak, MD, MS Biomedical Informatics, Columbia University Medical Informatics
More informationTruth Versus Truthiness in Clinical Data
Temple University Health System Truth Versus Truthiness in Clinical Data Mark Weiner, MD, FACP, FACMI Assistant Dean for Informatics, Temple University School of Medicine mark.weiner@tuhs.temple.edu 1
More informationOBSERVATIONAL STUDIES IN A LEARNING HEALTH SYSTEM
OBSERVATIONAL STUDIES IN A LEARNING HEALTH SYSTEM An Institute of Medicine Workshop Sponsored by the Patient-Centered Outcomes Research Institute A LEARNING HEALTH SYSTEM ACTIVITY IOM ROUNDTABLE ON VALUE
More informationPsychology, 2010, 1: doi: /psych Published Online August 2010 (
Psychology, 2010, 1: 194-198 doi:10.4236/psych.2010.13026 Published Online August 2010 (http://www.scirp.org/journal/psych) Using Generalizability Theory to Evaluate the Applicability of a Serial Bayes
More informationOptimal full matching for survival outcomes: a method that merits more widespread use
Research Article Received 3 November 2014, Accepted 6 July 2015 Published online 6 August 2015 in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/sim.6602 Optimal full matching for survival
More informationHawkes Process Modeling of Adverse Drug Reactions with Longitudinal Observational Data
Proceedings of Machine Learning for Healthcare 2017 JMLR W&C Track Volume 68 Hawkes Process Modeling of Adverse Drug Reactions with Longitudinal Observational Data Yujia Bao Department of Mathematics University
More informationAN INFORMATION VISUALIZATION APPROACH TO CLASSIFICATION AND ASSESSMENT OF DIABETES RISK IN PRIMARY CARE
Proceedings of the 3rd INFORMS Workshop on Data Mining and Health Informatics (DM-HI 2008) J. Li, D. Aleman, R. Sikora, eds. AN INFORMATION VISUALIZATION APPROACH TO CLASSIFICATION AND ASSESSMENT OF DIABETES
More informationArticle from. Forecasting and Futurism. Month Year July 2015 Issue Number 11
Article from Forecasting and Futurism Month Year July 2015 Issue Number 11 Calibrating Risk Score Model with Partial Credibility By Shea Parkes and Brad Armstrong Risk adjustment models are commonly used
More informationUnderstandable Statistics
Understandable Statistics correlated to the Advanced Placement Program Course Description for Statistics Prepared for Alabama CC2 6/2003 2003 Understandable Statistics 2003 correlated to the Advanced Placement
More informationPlans for Surveillance of Acute Myocardial Infarction in users of Oral Anti Diabetes Drugs
Plans for Surveillance of Acute Myocardial Infarction in users of Oral Anti Diabetes Drugs Bruce Fireman Kaiser Permanente, Oakland Brookings, Washington DC, 1 12 2011 Aims Develop and assess a framework
More informationClinically Meaningful Inclusion of Participants in Clinical Trials. David Hickam, MD, MPH Washington, DC April 9, 2015
Clinically Meaningful Inclusion of Participants in Clinical Trials David Hickam, MD, MPH Washington, DC April 9, 2015 Key Questions for this Presentation What are the important features of patient centered
More informationConditional Outlier Detection for Clinical Alerting
Conditional Outlier Detection for Clinical Alerting Milos Hauskrecht, PhD 1, Michal Valko, MSc 1, Iyad Batal, MSc 1, Gilles Clermont, MD, MS 2, Shyam Visweswaran MD, PhD 3, Gregory F. Cooper, MD, PhD 3
More informationLearning Objectives 9/9/2013. Hypothesis Testing. Conflicts of Interest. Descriptive statistics: Numerical methods Measures of Central Tendency
Conflicts of Interest I have no conflict of interest to disclose Biostatistics Kevin M. Sowinski, Pharm.D., FCCP Last-Chance Ambulatory Care Webinar Thursday, September 5, 2013 Learning Objectives For
More informationBIOSTATISTICAL METHODS
BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH PROPENSITY SCORE Confounding Definition: A situation in which the effect or association between an exposure (a predictor or risk factor) and
More informationUN Handbook Ch. 7 'Managing sources of non-sampling error': recommendations on response rates
JOINT EU/OECD WORKSHOP ON RECENT DEVELOPMENTS IN BUSINESS AND CONSUMER SURVEYS Methodological session II: Task Force & UN Handbook on conduct of surveys response rates, weighting and accuracy UN Handbook
More information9/4/2013. Decision Errors. Hypothesis Testing. Conflicts of Interest. Descriptive statistics: Numerical methods Measures of Central Tendency
Conflicts of Interest I have no conflict of interest to disclose Biostatistics Kevin M. Sowinski, Pharm.D., FCCP Pharmacotherapy Webinar Review Course Tuesday, September 3, 2013 Descriptive statistics:
More informationContents. Part 1 Introduction. Part 2 Cross-Sectional Selection Bias Adjustment
From Analysis of Observational Health Care Data Using SAS. Full book available for purchase here. Contents Preface ix Part 1 Introduction Chapter 1 Introduction to Observational Studies... 3 1.1 Observational
More informationInstitute of Medical Epidemiology, Biostatistics, and Informatics, University of Halle-Wittenberg, Halle (Saale) 2
Do Randomized and Non-Randomized Trials Yield Different Answers in Similar Populations? Evidence from a 'Meta-Propensity Score' Analysis in Cardiac Surgery Kuss O 1, Legler T 1, Börgermann J 2 1 Institute
More informationConfidence Intervals On Subsets May Be Misleading
Journal of Modern Applied Statistical Methods Volume 3 Issue 2 Article 2 11-1-2004 Confidence Intervals On Subsets May Be Misleading Juliet Popper Shaffer University of California, Berkeley, shaffer@stat.berkeley.edu
More informationResults from OHDSI and perspectives for international data sharing projects
Biomedical Informatics discovery and impact Results from OHDSI and perspectives for international data sharing projects George Hripcsak, MD, MS Biomedical Informatics, Columbia University Medical Informatics
More informationethnicity recording in primary care
ethnicity recording in primary care Multiple imputation of missing data in ethnicity recording using The Health Improvement Network database Tra Pham 1 PhD Supervisors: Dr Irene Petersen 1, Prof James
More informationThe journey toward Population-level Effect Estimation. Martijn Schuemie, PhD Janssen Research and Development
The journey toward Population-level Effect Estimation Martijn Schuemie, PhD Janssen Research and Development Population-level effect estimation What is the effect of treatment A on outcome X? What is the
More informationObservational Study Designs. Review. Today. Measures of disease occurrence. Cohort Studies
Observational Study Designs Denise Boudreau, PhD Center for Health Studies Group Health Cooperative Today Review cohort studies Case-control studies Design Identifying cases and controls Measuring exposure
More informationTechnical Specifications
Technical Specifications In order to provide summary information across a set of exercises, all tests must employ some form of scoring models. The most familiar of these scoring models is the one typically
More informationPCORnet Use Cases. Observational study: Dabigatran vs warfarin and ischemic and hemorrhagic stroke / extra-cranial bleeding
PCORnet Use Cases Observational study: Dabigatran vs warfarin and ischemic and hemorrhagic stroke / extra-cranial bleeding 1 Observational study: Dabigatran vs warfarin and stroke / bleeding Goal: Compare
More informationEvidence Based Medicine
Course Goals Goals 1. Understand basic concepts of evidence based medicine (EBM) and how EBM facilitates optimal patient care. 2. Develop a basic understanding of how clinical research studies are designed
More informationEMR Big Data and Clinical Research. -Distributed Research Network and Common Data Model-
2016 Healthcare Innovation Forum EMR Big Data and Clinical Research -Distributed Research Network and Common Data Model- Rae Woong Park, MD, PhD Department of Biomedical Informatics Ajou University School
More informationConfounding and Bias
28 th International Conference on Pharmacoepidemiology and Therapeutic Risk Management Barcelona, Spain August 22, 2012 Confounding and Bias Tobias Gerhard, PhD Assistant Professor, Ernest Mario School
More informationAccess from the University of Nottingham repository:
Reps, Jenna M. and Aickelin, Uwe and Ma, Jiangang and Zhang, Yanchun (2014) Refining adverse drug reactions using association rule mining for electronic healthcare data. In: IEEE International Conference
More informationA NOVEL VARIABLE SELECTION METHOD BASED ON FREQUENT PATTERN TREE FOR REAL-TIME TRAFFIC ACCIDENT RISK PREDICTION
OPT-i An International Conference on Engineering and Applied Sciences Optimization M. Papadrakakis, M.G. Karlaftis, N.D. Lagaros (eds.) Kos Island, Greece, 4-6 June 2014 A NOVEL VARIABLE SELECTION METHOD
More informationMethodologies for CRNs: Can Statisticians, Epidemiologists, and Machine Learners Play in the Same Sand Box? Perspectives from OHDSI
Methodologies for CRNs: Can Statisticians, Epidemiologists, and Machine Learners Play in the Same Sand Box? Perspectives from OHDSI Patrick Ryan, PhD Janssen Research and Development 2 October 2015 http://ohdsi.org
More informationAccepted Manuscript. Accuracy of an Automated Knowledge Base for Identifying Drug Adverse Reactions
Accepted Manuscript Accuracy of an Automated Knowledge Base for Identifying Drug Adverse Reactions E.A. Voss, R.D. Boyce, P.B. Ryan, J. van der Lei, P.R. Rijnbeek, M.J. Schuemie PII: S1532-0464(16)30179-4
More informationCritical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death. Debra Moy Faculty of Pharmacy University of Toronto
Critical Appraisal of a Meta-Analysis: Rosiglitazone and CV Death Debra Moy Faculty of Pharmacy University of Toronto Goal To provide practitioners with a systematic approach to evaluating a meta analysis
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector
More informationinvestigate. educate. inform.
investigate. educate. inform. Research Design What drives your research design? The battle between Qualitative and Quantitative is over Think before you leap What SHOULD drive your research design. Advanced
More informationMatching an Internet Panel Sample of Health Care Personnel to a Probability Sample
Matching an Internet Panel Sample of Health Care Personnel to a Probability Sample Charles DiSogra Abt SRBI Carla L Black CDC* Stacie M Greby CDC* John Sokolowski Abt SRBI K.P. Srinath Abt SRBI Xin Yue
More informationEffective Implementation of Bayesian Adaptive Randomization in Early Phase Clinical Development. Pantelis Vlachos.
Effective Implementation of Bayesian Adaptive Randomization in Early Phase Clinical Development Pantelis Vlachos Cytel Inc, Geneva Acknowledgement Joint work with Giacomo Mordenti, Grünenthal Virginie
More informationInterpreting Prospective Studies
Comparative Effectiveness Research Collaborative Initiative (CER CI) PART 1: INTERPRETING OUTCOMES RESEARCH STUDIES FOR HEALTH CARE DECISION MAKERS ASSESSING PROSPECTIVE DATABASE STUDIES: A PROPOSED MEASUREMENT
More informationQuantitative benefit-risk assessment: An analytical framework for a shared understanding of the effects of medicines. Patrick Ryan 21 April 2010
Quantitative benefit-risk assessment: An analytical framework for a shared understanding of the effects of medicines Patrick Ryan 21 April 2010 Challenges in understanding the effects of medicines Benefit
More informationCRITICAL EVALUATION OF BIOMEDICAL LITERATURE
Chapter 9 CRITICAL EVALUATION OF BIOMEDICAL LITERATURE M.G.Rajanandh, Department of Pharmacy Practice, SRM College of Pharmacy, SRM University. INTRODUCTION Reviewing the Biomedical Literature poses a
More informationA Data Mining Approach for Signal Detection and Analysis
SHORT COMMUNICATION Drug Safety 2002; 25 (6): 393-397 0114-5916/02/0006-0393/$25.00/0 Adis International Limited. All rights reserved. A Data Mining Approach for Signal Detection and Analysis Andrew Bate,
More informationActive TB drug-safety management & monitoring
Active TB drug-safety management & monitoring Global TB Programme, WHO, Switzerland 6 August 2015 Pharmacovigilance: definition of science and activities relating to the detection, assessment, understanding
More informationPatrick Ryan, PhD Janssen Research and Development Columbia University Medical Center 12 July 2017
An Open Science Community Approach to Observational Research: Lessons from the Observational Health Data Sciences and Informatics (OHDSI) collaborative Patrick Ryan, PhD Janssen Research and Development
More information(Regulatory) views on Biomarker defined Subgroups
(Regulatory) views on Biomarker defined Subgroups Norbert Benda Disclaimer: Views expressed in this presentation are the author's personal views and not necessarily the views of BfArM Biomarker defined
More informationPropensity score methods to adjust for confounding in assessing treatment effects: bias and precision
ISPUB.COM The Internet Journal of Epidemiology Volume 7 Number 2 Propensity score methods to adjust for confounding in assessing treatment effects: bias and precision Z Wang Abstract There is an increasing
More informationDecision Making in Confirmatory Multipopulation Tailoring Trials
Biopharmaceutical Applied Statistics Symposium (BASS) XX 6-Nov-2013, Orlando, FL Decision Making in Confirmatory Multipopulation Tailoring Trials Brian A. Millen, Ph.D. Acknowledgments Alex Dmitrienko
More informationApplying Machine Learning Methods in Medical Research Studies
Applying Machine Learning Methods in Medical Research Studies Daniel Stahl Department of Biostatistics and Health Informatics Psychiatry, Psychology & Neuroscience (IoPPN), King s College London daniel.r.stahl@kcl.ac.uk
More informationSeeing the Forest & Trees: novel analyses of complex interventions to guide health system decision making
Seeing the Forest & Trees: novel analyses of complex interventions to guide health system decision making Noah Ivers MD CCFP PhD Family Physician, Women s College Hospital Scientist, Women s College Research
More informationImproved Transparency in Key Operational Decisions in Real World Evidence
PharmaSUG 2018 - Paper RW-06 Improved Transparency in Key Operational Decisions in Real World Evidence Rebecca Levin, Irene Cosmatos, Jamie Reifsnyder United BioSource Corp. ABSTRACT The joint International
More informationZhao Y Y et al. Ann Intern Med 2012;156:
Zhao Y Y et al. Ann Intern Med 2012;156:560-569 Introduction Fibrates are commonly prescribed to treat dyslipidemia An increase in serum creatinine level after use has been observed in randomized, placebocontrolled
More informationTreatment effect estimates adjusted for small-study effects via a limit meta-analysis
Treatment effect estimates adjusted for small-study effects via a limit meta-analysis Gerta Rücker 1, James Carpenter 12, Guido Schwarzer 1 1 Institute of Medical Biometry and Medical Informatics, University
More informationBiases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University
Biases in clinical research Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University Learning objectives Understand goal of measurement and definition of accuracy Describe the threats to causal
More informationTRIPLL Webinar: Propensity score methods in chronic pain research
TRIPLL Webinar: Propensity score methods in chronic pain research Felix Thoemmes, PhD Support provided by IES grant Matching Strategies for Observational Studies with Multilevel Data in Educational Research
More informationIndex. Springer International Publishing Switzerland 2017 T.J. Cleophas, A.H. Zwinderman, Modern Meta-Analysis, DOI /
Index A Adjusted Heterogeneity without Overdispersion, 63 Agenda-driven bias, 40 Agenda-Driven Meta-Analyses, 306 307 Alternative Methods for diagnostic meta-analyses, 133 Antihypertensive effect of potassium,
More informationVariable selection should be blinded to the outcome
Variable selection should be blinded to the outcome Tamás Ferenci Manuscript type: Letter to the Editor Title: Variable selection should be blinded to the outcome Author List: Tamás Ferenci * (Physiological
More informationExperimental Psychology
Title Experimental Psychology Type Individual Document Map Authors Aristea Theodoropoulos, Patricia Sikorski Subject Social Studies Course None Selected Grade(s) 11, 12 Location Roxbury High School Curriculum
More informationTeam-Based Decision Support in Diabetes Outcomes and Costs
Team-Based Decision Support in Diabetes Outcomes and Costs Session 89, 8:30 a.m. February 13, 2019 Gary Ozanich, Ph.D. - College of Informatics, Northern Kentucky University 1 Conflict of Interest Gary
More informationMike Hinds, Royal Canadian Mint
Experience in the Use of the LBMA Reference Materials Mike Hinds Royal Canadian Mint LBMA Assayer and Refiner March 2011 1 LBMA RM Project 2007-2010 2 Gold Reference Materials AuRM1 and AuRM2 Available
More informationOA Biomarkers: What is required for validation and qualification? Part I. Evaluation Frameworks
OA Biomarkers: What is required for validation and qualification? Part I. Evaluation Frameworks Michael C. Nevitt, PhD Dept of Epidemiology and Biostatistics University of California, San Francisco OAI
More informationMODULE 3 APPRAISING EVIDENCE. Evidence-Informed Policy Making Training
MODULE 3 APPRAISING EVIDENCE Evidence-Informed Policy Making Training RECAP OF PREVIOUS DAY OR SESSION MODULE 3 OBJECTIVES At the end of this module participants will: Identify characteristics of basic
More informationChoice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias
Technical appendix Choice of axis, tests for funnel plot asymmetry, and methods to adjust for publication bias Choice of axis in funnel plots Funnel plots were first used in educational research and psychology,
More informationSmall Sample Bayesian Factor Analysis. PhUSE 2014 Paper SP03 Dirk Heerwegh
Small Sample Bayesian Factor Analysis PhUSE 2014 Paper SP03 Dirk Heerwegh Overview Factor analysis Maximum likelihood Bayes Simulation Studies Design Results Conclusions Factor Analysis (FA) Explain correlation
More informationDifferential Item Functioning
Differential Item Functioning Lecture #11 ICPSR Item Response Theory Workshop Lecture #11: 1of 62 Lecture Overview Detection of Differential Item Functioning (DIF) Distinguish Bias from DIF Test vs. Item
More informationMethods for Scaling Medical Device Analyses to Large Observational Data. Michael E. Matheny, MD, MS, MPH
Methods for Scaling Medical Device Analyses to Large Observational Data Michael E. Matheny, MD, MS, MPH Outline Introduction to Clinical Data Research Networks Capacity to conduct comparative effectiveness
More informationInstitute of Medical Epidemiology, Biostatistics, and Informatics, University of Halle-Wittenberg, Halle (Saale) 2
Do Randomized and Non-Randomized Trials Yield Different Answers in Similar Populations? Evidence from a 'Meta-Propensity Score' Analysis in Cardiac Surgery Kuss O 1, Legler T 1, Börgermann J 2 1 Institute
More informationHow should the propensity score be estimated when some confounders are partially observed?
How should the propensity score be estimated when some confounders are partially observed? Clémence Leyrat 1, James Carpenter 1,2, Elizabeth Williamson 1,3, Helen Blake 1 1 Department of Medical statistics,
More informationSurgical Outcomes: A synopsis & commentary on the Cardiac Care Quality Indicators Report. May 2018
Surgical Outcomes: A synopsis & commentary on the Cardiac Care Quality Indicators Report May 2018 Prepared by the Canadian Cardiovascular Society (CCS)/Canadian Society of Cardiac Surgeons (CSCS) Cardiac
More informationEvidence-Based Medicine Journal Club. A Primer in Statistics, Study Design, and Epidemiology. August, 2013
Evidence-Based Medicine Journal Club A Primer in Statistics, Study Design, and Epidemiology August, 2013 Rationale for EBM Conscientious, explicit, and judicious use Beyond clinical experience and physiologic
More informationEvidence Based Medicine Prof P Rheeder Clinical Epidemiology. Module 2: Applying EBM to Diagnosis
Evidence Based Medicine Prof P Rheeder Clinical Epidemiology Module 2: Applying EBM to Diagnosis Content 1. Phases of diagnostic research 2. Developing a new test for lung cancer 3. Thresholds 4. Critical
More informationSTATISTICS & PROBABILITY
STATISTICS & PROBABILITY LAWRENCE HIGH SCHOOL STATISTICS & PROBABILITY CURRICULUM MAP 2015-2016 Quarter 1 Unit 1 Collecting Data and Drawing Conclusions Unit 2 Summarizing Data Quarter 2 Unit 3 Randomness
More information4. Model evaluation & selection
Foundations of Machine Learning CentraleSupélec Fall 2017 4. Model evaluation & selection Chloé-Agathe Azencot Centre for Computational Biology, Mines ParisTech chloe-agathe.azencott@mines-paristech.fr
More informationPropensity Score Matching with Limited Overlap. Abstract
Propensity Score Matching with Limited Overlap Onur Baser Thomson-Medstat Abstract In this article, we have demostrated the application of two newly proposed estimators which accounts for lack of overlap
More informationRefining adverse drug reaction signals by incorporating interaction variables identified using emergent pattern mining
Refining adverse drug reaction signals by incorporating interaction variables identified using emergent pattern mining Jenna M. Reps a, Uwe Aickelin a, Richard B. Hubbard b aschool of Computer Science,
More informationPropensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018
Propensity Score Methods to Adjust for Bias in Observational Data SAS HEALTH USERS GROUP APRIL 6, 2018 Institute Institute for Clinical for Clinical Evaluative Evaluative Sciences Sciences Overview 1.
More informationProgress from the Patient-Centered Outcomes Research Institute (PCORI)
Progress from the Patient-Centered Outcomes Research Institute (PCORI) Anne Beal, Chief Operating Officer of the Patient-Centered Outcomes Research Institute Sharon-Lise Normand, Vice Chair, Methodology
More informationComplications of Proton Pump Inhibitor Therapy. Gastroenterology 2017; 153:35-48 발표자 ; F1 김선화
Complications of Proton Pump Inhibitor Therapy Gastroenterology 2017; 153:35-48 발표자 ; F1 김선화 Background Proton pump inhibitors (PPIs) are among the most commonly prescribed medicines for gastroesophageal
More informationExecutive Summary Report on Rates and Relative Risks by Individual Drug
Safety Evaluation of Adverse Reactions in Diabetes HEALTH-282521 Executive Summary Report on Rates and Relative Risks by Individual Drug Author(s): SA Romio (EMC), I. Leal (EMC), G Masclee (EMC), P Rijnbeek
More informationStatistical Considerations for Post Market Surveillance
Statistical Considerations for Post Market Surveillance 30 th International Conference on Phamacoepidemiology and Therapeutic Risk Management Ted Lystig, Ph.D. MEDTRONIC INC. Distinguished Statistician
More informationCase-based reasoning using electronic health records efficiently identifies eligible patients for clinical trials
Case-based reasoning using electronic health records efficiently identifies eligible patients for clinical trials Riccardo Miotto and Chunhua Weng Department of Biomedical Informatics Columbia University,
More information