Sensitivity, specicity, ROC
|
|
- Erin Wilkinson
- 5 years ago
- Views:
Transcription
1 Sensitivity, specicity, ROC Thomas Alexander Gerds Department of Biostatistics, University of Copenhagen 1 / 53
2 Epilog: disease prevalence The prevalence is the proportion of cases in the population today. It is easy to estimate: Prev = No. cases No. of subjects Exact condence limits for proportions can be obtained from most statistical software packages. Approximative condence limits are obtained from the formula [ ] Prev 1.96 Prev(1 Prev) Prev(1 Prev) ; Prev sample size sample size 2 / 53
3 Introduction A diagnosis is an estimate of the patient's current status A prediction is an estimate of the patient's future status The estimates can be based on patient's genotype, phenotype and exposure history. 3 / 53
4 Who is asking the question? The patient wants to know if she or he is diseased The doctor wants to know what treatment to use The researcher wants to know if a new marker is useful The hospital wants to plan its resources 4 / 53
5 Medical test A medical diagnostic test is a decision rule { 1 positive / disease X = 0 negative / non-disease The test can be based on a biomarker. A biomarker is any biological measurement made on a patient which is related to the disease status, extent, or activity. 5 / 53
6 Example: screening for prostate cancer The rst commercial PSA 1 test: { 1 positive if PSA > 4.0 ng/ml X = 0 negative if PSA 4.0 ng/ml 1 Prostate Specic Antigen 6 / 53
7 Example: screening for prostate cancer The rst commercial PSA 1 test: { 1 positive if PSA > 4.0 ng/ml X = 0 negative if PSA 4.0 ng/ml The reference range of serum PSA is ng/ml (based on a study of 472 healthy men where 99% had a total PSA level below 4 ng/ml). 1 Prostate Specic Antigen 6 / 53
8 Example: screening for prostate cancer The rst commercial PSA 1 test: { 1 positive if PSA > 4.0 ng/ml X = 0 negative if PSA 4.0 ng/ml The reference range of serum PSA is ng/ml (based on a study of 472 healthy men where 99% had a total PSA level below 4 ng/ml). There are some that feel that this level should be lowered to 2.5 ng/ml in order to detect more cases of prostate cancer 1 Prostate Specic Antigen 6 / 53
9 From the Internet 2 University of Michigan researchers identify new blood test for prostate cancer. The test looks at 22 biomarkers; The results are more accurate than PSA These 22 biomarkers appear to be the right number. If you used too many or too few, the accuracy went down a bit. Our ndings held up when we tested the model on an independent set of blood serum samples,... 2 http: // 7 / 53
10 Predicted probabilities A prediction rule is a fully specied mathematical function for mapping from patients characteristics to a predicted probability. Patients characteristics may include: conventional predictors such as age, gender, blood pressure, etc. biomarkers and (high dimensional) genetic markers exposure history (until today) treatment The function is described by (estimated) parameters, such as regression coecients and cut-o thresholds. A set of biomarkers or a genes signature is not a prediction model. 8 / 53
11 Prostate Cancer Risk Calculator Available Online American researchers have developed and released an online calculator to predict a man's risk of developing prostate cancer based on his age, biopsy results, PSA levels, and digital rectal exam results. The original Prostate Cancer Prevention Trial (PCPT) Prostate Cancer Risk Calculator (PCPTRC) posted in 2006 was developed based upon 5519 men in the placebo group of the Prostate Cancer Prevention Trial. All of these 5519 men initially had a prostate-specic antigen (PSA) value less than or equal to 3.0 ng/ml and were followed for seven years with annual PSA and digital rectal examination (DRE). and had at least one prostate biopsy. 9 / 53
12 Prostate Cancer Risk Calculator Available Online PSA, family history, DRE ndings, and history of a prior negative prostate biopsy provided independent predictive value to the calculation of risk of a biopsy that showed presence of cancer. Disclaimer The calculator is in principle only applicable to men under the following restrictions: Age 55 or older No previous diagnosis of prostate cancer DRE and PSA results less than 1 year old 10 / 53
13 Prostate Cancer Risk Calculator in action / 53
14 Prostate Cancer Risk Calculator in action 3 12 / 53
15 Prostate Cancer Risk Calculator in action 3 13 / 53
16 Prostate Cancer Risk Calculator in action 3 14 / 53
17 What is behind the 'Prostate Cancer Risk Calculator' The Prostate Cancer Prevention Trial 4 Here we used prostate biopsy data from 5519 participants in the PCPT to examine whether interactions among these variables (PSA level, family history of prostate cancer, age, race, and digital rectal examination) can be used to predict prostate cancer risk in an individual patient. We used multivariable logistic regression to model the risk of prostate cancer by considering all possible combinations of main eects and interactions. The models chosen were those that minimized the Bayesian information criterion (BIC) and maximized the average out-of-sample area under the receiver operating characteristic curve (via 4-fold cross-validation). 4 Thompson et al. J Natl Cancer Inst, 98(8):529-34, / 53
18 Notation for Binary Markers [Y : ] Outcome (disease status) E.g. coronary heart disease [X : ] Test result (biomarker) E.g. exercise stress test) Y = 1 Y = 0 X = 0 False negative True negative X = 1 True positive False positive 16 / 53
19 Evaluation of Binary Markers To what extent does a biomarker reect true disease status? [True positive rate: ] TPR = P(X = 1 Y = 1) [False positive rate: ] FPR = P(X = 1 Y = 0) Terminology: TPR = sensitivity, FPR = 1 specicity Ideal tests have FPR = 0 and TPR = 1, but usually both error rates have to be optimized simultaneously. 17 / 53
20 Estimating TPR and FPR Use a case control study if disease prevalence is low: No. controls with positive test FPR = No. controls No. cases with postive test TPR = No. cases Condence intervals are either obtained exactly or via: FPR ± 1.96 (1/n case ) FPR TPR ± 1.96 (1/n control ) TPR ( 1 FPR ) ( 1 TPR ) 18 / 53
21 Example: Coronary Artery Surgery Study 5 Y : Coronary heart disease status X : Exercise Stress Test Y = 0 Y = 1 X = X = FPR = 115/( ) = 0.26, TPR = 815/( ) = Data from Table 2 of: Weiner DA, Ryan TJ, McCabe CH, et al. Correlations among history of angina, ST-segment response and prevalence of coronary-artery disease in the Coronary Artery Surgery Study (CASS). NEJM 301(5): / 53
22 Continuous Markers In many clinical applications, biomarkers are continuous (Example: Prostate Specic Antigen (PSA) for prostate cancer) For any given cut-o value c, we may dene a test Y = 0 Y = 1 X c False Positve True Positive X < c True Negative False Negative Classication accuracy: FPR(c) = P(X c Y = 0), TPR(c) = P(X c Y = 1) 20 / 53
23 Example: Pancreatic Cancer Study Antigens, CA-125 and CA 19-9 are possible biomarkers of pancreatic cancer 6 Distribution of CA125 among cases and controls Trade-o between: Increase c FPR and TPR Decrease c FPR and TPR 6 Wieand et al (1989) studied n case = 90 patients with pancreatic cancer and n control = 51 healthy patients with pancreatitis 21 / 53
24 Estimation of FPR(c) and TPR(c) FPR(c) = TPR(c) = No. controls with X c No. controls No. cases with X c No. cases 22 / 53
25 The Receiver Operating Characteristic (ROC) Curve: plots TPR(c) against FPR(c) for all dierent cut-o values c. True positive rate = Sensitivity Perfect test Actual test No predictive value False positive rate = 1 Specificity 23 / 53
26 Comparing markers The ROC curve is invariant under monotone transformations of the marker (e.g. same ROC curve for X and log(x ) and 4.13 X ) ROC Curves of CA 19-9 and CA 125 Useful for comparing dierent markers All markers are put on the same scale The ideal ROC curve approaches the point (0, 1). 24 / 53
27 Area under the curve (AUC) True positive rate = Sensitivity Perfect test Actual test No predictive value False positive rate = 1 Specificity The higher the better. Lower benchmark: 0.5 (coin toss) Upper benchmark: 1.0 (perfect discrimination) AUC is also known as the c-statistic. Methods for analyzing AUC are well established: E.g. Bamber (1975); DeLong, DeLong and Clarke-Pearson (1988) 25 / 53
28 Estimating AUC AUC can be estimated based on case control pairs: ÂUC = No. (case, control)-pairs with X case X control No. (case, control)-pairs AUC of CA 19-9 and CA 125 ÂUC = 0.86 for CA ÂUC = 0.71 for CA / 53
29 Limitations of AUC Two ROC curves may cross, but this cannot be seen from the AUC TPR FPR 27 / 53
30 Break 28 / 53
31 Limitation of ROC analysis The classication accuracy measures are good: for describing the capacity a marker has in distinguishing a diseased subject from a non-diseased subject. in the discovery stage when interest lies in identifying markers for disease diagnosis and prognosis. In clinical practice, patients and clinicians are often more interested in knowing: How likely is it that the patient is truly diseased if the test is positive? How likely is it that the patient is truly disease free if the test is negative? 29 / 53
32 Predictive Values The positive predictive value: PPV= P(Y = 1 X = 1) = The probability that a patient with a positive test is diseased The negative predictive value: NPV= P(Y = 0 X = 0) The probability that a patient with a negative test is not diseased A perfect test has PPV = 1 and NPV = 1. A useless test has PPV = Prev and NPV = 1- Prev 7, 8 7 Similarly for a continuous marker X : PPV(c) = P(Y = 1 X c), NPV(c) = P(Y = 0 X < c) 8 where Prev= disease prevalence 30 / 53
33 Estimation of predictive values In a cohort study the PPV(c) and NPV(c) can be estimated directly as: PPV(c) = No. cases among subjects with X c No. subjects with X c NPV(c) = No. controls among subjects with X < c No. subjects with X < c In a case-control study PPV and NPV cannot be estimated (by using this formula). 31 / 53
34 Relation to TPR and FPR The clinical interpretations of PPV and NPV are dierent from that of FPR and TPR. But the values are closely related via the prevalence and Bayes' theorem: PPV(c) = TPR(c) Prev TPR(c) Prev +FPR(c)(1 Prev) NPV(c) = {1 FPR(c)}(1 Prev) {1 FPR(c)}(1 Prev) + {1 TPR(c)} Prev 32 / 53
35 Example: epo study 9 Anaemia is a deciency of red blood cells and/or hemoglobin and an additional risk factor for cancer patients. Randomized placebo controlled trial: does treatment with epoetin beta epo (300 U/kg) enhance hemoglobin concentration level and improve survival chances? Henke et al identied the c20 expression (erythropoietin receptor status) as a new biomarker for the prognosis of locoregional progression-free survival. 9 Henke et al. Do erythropoietin receptors on cancer cells explain unexpected clinical ndings? J Clin Oncol, 24(29): , / 53
36 Treatment The study includes head and neck cancer patients with a tumor located in the oropharynx (36%), the oral cavity (27%), the larynx (14%) or in the hypopharynx (23%). One of the treatments was radiotherapy following Resection Complete Incomplete No Placebo Epo with non-missing blood values 34 / 53
37 Outcome Blood hemoglobin levels were measured weekly during radiotherapy (7 weeks). Treatment with epoetin beta was dened successful when the hemoglobin level increased suciently. For patient i set Y i = { 1 treatment successful 0 treatment failed 35 / 53
38 Target Patient no. Treatment successful Predicted probability 1 0 P P P P P P P 7 36 / 53
39 Predictors Age min: 41 y, median: 59 y, max: 80 y Gender male: 85%, female: 15% Baseline hemoglobin mean: g/dl, std: 1.45 Treatment epo: 50%, placebo 50% Stratum complete: 48%, incomplete: 19%, no resection: 34% Erythropoietin receptor status neg: 32%, pos: 68% 37 / 53
40 Logistic regression Response: treatment successful yes/no Factor OddsRatio StandardError CI.95 pvalue (Intercept) < Age [0.91; 1.03] Sex:female [0.91; 26.02] HbBase [1.99; 5.91] < Treatment:Epo [23.9; ] < Resection:Incompl [0.36; 9.03] Resection:Compl [1.13; 17.36] Receptor:positive [1.72; 23.39] / 53
41 The model provides general information Treatment with epo increases the chance (odds) of reaching the target hemoglobin level signicantly by a factor of (CI 95% : [23.9; 493.4], p < ) in the overall study population. Does that mean everyone should be treated? 39 / 53
42 The model provides information for a single patient For example: the predicted probability that a 51 year old man with complete tumor resection and baseline hemoglobin level 12.6 g/dl reaches the target hemoglobin level (Y i =1) is [Epo group: ] 97.4% [ Placebo: ] 29.2 % If a similar patient has baseline hemoglobin level 14.8 g/dl then the model predicts: [Epo group: ] 99.8% [Placebo: ] 84.7 % 40 / 53
43 Predicted treatment success probability For a treated man with no resection possible and negative epo receptor status. Predicted risk 100% 14 90% 80% 13 70% Baseline hemoglobin (g/dl) % 50% 40% 10 30% 9 20% 10% Age (years) 0% 41 / 53
44 The model behind the table log ( Pi ) = β 0 + β 1 x 1,i + + β k x k,i 1 P i P i = exp{β 0 + β 1 x 1,i + + β k x k,i } P i the probability of successful treatment x 1,i rst predictor for subject i: (e.g. age = 50) x 2,i second predictor for subject i: (e.g. gender = male) x k,i k'th predictor for subject i: (e.g. eporeceptor = pos) β 0,..., β k are regression coecients that are estimated based on the epo study 42 / 53
45 Logistic regression in R data(epo) Epo$Y <- as.numeric(epo$hbsuccess==1) ## fit the model via glm glmfit <- glm(y~age+sex+hbbase+arm+resection+eporec, data=epo,family="binomial") ## predicting the chance of successful treatment predict(glmfit,type="response",newdata=epo) predict(glmfit,type="response", newdata=data.frame(hbbase=13.4, age=54, sex="male", arm="epo", Resection="Incomplete", eporec="positive")) 43 / 53
46 Evaluation of prediction models Idea: use the predicted probability P for a positive outcome as a continuous "marker": P c P < c Y = 0 False Positve True Negative Y = 1 True Positive False Negative 44 / 53
47 Assessing the added value of marker Sensitivity AUC=0.947 AUC=0.933 LRM (full) LRM (without eporec) Specificity 45 / 53
48 Assessing the added value of marker Sensitivity AUC=0.947 AUC=0.796 LRM (full) LRM (without treatment arm) Specificity 46 / 53
49 Assessing the predictive power of the model A residual is dened as the dierence between: the true disease status of a patient the probability of disease for this patient as predicted by the model Residual(Patient i) = Status(i) Predicted probability(i) = Y i P i 47 / 53
50 Assessing the predictive power of the model Patient Treatment Predicted no. successful probability (%) Residual Y i P i Y i P i / 53
51 Brier score The Brier score is the squared dierence between a patient's status and the predicted probability for this patient. The mean Brier score is a useful summary of the accuracy of the model: B = 1 N N (Y i P i ) 2 = 1 N {(Y 1 P 1 ) (Y N P N ) 2 } i=1 where N is the sample size. The ideal model has mean Brier score equal to 0 (perfect prediction) 49 / 53
52 Assessing the predictive power of the model Patient Treatment Predicted Brier no. successful probability (%) Residual score Y i P i Y i P i (Y i P i ) < Σ / 53
53 Comparison to a model that ignores all covariates Patient Treatment Predicted Brier no. successful probability (%) Residual score Y i P i Y i P i (Y i P i ) Σ / 53
54 Improving the predictive power New predictor variables Variable selection Dierent link function Systematically searching for the model that optimizes the predictive power Machine learning tools 52 / 53
55 Take home messages Sensitivity and specicity and the predictive values are important for medical practice. The ROC curve is useful for summarizing the discriminatory capacity of a marker or a model. Summary measures like AUC and Brier score are useful for comparing the overall accuracy of diagnostic and prognostic models. 53 / 53
Module Overview. What is a Marker? Part 1 Overview
SISCR Module 7 Part I: Introduction Basic Concepts for Binary Classification Tools and Continuous Biomarkers Kathleen Kerr, Ph.D. Associate Professor Department of Biostatistics University of Washington
More informationSISCR Module 7 Part I: Introduction Basic Concepts for Binary Biomarkers (Classifiers) and Continuous Biomarkers
SISCR Module 7 Part I: Introduction Basic Concepts for Binary Biomarkers (Classifiers) and Continuous Biomarkers Kathleen Kerr, Ph.D. Associate Professor Department of Biostatistics University of Washington
More informationAssessment of performance and decision curve analysis
Assessment of performance and decision curve analysis Ewout Steyerberg, Andrew Vickers Dept of Public Health, Erasmus MC, Rotterdam, the Netherlands Dept of Epidemiology and Biostatistics, Memorial Sloan-Kettering
More informationLogistic regression. Department of Statistics, University of South Carolina. Stat 205: Elementary Statistics for the Biological and Life Sciences
Logistic regression Department of Statistics, University of South Carolina Stat 205: Elementary Statistics for the Biological and Life Sciences 1 / 1 Logistic regression: pp. 538 542 Consider Y to be binary
More informationMultivariable Cox regression. Day 3: multivariable Cox regression. Presentation of results. The statistical methods section
Outline: Multivariable Cox regression PhD course Survival analysis Day 3: multivariable Cox regression Thomas Alexander Gerds Presentation of results The statistical methods section Modelling The linear
More informationIntroduction to Meta-analysis of Accuracy Data
Introduction to Meta-analysis of Accuracy Data Hans Reitsma MD, PhD Dept. of Clinical Epidemiology, Biostatistics & Bioinformatics Academic Medical Center - Amsterdam Continental European Support Unit
More informationDiagnostic tests, Laboratory tests
Diagnostic tests, Laboratory tests I. Introduction II. III. IV. Informational values of a test Consequences of the prevalence rate Sequential use of 2 tests V. Selection of a threshold: the ROC curve VI.
More informationIntroduction. We can make a prediction about Y i based on X i by setting a threshold value T, and predicting Y i = 1 when X i > T.
Diagnostic Tests 1 Introduction Suppose we have a quantitative measurement X i on experimental or observed units i = 1,..., n, and a characteristic Y i = 0 or Y i = 1 (e.g. case/control status). The measurement
More informationEC352 Econometric Methods: Week 07
EC352 Econometric Methods: Week 07 Gordon Kemp Department of Economics, University of Essex 1 / 25 Outline Panel Data (continued) Random Eects Estimation and Clustering Dynamic Models Validity & Threats
More informationComputer Models for Medical Diagnosis and Prognostication
Computer Models for Medical Diagnosis and Prognostication Lucila Ohno-Machado, MD, PhD Division of Biomedical Informatics Clinical pattern recognition and predictive models Evaluation of binary classifiers
More informationIntroduction to ROC analysis
Introduction to ROC analysis Andriy I. Bandos Department of Biostatistics University of Pittsburgh Acknowledgements Many thanks to Sam Wieand, Nancy Obuchowski, Brenda Kurland, and Todd Alonzo for previous
More informationScreening for Disease
Screening for Disease An Ounce of Prevention is Worth a Pound of Cure. Actually, an ounce of prevention is better than a pound of cure, but if prevention hasn t been effective, perhaps early identification
More informationEvaluation of diagnostic tests
Evaluation of diagnostic tests Biostatistics and informatics Miklós Kellermayer Overlapping distributions Assumption: A classifier value (e.g., diagnostic parameter, a measurable quantity, e.g., serum
More information3. Model evaluation & selection
Foundations of Machine Learning CentraleSupélec Fall 2016 3. Model evaluation & selection Chloé-Agathe Azencot Centre for Computational Biology, Mines ParisTech chloe-agathe.azencott@mines-paristech.fr
More informationPredicting Prostate Biopsy Outcome Using a PCA3-based Nomogram in a Polish Cohort
Predicting Prostate Biopsy Outcome Using a PCA3-based Nomogram in a Polish Cohort MACIEJ SALAGIERSKI 1, PETER MULDERS 2 and JACK A. SCHALKEN 2 1 Urology Department, Medical University of Łódź, Poland;
More informationEUROPEAN UROLOGY 58 (2010)
EUROPEAN UROLOGY 58 (2010) 551 558 available at www.sciencedirect.com journal homepage: www.europeanurology.com Prostate Cancer Prostate Cancer Prevention Trial and European Randomized Study of Screening
More informationLecture Outline. Biost 590: Statistical Consulting. Stages of Scientific Studies. Scientific Method
Biost 590: Statistical Consulting Statistical Classification of Scientific Studies; Approach to Consulting Lecture Outline Statistical Classification of Scientific Studies Statistical Tasks Approach to
More informationSystematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies
Systematic reviews of prognostic studies 3 meta-analytical approaches in systematic reviews of prognostic studies Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group Conflict
More informationSTATISTICAL METHODS FOR DIAGNOSTIC TESTING: AN ILLUSTRATION USING A NEW METHOD FOR CANCER DETECTION XIN SUN. PhD, Kansas State University, 2012
STATISTICAL METHODS FOR DIAGNOSTIC TESTING: AN ILLUSTRATION USING A NEW METHOD FOR CANCER DETECTION by XIN SUN PhD, Kansas State University, 2012 A THESIS Submitted in partial fulfillment of the requirements
More informationReview. Imagine the following table being obtained as a random. Decision Test Diseased Not Diseased Positive TP FP Negative FN TN
Outline 1. Review sensitivity and specificity 2. Define an ROC curve 3. Define AUC 4. Non-parametric tests for whether or not the test is informative 5. Introduce the binormal ROC model 6. Discuss non-parametric
More informationDetection & Risk Stratification for Early Stage Prostate Cancer
Detection & Risk Stratification for Early Stage Prostate Cancer Andrew J. Stephenson, MD, FRCSC, FACS Chief, Urologic Oncology Glickman Urological and Kidney Institute Cleveland Clinic Risk Stratification:
More informationSystematic reviews of prognostic studies: a meta-analytical approach
Systematic reviews of prognostic studies: a meta-analytical approach Thomas PA Debray, Karel GM Moons for the Cochrane Prognosis Review Methods Group (Co-convenors: Doug Altman, Katrina Williams, Jill
More informationPSA and the Future. Axel Heidenreich, Department of Urology
PSA and the Future Axel Heidenreich, Department of Urology PSA and Prostate Cancer EAU Guideline 2011 PSA is a continuous variable PSA value (ng/ml) risk of PCa, % 0 0.5 6.6 0.6 1 10.1 1.1 2 17.0 2.1 3
More informationBAYESIAN JOINT LONGITUDINAL-DISCRETE TIME SURVIVAL MODELS: EVALUATING BIOPSY PROTOCOLS IN ACTIVE-SURVEILLANCE STUDIES
BAYESIAN JOINT LONGITUDINAL-DISCRETE TIME SURVIVAL MODELS: EVALUATING BIOPSY PROTOCOLS IN ACTIVE-SURVEILLANCE STUDIES Lurdes Y. T. Inoue, PhD Professor Department of Biostatistics University of Washington
More informationContent. Basic Statistics and Data Analysis for Health Researchers from Foreign Countries. Research question. Example Newly diagnosed Type 2 Diabetes
Content Quantifying association between continuous variables. Basic Statistics and Data Analysis for Health Researchers from Foreign Countries Volkert Siersma siersma@sund.ku.dk The Research Unit for General
More informationNIH Public Access Author Manuscript World J Urol. Author manuscript; available in PMC 2012 February 1.
NIH Public Access Author Manuscript Published in final edited form as: World J Urol. 2011 February ; 29(1): 11 14. doi:10.1007/s00345-010-0625-4. Significance of preoperative PSA velocity in men with low
More information4. Model evaluation & selection
Foundations of Machine Learning CentraleSupélec Fall 2017 4. Model evaluation & selection Chloé-Agathe Azencot Centre for Computational Biology, Mines ParisTech chloe-agathe.azencott@mines-paristech.fr
More informationOBSERVATIONAL MEDICAL OUTCOMES PARTNERSHIP
OBSERVATIONAL Patient-centered observational analytics: New directions toward studying the effects of medical products Patrick Ryan on behalf of OMOP Research Team May 22, 2012 Observational Medical Outcomes
More informationBJUI. Study Type Prognosis (individual cohort study) Level of Evidence 2b OBJECTIVES CONCLUSIONS
. JOURNAL COMPILATION 2008 BJU INTERNATIONAL Urological Oncology PREDICTING THE OUTCOME OF PROSTATE BIOPSY HERNANDEZ et al. BJUI BJU INTERNATIONAL Predicting the outcome of prostate biopsy: comparison
More informationUNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Midterm, 2016
UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Midterm, 2016 Exam policy: This exam allows one one-page, two-sided cheat sheet; No other materials. Time: 80 minutes. Be sure to write your name and
More informationDiagnostic methods 2: receiver operating characteristic (ROC) curves
abc of epidemiology http://www.kidney-international.org & 29 International Society of Nephrology Diagnostic methods 2: receiver operating characteristic (ROC) curves Giovanni Tripepi 1, Kitty J. Jager
More informationSupplementary Materials
Supplementary Materials July 2, 2015 1 EEG-measures of consciousness Table 1 makes explicit the abbreviations of the EEG-measures. Their computation closely follows Sitt et al. (2014) (supplement). PE
More information10/2/2018 OBJECTIVES PROSTATE HEALTH BACKGROUND THE PROSTATE HEALTH INDEX PHI*: BETTER PROSTATE CANCER DETECTION
THE PROSTATE HEALTH INDEX PHI*: BETTER PROSTATE CANCER DETECTION Lenette Walters, MS, MT(ASCP) Medical Affairs Manager Beckman Coulter, Inc. *phi is a calculation using the values from PSA, fpsa and p2psa
More informationJ Clin Oncol 25: by American Society of Clinical Oncology INTRODUCTION
VOLUME 25 NUMBER 21 JULY 20 2007 JOURNAL OF CLINICAL ONCOLOGY O R I G I N A L R E P O R T Prediction of Prostate Cancer for Patients Receiving Finasteride: Results From the Prostate Cancer Prevention Trial
More informationCombining Predictors for Classification Using the Area Under the ROC Curve
UW Biostatistics Working Paper Series 6-7-2004 Combining Predictors for Classification Using the Area Under the ROC Curve Margaret S. Pepe University of Washington, mspepe@u.washington.edu Tianxi Cai Harvard
More informationBayesian Methods for Medical Test Accuracy. Broemeling & Associates Inc., 1023 Fox Ridge Road, Medical Lake, WA 99022, USA;
Diagnostics 2011, 1, 1-35; doi:10.3390/diagnostics1010001 OPEN ACCESS diagnostics ISSN 2075-4418 www.mdpi.com/journal/diagnostics/ Review Bayesian Methods for Medical Test Accuracy Lyle D. Broemeling Broemeling
More informationSupplemental Information
Supplemental Information Prediction of Prostate Cancer Recurrence using Quantitative Phase Imaging Shamira Sridharan 1, Virgilia Macias 2, Krishnarao Tangella 3, André Kajdacsy-Balla 2 and Gabriel Popescu
More informationCHL 5225 H Advanced Statistical Methods for Clinical Trials. CHL 5225 H The Language of Clinical Trials
CHL 5225 H Advanced Statistical Methods for Clinical Trials Two sources for course material 1. Electronic blackboard required readings 2. www.andywillan.com/chl5225h code of conduct course outline schedule
More informationStatistics, Probability and Diagnostic Medicine
Statistics, Probability and Diagnostic Medicine Jennifer Le-Rademacher, PhD Sponsored by the Clinical and Translational Science Institute (CTSI) and the Department of Population Health / Division of Biostatistics
More informationPredictive Models. Michael W. Kattan, Ph.D. Department of Quantitative Health Sciences and Glickman Urologic and Kidney Institute
Predictive Models Michael W. Kattan, Ph.D. Department of Quantitative Health Sciences and Glickman Urologic and Kidney Institute Treatment for clinically localized prostate cancer Trade off: Substantial
More informationThe index of prediction accuracy: an intuitive measure useful for evaluating risk prediction models
Kattan and Gerds Diagnostic and Prognostic Research (2018) 2:7 https://doi.org/10.1186/s41512-018-0029-2 Diagnostic and Prognostic Research METHODOLOGY Open Access The index of prediction accuracy: an
More informationBMI 541/699 Lecture 16
BMI 541/699 Lecture 16 Where we are: 1. Introduction and Experimental Design 2. Exploratory Data Analysis 3. Probability 4. T-based methods for continous variables 5. Proportions & contingency tables -
More informationBiost 590: Statistical Consulting
Biost 590: Statistical Consulting Statistical Classification of Scientific Questions October 3, 2008 Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics, University of Washington 2000, Scott S. Emerson,
More informationLecture Outline Biost 517 Applied Biostatistics I
Lecture Outline Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 2: Statistical Classification of Scientific Questions Types of
More informationLecture Outline Biost 517 Applied Biostatistics I. Statistical Goals of Studies Role of Statistical Inference
Lecture Outline Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Statistical Inference Role of Statistical Inference Hierarchy of Experimental
More informationBiomarker adaptive designs in clinical trials
Review Article Biomarker adaptive designs in clinical trials James J. Chen 1, Tzu-Pin Lu 1,2, Dung-Tsa Chen 3, Sue-Jane Wang 4 1 Division of Bioinformatics and Biostatistics, National Center for Toxicological
More informationCritical reading of diagnostic imaging studies. Lecture Goals. Constantine Gatsonis, PhD. Brown University
Critical reading of diagnostic imaging studies Constantine Gatsonis Center for Statistical Sciences Brown University Annual Meeting Lecture Goals 1. Review diagnostic imaging evaluation goals and endpoints.
More informationA mathematical model of tumor dynamics during stereotactic body radiation therapy for non-small cell lung cancer
A mathematical model of tumor dynamics during stereotactic body radiation therapy for non-small cell lung cancer Russell Injerd, Emma Turian Abstract Image guided radiotherapy allows tumor volume dynamics
More informationSensitivity, Specificity, and Relatives
Sensitivity, Specificity, and Relatives Brani Vidakovic ISyE 6421/ BMED 6700 Vidakovic, B. Se Sp and Relatives January 17, 2017 1 / 26 Overview Today: Vidakovic, B. Se Sp and Relatives January 17, 2017
More informationA Hybrid Approach for Mining Metabolomic Data
A Hybrid Approach for Mining Metabolomic Data Dhouha Grissa 1,3, Blandine Comte 1, Estelle Pujos-Guillot 2, and Amedeo Napoli 3 1 INRA, UMR1019, UNH-MAPPING, F-63000 Clermont-Ferrand, France, 2 INRA, UMR1019,
More informationLimitations of the Odds Ratio in Gauging the Performance of a Diagnostic, Prognostic, or Screening Marker
American Journal of Epidemiology Copyright 2004 by the Johns Hopkins Bloomberg School of Public Health All rights reserved Vol. 159, No. 9 Printed in U.S.A. DOI: 10.1093/aje/kwh101 Limitations of the Odds
More informationKnowledge Discovery and Data Mining. Testing. Performance Measures. Notes. Lecture 15 - ROC, AUC & Lift. Tom Kelsey. Notes
Knowledge Discovery and Data Mining Lecture 15 - ROC, AUC & Lift Tom Kelsey School of Computer Science University of St Andrews http://tom.home.cs.st-andrews.ac.uk twk@st-andrews.ac.uk Tom Kelsey ID5059-17-AUC
More informationElevated PSA. Dr.Nesaretnam Barr Kumarakulasinghe Associate Consultant Medical Oncology National University Cancer Institute, Singapore 9 th July 2017
Elevated PSA Dr.Nesaretnam Barr Kumarakulasinghe Associate Consultant Medical Oncology National University Cancer Institute, Singapore 9 th July 2017 Issues we will cover today.. The measurement of PSA,
More information1 Introduction. st0020. The Stata Journal (2002) 2, Number 3, pp
The Stata Journal (22) 2, Number 3, pp. 28 289 Comparative assessment of three common algorithms for estimating the variance of the area under the nonparametric receiver operating characteristic curve
More informationDepartment of Epidemiology, Rollins School of Public Health, Emory University, Atlanta GA, USA.
A More Intuitive Interpretation of the Area Under the ROC Curve A. Cecile J.W. Janssens, PhD Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta GA, USA. Corresponding
More informationMETHODS FOR DETECTING CERVICAL CANCER
Chapter III METHODS FOR DETECTING CERVICAL CANCER 3.1 INTRODUCTION The successful detection of cervical cancer in a variety of tissues has been reported by many researchers and baseline figures for the
More informationInfluence of Hypertension and Diabetes Mellitus on. Family History of Heart Attack in Male Patients
Applied Mathematical Sciences, Vol. 6, 01, no. 66, 359-366 Influence of Hypertension and Diabetes Mellitus on Family History of Heart Attack in Male Patients Wan Muhamad Amir W Ahmad 1, Norizan Mohamed,
More informationDynamic prediction using joint models for recurrent and terminal events: Evolution after a breast cancer
Dynamic prediction using joint models for recurrent and terminal events: Evolution after a breast cancer A. Mauguen, B. Rachet, S. Mathoulin-Pélissier, S. Siesling, G. MacGrogan, A. Laurent, V. Rondeau
More informationSCHOOL OF MATHEMATICS AND STATISTICS
Data provided: Tables of distributions MAS603 SCHOOL OF MATHEMATICS AND STATISTICS Further Clinical Trials Spring Semester 014 015 hours Candidates may bring to the examination a calculator which conforms
More informationEstimation of Area under the ROC Curve Using Exponential and Weibull Distributions
XI Biennial Conference of the International Biometric Society (Indian Region) on Computational Statistics and Bio-Sciences, March 8-9, 22 43 Estimation of Area under the ROC Curve Using Exponential and
More informationNet Reclassification Risk: a graph to clarify the potential prognostic utility of new markers
Net Reclassification Risk: a graph to clarify the potential prognostic utility of new markers Ewout Steyerberg Professor of Medical Decision Making Dept of Public Health, Erasmus MC Birmingham July, 2013
More informationSurvival Prediction Models for Estimating the Benefit of Post-Operative Radiation Therapy for Gallbladder Cancer and Lung Cancer
Survival Prediction Models for Estimating the Benefit of Post-Operative Radiation Therapy for Gallbladder Cancer and Lung Cancer Jayashree Kalpathy-Cramer PhD 1, William Hersh, MD 1, Jong Song Kim, PhD
More informationFrom single studies to an EBM based assessment some central issues
From single studies to an EBM based assessment some central issues Doug Altman Centre for Statistics in Medicine, Oxford, UK Prognosis Prognosis commonly relates to the probability or risk of an individual
More informationDeveloping a new score system for patients with PSA ranging from 4 to 20 ng/ ml to improve the accuracy of PCa detection
DOI 10.1186/s40064-016-3176-3 RESEARCH Open Access Developing a new score system for patients with PSA ranging from 4 to 20 ng/ ml to improve the accuracy of PCa detection Yuxiao Zheng, Yuan Huang, Gong
More informationTitle: A novel differential diagnostic model based on multiple biological parameters for immunoglobulin A nephropathy
Author's response to reviews Title: A novel differential diagnostic model based on multiple biological parameters for immunoglobulin A nephropathy Authors: Nan Zhen Dong (dongzn@301hospital.com.cn) Yong
More informationHeterogeneity and statistical signi"cance in meta-analysis: an empirical study of 125 meta-analyses -
STATISTICS IN MEDICINE Statist. Med. 2000; 19: 1707}1728 Heterogeneity and statistical signi"cance in meta-analysis: an empirical study of 125 meta-analyses - Eric A. Engels *, Christopher H. Schmid, Norma
More informationInterval Likelihood Ratios: Another Advantage for the Evidence-Based Diagnostician
EVIDENCE-BASED EMERGENCY MEDICINE/ SKILLS FOR EVIDENCE-BASED EMERGENCY CARE Interval Likelihood Ratios: Another Advantage for the Evidence-Based Diagnostician Michael D. Brown, MD Mathew J. Reeves, PhD
More informationDiagnostic screening. Department of Statistics, University of South Carolina. Stat 506: Introduction to Experimental Design
Diagnostic screening Department of Statistics, University of South Carolina Stat 506: Introduction to Experimental Design 1 / 27 Ties together several things we ve discussed already... The consideration
More informationAssessing the diagnostic accuracy of a sequence of tests
Biostatistics (2003), 4, 3,pp. 341 351 Printed in Great Britain Assessing the diagnostic accuracy of a sequence of tests MARY LOU THOMPSON Department of Biostatistics, Box 357232, University of Washington,
More informationAn Improved Patient-Specific Mortality Risk Prediction in ICU in a Random Forest Classification Framework
An Improved Patient-Specific Mortality Risk Prediction in ICU in a Random Forest Classification Framework Soumya GHOSE, Jhimli MITRA 1, Sankalp KHANNA 1 and Jason DOWLING 1 1. The Australian e-health and
More informationAnalysis of Rheumatoid Arthritis Data using Logistic Regression and Penalized Approach
University of South Florida Scholar Commons Graduate Theses and Dissertations Graduate School November 2015 Analysis of Rheumatoid Arthritis Data using Logistic Regression and Penalized Approach Wei Chen
More information..biomarkers, running the gauntlet..
The long and winding round for the clinical introduction of a biomarker Molecular diagnostic of prostate cancer based on non invasive liquid biopsies..biomarkers, running the gauntlet.. Prof dr Jack A
More informationThe Potential of Genes and Other Markers to Inform about Risk
Research Article The Potential of Genes and Other Markers to Inform about Risk Cancer Epidemiology, Biomarkers & Prevention Margaret S. Pepe 1,2, Jessie W. Gu 1,2, and Daryl E. Morris 1,2 Abstract Background:
More informationGlucose tolerance status was defined as a binary trait: 0 for NGT subjects, and 1 for IFG/IGT
ESM Methods: Modeling the OGTT Curve Glucose tolerance status was defined as a binary trait: 0 for NGT subjects, and for IFG/IGT subjects. Peak-wise classifications were based on the number of incline
More informationDiscrimination and Reclassification in Statistics and Study Design AACC/ASN 30 th Beckman Conference
Discrimination and Reclassification in Statistics and Study Design AACC/ASN 30 th Beckman Conference Michael J. Pencina, PhD Duke Clinical Research Institute Duke University Department of Biostatistics
More informationTITLE: A Data-Driven Approach to Patient Risk Stratification for Acute Respiratory Distress Syndrome (ARDS)
TITLE: A Data-Driven Approach to Patient Risk Stratification for Acute Respiratory Distress Syndrome (ARDS) AUTHORS: Tejas Prahlad INTRODUCTION Acute Respiratory Distress Syndrome (ARDS) is a condition
More informationAbout OMICS International
About OMICS International OMICS International through its Open Access Initiative is committed to make genuine and reliable contributions to the scientific community. OMICS International hosts over 700
More informationExploitation of Epigenetic Changes to Distinguish Benign from Malignant Prostate Biopsies
Exploitation of Epigenetic Changes to Distinguish Benign from Malignant Prostate Biopsies Disclosures MDxHealth Scientific Advisor 2 Case Study 54-year-old man referred for a PSA of 7 - Healthy, minimal
More informationIt s hard to predict!
Statistical Methods for Prediction Steven Goodman, MD, PhD With thanks to: Ciprian M. Crainiceanu Associate Professor Department of Biostatistics JHSPH 1 It s hard to predict! People with no future: Marilyn
More informationYeast Cells Classification Machine Learning Approach to Discriminate Saccharomyces cerevisiae Yeast Cells Using Sophisticated Image Features.
Yeast Cells Classification Machine Learning Approach to Discriminate Saccharomyces cerevisiae Yeast Cells Using Sophisticated Image Features. Mohamed Tleis Supervisor: Fons J. Verbeek Leiden University
More informationAn Introduction to Bayesian Statistics
An Introduction to Bayesian Statistics Robert Weiss Department of Biostatistics UCLA Fielding School of Public Health robweiss@ucla.edu Sept 2015 Robert Weiss (UCLA) An Introduction to Bayesian Statistics
More informationIntroduction to screening tests. Tim Hanson Department of Statistics University of South Carolina April, 2011
Introduction to screening tests Tim Hanson Department of Statistics University of South Carolina April, 2011 1 Overview: 1. Estimating test accuracy: dichotomous tests. 2. Estimating test accuracy: continuous
More informationSummarising and validating test accuracy results across multiple studies for use in clinical practice
Summarising and validating test accuracy results across multiple studies for use in clinical practice Richard D. Riley Professor of Biostatistics Research Institute for Primary Care & Health Sciences Thank
More informationMachine learning II. Juhan Ernits ITI8600
Machine learning II Juhan Ernits ITI8600 Hand written digit recognition 64 Example 2: Face recogition Classification, regression or unsupervised? How many classes? Example 2: Face recognition Classification,
More informationEvidence Based Medicine Prof P Rheeder Clinical Epidemiology. Module 2: Applying EBM to Diagnosis
Evidence Based Medicine Prof P Rheeder Clinical Epidemiology Module 2: Applying EBM to Diagnosis Content 1. Phases of diagnostic research 2. Developing a new test for lung cancer 3. Thresholds 4. Critical
More informationOptimization and Machine Learning Methods for Diagnostic Testing of Prostate Cancer
Optimization and Machine Learning Methods for Diagnostic Testing of Prostate Cancer by Selin Merdan A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy
More informationLimitations of the Odds Ratio in Gauging the Performance of a Diagnostic or Prognostic Marker
UW Biostatistics Working Paper Series 1-7-2005 Limitations of the Odds Ratio in Gauging the Performance of a Diagnostic or Prognostic Marker Margaret S. Pepe University of Washington, mspepe@u.washington.edu
More informationRISK PREDICTION MODEL: PENALIZED REGRESSIONS
RISK PREDICTION MODEL: PENALIZED REGRESSIONS Inspired from: How to develop a more accurate risk prediction model when there are few events Menelaos Pavlou, Gareth Ambler, Shaun R Seaman, Oliver Guttmann,
More informationSerum Prostate-Specific Antigen as a Predictor of Prostate Volume in the Community: The Krimpen Study
european urology 51 (2007) 1645 1653 available at www.sciencedirect.com journal homepage: www.europeanurology.com Benign Prostatic Hyperplasia Serum Prostate-Specific Antigen as a Predictor of Prostate
More informationPROSTATE CANCER SCREENING: AN UPDATE
PROSTATE CANCER SCREENING: AN UPDATE William G. Nelson, M.D., Ph.D. Sidney Kimmel Comprehensive Cancer Center at Johns Hopkins American Association for Cancer Research William G. Nelson, M.D., Ph.D. Disclosures
More informationSupplementary Material
Supplementary Material Identification of mir-187 and mir-182 as biomarkers for early diagnosis and prognosis in prostate cancer patients treated with radical prostatectomy Irene Casanova-Salas 1, José
More information7/17/2013. Evaluation of Diagnostic Tests July 22, 2013 Introduction to Clinical Research: A Two week Intensive Course
Evaluation of Diagnostic Tests July 22, 2013 Introduction to Clinical Research: A Two week Intensive Course David W. Dowdy, MD, PhD Department of Epidemiology Johns Hopkins Bloomberg School of Public Health
More informationHorizon Scanning Technology Briefing. Prostate cancer gene 3 (Progensa PCA3) assay in the diagnosis of prostate cancer
Horizon Scanning Technology Briefing National Horizon Scanning Centre Prostate cancer gene 3 (Progensa PCA3) assay in the diagnosis of prostate cancer December 2006 This technology summary is based on
More information4 Diagnostic Tests and Measures of Agreement
4 Diagnostic Tests and Measures of Agreement Diagnostic tests may be used for diagnosis of disease or for screening purposes. Some tests are more effective than others, so we need to be able to measure
More informationPROSTATE CANCER SURVEILLANCE
PROSTATE CANCER SURVEILLANCE ESMO Preceptorship on Prostate Cancer Singapore, 15-16 November 2017 Rosa Nadal National Cancer Institute, NIH Bethesda, USA DISCLOSURE No conflicts of interest to declare
More informationActive Surveillance (AS) is an expectant management. Health Services Research
Factors Influencing Selection of Active Surveillance for Localized Prostate Cancer Health Services Research Jianyu Liu, Paul R. Womble, Selin Merdan, David C. Miller, James E. Montie, Brian T. Denton on
More informationQuestions and Answers About the Prostate-Specific Antigen (PSA) Test
CANCER FACTS N a t i o n a l C a n c e r I n s t i t u t e N a t i o n a l I n s t i t u t e s o f H e a l t h D e p a r t m e n t o f H e a l t h a n d H u m a n S e r v i c e s Questions and Answers
More informationUnderstanding Diagnostic Research Outline of Topics
Albert-Ludwigs-Universität Freiburg Freiräume für wissenschaftliche Weiterbildung Understanding Diagnostic Research Outline of Topics Werner Vach, Veronika Reiser, Izabela Kolankowska In Kooperation mit
More information