Model calibration and Bayesian methods for probabilistic projections
|
|
- Coleen Wilson
- 5 years ago
- Views:
Transcription
1 ETH Zurich Reto Knutti Model calibration and Bayesian methods for probabilistic projections Reto Knutti, IAC ETH
2 Toy model Model: obs = linear trend + noise(variance, spectrum) 1) Short term predictability, 2) separation of trend plus noise, 3) structure of model / model evaluation, 4) calibration/probability
3 Questions What is probabilistic modeling? What is it useful for? Why is it difficult? What is model calibration in the climate model context? Why is it helpful? Why is it hard? Is it ok to tune a model? Why yes, why not?
4 The EU, UNFCCC and 2 C [...] the Council believes that global average temperatures should not exceed 2 degrees above pre-industrial level and that therefore concentration levels lower than 550 ppm CO 2 should guide global limitation and reduction efforts.[...] (1939th Council meeting, Luxembourg, 25 June 1996) The European Council calls upon all Parties to embrace the 2 C objective and to agree to global emission reductions of at least 50%, and aggregate developed country emission reductions of at least 80-95%, as part of such global emission reductions, by 2050 compared to 1990 levels. (EU Council, 2009) The Paris agreement aims at holding the increase in the global average temperature to well below 2 C above pre-industrial levels and to pursue efforts to limit the temperature increase to 1.5 C above preindustrial levels (UNFCCC Paris, 2015)
5 Why 2 C? 2 C has been agreed formally as a climate target. Science alone cannot defend 2 C. 2 C may be the worst we can tolerate and the best we can hope for. Even 2 C will have significant adverse impacts that require adaptation. Warming without intervention is likely to have serious negative and potentially irreversible impacts. 2 C as an illustration of a mitigation scenario. The following ideas apply also to any other target.
6 How do we get there? 2 C? Similar to our toy model idea, to answer this we need: a model to make prediction calibration to observations to take into account uncertainties
7 How do we get there? 2 C Similar to our toy model idea, to answer this we need: a model to make prediction calibration to observations to take into account uncertainties
8 Definitions Verification/Validation: any model is a simplification of the target system and cannot strictly be verified, i.e. proven to be true, nor can it be validated in the sense of being shown to accurately represent all the relevant processes Evaluation: testing a model and comparing model results with observations Calibration: estimating values for unknown or uncertain parameters Tuning: calibration, but with a negative undertone of being dishonest and adjusting parameters to get the right effect for the wrong reason Agreement between model and data does not imply that the modelling assumptions accurately describe the processes producing the observed climate system behaviour; it merely indicates that the model is one (of maybe several) that is plausible, meaning it is empirically adequate for a particular purpose.
9 Frequentist vs Bayes The probability of throwing 6 with a die is 1/6. Frequency of occurrence in a repeated experiment. Global temperature change in 2100 will be in the range of 2 to 3 C with 66% probability. Single outcome, true but unknown value. Probability is a degree of belief, probability measures the degree to which different outcomes are supported by current evidence (data, models), quantifies my judgement of what will happen.
10 Bayesian inference Thomas Bayes ( , Tunbridge Wells, Kent ) P( A, B) = P( A) P( B A) = P( B) P( A B) P( B A) = P( B) P( A B) P( A) What we want to know P( par data) = Likelihood (often Prior from a model) P( par) P( data par) P( data) Normalization
11 Example Prior: P(sun) = 0.8, P(rain) = 0.2 P(swim sun) = 0.5, P(swim rain) = 0.1 Thomas went swimming. What is the probability that the sun was shining given that additional information? P(sun swim) = P(swim sun) P(sun) / P(swim) =?
12 Bayesian inference Bayesian inference uses a numerical estimate of the degree of belief in a hypothesis before evidence has been observed and calculates a numerical estimate of the degree of belief in the hypothesis after evidence has been observed. Bayesian inference usually relies on degrees of belief, or subjective probabilities, in the induction process and does not necessarily claim to provide an objective method of induction (Source: Wikipedia)
13 Energy (im)balance Q = F - λ T GHG F λ T 2 Equilibrium CO 2 only GHG Transient Q=0 Aerosol F λ T 1 Q Equilibrium: Q = 0 F = λ T 2 Climate sensitivity: Global equilibrium temperature change for double CO 2 forcing: S = 1 / λ = T 2 / F Commitment warming: T 2 - T 1
14 How much warming and CO 2 is dangerous? Involves value judgments Equilibrium warming depends only on climate sensitivity 450 ppm equivalent CO 2 gives a ~50% probability for keeping warming below 2 C (Knutti and Hegerl 2008, based on IPCC 2007)
15 Compensating effects of forcing and feedbacks High S (small λ), small F Q = F - λ T Low S (large λ), large F
16 Climate sensitivity IPCC AR4: Climate sensitivity is most likely near 3 C, likely (>66%) in the range C, very likely (>90%) larger than 1.5 C. Disturbingly long tail at the upper end. IPCC AR5: likely C, less fat tail (Knutti and Hegerl 2008)
17 Why the long tail? (1) Equilibrium climate sensitivity is not well constrained from the transient climate response (Knutti et al. 2005)
18 Why the long tail? (2) Sensitivity S=1/(1-f) if f is the feedback/gain Explains much of the shape of most PDFs if the distribution of the feedbacks f is normal Shown by Roe and Baker 2007, but concept is 25 years old 30% reduction in feedback uncertainty would bring the 95% level from 8.5 C down to 6 C % reduction in feedback uncertainty (Knutti and Hegerl 2008, modified from Roe and Baker 2007)
19 Does the fat tail of climate sensitivity matter? There is a small probability that climate change may be very large. Allen and Frame 2007: The upper bound of sensitivity is inherently hard to find but does not matter, we simply have to adapt our stabilization CO 2 target as we go along and observe. For discount rates of a few percent anything beyond 50 or 100 years is irrelevant, so we should not care about sensitivity and stabilization. Martin Weitzman: the tail of the sensitivity is not only long but fat (polynomial). If the damage function is exponential, the expected damage is infinite. The somewhat strange conclusion is that we should allocate all resources to prevent the tiny probability of a true catastrophe.
20 Probabilistic projections with simple models?
21 Probabilistic projections with simple models
22 Probabilistic projections with simple models
23 Probabilistic projections with simple models Economic uncertainties are reflected in scenarios Bayesian methods use observations to yield probabilistic projections.
24 Probabilistic attribution of warming Assume priors on model parameters Use Bayesian method to constrain parameters based on observations Run single forcings with constrained parameter distributions (Huber and Knutti, 2011)
25 Probabilistic attribution of warming Observed warming and ocean heat uptake, combined with prior knowledge about forcing and a model allow for attribution of the observed warming to causes Very likely more than 75% of the warming is externally forced Warming due to greenhouse gases very likely larger than the observed, and partly compensated by aerosol cooling. (Huber and Knutti, 2011)
26 The hard bits For Bayesian studies, PDFs depend on the assumed prior distribution. Uniform priors in climate sensitivity have been used as uninformative priors but have been criticized and may be overly pessimistic. No prior knowledge is impossible. Expert priors are unlikely to be independent of the data. Fuzzy PDFs, classes of priors, In theory, combining independent constraints should lead to a more narrow constraints. In practice, there is no formal way to combine different PDFs. We don t know how to properly account for structural uncertainty.
27 Bayesian methods Decide on a model that describes the qualitative behavior of your system. Decide on a prior distribution for uncertain parameters that reflects your prior belief before using the data. Calculate the posterior PDF of the parameters given the data Use posterior PDFs to make predictions, understand system,
28 Open issues Results depend strongly on prior distribution if the data constraint is weak. (Frame et al. 2005)
29 Thoughts on prior distributions There is usually no correct prior, every prior is subjective. There is no uninformative prior. MY PDF rather than THE PDF, because it is conditional on prior, data, model, assumptions, Avoid double counting. Prior knowledge and model must not be influenced by the data (or the amount of data). Avoid prior that gives zero probability to things that may be possible. Priors are particularly problematic if the data constraint is weak.
30 Expert prior distributions of climate sensitivity A uniform prior in the 1-10K (1-100K) range assumes >50% (>95%) probability that sensitivity is higher than any of the CMIP models. Expert priors may be an alternative to flat priors. But which expert should we ask? How do we ensure the data has not been used in generating the prior? (Morgan and Keith, 1995)
31 Constructing a likelihood Weighting for example by exp(-(model-observations)^2) RMS error (relative to internal variability)
32 Open issues All models are wrong. Structural error is usually not taken into account. Adding data might show that the model is inadequate. Sometimes all models have near zero likelihood, but we just scale them up such that the PDF integrates to one. Add discrepancy term. (Sanderson et al 2008)
33 Computational aspects Analytical solutions are rarely possible. Simple brute force Monte Carlo sampling is often unfeasible. Imagine a climate model with 20 parameters and testing 10 values for each parameter. How long would this take? Importance sampling, Markov Chain Monte Carlo sampling etc. are powerful methods to approximate the posterior, but they are still expensive. Some are sequential and therefore slow. The acceptable parameter space may be very small. Imagine that two of the ten values for each of the 20 parameters give a good fit. How big is the hit rate for a good fit with random sampling?
34 Do people understand probabilities?
35 Do we need PDFs, and when should we stop? PDF of change in summer mean daily maximum temperature (ºC) over a particular 25 km square by the 2080s under the High emissions scenario. (UKCP09) Given the acknowledged systematic errors in all current climate models, treating model outputs as decision-relevant probabilistic forecasts can be seriously misleading. This casts doubt on our ability, today, to make trustworthy, high-resolution predictions out to the end of this century (Frigg et al. 2013)
36 Do we need PDFs, and when should we stop? PDFs in principal convey the maximum information. In an ideal quantifiable world, shared values/attitude towards risk, and an agreed goal, they allow for an optimal decision. Probabilistic methods are not fully objective, but they help formalize uncertainty assessments by being explicit about priors, data, methods. But they are technically very hard. And they are hard to communicate. In the presence of deep uncertainties, they may depend sensitively on subjective choice (structure, prior, model discrepancy), and imply accuracy that is not justified, in particular in the tails. Robust decisions are not optimal but perform well under a broad range of outcomes.
The Context of Detection and Attribution
10.2.1 The Context of Detection and Attribution In IPCC Assessments, detection and attribution involve quantifying the evidence for a causal link between external drivers of climate change and observed
More informationClimate-Related Decision Making Under Uncertainty. Chris Weaver February 2016
Climate-Related Decision Making Under Uncertainty Chris Weaver February 2016 Why is climate change decision making hard? Climate change is a uniquely tricky problem But effective, science-based decision
More informationBayesian and Frequentist Approaches
Bayesian and Frequentist Approaches G. Jogesh Babu Penn State University http://sites.stat.psu.edu/ babu http://astrostatistics.psu.edu All models are wrong But some are useful George E. P. Box (son-in-law
More informationBayesians methods in system identification: equivalences, differences, and misunderstandings
Bayesians methods in system identification: equivalences, differences, and misunderstandings Johan Schoukens and Carl Edward Rasmussen ERNSI 217 Workshop on System Identification Lyon, September 24-27,
More informationGuidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties
Guidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties IPCC Cross-Working Group Meeting on Consistent Treatment of Uncertainties Jasper Ridge, CA, USA
More informationThe Human Side of Science: I ll Take That Bet! Balancing Risk and Benefit. Uncertainty, Risk and Probability: Fundamental Definitions and Concepts
The Human Side of Science: I ll Take That Bet! Balancing Risk and Benefit Uncertainty, Risk and Probability: Fundamental Definitions and Concepts What Is Uncertainty? A state of having limited knowledge
More informationLecture 2: Learning and Equilibrium Extensive-Form Games
Lecture 2: Learning and Equilibrium Extensive-Form Games III. Nash Equilibrium in Extensive Form Games IV. Self-Confirming Equilibrium and Passive Learning V. Learning Off-path Play D. Fudenberg Marshall
More informationUNLOCKING VALUE WITH DATA SCIENCE BAYES APPROACH: MAKING DATA WORK HARDER
UNLOCKING VALUE WITH DATA SCIENCE BAYES APPROACH: MAKING DATA WORK HARDER 2016 DELIVERING VALUE WITH DATA SCIENCE BAYES APPROACH - MAKING DATA WORK HARDER The Ipsos MORI Data Science team increasingly
More informationCombining Risks from Several Tumors Using Markov Chain Monte Carlo
University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln U.S. Environmental Protection Agency Papers U.S. Environmental Protection Agency 2009 Combining Risks from Several Tumors
More informationImproving the U.S. Public s Understanding of Climate Change
Improving the U.S. Public s Understanding of Climate Change Paul C. Stern, Director, Committee on the Human Dimensions of Global Change National Research Council, USA Presentation to Symposium on Communicating
More informationSubjectivity and objectivity in Bayesian statistics: rejoinder to the discussion
Bayesian Analysis (2006) 1, Number 3, pp. 465 472 Subjectivity and objectivity in Bayesian statistics: rejoinder to the discussion Michael Goldstein It has been very interesting to engage in this discussion
More informationST440/550: Applied Bayesian Statistics. (10) Frequentist Properties of Bayesian Methods
(10) Frequentist Properties of Bayesian Methods Calibrated Bayes So far we have discussed Bayesian methods as being separate from the frequentist approach However, in many cases methods with frequentist
More informationExpert judgements in risk and reliability analysis
Expert judgements in risk and reliability analysis Jan-Erik Holmberg M2-E2117 Risk analysis, April 17, 2016 Aalto university Contents Definitions Applications Bayesian approach Examples 2 Background Objective,
More informationIntroduction. Patrick Breheny. January 10. The meaning of probability The Bayesian approach Preview of MCMC methods
Introduction Patrick Breheny January 10 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/25 Introductory example: Jane s twins Suppose you have a friend named Jane who is pregnant with twins
More informationA Decision-Theoretic Approach to Evaluating Posterior Probabilities of Mental Models
A Decision-Theoretic Approach to Evaluating Posterior Probabilities of Mental Models Jonathan Y. Ito and David V. Pynadath and Stacy C. Marsella Information Sciences Institute, University of Southern California
More informationA Brief Introduction to Bayesian Statistics
A Brief Introduction to Statistics David Kaplan Department of Educational Psychology Methods for Social Policy Research and, Washington, DC 2017 1 / 37 The Reverend Thomas Bayes, 1701 1761 2 / 37 Pierre-Simon
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 10: Introduction to inference (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 17 What is inference? 2 / 17 Where did our data come from? Recall our sample is: Y, the vector
More informationCombining Risks from Several Tumors using Markov chain Monte Carlo (MCMC)
Combining Risks from Several Tumors using Markov chain Monte Carlo (MCMC) Leonid Kopylev & Chao Chen NCEA/ORD/USEPA The views expressed in this presentation are those of the authors and do not necessarily
More informationStructural assessment of heritage buildings
Defence Sites 69 Structural assessment of heritage buildings M. Holicky & M. Sykora Klokner Institute, Czech Technical University in Prague, Czech Republic Abstract Reliability assessment of heritage buildings
More informationWe Can Test the Experience Machine. Response to Basil SMITH Can We Test the Experience Machine? Ethical Perspectives 18 (2011):
We Can Test the Experience Machine Response to Basil SMITH Can We Test the Experience Machine? Ethical Perspectives 18 (2011): 29-51. In his provocative Can We Test the Experience Machine?, Basil Smith
More informationRisk Interpretation and Action
Risk Interpretation and Action J. Richard Eiser 1, Ann Bostrom 2, Ian Burton 3, David Johnston 4, John McClure 5, Douglas Paton 6, Joop van der Pligt 7, Mathew White 8. 1 University of Sheffield, UK; 2
More informationSpatial and Temporal Data Fusion for Biosurveillance
Spatial and Temporal Data Fusion for Biosurveillance Karen Cheng, David Crary Applied Research Associates, Inc. Jaideep Ray, Cosmin Safta, Mahmudul Hasan Sandia National Laboratories Contact: Ms. Karen
More informationConfirmation Bias. this entry appeared in pp of in M. Kattan (Ed.), The Encyclopedia of Medical Decision Making.
Confirmation Bias Jonathan D Nelson^ and Craig R M McKenzie + this entry appeared in pp. 167-171 of in M. Kattan (Ed.), The Encyclopedia of Medical Decision Making. London, UK: Sage the full Encyclopedia
More informationIntroduction to Machine Learning. Katherine Heller Deep Learning Summer School 2018
Introduction to Machine Learning Katherine Heller Deep Learning Summer School 2018 Outline Kinds of machine learning Linear regression Regularization Bayesian methods Logistic Regression Why we do this
More informationA Cue Imputation Bayesian Model of Information Aggregation
A Cue Imputation Bayesian Model of Information Aggregation Jennifer S. Trueblood, George Kachergis, and John K. Kruschke {jstruebl, gkacherg, kruschke}@indiana.edu Cognitive Science Program, 819 Eigenmann,
More informationLearning from data when all models are wrong
Learning from data when all models are wrong Peter Grünwald CWI / Leiden Menu Two Pictures 1. Introduction 2. Learning when Models are Seriously Wrong Joint work with John Langford, Tim van Erven, Steven
More informationHow Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis?
How Does Analysis of Competing Hypotheses (ACH) Improve Intelligence Analysis? Richards J. Heuer, Jr. Version 1.2, October 16, 2005 This document is from a collection of works by Richards J. Heuer, Jr.
More informationBayesian integration in sensorimotor learning
Bayesian integration in sensorimotor learning Introduction Learning new motor skills Variability in sensors and task Tennis: Velocity of ball Not all are equally probable over time Increased uncertainty:
More informationHow to get the most out of data with Bayes
How to get the most out of data with Bayes Thomas Bayes 1702-1761 Zoltán Dienes Harold Jeffreys 1891-1989 Evidence for H0 No evidence to speak of Evidence for H1 P-values make a two-way distinction: Evidence
More informationOn the meaning of independence in climate science
doi:10.5194/esd-8-211-2017 Author(s) 2017. CC Attribution 3.0 License. On the meaning of independence in climate science James D. Annan and Julia C. Hargreaves BlueSkiesResearch.org.uk, The Old Chapel,
More informationAn Experimental Investigation of Self-Serving Biases in an Auditing Trust Game: The Effect of Group Affiliation: Discussion
1 An Experimental Investigation of Self-Serving Biases in an Auditing Trust Game: The Effect of Group Affiliation: Discussion Shyam Sunder, Yale School of Management P rofessor King has written an interesting
More informationType and quantity of data needed for an early estimate of transmissibility when an infectious disease emerges
Research articles Type and quantity of data needed for an early estimate of transmissibility when an infectious disease emerges N G Becker (Niels.Becker@anu.edu.au) 1, D Wang 1, M Clements 1 1. National
More informationJohn Quigley, Tim Bedford, Lesley Walls Department of Management Science, University of Strathclyde, Glasgow
Empirical Bayes Estimates of Development Reliability for One Shot Devices John Quigley, Tim Bedford, Lesley Walls Department of Management Science, University of Strathclyde, Glasgow This article describes
More informationBeyond Subjective and Objective in Statistics
June 05 Foundations of Statistics Other objectivity vs. subjectivity issues The current discourse is not helpful. Objectivity and Subjectivity in Statistics Starting point: how are these terms used in
More informationArtificial Intelligence Programming Probability
Artificial Intelligence Programming Probability Chris Brooks Department of Computer Science University of San Francisco Department of Computer Science University of San Francisco p.1/25 17-0: Uncertainty
More informationPolitical Science 15, Winter 2014 Final Review
Political Science 15, Winter 2014 Final Review The major topics covered in class are listed below. You should also take a look at the readings listed on the class website. Studying Politics Scientifically
More informationRecognizing Ambiguity
Recognizing Ambiguity How Lack of Information Scares Us Mark Clements Columbia University I. Abstract In this paper, I will examine two different approaches to an experimental decision problem posed by
More informationCISC453 Winter Probabilistic Reasoning Part B: AIMA3e Ch
CISC453 Winter 2010 Probabilistic Reasoning Part B: AIMA3e Ch 14.5-14.8 Overview 2 a roundup of approaches from AIMA3e 14.5-14.8 14.5 a survey of approximate methods alternatives to the direct computing
More informationDecisions based on verbal probabilities: Decision bias or decision by belief sampling?
Decisions based on verbal probabilities: Decision bias or decision by belief sampling? Hidehito Honda (hitohonda.02@gmail.com) Graduate School of Arts and Sciences, The University of Tokyo 3-8-1, Komaba,
More informationJournal of Political Economy, Vol. 93, No. 2 (Apr., 1985)
Confirmations and Contradictions Journal of Political Economy, Vol. 93, No. 2 (Apr., 1985) Estimates of the Deterrent Effect of Capital Punishment: The Importance of the Researcher's Prior Beliefs Walter
More informationSupplementary notes for lecture 8: Computational modeling of cognitive development
Supplementary notes for lecture 8: Computational modeling of cognitive development Slide 1 Why computational modeling is important for studying cognitive development. Let s think about how to study the
More informationGeneric Priors Yield Competition Between Independently-Occurring Preventive Causes
Powell, D., Merrick, M. A., Lu, H., & Holyoak, K.J. (2014). Generic priors yield competition between independentlyoccurring preventive causes. In B. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.),
More informationFAQ: Heuristics, Biases, and Alternatives
Question 1: What is meant by the phrase biases in judgment heuristics? Response: A bias is a predisposition to think or act in a certain way based on past experience or values (Bazerman, 2006). The term
More informationAtt vara eller inte vara (en Bayesian)?... Sherlock-conundrum
Att vara eller inte vara (en Bayesian)?... Sherlock-conundrum (Thanks/blame to Google Translate) Gianluca Baio University College London Department of Statistical Science g.baio@ucl.ac.uk http://www.ucl.ac.uk/statistics/research/statistics-health-economics/
More informationEndogeneity is a fancy word for a simple problem. So fancy, in fact, that the Microsoft Word spell-checker does not recognize it.
Jesper B Sørensen August 2012 Endogeneity is a fancy word for a simple problem. So fancy, in fact, that the Microsoft Word spell-checker does not recognize it. Technically, in a statistical model you have
More informationEvaluation Models STUDIES OF DIAGNOSTIC EFFICIENCY
2. Evaluation Model 2 Evaluation Models To understand the strengths and weaknesses of evaluation, one must keep in mind its fundamental purpose: to inform those who make decisions. The inferences drawn
More informationThe Psychology of Inductive Inference
The Psychology of Inductive Inference Psychology 355: Cognitive Psychology Instructor: John Miyamoto 05/24/2018: Lecture 09-4 Note: This Powerpoint presentation may contain macros that I wrote to help
More informationWhat is a probability? Two schools in statistics: frequentists and Bayesians.
Faculty of Life Sciences Frequentist and Bayesian statistics Claus Ekstrøm E-mail: ekstrom@life.ku.dk Outline 1 Frequentists and Bayesians What is a probability? Interpretation of results / inference 2
More informationIEEE SIGNAL PROCESSING LETTERS, VOL. 13, NO. 3, MARCH A Self-Structured Adaptive Decision Feedback Equalizer
SIGNAL PROCESSING LETTERS, VOL 13, NO 3, MARCH 2006 1 A Self-Structured Adaptive Decision Feedback Equalizer Yu Gong and Colin F N Cowan, Senior Member, Abstract In a decision feedback equalizer (DFE),
More informationDECISION ANALYSIS WITH BAYESIAN NETWORKS
RISK ASSESSMENT AND DECISION ANALYSIS WITH BAYESIAN NETWORKS NORMAN FENTON MARTIN NEIL CRC Press Taylor & Francis Croup Boca Raton London NewYork CRC Press is an imprint of the Taylor Si Francis an Croup,
More informationYou must answer question 1.
Research Methods and Statistics Specialty Area Exam October 28, 2015 Part I: Statistics Committee: Richard Williams (Chair), Elizabeth McClintock, Sarah Mustillo You must answer question 1. 1. Suppose
More informationSo You Want to do a Survey?
Institute of Nuclear Power Operations So You Want to do a Survey? G. Kenneth Koves Ph.D. NAECP Conference, Austin TX 2015 September 29 1 Who am I? Ph.D. in Industrial/Organizational Psychology from Georgia
More informationA Case Study: Two-sample categorical data
A Case Study: Two-sample categorical data Patrick Breheny January 31 Patrick Breheny BST 701: Bayesian Modeling in Biostatistics 1/43 Introduction Model specification Continuous vs. mixture priors Choice
More informationCoherence and calibration: comments on subjectivity and objectivity in Bayesian analysis (Comment on Articles by Berger and by Goldstein)
Bayesian Analysis (2006) 1, Number 3, pp. 423 428 Coherence and calibration: comments on subjectivity and objectivity in Bayesian analysis (Comment on Articles by Berger and by Goldstein) David Draper
More informationResponse to the ASA s statement on p-values: context, process, and purpose
Response to the ASA s statement on p-values: context, process, purpose Edward L. Ionides Alexer Giessing Yaacov Ritov Scott E. Page Departments of Complex Systems, Political Science Economics, University
More informationERA: Architectures for Inference
ERA: Architectures for Inference Dan Hammerstrom Electrical And Computer Engineering 7/28/09 1 Intelligent Computing In spite of the transistor bounty of Moore s law, there is a large class of problems
More informationIntroduction to Bayesian Analysis 1
Biostats VHM 801/802 Courses Fall 2005, Atlantic Veterinary College, PEI Henrik Stryhn Introduction to Bayesian Analysis 1 Little known outside the statistical science, there exist two different approaches
More informationChapter 02 Developing and Evaluating Theories of Behavior
Chapter 02 Developing and Evaluating Theories of Behavior Multiple Choice Questions 1. A theory is a(n): A. plausible or scientifically acceptable, well-substantiated explanation of some aspect of the
More informationBayes theorem describes the probability of an event, based on prior knowledge of conditions that might be related to the event.
Bayes theorem Bayes' Theorem is a theorem of probability theory originally stated by the Reverend Thomas Bayes. It can be seen as a way of understanding how the probability that a theory is true is affected
More informationUSING ASSERTIVENESS TO COMMUNICATE ABOUT SEX
Chapter 5: Sexual Health Exercise 1 USING ASSERTIVENESS TO COMMUNICATE ABOUT SEX Aggressive Passive Manipulative/manipulation Assertive Balance of power Sex Sexual coercion 1. To build learners communication
More informationHow do People Really Think about Climate Change?
How do People Really Think about Climate Change? #LSESunstein Professor Cass Sunstein Robert Walmsley University Professor at Harvard Law School. Former Administrator of the White House Office of Information
More informationLecture Outline. Biost 590: Statistical Consulting. Stages of Scientific Studies. Scientific Method
Biost 590: Statistical Consulting Statistical Classification of Scientific Studies; Approach to Consulting Lecture Outline Statistical Classification of Scientific Studies Statistical Tasks Approach to
More informationComparing Direct and Indirect Measures of Just Rewards: What Have We Learned?
Comparing Direct and Indirect Measures of Just Rewards: What Have We Learned? BARRY MARKOVSKY University of South Carolina KIMMO ERIKSSON Mälardalen University We appreciate the opportunity to comment
More informationBayesian performance
Bayesian performance In this section we will study the statistical properties of Bayesian estimates. Major topics include: The likelihood principle Decision theory/bayes rules Shrinkage estimators Frequentist
More informationHow to weigh the strength of prior information and clarify the expected level of evidence?
How to weigh the strength of prior information and clarify the expected level of evidence? Martin Posch martin.posch@meduniwien.ac.at joint work with Gerald Hlavin Franz König Christoph Male Peter Bauer
More information5 $3 billion per disease
$3 billion per disease Chapter at a glance Our aim is to set a market size large enough to attract serious commercial investment from several pharmaceutical companies that see technological opportunites,
More informationInternational Climate Mitigation Regime Beyond 2012: How Do Quota Allocation Rules Perform Under Uncertainty?
International Climate Mitigation Regime Beyond 2012: How Do Quota Allocation Rules Perform Under Uncertainty? Renaud CRASSOUS, CIRED In collaboration with Franck LECOCQ, World Bank With financial support
More informationSome Thoughts on Expert Elicitation
Some Thoughts on Expert Elicitation Prof. M. Granger Morgan Department of Engineering and Public Policy Carnegie Mellon University 412-268-2672 granger.morgan@andrew.cmu.edu Portions of this talk are based
More informationBayesian (Belief) Network Models,
Bayesian (Belief) Network Models, 2/10/03 & 2/12/03 Outline of This Lecture 1. Overview of the model 2. Bayes Probability and Rules of Inference Conditional Probabilities Priors and posteriors Joint distributions
More informationCitation for published version (APA): Ebbes, P. (2004). Latent instrumental variables: a new approach to solve for endogeneity s.n.
University of Groningen Latent instrumental variables Ebbes, P. IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document
More informationJanuary 2, Overview
American Statistical Association Position on Statistical Statements for Forensic Evidence Presented under the guidance of the ASA Forensic Science Advisory Committee * January 2, 2019 Overview The American
More informationINFERENCING STRATEGIES
INFERENCING STRATEGIES Table of Content Introduction Categories of Reasoning Inference Techniques Control Strategies Comparative Summary of Backward and Forward Chaining Conflict Resolution Goal Agenda
More informationDiscussion Papers in Economics
Discussion Papers in Economics No. 2000/62 No. 2000/39 Dynamics of Output Growth, Consumption and Physical Capital in Two-Sector Bayesian Value-of-Information Models Endogenous Analysis: Growth An Application
More informationFMEA AND RPN NUMBERS. Failure Mode Severity Occurrence Detection RPN A B
FMEA AND RPN NUMBERS An important part of risk is to remember that risk is a vector: one aspect of risk is the severity of the effect of the event and the other aspect is the probability or frequency of
More informationRemarks on Bayesian Control Charts
Remarks on Bayesian Control Charts Amir Ahmadi-Javid * and Mohsen Ebadi Department of Industrial Engineering, Amirkabir University of Technology, Tehran, Iran * Corresponding author; email address: ahmadi_javid@aut.ac.ir
More informationLecture Outline. Biost 517 Applied Biostatistics I. Purpose of Descriptive Statistics. Purpose of Descriptive Statistics
Biost 517 Applied Biostatistics I Scott S. Emerson, M.D., Ph.D. Professor of Biostatistics University of Washington Lecture 3: Overview of Descriptive Statistics October 3, 2005 Lecture Outline Purpose
More informationExpanding the Toolkit: The Potential for Bayesian Methods in Education Research (Symposium)
Expanding the Toolkit: The Potential for Bayesian Methods in Education Research (Symposium) Symposium Abstract, SREE 2017 Spring Conference Organizer: Alexandra Resch, aresch@mathematica-mpr.com Symposium
More informationDoing High Quality Field Research. Kim Elsbach University of California, Davis
Doing High Quality Field Research Kim Elsbach University of California, Davis 1 1. What Does it Mean to do High Quality (Qualitative) Field Research? a) It plays to the strengths of the method for theory
More informationBayesian Inference Bayes Laplace
Bayesian Inference Bayes Laplace Course objective The aim of this course is to introduce the modern approach to Bayesian statistics, emphasizing the computational aspects and the differences between the
More informationDRAFT REPORT HIERARCHY OF METHODS TO CHARACTERIZE UNCERTAINTY: STATE OF SCIENCE OF METHODS FOR DESCRIBING AND QUANTIFYING UNCERTAINTY
DRAFT REPORT HIERARCHY OF METHODS TO CHARACTERIZE UNCERTAINTY: STATE OF SCIENCE OF METHODS FOR DESCRIBING AND QUANTIFYING UNCERTAINTY EPA Contract No. 68-D-00-265 Work Assignment No. 2-24 Prepared by:
More informationPUBLISHED VERSION. Authors. 3 August As per correspondence received 8/07/2015 PERMISSIONS
PUBLSHED VERSON Daniel Navarro Finding hidden types: nductive inference in long-tailed environments Proceedings of the 35th Annual Meeting of the Cognitive Science Society, 2013 / pp.101-10 Authors PERMSSONS
More informationRunning head: INDIVIDUAL DIFFERENCES 1. Why to treat subjects as fixed effects. James S. Adelman. University of Warwick.
Running head: INDIVIDUAL DIFFERENCES 1 Why to treat subjects as fixed effects James S. Adelman University of Warwick Zachary Estes Bocconi University Corresponding Author: James S. Adelman Department of
More informationMacroeconometric Analysis. Chapter 1. Introduction
Macroeconometric Analysis Chapter 1. Introduction Chetan Dave David N. DeJong 1 Background The seminal contribution of Kydland and Prescott (1982) marked the crest of a sea change in the way macroeconomists
More information15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA
15.301/310, Managerial Psychology Prof. Dan Ariely Recitation 8: T test and ANOVA Statistics does all kinds of stuff to describe data Talk about baseball, other useful stuff We can calculate the probability.
More informationNaïve Sampling and Format Dependence in Subjective Probability Calibration
Naïve Sampling and Format Dependence in Subjective Probability Calibration Patrik Hansson (patrik.hansson@psy.umu.se) Department of Psychology, Umeå University SE-901 87, Umeå, Sweden Peter Juslin (peter.juslin@psy.umu.se)
More informationHierarchy of Statistical Goals
Hierarchy of Statistical Goals Ideal goal of scientific study: Deterministic results Determine the exact value of a ment or population parameter Prediction: What will the value of a future observation
More informationEvaluating the Causal Role of Unobserved Variables
Evaluating the Causal Role of Unobserved Variables Christian C. Luhmann (christian.luhmann@vanderbilt.edu) Department of Psychology, Vanderbilt University 301 Wilson Hall, Nashville, TN 37203 USA Woo-kyoung
More informationINTRODUCTION TO BAYESIAN REASONING
International Journal of Technology Assessment in Health Care, 17:1 (2001), 9 16. Copyright c 2001 Cambridge University Press. Printed in the U.S.A. INTRODUCTION TO BAYESIAN REASONING John Hornberger Roche
More informationAnswers to end of chapter questions
Answers to end of chapter questions Chapter 1 What are the three most important characteristics of QCA as a method of data analysis? QCA is (1) systematic, (2) flexible, and (3) it reduces data. What are
More informationBOOTSTRAPPING CONFIDENCE LEVELS FOR HYPOTHESES ABOUT QUADRATIC (U-SHAPED) REGRESSION MODELS
BOOTSTRAPPING CONFIDENCE LEVELS FOR HYPOTHESES ABOUT QUADRATIC (U-SHAPED) REGRESSION MODELS 12 June 2012 Michael Wood University of Portsmouth Business School SBS Department, Richmond Building Portland
More informationLearn 10 essential principles for research in all scientific and social science disciplines
Helpsheet Giblin Eunson Library ESEACH ESSENTIALS Use this sheet to help you: Learn 10 essential principles for research in all scientific and social science disciplines 5 minute self test Look at the
More informationCognitive Science and Bayes. The main question. Several views. Introduction. The main question Several views Examples. The heuristics view
To Bayes or not to Bayes Radboud University Nijmegen 07-04- 09 The original Bayesian view Are people Bayesian estimators? Or more precisely: should cognitive judgments be viewed as following optimal statistical
More informationThe Good Judgment Project: A Large Scale Test of Different Methods of Combining Expert Predictions
AAAI Technical Report FS-12-06 Machine Aggregation of Human Judgment The Good Judgment Project: A Large Scale Test of Different Methods of Combining Expert Predictions Lyle Ungar, Barb Mellors, Ville Satopää,
More informationMinimizing Uncertainty in Property Casualty Loss Reserve Estimates Chris G. Gross, ACAS, MAAA
Minimizing Uncertainty in Property Casualty Loss Reserve Estimates Chris G. Gross, ACAS, MAAA The uncertain nature of property casualty loss reserves Property Casualty loss reserves are inherently uncertain.
More information20. Experiments. November 7,
20. Experiments November 7, 2015 1 Experiments are motivated by our desire to know causation combined with the fact that we typically only have correlations. The cause of a correlation may be the two variables
More informationTesting the robustness of anonymization techniques: acceptable versus unacceptable inferences - Draft Version
Testing the robustness of anonymization techniques: acceptable versus unacceptable inferences - Draft Version Gergely Acs, Claude Castelluccia, Daniel Le étayer 1 Introduction Anonymization is a critical
More informationResponse to Comment on Cognitive Science in the field: Does exercising core mathematical concepts improve school readiness?
Response to Comment on Cognitive Science in the field: Does exercising core mathematical concepts improve school readiness? Authors: Moira R. Dillon 1 *, Rachael Meager 2, Joshua T. Dean 3, Harini Kannan
More informationToday: Statistical inference.
Model Based Statistics in Biology. Part II. Quantifying Uncertainty. Chapter 7 Statistical Inference ReCap. Part I (Chapters 1,2,3,4) ReCap Part II (Ch 5, 6) 7.0 Inferential statistics Probability and
More informationInternal Requirements for Change Agents
for Change Agents The True Purpose Process The inner game of becoming a powerful change agent is of paramount importance. In its ordinary configuration, the ego is not properly tuned and optimized to be
More information