Bayes, Data and NUREG/CR-6928 Caveats Nathan Larson, Carroll Trull September 2017

Similar documents
GOOD SCIENCE Vs UNCERTAIN REGULATORY GUIDANCE or HOW CHI/Q AFFECTS NUCLEAR SAFETY

Probabilistic Modeling to Support and Facilitate Decision Making in Early Drug Development

TIME TO REACH PEAK HEAT RELEASE RATE: Nuclear Plant Electrical Enclosure Fires

Workshop Information IAEA Workshop

Outline. What s inside this paper? My expectation. Software Defect Prediction. Traditional Method. What s inside this paper?

Small Sample Bayesian Factor Analysis. PhUSE 2014 Paper SP03 Dirk Heerwegh

John Quigley, Tim Bedford, Lesley Walls Department of Management Science, University of Strathclyde, Glasgow

MS&E 226: Small Data

Expert judgements in risk and reliability analysis

Introduction to Bayesian Analysis 1

Ecological Statistics

The export of cannabis cultivated in The Netherlands An estimate of the size and a discussion of the possibilities and limitations of the research

Application of Bayesian Networks to Quantitative Assessment of Safety Barriers Performance in the Prevention of Major Accidents

CARISMA-LMS Workshop on Statistics for Risk Analysis

A Brief Introduction to Bayesian Statistics

Stroke-free duration and stroke risk in patients with atrial fibrillation: simulation using a Bayesian inference

Supplementary notes for lecture 8: Computational modeling of cognitive development

CS 520: Assignment 3 - Probabilistic Search (and Destroy)

Knowledge is rarely absolutely certain. In expert systems we need a way to say that something is probably but not necessarily true.

ERA: Architectures for Inference

Bayesian Belief Network Based Fault Diagnosis in Automotive Electronic Systems

OPERATIONAL RISK WITH EXCEL AND VBA

Workshop Information IAEA Workshop

Modeling Terrorist Beliefs and Motivations

Combining Risks from Several Tumors using Markov chain Monte Carlo (MCMC)

Lecture 9 Internal Validity

Modeling Terrorist Beliefs and Motivations

Model calibration and Bayesian methods for probabilistic projections

CHAPTER 6. Conclusions and Perspectives

Bayesian Inference Bayes Laplace

Proof testing of safety-instrumented systems: New testing strategy induced by dangerous detected failures

Sensory specific satiation: using Bayesian networks to combine data from related studies

A Proposal for the Validation of Control Banding Using Bayesian Decision Analysis Techniques

TESTING at any level (e.g., production, field, or on-board)

BAYESIAN HYPOTHESIS TESTING WITH SPSS AMOS

CANCER DIAGNOSIS USING NAIVE BAYES ALGORITHM

Bayesian integration in sensorimotor learning

Political Science 15, Winter 2014 Final Review

Improving statistical estimates used in the courtroom. Precis. Bayes Theorem. Professor Norman Fenton. Queen Mary University of London and Agena Ltd

Lesson 87 Bayes Theorem

Estimating The Size Of Hidden Populations

Chapter 1: Introduction to Statistics

Use of the deterministic and probabilistic approach in the Belgian regulatory context

Hierarchy of Statistical Goals

ICH M4E(R2): Revised Guideline on Common Technical Document -- Efficacy

Exploring the Influence of Particle Filter Parameters on Order Effects in Causal Learning

I. Energy, ATP and Cellular Respiration

PANDAROSA. Probabilistic ANd Deterministic Analysis for Risk-Oriented Severe Accidents Vapor Explosion Risk in Nordic LWRs.

Using Probabilistic Methods to Optimize Data Entry in Accrual of Patients to Clinical Trials

SPRING GROVE AREA SCHOOL DISTRICT. Course Description. Instructional Strategies, Learning Practices, Activities, and Experiences.

Application of Bayesian Network Model for Enterprise Risk Management of Expressway Management Corporation

Artificial Intelligence Programming Probability

Application of Analytical Hierarchy Process and Bayesian Belief Networks for Risk Analysis

Structural Modelling of Operational Risk in Financial Institutions:

Combining Risks from Several Tumors Using Markov Chain Monte Carlo

Cost-effectiveness of endovascular abdominal aortic aneurysm repair Michaels J A, Drury D, Thomas S M

Bayes Linear Statistics. Theory and Methods

THE INDIRECT EFFECT IN MULTIPLE MEDIATORS MODEL BY STRUCTURAL EQUATION MODELING ABSTRACT

Neurons and neural networks II. Hopfield network

You must answer question 1.

Bayesian Logistic Regression Modelling via Markov Chain Monte Carlo Algorithm

Using Bayesian Networks to Direct Stochastic Search in Inductive Logic Programming

FDA-iRISK 4.0 A Comparative Risk Assessment Tool J u l y 6,

What is a probability? Two schools in statistics: frequentists and Bayesians.

Bayesian Hierarchical Models for Fitting Dose-Response Relationships

Behavioral probabilities

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo

Models for Inexact Reasoning. Imprecision and Approximate Reasoning. Miguel García Remesal Department of Artificial Intelligence

Bayesian vs Frequentist

A Method for Statistical Process Control of Radiation Sterilization Facilities

CrimeStat Version 3.1 Update Notes

Marian L Neuhouser, PhD, RD

Child Neuropsychology, in press. On the optimal size for normative samples in neuropsychology: Capturing the

Hypothesis Testing. Richard S. Balkin, Ph.D., LPC-S, NCC

Att vara eller inte vara (en Bayesian)?... Sherlock-conundrum

ST440/550: Applied Bayesian Statistics. (10) Frequentist Properties of Bayesian Methods

Controlling the risk due to the use of gamma sources for NDT First feedback from the deployment of replacement NDT Techniques

The Century of Bayes

Lecture 3: Bayesian Networks 1

An Exercise in Bayesian Econometric Analysis Probit and Linear Probability Models

This is a licensed product of Ken Research and should not be copied

Statistical Analysis Using Machine Learning Approach for Multiple Imputation of Missing Data

Back to Basics - Uncertainty. Presented by: Neill Stanford, CHP Stanford Dosimetry LLC Presented at the 2007 Dosimetry and Records Symposium

A Psychological Model for Aggregating Judgments of Magnitude

A probabilistic method for food web modeling

Bayesian Tailored Testing and the Influence

How to use the Lafayette ESS Report to obtain a probability of deception or truth-telling

Cumulative Risk Assessment

PROBABILISTIC RISK ASSESSMENT OF THE SHIPYARD INDUSTRY USING THE BAYESIAN METHOD

Emergency response - ESTE - Fast running SW tool for source term evaluation and radiological impacts assessment

A Predictive Chronological Model of Multiple Clinical Observations T R A V I S G O O D W I N A N D S A N D A M. H A R A B A G I U

UNLOCKING VALUE WITH DATA SCIENCE BAYES APPROACH: MAKING DATA WORK HARDER

Decisions and Dependence in Influence Diagrams

Topic 4. Representation and Reasoning with Uncertainty

A FRAMEWORK FOR SIMULATIONS IN CLINICAL RESEARCH

FINAL. Recommendations for Update to Arsenic Soil CTL Computation. Methodology Focus Group. Contaminated Soils Forum. Prepared by:

Deposited on: 8 May 2008 Glasgow eprints Service

CISC453 Winter Probabilistic Reasoning Part B: AIMA3e Ch

Estimating Testicular Cancer specific Mortality by Using the Surveillance Epidemiology and End Results Registry

Bayes Theorem Application: Estimating Outcomes in Terms of Probability

Transcription:

Bayes, Data and NUREG/CR-6928 Caveats Nathan Larson, Carroll Trull September 2017 1

Overview State-of-Knowledge Correlation Change-of-State Failure Mode LOCA Treatment Plant Availability Factor Zero Event Bayesian Updating 2

State-of-Knowledge Correlation The correlation between data pools Use Monte Carlo or other sampling method and compare mean with point estimate (within 10% means you re done) Sample on type codes so that multiple components reflect that correlation for a given sample Must use sufficient sample size and a random seed or it defeats the purpose Select sensitivities can be a surrogate because one can do the accounting manually, and a sampling method is effectively a large set of sensitivities If the effect is large (>10%), should artificially account for SoKC in cutsets (e.g., via multiplier E λ2 E λ 2 ) 3

Change-of-State Failure Mode Two general methods are acknowledged in the industry Failure on Demand Failure in Standby NUREG-6823 suggests that either method individually or both methods can be acceptable together. Key consideration is that the data pools will likely be the same Most likely that either failure mechanism was ultimately discovered when a demand on the component was initiated If both methods are applied data would need to be appropriately parsed such that double counting does not occur, time consuming effort 4

Change-of-State Failure Mode Cont. US Industry being driven to consensus failure on demand, data more readily available. NUREG/CR-6928 discusses the standby failure mode in detail as follows: Standby component failure modes such as pump FTS and valve FTO/C historically have been modeled as either demand related (failure probability upon demand) or standby time related (failure rate). For example, the NUREG- 1150 studies expressed such events as probability per demand, while the Probabilistic Safety Analysis Procedures Guide expressed such events as rates per standby time. The present study follows the more traditional approach of probability per demand presently used in the SPAR models. Also, this same approach was taken for the INL system studies, in which significant effort was expended to develop state-of-the-art analysis methodologies This decision was made mainly because the available data were typically collected on a perdemand basis... 5

LOCA Frequencies NUREG-1829 (Tables 7-17 through 7-19) should be used instead of NUREG/CR-6928 Identify approximate applicable break ranges and/or interpolate with a power law fit for specific sizes Determine respective base frequencies from NUREG-1829; must convert from exceedance basis to interval basis (subtract) (NUREG suggests there is not statistical significance to treat percentiles similarly) Normalize frequencies for at-power conditions; should use the same assumption that NUREG/CR-6928 used - that on average, the generic plant operates 90% of the year (divide by 0.9) May need to divide frequencies for model impacts (e.g., per leg) - this should be captured in the Beta to maintain units 6

Zero Event Bayesian Updating Frequencies in NUREG-1829 were used without any changes in NUREG/CR-6928, which was published in 2010; i.e., the experts concluded that NUREG-1829 frequencies remain applicable until at least 2010, without adjustment - therefore, Bayesian update should be back to the NUREG/CR-6928 publish date Bayesian probability distribution is a model of our belief in the true value of an event, and additional data, combined through Bayes Theorem, serves to update our belief in the value; rather than representing random variation, the distribution represents uncertainty in our belief NUREG/CR-6928 does not treat them differently; in fact, it provides prior information for these events specifically for plant-specific use in Bayesian updating 7

Questions? 8