Bayesian methods in health economics

Similar documents
Health economic evaluation: a very Bayesian thing

Att vara eller inte vara (en Bayesian)?... Sherlock-conundrum

A CASE STUDY OF VALUE OF INFORMATION

Cost-Effectiveness and Value of Further Research of Treatment Strategies for Cardiovascular Disease

NICE Guidelines for HTA Issues of Controversy

Bayesian Multiparameter Evidence Synthesis to Inform Decision Making: A Case Study in Metastatic Hormone-Refractory Prostate Cancer

A Brief Introduction to Bayesian Statistics

Health technology The study compared three strategies for diagnosing and treating obstructive sleep apnoea syndrome (OSAS).

Bayesian Joint Modelling of Benefit and Risk in Drug Development

Bayesian and Frequentist Approaches

Appendix. Lifetime extrapolation of data from the randomised controlled DiGEM trial

Pharmacoeconomics: from Policy to Science. Olivia Wu, PhD Health Economics and Health Technology Assessment

Practical Bayesian Design and Analysis for Drug and Device Clinical Trials

Economic evaluation of factorial randomised controlled trials: challenges, methods and recommendations

Using Health Economics to Inform the Development of Medical Devices. Matthew Allsop MATCH / BITECIC

Bringing Together Health Economics and Clinical Research

Outcomes assessed in the review The outcomes assessed in the review and used as model inputs were the incident rates of:

Making Economic Evaluation Fit for Purpose to Guide Resource Allocation Decisions

Cost-effectiveness of endovascular abdominal aortic aneurysm repair Michaels J A, Drury D, Thomas S M

A Case Study: Two-sample categorical data

Real-world observational data in costeffectiveness analyses: Herceptin as a case study

Regression Discontinuity Designs: An Approach to Causal Inference Using Observational Data

Gianluca Baio. University College London Department of Statistical Science.

Performing a cost-effectiveness analysis: surveillance of patients with ulcerative colitis Provenzale D, Wong J B, Onken J E, Lipscomb J

An Introduction to Costeffectiveness

Setting The setting was secondary care. The economic study was conducted in the USA.

Discussion Papers in Economics

Bayesian Logistic Regression Modelling via Markov Chain Monte Carlo Algorithm

27 August 2010 Re: Erlotinib monotherapy for the maintenance treatment of non-small cell lung cancer

This is a repository copy of Practical guide to sample size calculations: superiority trials.

A Pilot Study of Value of Information Analysis to Support Research Recommendations for NICE. CHE Research Paper 4

Critical Appraisal Skills. Professor Dyfrig Hughes Health Economist AWMSG

Cost-effectiveness of radiofrequency catheter ablation for atrial fibrillation Chan P S, Vijan S, Morady F, Oral H

Cost-effectiveness considerations in the treatment of essential thrombocythemia Golub R, Adams J, Dave S, Bennett C L

Meta-analysis of few small studies in small populations and rare diseases

Setting The setting was secondary care. The economic study was carried out in Belgium.

Structured models for dengue epidemiology

Health technology Pneumococcal polysaccharide vaccination was compared with no vaccination.

Historical controls in clinical trials: the meta-analytic predictive approach applied to over-dispersed count data

Sepsis. National Clinical Guideline Centre. Sepsis: the recognition, diagnosis and management of sepsis. NICE guideline <number> January 2016

Bayesian Nonparametric Methods for Precision Medicine

of stratified medicines

1. Comparative effectiveness of liraglutide

What does it mean for innovative technologies/medicines? Health economic evaluations and their role in health care decision making.

Dynamic borrowing of historical data: Performance and comparison of existing methods based on a case study

Meta-analysis of two studies in the presence of heterogeneity with applications in rare diseases

Russian Journal of Agricultural and Socio-Economic Sciences, 3(15)

Is proton beam therapy cost effective in the treatment of adenocarcinoma of the prostate? Konski A, Speier W, Hanlon A, Beck J R, Pollack A

Bayesian meta-analysis of Papanicolaou smear accuracy

Bayesian Models for Combining Data Across Subjects and Studies in Predictive fmri Data Analysis

Cost-effectiveness of ixazomib (Ninlaro ) for the Treatment of Adult Patients with Multiple Myeloma who have Received at Least One Prior Therapy

TIPI di ANALISI ECONOMICHE Patrizia Berto LASER Analytica - Milano

Marc Baguelin 1,2. 1 Public Health England 2 London School of Hygiene & Tropical Medicine

A. Introduction to Health Economics. Dr Alan Haycox Reader in Health Economics Health Economics Unit University of Liverpool Management School

Comparing treatments evaluated in studies forming disconnected networks of evidence: A review of methods

Multiple Bivariate Gaussian Plotting and Checking

How to weigh the strength of prior information and clarify the expected level of evidence?

Study population The study population comprised a hypothetical cohort of poorly reversible COPD patients with a history of exacerbations.

heterogeneity in meta-analysis stats methodologists meeting 3 September 2015

MEA DISCUSSION PAPERS

Health technology Four strategies for the control of serogroup C meningococcal disease (CMD) were examined. These were:

A cost effectiveness analysis of treatment options for methotrexate-naive rheumatoid arthritis Choi H K, Seeger J D, Kuntz K M

Setting The setting was primary care. The economic study was carried out in Brazil, France, Germany and Italy.

Bayesians methods in system identification: equivalences, differences, and misunderstandings

YONDELIS (TRABECTEDIN) FOR THE TREATMENT OF SOFT TISSUE SARCOMA. RESPONSE TO EVIDENCE REVIEW GROUP QUERIES (15 th April 2009)

BayesOpt: Extensions and applications

A Bayesian Measurement Model of Political Support for Endorsement Experiments, with Application to the Militant Groups in Pakistan

Bayesian Tolerance Intervals for Sparse Data Margin Assessment

Analysis of left-censored multiplex immunoassay data: A unified approach

Ponatinib for treating chronic myeloid leukaemia and acute lymphoblastic leukaemia

Combining Risks from Several Tumors Using Markov Chain Monte Carlo

3. Fixed-sample Clinical Trial Design

Setting The setting was secondary care. The economic study was carried out in Canada.

Support system for breast cancer treatment

Cost-effectiveness of influenza vaccination in high-risk children in Argentina Dayan G H, Nguyen V H, Debbag R, Gomez R, Wood S C

Sampling Uncertainty / Sample Size for Cost-Effectiveness Analysis

Empirical evidence on sources of bias in randomised controlled trials: methods of and results from the BRANDO study

Handling Partial Preferences in the Belief AHP Method: Application to Life Cycle Assessment

Linezolid for treatment of ventilator-associated pneumonia: a cost-effective alternative to vancomycin Shorr A F, Susla G M, Kollef M H

Spatio-temporal modelling and probabilistic forecasting of infectious disease counts

NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE

A cost-utility analysis of treatment options for inguinal hernia in 1,513,008 adult patients Stylopoulos N, Gazelle G S, Rattner D W

Applied Medical. Statistics Using SAS. Geoff Der. Brian S. Everitt. CRC Press. Taylor Si Francis Croup. Taylor & Francis Croup, an informa business

Quantitative benefit-risk assessment: An analytical framework for a shared understanding of the effects of medicines. Patrick Ryan 21 April 2010

Advanced IPD meta-analysis methods for observational studies

Introduction to Cost-Effectiveness Analysis

The cost-effectiveness of a new statin (rosuvastatin) in the UK NHS Palmer S J, Brady A J, Ratcliffe A E

Sample size calculation for a stepped wedge trial

Folland et al Chapter 4

Statistical Hocus Pocus? Assessing the Accuracy of a Diagnostic Screening Test When You Don t Even Know Who Has the Disease

Practical Bayesian Optimization of Machine Learning Algorithms. Jasper Snoek, Ryan Adams, Hugo LaRochelle NIPS 2012

Missing data. Patrick Breheny. April 23. Introduction Missing response data Missing covariate data

Bayesian Model Averaging for Propensity Score Analysis

Intelligent Machines That Act Rationally. Hang Li Toutiao AI Lab

1 Executive summary. Background

Food Allergy in Children Appendix 3

Source of effectiveness data The effectiveness evidence was derived from a single study that was identified from a review of the literature.

Cost-utility of initial medical management for Crohn's disease perianal fistulae Arseneau K O, Cohn S M, Cominelli F, Connors A F

NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE. Technology Appraisals. Patient Access Scheme Submission Template

Transcription:

Bayesian methods in health economics Gianluca Baio University College London Department of Statistical Science g.baio@ucl.ac.uk Seminar Series of the Master in Advanced Artificial Intelligence Madrid, Universidad Nacional De Educación a Distancia Thursday 11 June 2015 Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 1 / 27

Outline Health economic evaluation What is health economics? What does health economics do? Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 2 / 27

Outline Health economic evaluation What is health economics? What does health economics do? Statistical modelling Models for individual-level data Models for aggregated data Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 2 / 27

Outline Health economic evaluation What is health economics? What does health economics do? Statistical modelling Models for individual-level data Models for aggregated data Economic modelling & Decision analysis Cost-effectiveness/cost-utility analysis Criteria for decision-making in health economics Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 2 / 27

Outline Health economic evaluation What is health economics? What does health economics do? Statistical modelling Models for individual-level data Models for aggregated data Economic modelling & Decision analysis Cost-effectiveness/cost-utility analysis Criteria for decision-making in health economics Uncertainty analysis Rationale Main ideas Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 2 / 27

Outline Health economic evaluation What is health economics? What does health economics do? Statistical modelling Models for individual-level data Models for aggregated data Economic modelling & Decision analysis Cost-effectiveness/cost-utility analysis Criteria for decision-making in health economics Uncertainty analysis Rationale Main ideas Conclusions Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 2 / 27

What does health economics do? Objective: Combine costs & benefits of a given intervention into a rational scheme for allocating resources Recently, models have been built upon more advanced statistical foundations This problem can be formalised within a statistical decision-theoretic approach. Rational decision-making is effected through the comparison of expected utilities Incremental approach: need to consider at least two interventions Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 3 / 27

What does health economics do? Objective: Combine costs & benefits of a given intervention into a rational scheme for allocating resources Recently, models have been built upon more advanced statistical foundations This problem can be formalised within a statistical decision-theoretic approach. Rational decision-making is effected through the comparison of expected utilities Incremental approach: need to consider at least two interventions Increasingly under a Bayesian framework, especially in the UK: 5.9.10 12 Dealing with parameter uncertainty in cost-effectiveness analysis (NICE Methods for Technology Assessment) All inputs used in the analysis will be estimated with a degree of imprecision. Probabilistic sensitivity analysis is preferred for translating the imprecision in all input variables into a measure of decision uncertainty in the cost-effectiveness of the options being compared. Appropriate ways of presenting uncertainty include confidence ellipses and scatter plots on the cost-effectiveness plane (when the comparison is restricted to two alternatives) and cost-effectiveness acceptability curves. Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 3 / 27

Health economic outcome One of the most important characteristic of health economic data is that we have multivariate outcomes e = suitable measure of clinical benefit of an intervention c = suitable costs associated with an intervention Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 4 / 27

Health economic outcome One of the most important characteristic of health economic data is that we have multivariate outcomes e = suitable measure of clinical benefit of an intervention c = suitable costs associated with an intervention We typically need to assess these quantities jointly Costs and benefit will tend to be correlated Strong positive correlation effective treatments are innovative and result from intensive and lengthy research are associated with higher unit costs Negative correlation more effective treatments may reduce total care pathway costs e.g. by reducing hospitalisations, side effects, etc. In any case, the economic evaluation is based on both! Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 4 / 27

Health economic outcome One of the most important characteristic of health economic data is that we have multivariate outcomes e = suitable measure of clinical benefit of an intervention c = suitable costs associated with an intervention We typically need to assess these quantities jointly Costs and benefit will tend to be correlated Strong positive correlation effective treatments are innovative and result from intensive and lengthy research are associated with higher unit costs Negative correlation more effective treatments may reduce total care pathway costs e.g. by reducing hospitalisations, side effects, etc. In any case, the economic evaluation is based on both! There are different ways in which we can define (e, c) for a specific problem Direct vs indirect vs intangible costs Hard- vs utility-based clinical outcomes Public (e.g. NHS) vs private (e.g. insurance) perspective Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 4 / 27

Health economic evaluations Statistical model Estimates relevant population parameters Varies with the type of available data (& statistical approach!) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 5 / 27

Health economic evaluations Statistical model Economic model Estimates relevant population parameters Varies with the type of available data (& statistical approach!) Combines the parameters to obtain a population average measure for costs and clinical benefits Varies with the type of available data & statistical model used Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 5 / 27

Health economic evaluations Statistical model Economic model Decision analysis Estimates relevant population parameters Varies with the type of available data (& statistical approach!) Combines the parameters to obtain a population average measure for costs and clinical benefits Varies with the type of available data & statistical model used Summarises the economic model by computing suitable measures of cost-effectiveness Dictates the best course of actions, given current evidence Standardised process Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 5 / 27

Health economic evaluations Uncertainty analysis Assesses the impact of uncertainty (eg in parameters or model structure) on the economic results Fundamentally Bayesian! Statistical model Economic model Decision analysis Estimates relevant population parameters Varies with the type of available data (& statistical approach!) Combines the parameters to obtain a population average measure for costs and clinical benefits Varies with the type of available data & statistical model used Summarises the economic model by computing suitable measures of cost-effectiveness Dictates the best course of actions, given current evidence Standardised process Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 5 / 27

1. Statistical modelling Sampling variability for the health economic outcomes is described by a distribution p(e, c θ t ), which depends on a set of population parameters θ t Probability of some clinical outcome Duration in treatment Reduction in the rate of occurrence of some event Unit cost of acquisition of a health technology Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 6 / 27

1. Statistical modelling Sampling variability for the health economic outcomes is described by a distribution p(e, c θ t ), which depends on a set of population parameters θ t Probability of some clinical outcome Duration in treatment Reduction in the rate of occurrence of some event Unit cost of acquisition of a health technology Under the Bayesian approach, parametric uncertainty is modelled using a prior distribution p(θ t ) This describes the level of knowledge in the value of the population parameters Can be based on subjective information, or existing data Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 6 / 27

1. Statistical modelling Sampling variability for the health economic outcomes is described by a distribution p(e, c θ t ), which depends on a set of population parameters θ t Probability of some clinical outcome Duration in treatment Reduction in the rate of occurrence of some event Unit cost of acquisition of a health technology Under the Bayesian approach, parametric uncertainty is modelled using a prior distribution p(θ t ) This describes the level of knowledge in the value of the population parameters Can be based on subjective information, or existing data The way in which we construct our statistical model, depends on The characteristic of the available data (individual-level vs aggregated data) The statistical framework (Bayesian vs frequentist) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 6 / 27

Models for individual-level data Observe vectors (e, c) under each intervention being compared May also observe other variables (covariates) e.g. individual values for age, sex, co-morbidities, etc Use observed data to estimate the relevant population parameters θ t = (θ t e, θ t c) These are generally vectors, made by several components (e.g. means, variances, rates, etc) The main interest is in the population average benefits and costs under treatment t µ t e = E[e θ t ] and µ t c = E[c θ t ] NB: Because of underlying correlation, it is necessary to use some form of joint model But: simple models (such as bivariate Normal) are not suitable, as both e, c tend to be skewed and cost are positive Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 7 / 27

Models for individual-level data Can factorise the joint distribution, for example as p(e, c) = p(c)p(e c) Marginal model for c µ ct µ et Conditional model for e c ξ t γ t η t λ t φ it [τ t ] c it e it Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 8 / 27

Models for individual-level data Can factorise the joint distribution, for example as p(e, c) = p(c)p(e c) Marginal model for c µ ct µ et Conditional model for e c ξ t γ t η t λ t φ it [τ t ] c it e it For instance, can model c it Gamma(η t, λ t ) [rate & shape] µ ct = η t /λ t c it lognormal(η t, λ t ) [log mean & log sd] µ ct = exp ( η t + λ 2 t /2 ) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 8 / 27

Models for individual-level data Can factorise the joint distribution, for example as p(e, c) = p(c)p(e c) Marginal model for c µ ct µ et Conditional model for e c ξ t γ t η t λ t φ it [τ t ] c it e it For instance, can model c it Gamma(η t, λ t ) [rate & shape] µ ct = η t /λ t c it lognormal(η t, λ t ) [log mean & log sd] µ ct = exp ( η t + λ 2 t /2 ) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 8 / 27

Models for individual-level data Can factorise the joint distribution, for example as p(e, c) = p(c)p(e c) Marginal model for c µ ct µ et Conditional model for e c ξ t γ t η t λ t φ it [τ t ] c it e it For instance, can model c it Gamma(η t, λ t ) [rate & shape] µ ct = η t /λ t c it lognormal(η t, λ t ) [log mean & log sd] µ ct = exp ( η t + λ 2 t /2 ) E[e it ] = φ it ; g(φ it ) = ξ t + γ t (c it µ ct ) µ et = g 1 (ξ t ) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 8 / 27

Decision-analytic models Often, we do not have access to individual data and all we have is a set of aggregated data on relevant quantities These can in turn be used to construct a population model to describe the disease history and its implications Decision trees Markov (multistate) models Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 9 / 27

Decision-analytic models Often, we do not have access to individual data and all we have is a set of aggregated data on relevant quantities These can in turn be used to construct a population model to describe the disease history and its implications Decision trees Markov (multistate) models Example: influenza Yes (p 1) Cost with NIs + cost influenza Yes Influenza? No (1 p 1) Cost with NIs Prophylactic NIs? Yes (p 0) Cost influenza No Influenza? No (1 p 0) Cost with no NIs Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 9 / 27

Decision-analytic models p 1 p 0 ρ µ γ σ 2 γ µ δ σ 2 δ γ h α s δ s β h m h π s (0) n (0) s π s (1) n (1) s h = 1,..., H x h r s (0) r s (1) s = 1,..., S Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 10 / 27

2. Economic modelling (types of evaluations) Cost minimisation Assumes that the benefits produced by two interventions are identical the only dimension of interest is costs Cost-benefit analysis Requires that costs and benefits are converted and analysed into monetary terms difficulties in valuing health outcomes in monetary units Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 11 / 27

2. Economic modelling (types of evaluations) Cost minimisation Assumes that the benefits produced by two interventions are identical the only dimension of interest is costs Cost-benefit analysis Requires that costs and benefits are converted and analysed into monetary terms difficulties in valuing health outcomes in monetary units Cost-effectiveness analysis (CEA) Evaluates cost-per-outcome gained Outcomes are usually hard measurements (eg death) easy to understand for clinicians, but difficult to compare across diseases (may have different main outcome) Cost-utility analysis (CUA) Considers a common health outcome unit (= QALYs), so easy to compare across diseases Often interchangeable with CEA (common methodology!) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 11 / 27

2. Economic modelling Can think of this step as the process of obtaining relevant population summaries for the measures of cost & clinical benefits. For example, when comparing two interventions t = 0, 1, the main focus is on The increment in mean benefits The increment in mean costs: e = E[e θ 1 ] E[e θ 0 ] }{{}}{{} µ e 1 µ e 0 c = E[c θ 1 ] E[c θ 0 ] }{{}}{{} µ c 1 µ c 0 Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 12 / 27

2. Economic modelling Can think of this step as the process of obtaining relevant population summaries for the measures of cost & clinical benefits. For example, when comparing two interventions t = 0, 1, the main focus is on The increment in mean benefits The increment in mean costs: e = E[e θ 1 ] E[e θ 0 ] }{{}}{{} µ e 1 µ e 0 c = E[c θ 1 ] E[c θ 0 ] }{{}}{{} µ c 1 µ c 0 NB: In a Bayesian context, these are functions of θ and thus random variables! When using individual-level data, estimation typically directly available from the statistical model; for decision-analytic models, it may be necessary to combine the parameters to obtain these Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 12 / 27

3. Decision analysis In order to compare the two interventions (t = 0, 1), we define suitable health economic indicators The population average increment in benefits E[ e ] = ē 1 ē 0 = E[µ e 1] E[µ e 0] The population average increment in costs: E[ c ] = c 1 c 0 = E[µ c 1] E[µ c 0] Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 13 / 27

3. Decision analysis In order to compare the two interventions (t = 0, 1), we define suitable health economic indicators The population average increment in benefits E[ e ] = ē 1 ē 0 = E[µ e 1] E[µ e 0] The population average increment in costs: E[ c ] = c 1 c 0 = E[µ c 1] E[µ c 0] Generally, economic summaries are computed in the form of cost per outcome ratios ICER = E[ c] = Additional cost to gain 1 unit of benefit E[ e ] Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 13 / 27

3. Decision analysis (cont d) Cost-effectiveness plane c Cost differential e Effectiveness differential Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 14 / 27

3. Decision analysis (cont d) Cost-effectiveness plane c Cost differential ICER = E[ c] E[ e] = Cost per QALY e Effectiveness differential Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 14 / 27

3. Decision analysis (cont d) When considering only two interventions t = 0, 1, can equivalently represent the problem using the Expected Incremental Benefit EIB = ke[ e ] E[ c ] where k is the willingness to pay Puts costs and benefits on the same scale Represents the amount of the decision-maker is willing to invest to increment the benefits by 1 unit Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 15 / 27

3. Decision analysis (cont d) When considering only two interventions t = 0, 1, can equivalently represent the problem using the Expected Incremental Benefit EIB = ke[ e ] E[ c ] where k is the willingness to pay Puts costs and benefits on the same scale Represents the amount of the decision-maker is willing to invest to increment the benefits by 1 unit One-to-one relationship between ICER and EIB EIB > 0 k > E[ c] E[ e ] = ICER Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 15 / 27

3. Decision analysis (cont d) When considering only two interventions t = 0, 1, can equivalently represent the problem using the Expected Incremental Benefit EIB = ke[ e ] E[ c ] where k is the willingness to pay Puts costs and benefits on the same scale Represents the amount of the decision-maker is willing to invest to increment the benefits by 1 unit One-to-one relationship between ICER and EIB EIB > 0 k > E[ c] E[ e ] = ICER The EIB is also more directly linked to a (Bayesian) decision-theoretic approach Define a utility function to quantify the value of an intervention Compute the expected utility (wrt to both individual & population variations) Choose the intervention with the highest expected utility Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 15 / 27

Cost-effectiveness plane vs EIB vs ICER Cost effectiveness plane New Chemotherapy vs Old Chemotherapy ICER=6497.10 Cost differential 200000 0 200000 600000 k = 1000 200 100 0 100 200 Effectiveness differential Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 16 / 27

Cost-effectiveness plane vs EIB vs ICER Cost effectiveness plane New Chemotherapy vs Old Chemotherapy ICER=6497.10 Cost differential 200000 0 200000 600000 k = 25000 200 100 0 100 200 Effectiveness differential Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 16 / 27

Cost-effectiveness plane vs EIB vs ICER Expected Incremental Benefit EIB 0 500000 1000000 1500000 k* = 6700 0 10000 20000 30000 40000 50000 Willingness to pay Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 16 / 27

4. Uncertainty analysis So: problem solved? Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 17 / 27

4. Uncertainty analysis So: problem solved?... Well, not really! Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 17 / 27

4. Uncertainty analysis So: problem solved?... Well, not really! The quality of the current evidence is often limited During the pre-market authorisation phase, the regulator should decide whether to grant reimbursement to a new product and in some countries also set the price on the basis of uncertain evidence, regarding both clinical and economic outcomes Although it is possible to answer some unresolved questions after market authorisation, relevant decisions such as that on reimbursement (which determines the overall access to the new treatment) have already been taken Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 17 / 27

4. Uncertainty analysis So: problem solved?... Well, not really! The quality of the current evidence is often limited During the pre-market authorisation phase, the regulator should decide whether to grant reimbursement to a new product and in some countries also set the price on the basis of uncertain evidence, regarding both clinical and economic outcomes Although it is possible to answer some unresolved questions after market authorisation, relevant decisions such as that on reimbursement (which determines the overall access to the new treatment) have already been taken This leads to the necessity of performing (probabilistic) sensitivity analysis (PSA) Formal quantification of the impact of uncertainty in the parameters on the results of the economic model Standard requirement in many health systems (e.g. for NICE in the UK), but still not universally applied Often limited to parametric uncertainty, but should be extended to structural uncertainty too Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 17 / 27

Uncertainty analysis Frequentist vs Bayesian approach 1. Estimation (base-case) 2. PSA p(θ) g(ˆθ) ˆθ = f(y ) θ θ p(y θ) y Economic model Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 18 / 27

Uncertainty analysis Frequentist vs Bayesian approach 1. Estimation (base-case) 2. PSA p(θ) g(ˆθ) ˆθ = f(y ) θ θ p(y θ) y Economic model Estimation & PSA (one stage) p(θ) θ p(θ y) Economic model p(y θ) y Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 18 / 27

PSA to parameter uncertainty Parameters Model structure Decision analysis π 0 t = 0: Old chemotherapy A0 Ambulatory care (γ) c amb Old chemotherapy Benefits Costs 0.0 0.2 0.4 0.6 0.8 1.0 SE0 Blood-related side effects (π0) ρ c drug 0 N Standard treatment H0 Hospital admission (1 γ) c hosp 743.1 656 644.6 N SE0 No side effects (1 π0) 0.0 0.5 1.0 1.5 2.0 γ t = 1: New chemotherapy New chemotherapy Benefits Costs A0 Ambulatory care (γ) c amb SE0 Blood-related 0.0 0.2 0.4 0.6 0.8 1.0 c hosp c drug 1 N Standard treatment side effects (π1 = π0ρ) N SE0 No side effects (1 π1) H0 Hospital admission (1 γ) c hosp 743.1 656 644.6 20 000 ICER = 1QALY 0 2000 6000 10000 Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 19 / 27

PSA to parameter uncertainty Parameters Model structure Decision analysis x π 0 0.0 0.2 0.4 0.6 0.8 1.0 t = 0: Old chemotherapy SE0 Blood-related side effects (π0) A0 Ambulatory care (γ) c amb Old chemotherapy Benefits Costs 741 670 382.1 ρ c drug 0 N Standard treatment H0 Hospital admission (1 γ) c hosp x 0.0 0.5 1.0 1.5 2.0 γ t = 1: New chemotherapy N SE0 No side effects (1 π0) A0 Ambulatory care (γ) c amb New chemotherapy Benefits Costs 732 1 131 978 x 0.0 0.2 0.4 0.6 0.8 1.0 SE0 Blood-related side effects (π1 = π0ρ) c hosp x 0 2000 6000 10000 c drug 1 N Standard treatment N SE0 No side effects (1 π1) H0 Hospital admission (1 γ) c hosp 20 000 ICER = 1QALY Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 19 / 27

PSA to parameter uncertainty Parameters Model structure Decision analysis x π 0 0.0 0.2 0.4 0.6 0.8 1.0 t = 0: Old chemotherapy SE0 Blood-related side effects (π0) A0 Ambulatory care (γ) c amb Old chemotherapy Benefits Costs 741 670 382.1 699 871 273.3 ρ c drug 0 N Standard treatment H0 Hospital admission (1 γ) c hosp x 0.0 0.5 1.0 1.5 2.0 γ t = 1: New chemotherapy N SE0 No side effects (1 π0) A0 Ambulatory care (γ) c amb New chemotherapy Benefits Costs 732 1 131 978 664 1 325 654 x 0.0 0.2 0.4 0.6 0.8 1.0 SE0 Blood-related side effects (π1 = π0ρ) c hosp x 0 2000 6000 10000 c drug 1 N Standard treatment N SE0 No side effects (1 π1) H0 Hospital admission (1 γ) c hosp 20 000 ICER = 1QALY Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 19 / 27

PSA to parameter uncertainty Parameters Model structure Decision analysis π 0 x 0.0 0.2 0.4 0.6 0.8 1.0 ρ t = 0: Old chemotherapy c drug 0 N Standard treatment SE0 Blood-related side effects (π0) A0 Ambulatory care (γ) H0 Hospital admission (1 γ) c amb c hosp Old chemotherapy Benefits Costs 741 670 382.1 699 871 273.3...... 726 425 822.2 716.2 790 381.2 x 0.0 0.5 1.0 1.5 2.0 γ x 0.0 0.2 0.4 0.6 0.8 1.0 c hosp x 0 2000 6000 10000 t = 1: New chemotherapy c drug 1 N Standard treatment N SE0 No side effects (1 π0) SE0 Blood-related side effects (π1 = π0ρ) N SE0 No side effects (1 π1) A0 Ambulatory care (γ) H0 Hospital admission (1 γ) c amb c hosp New chemotherapy Benefits Costs 732 1 131 978 664 1 325 654...... 811 766 411.4 774.5 1 066 849.8 276 468.6 ICER = 58.3 ICER= 6 497.1 Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 19 / 27

Summarising PSA CEAC Cost Effectiveness Acceptability Curve Probability of cost effectiveness 0.0 0.2 0.4 0.6 0.8 1.0 0 10000 20000 30000 40000 50000 Willingness to pay Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 20 / 27

Is this all we need? The CEAC only deals with the probability of making the right decision But it does not account for the payoff/penalty associated with making the wrong one! Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 21 / 27

Is this all we need? The CEAC only deals with the probability of making the right decision But it does not account for the payoff/penalty associated with making the wrong one! Example 1: Intervention t = 1 is the most cost-effective, given current evidence Pr(t = 1 is cost-effective) = 0.51 If we get it wrong: Increase in costs = 3 If we get it wrong: Decrease in effectiveness = 0.000001 QALYs Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 21 / 27

Is this all we need? The CEAC only deals with the probability of making the right decision But it does not account for the payoff/penalty associated with making the wrong one! Example 1: Intervention t = 1 is the most cost-effective, given current evidence Pr(t = 1 is cost-effective) = 0.51 If we get it wrong: Increase in costs = 3 If we get it wrong: Decrease in effectiveness = 0.000001 QALYs Example 2: Intervention t = 1 is the most cost-effective, given current evidence Pr(t = 1 is cost-effective) = 0.999 If we get it wrong: Increase in costs = 1 000 000 000 If we get it wrong: Decrease in effectiveness = 999999 QALYs Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 21 / 27

Expected value of information Basically quantifies the value (in terms of utility) of reducing uncertainty in the parameters NB: Information has value only if can modify your current decision Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 22 / 27

Expected value of information Basically quantifies the value (in terms of utility) of reducing uncertainty in the parameters NB: Information has value only if can modify your current decision Obtained by comparing 1 The decision made using currently available evidence 2 The decision that would be made if we could gather perfect information on the uncertain parameters Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 22 / 27

Expected value of information Basically quantifies the value (in terms of utility) of reducing uncertainty in the parameters NB: Information has value only if can modify your current decision Obtained by comparing 1 The decision made using currently available evidence 2 The decision that would be made if we could gather perfect information on the uncertain parameters Comments: Perfect information is just a hypothetical concept that is why we consider the expected value If the optimal treatment is not dominated at any point in the parameter space, the EVPI is equal to 0 and the uncertainty in the parameters has no impact on the decision process Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 22 / 27

Difficulties with the EVPI analysis Non-intuitive interpretation: when is the EVPI low enough? Links with research prioritisation compare the EVPI with the cost of buying information (e.g. a trial) and decide whether it is worth deferring the decision Depends also on the size of the target population Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 23 / 27

Difficulties with the EVPI analysis Non-intuitive interpretation: when is the EVPI low enough? Links with research prioritisation compare the EVPI with the cost of buying information (e.g. a trial) and decide whether it is worth deferring the decision Depends also on the size of the target population Usually, it is impossible to buy information on all the model parameters Some parameters are not even that interesting e.g. fixed costs, things we cannot change,... Some other though, are interesting, because we can conduct a study to learn more and thus potentially change the optimal decision Can consider the Expected Value of Partial Perfect Information Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 23 / 27

Expected Value of Partial Information Suppose the parameters of your model are collected in a vector θ And that you can split them into two subsets The important parameters φ and the unimportant parameters ψ We are interested in quantifying the value of gaining more information on φ, while leaving the current level of uncertainty on ψ unchanged Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 24 / 27

Expected Value of Partial Information Suppose the parameters of your model are collected in a vector θ And that you can split them into two subsets The important parameters φ and the unimportant parameters ψ We are interested in quantifying the value of gaining more information on φ, while leaving the current level of uncertainty on ψ unchanged Technical issue: because φ and ψ are typically correlated, we cannot make easy computations for the EVPPI (certainly not in Excel!) Nested Monte Carlo simulations 1 Simulate a large number of values for φ 2 For each of the simulated values of φ, simulate a large values of ψ 3 This means we may need to run a PSA with 10 000s 10 000s iterations too big! Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 24 / 27

Expected Value of Partial Information Suppose the parameters of your model are collected in a vector θ And that you can split them into two subsets The important parameters φ and the unimportant parameters ψ We are interested in quantifying the value of gaining more information on φ, while leaving the current level of uncertainty on ψ unchanged Technical issue: because φ and ψ are typically correlated, we cannot make easy computations for the EVPPI (certainly not in Excel!) Nested Monte Carlo simulations 1 Simulate a large number of values for φ 2 For each of the simulated values of φ, simulate a large values of ψ 3 This means we may need to run a PSA with 10 000s 10 000s iterations too big! New methods based on non-parametric regression (fancy stats) Can use a standard run of 1 000 PSA simulations and can approximate the true value of the EVPPI very accurately! Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 24 / 27

Conclusions Bayesian modelling particularly effective in health economic evaluations Allows the incorporation of external, additional information to the current analysis Previous studies Elicitation of expert opinions Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 25 / 27

Conclusions Bayesian modelling particularly effective in health economic evaluations Allows the incorporation of external, additional information to the current analysis Previous studies Elicitation of expert opinions In general, Bayesian models are more flexible and allow the inclusion of complex relationships between variables and parameters This is particularly effective in decision-models, where information from different sources may be combined into a single framework Useful in the case of individual-level data (eg from Phase III RCT) Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 25 / 27

Conclusions Bayesian modelling particularly effective in health economic evaluations Allows the incorporation of external, additional information to the current analysis Previous studies Elicitation of expert opinions In general, Bayesian models are more flexible and allow the inclusion of complex relationships between variables and parameters This is particularly effective in decision-models, where information from different sources may be combined into a single framework Useful in the case of individual-level data (eg from Phase III RCT) Using MCMC methods, it is possible to produce the results in terms of simulations from the posterior distributions These can be used to build suitable variables of cost and benefit Particularly effective for running probabilistic sensitivity analysis Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 25 / 27

Thank you! Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 26 / 27

Some references Baio, G. (2012), Bayesian Methods in Health Economics. Chapman Hall, CRC Press, Boca Raton, FL. Briggs, A., M. Sculpher, and K. Claxton (2006). Decision modelling for health economic evaluation. Oxford University Press, Oxford, UK. Heath, A., I. Manolopoulou, and G. Baio (2015). Efficient High-Dimensional Gaussian Process Regression to calculate the Expected Value of Partial Perfect Information in Health Economic Evaluations. http://arxiv.org/abs/1504.05436v1. Jackson, C., L. Sharples, and S. Thompson (2010). Structural and parameter uncertainty in Bayesian cost-effectiveness analysis. Journal of the Royal Statistical Society, C 59, 233 253. Spiegelhalter, D., K. Abrams, and J. Myles (2004). Bayesian Approaches to Clinical Trials and Health-Care Evaluation. John Wiley and Sons, Chichester, UK. Strong, M., J. Oakley, and A. Brennan (2014). Estimating Multiparameter Partial Expected Value of Perfect Information from a Probabilistic Sensitivity Analysis Sample A Nonparametric Regression Approach. Medical Decision Making 34(3), 311 326. Welton, N., A. Sutton, N. Cooper, K. Abrams, and A. Ades (2012). Evidence Synthesis for Decision Making in Healthcare John Wiley and Sons, Chichester, UK. Gianluca Baio ( UCL) Bayesian methods in health economics Seminar UNED, 11 Jun 2015 27 / 27