The effect of blood pressure and cholesterol variability on the precision of Framingham cardiovascular risk estimation: a simulation study

Similar documents
Primary care. Abstract. Introduction. Tom Marshall, Andrew Rouse

RESEARCH. An independent external validation and evaluation of QRISK cardiovascular risk prediction: a prospective open cohort study

RESEARCH. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study

RESEARCH. Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2

Discontinuation and restarting in patients on statin treatment: prospective open cohort study using a primary care database

RESEARCH. An independent and external validation of QRISK2 cardiovascular disease risk score: a prospective open cohort study

Identification of subjects at high risk for cardiovascular disease

Primary care. Coronary heart disease prevention: insights from modelling incremental cost effectiveness. Abstract. Methods. Introduction.

Supplementary Online Content

Ethnic group differences in CVD risk estimates using JBS2 and QRISK2 risk scores. Dr Andrew R H Dalton

Predictive accuracy of the Framingham coronary risk score in British men: prospective cohort study

NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE

Northwestern University Feinberg School of Medicine Calculating the CVD Risk Score: Which Tool for Which Patient?

NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE

Validation of QRISK2 (2014) in patients with diabetes

K D Lawson, 1 E A L Fenwick, 1 A C H Pell, 2 J P Pell 1. Epidemiology

Optimizing risk assessment of total cardiovascular risk What are the tools? Lars Rydén Professor Karolinska Institutet Stockholm, Sweden

EuroPrevent 2010 Fatal versus total events in risk assessment models

New approaches to the implementation of cardiovascular disease prevention Jørstad, H.T.

Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study

CVD Prevention, Who to Consider

Logistic Regression Predicting the Chances of Coronary Heart Disease. Multivariate Solutions

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University

Family history of premature coronary heart disease and risk prediction in the EPIC-Norfolk prospective population study

Guidelines on cardiovascular risk assessment and management

AN INDEPENDENT VALIDATION OF QRISK ON THE THIN DATABASE

... Introduction. Methods. Eeva Ketola 1, Tiina Laatikainen 2, Erkki Vartiainen 2

Placebo-Controlled Statin Trials MANAGEMENT OF HIGH BLOOD CHOLESTEROL MANAGEMENT OF HIGH BLOOD CHOLESTEROL: IMPLICATIONS OF THE NEW GUIDELINES

Comparison of Probability of Stroke Between the Copenhagen City Heart Study and the Framingham Study

Supplemental tables/figures

Overview of the outcome trials in older patients with isolated systolic hypertension

The Framingham Coronary Heart Disease Risk Score

Setting The setting was primary care. The economic study was carried out in the UK.

Appendix J: Cost-effectiveness analysis blood pressure monitoring for confirming a diagnosis of hypertension (new 2011)

JOURNAL OF THE AMERICAN COLLEGE OF CARDIOLOGY VOL. 64, NO. 10, 2014 ª 2014 BY THE AMERICAN COLLEGE OF CARDIOLOGY FOUNDATION ISSN /$36.

Placebo-Controlled Statin Trials Prevention Of CVD in Women"

ORIGINAL INVESTIGATION. C-Reactive Protein Concentration and Incident Hypertension in Young Adults

European Journal of Cardiovascular Prevention & Rehabilitation

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University

The Nottingham eprints service makes this work by researchers of the University of Nottingham available open access under the following conditions.

The polypill in the primary prevention of cardiovascular disease

well-targeted primary prevention of cardiovascular disease: an underused high-value intervention?

Appendix J: Cost-effectiveness analysis blood pressure monitoring for confirming a diagnosis of hypertension (new 2011)

Cardiovascular risk assessment and the modification of blood lipids for the primary and secondary prevention of cardiovascular disease

Low fractional diastolic pressure in the ascending aorta increased the risk of coronary heart disease

SUPPLEMENTAL MATERIAL

National Horizon Scanning Centre. Irbesartan (Aprovel) for prevention of cardiovascular complications in patients with persistent atrial fibrillation

LIST OF ABBREVIATIONS

Type of intervention Primary prevention; secondary prevention. Economic study type Cost-effectiveness analysis and cost utility analysis.

Calculating Risk for Primary Prevention of Cardiovascular Disease (CVD)

Deposited on: 2 June 2010

Using Cardiovascular Risk to Guide Antihypertensive Treatment Implications For The Pre-elderly and Elderly

Getting serious about preventing cardiovascular disease

The problem of uncontrolled hypertension

University of Dundee

Placebo-Controlled Statin Trials EXPLAINING THE DECREASE IN DEATHS FROM CHD! PREVENTION OF CARDIOVASCULAR DISEASE IN WOMEN EXPLAINING THE DECREASE IN

Is there a mechanism of interaction between hypertension and dyslipidaemia?

Key causes of preventable deaths in New Zealand In a population of 10,000 New Zealanders, every year there will be about:

BMJ Open. General practice / Family practice. Keywords: PREVENTIVE MEDICINE, PRIMARY CARE, THERAPEUTICS

The Whitehall II study originally comprised 10,308 (3413 women) individuals who, at

Cardiovascular Risk Assessment: A Systematic Review of Guidelines.

Antihypertensive Trial Design ALLHAT

Diabetologia 9 Springer-Verlag 1991

Predicting cardiovascular risk in the elderly in different European countries

Modelling Reduction of Coronary Heart Disease Risk among people with Diabetes

Biases in clinical research. Seungho Ryu, MD, PhD Kanguk Samsung Hospital, Sungkyunkwan University

Dr Chris Ellis. Consultant Cardiologist Auckland

New Lipid Guidelines. PREVENTION OF CARDIOVASCULAR DISEASE IN WOMEN: Implications of the New Guidelines for Hypertension and Lipids.

Understanding new international guidelines to tackle CV Risk: A practical model John Deanfield, MD UCL, London United Kingdom s

Placebo-Controlled Statin Trials

Should we base treatment decisions on short-term or lifetime CVD risk? Rod Jackson University of Auckland New Zealand

Validity of the Framingham point scores in the elderly: Results from the Rotterdam study

Cost effectiveness of case-finding strategies for primary prevention of cardiovascular disease:

Lifetime vs. 10-year risk to allocate treatments for the primary prevention of cardiovascular disease

CVD risk assessment using risk scores in primary and secondary prevention

incorporating the National Children s Hospital, Tallaght, Ireland

Predicted and observed cardiovascular disease in South Asians: application of FINRISK, Framingham and SCORE models to Newcastle Heart Project data

John J.P. Kastelein MD PhD Professor of Medicine Dept. of Vascular Medicine Academic Medial Center / University of Amsterdam

RESEARCH. Predicting risk of type 2 diabetes in England and Wales: prospective derivation and validation of QDScore

CVD Risk Assessment. Michal Vrablík Charles University, Prague Czech Republic

Baldness and Coronary Heart Disease Rates in Men from the Framingham Study

Management of Lipid Disorders and Hypertension: Implications of the New Guidelines

ALLHAT Role of Diuretics in the Prevention of Heart Failure - The Antihypertensive and Lipid- Lowering Treatment to Prevent Heart Attack Trial

Online Supplementary Material

Cost-effectiveness of evolocumab (Repatha ) for hypercholesterolemia

The All Wales Medicine Strategy Group (AWMSG) is asked to support implementation of the following prescribing indicators.

Effect of blood pressure and total cholesterol measurement on risk prediction using the Systematic COronary Risk Evaluation (SCORE)

Prevalence, awareness, treatment and control of hypertension in North America, North Africa and Asia

CONTRIBUTING FACTORS FOR STROKE:

rosuvastatin, 5mg, 10mg, 20mg, film-coated tablets (Crestor ) SMC No. (725/11) AstraZeneca UK Ltd.

Preventing Cardiovascular Disease Stroke Primary Prevention Guidelines. John Potter Professor Ageing & Stroke Medicine University of East Anglia

Dyslipidemia in women: Who should be treated and how?

Risk Associated with Various Definitions of Family History of Coronary Heart Disease

Citation. ROYAL COLLEGE OF GENERAL PRACTITIONERS 14 Princes Gate, Hyde Park, London, SW7 1PU Registered charity No

Modifying effects of dietary polyunsaturated fatty acid (PUFA) on levels of cholesterol and their implications for heart health

Importance of a Patient s Personal Health History on Assessments of Future Risk of Coronary Heart Disease

Costing report: Lipid modification Implementing the NICE guideline on lipid modification (CG181)

Outcomes and Perspectives of Single-Pill Combination Therapy for the modern management of hypertension

COMPETING INTEREST OF FINANCIAL VALUE

Appendix E Health Economic modelling

Transcription:

(2010) 24, 631 638 & 2010 Macmillan Publishers Limited All rights reserved 0950-9240/10 www.nature.com/jhh ORIGINAL ARTICLE The effect of blood pressure and cholesterol variability on the precision of Framingham cardiovascular risk estimation: a simulation study Department of Public Health, Epidemiology and Biostatistics, University of Birmingham, Birmingham, UK This simulation study investigates the effects of withinindividual variability in estimated cardiovascular risk on categorization of patients as high risk. Published estimates of within-individual blood pressure and cholesterol variability were used to generate blood pressure and cholesterol levels for hypothetical subjects at a range of ages. These were used to calculate the estimated cardiovascular risk of each individual. The relationship between an individual s mean cardiovascular risk and within-individual coefficient of variation for cardiovascular risk was determined. Using the derived relationship, mean cardiovascular risk and withinindividual variation in risk was calculated for 5018 adults from a population health survey. From this, was determined their probability of being classified as high risk (420% 10-year cardiovascular risk) and the test characteristics of risk estimation at a range of ages. Within-individual variability in cardiovascular risk and potential for misclassification are both greater in lowerrisk populations. At age 35 44 years, the positive predictive value of a diagnosis of high risk is 0.61 (95% confidence interval (CI): 0.59 0.64), and at age 65 74 years, it is 0.94 (95% CI: 0.91 0.96). About 39% of adults under 45 years diagnosed as high risk are not at high risk. Cardiovascular risk assessment should be targeted at high-risk populations. (2010) 24, 631 638; doi:10.1038/jhh.2009.114; published online 7 January 2010 Keywords: risk stratification; coronary heart disease; primary care; diagnosis; measurement error; screening Introduction Since it was first proposed in New Zealand in 1993, estimating cardiovascular risk has become an integral part of determining the eligibility for treatment with aspirin, antihypertensives or statins. 1 The Framingham risk equations remain the most widely used for this purpose. 2 For example, most UK guidelines recommend antihypertensive treatment for those whose blood pressures exceed 140/90 mm Hg if their 10-year cardiovascular risk is 420%. 3 5 Some guidelines recommend aspirin for those at 420% 10-year cardiovascular risk who are aged 450 years. 5 Lipid-lowering guidelines recommend treatment if the 10-year cardiovascular risk exceeds 20%. 5,6 Multivariable risk estimation is also part of the European guidelines, although using a different risk equation. 7,8 Further risk equations Correspondence: Dr, Department of Public Health, Epidemiology and Biostatistics, University of Birmingham, Edgbaston, Birmingham, West Midlands B15 2TT, UK. E-mail: T.P.Marshall@bham.ac.uk Received 29 July 2009; revised 14 October 2009; accepted 6 December 2009; published online 7 January 2010 continue to be developed, usually using national data sources. 9 11 To date, the Framingham cardiovascular equation remains the most widely used method of assessing risk. This equation was derived from a large cohort study in the United States. It determines cumulative incidence (risk) of any vascular event in individuals free from cardiovascular disease, using as predictors: age, sex, systolic blood pressure, smoking status, total cholesterol level and high-density lipoprotein (HDL) cholesterol level, diabetic status and electrocardiographic evidence of left ventricular hypertrophy. 2 For an individual patient, the risk equation is derived from the average of two systolic blood pressures, a single total cholesterol level and a single HDL cholesterol level. Individualized cardiovascular risk estimation is therefore a diagnostic test for high risk of cardiovascular disease that has become a part of routine clinical practice. But little attention has been paid to the diagnostic test characteristics of estimating cardiovascular risk. There is an unacknowledged uncertainty in risk prediction. Individuals are assigned a precise risk of developing cardiovascular disease and treatment decisions are made accordingly, but the variables from which this probability

632 is calculated are subjected to chance variation. Age and sex can be determined with certainty, but there is a degree of uncertainty in the determination of smoking status, diabetic status, systolic blood pressure, total cholesterol level and HDL cholesterol level. For the categorical variables (diabetic and smoking status), this uncertainty is because of misclassification of individuals diabetic and smoking status. For the continuous variables this is because blood pressure and lipid levels are intrinsically variable within the same individual. The effect of this variation is to impart a degree of imprecision to any estimate of cardiovascular risk. By chance, the same individual will have different blood pressures and lipid levels from one consultation to the next and as a result estimated cardiovascular risk will also vary. The variability of blood pressure is well recognized and test characteristics have been determined for measurement of blood pressure and classification of individuals as hypertensive. 12 This analysis uses data on within-individual variability in blood pressure and cholesterol levels to determine the variability of estimated 10-year cardiovascular risk. It then applies this variability to a population of individuals whose cardiovascular risk is known, allowing us to determine the distribution of cardiovascular risks that we would expect to find in each individual. We can therefore determine the probability that cardiovascular risk estimation would classify an individual as high risk (X20% 10-year cardiovascular risk). From this we can determine the proportion of a population who would be classified as high risk and to calculate the test characteristics of a diagnosis of high risk. Materials and methods The analysis is conducted in two parts. The first part is a simulation study to estimate within-individual variability in cardiovascular risk resulting from variability in diagnostic measurements. The second part is a classification study, using the estimated variability in cardiovascular risk to determine the proportion of persons who would be diagnosed as high risk in a survey population in relation to their true (reference) high-risk status determined from cardiovascular risk factors recorded in the same survey. Simulation study: cardiovascular risk and within-individual variability in cardiovascular risk To determine the relationship between cardiovascular risk and within-individual variability in cardiovascular risk across a range of ages, 10-year cardiovascular risk was calculated for 18 hypothetical subjects: nine men and nine women aged 30, 35, 40, 45, 50, 55, 60, 65 and 70 years, all nonsmoking and all non-diabetic. Each subject was assumed to have an average systolic blood pressure, total cholesterol and HDL cholesterol level for a person of their age, gender, smoking status and diabetic status. Each was assigned true mean blood pressures, total cholesterol levels and HDL cholesterol levels. The true mean values were obtained from the Health Survey for England 1998 for men and women in the age bands 30 35, 35 44, 45 54, 55 64 and 65 74 years. 13 The process was repeated for 18 smokers of the same age and sex and for 18 diabetic subjects of the same age and sex, using the appropriate true mean blood pressures and cholesterol levels for smokers and diabetics. The extent of within-individual variation in blood pressure was determined from a recent secondary analysis of data from a large clinical trial in subjects with a history of transient ischaemic attack or minor stroke. Among patients treated with dual therapy (ACE inhibitor with a thiazide diuretic), this found within-individual measurements of systolic blood pressure to have a coefficient of variation (s.d. divided by the mean) of 7.3% in a population with an average systolic blood pressure of 133 mm Hg. 14 To reflect within-individual variation in measured blood pressure that would be observed in 500 clinic visits, a large number (500) of systolic blood pressures incorporating a degree of variability were generated for each individual. These systolic blood pressures were the sum of the average systolic blood pressure and variation from the average. This variation is the product of an error term and the average systolic blood pressure for that individual. Error terms were generated using Excel as a series of normally distributed random numbers with a mean of zero and an s.d. equal to the coefficient of variation for within-individual blood pressure variation. Pearson s correlation coefficients were calculated for each series of random numbers to confirm that each series of generated random numbers was truly independent. Each individual therefore had 500 normally distributed measured blood pressures, with a mean equal to their true mean blood pressure and an s.d. equal to the product of the coefficient of variation and their true mean blood pressure. Using the same method, 500 total cholesterols and 500 HDL cholesterols were generated, reflecting within-individual variation in total cholesterol and HDL cholesterol. The Framingham equation calculates cardiovascular risk from the ratio of total cholesterol to HDL cholesterol. A published estimate of within-individual (biological) variability of total cholesterol to HDL cholesterol ratio indicates that this has a coefficient of variation of 6.8%. 15 Risk factors were assumed to vary independently. Five hundred estimates of 10-year cardiovascular risk were calculated for each of the 18 subjects using one total cholesterol, one HDL cholesterol and the average of two systolic blood pressures. These represent 500 different 10-year cardiovascular risks that might be calculated on these individuals at 500 different clinic visits. For each individual, their

mean cardiovascular risk was determined and the distributional characteristics of their cardiovascular risk: the 5th and 95th percentiles, the s.d. and the coefficient of variation using the log antilog method. 15 The probability that each individual would be categorized as high risk (420% 10-year cardiovascular risk) was determined from the s.d. and true mean cardiovascular risk. Finally, the equation of a line of best fit for the relationship between cardiovascular risk and coefficient of variation of cardiovascular risk was determined in order to be able to calculate the coefficient of variation for a patient at any given level of cardiovascular risk. it is possible to determine the diagnostic test characteristics assessment for men and women of different ages. The sensitivity of cardiovascular risk assessment is the expected number of high-risk individuals correctly classified as high risk divided by the total number of truly high-risk individuals. The positive predictive value (PPV) of cardiovascular risk assessment is the number of truly high-risk individuals correctly classified as high risk divided by the total sum of probabilities of being classified as high risk. The specificity of cardiovascular risk assessment is the expected number of individuals correctly classified as not at high risk divided by the total number not at high risk. 633 Classification study: misclassification as high risk in a population of adults To determine the effects of cardiovascular risk misclassification on a population, a sample population was selected from the Health Survey for England 2003. 16 The analysis was confined to persons in whom the Framingham risk equation is valid, those aged 30 74 years and free from cardiovascular disease. Of 18 553 individuals in the survey, 5018 have blood pressure and cholesterol measurements, are free from cardiovascular disease and aged 30 74 years. Risk factor data for each of the 5018 individuals were entered into Excel and the 10-year cardiovascular risk was calculated. This is regarded as the true (reference) cardiovascular risk. The test cardiovascular risk is the result that would be obtained as a result of cardiovascular risk estimation. Test cardiovascular risks will form a distribution around the true mean cardiovascular risk. Using the relationship between individual risk and the coefficient of variation derived from the modelling exercise described above, the coefficient of variation and s.d. of each individual s test cardiovascular risk was determined. By knowing the s.d. and true (reference) mean cardiovascular risk, it is possible to determine the probability that any single individual would be classified as high risk (420% 10-year cardiovascular risk) using the normal distribution function in Excel. Across a population, the sum of all individuals probabilities of being classified as high risk is numerically equal to the total number of individuals that we would expect to be classified as high risk following assessment. For example, if 100 individuals each have a probability of 0.05 of being classified as high risk, we would expect 5 to be misclassified if all were assessed. The sum of probabilities of being classified as high risk in all low-risk individuals (mean 10-year cardiovascular risk o20%) is numerically equal to the expected number of false positives that would be found in low-risk individuals. The sum of probabilities of being classified as high risk in all high-risk individuals is numerically equal to the expected number of true positives that would be found in high-risk individuals. From this Sensitivity analysis The relationship between variability and mean systolic blood pressure is not precisely described, but coefficient of variation may be greater in those with higher blood pressures. 17 Data in the same paper suggest that an individual s coefficient of variation increases by B0.00043 for every mm Hg increase in their mean systolic blood pressure. A sensitivity analysis was carried out by adjusting the coefficient of variation of cardiovascular risk by 0.00043 for every mm Hg that an individual s systolic blood pressure differs from the population mean from which the coefficient of variation was derived (133 mm Hg). This somewhat exaggerates the likely effect of increasing variability of higher blood pressures. Results Simulation study According to the Framingham equation, average 10-year cardiovascular risk for a 70-year-old nonsmoking, non-diabetic woman with average blood pressure and cholesterol levels is 19.1%. The 5th and 95th percentiles of her 10-year cardiovascular risk are 15.7 and 23.3%. On 35.6% of occasions she will be found to be at 420% 10-year cardiovascular risk. Average 10-year cardiovascular risk for a 55- year-old non-smoking, non-diabetic man with average blood pressure and cholesterol levels is 16.4% with 5th and 95th percentiles of 13.3 and 20.2%, respectively. On 4.4% of occasions he will be found to be at 420% 10-year cardiovascular risk (Tables 1 3, Figure 1). The distribution of cardiovascular risks in a 55-year-old male non-diabetic, non-smoker is shown in Figure 2. Measured by the coefficient of variation, the variability of 10-year cardiovascular risk is greater than the variability of either blood pressure or cholesterol levels. Variability is greater at lower mean cardiovascular risk and therefore greater in younger than in older adults. Across the relevant range of ages, the relationship between coefficient of variation of 10-year cardiovascular risk and average

634 Table 1 Distributional characteristics of 500 simulated 10-year cardiovascular risks in nine male and nine female non-diabetic, non-smokers Age (years) 10-year cardiovascular risk Percentage of 10-year cardiovascular risk estimates 420% Mean 95th percentile 5th percentile Median s.d. Coefficient of variation Males: non-diabetic, non-smokers 30 1.1 1.5 0.7 1.0 0.3 26.6 0.0 35 2.5 3.4 1.8 2.4 0.5 22.8 0.0 40 4.4 5.9 3.2 4.3 0.8 20.3 0.0 45 7.8 10.1 6.0 7.7 1.3 17.5 0.0 50 11.1 14.1 8.8 11.0 1.6 15.8 0.0 55 16.4 20.2 13.3 16.2 2.1 13.7 4.4 60 20.7 25.0 17.1 20.5 2.4 12.4 61.4 65 27.7 32.6 23.5 27.5 2.8 10.6 99.7 70 32.4 37.6 27.9 32.2 3.0 9.6 100.0 Females: non-diabetic, non-smokers 30 0.5 0.7 0.3 0.5 0.1 29.8 0.0 35 1.1 1.6 0.7 1.1 0.3 26.4 0.0 40 1.8 2.6 1.3 1.8 0.4 24.2 0.0 45 3.6 4.9 2.6 3.5 0.7 21.2 0.0 50 5.0 6.7 3.7 4.9 0.9 19.6 0.0 55 8.6 11.0 6.6 8.4 1.4 17.1 0.0 60 10.8 13.7 8.5 10.7 1.6 15.9 0.0 65 16.3 20.0 13.2 16.1 2.1 13.7 3.9 70 19.1 23.3 15.7 19.0 2.3 12.8 35.6 Table 2 Distributional characteristics of 500 simulated 10-year cardiovascular risks in nine male and nine female non-diabetic smokers Age (years) 10-year cardiovascular risk Percentage of 10-year cardiovascular risk estimates 420% Mean 95th percentile 5th percentile Median s.d. Coefficient of variation Males: diabetic, non-smokers 30 3.0 4.1 2.2 2.9 0.6 22.0 0.0 35 6.1 8.0 4.6 6.0 1.0 18.8 0.0 40 9.7 12.4 7.6 9.6 1.5 16.5 0.0 45 15.9 19.6 12.9 15.7 2.1 13.9 2.5 50 21.1 25.4 17.5 20.9 2.4 12.3 67.6 55 28.7 33.7 24.5 28.5 2.8 10.4 99.9 60 34.3 39.6 29.7 34.1 3.0 9.2 100.0 65 41.5 46.9 36.7 41.3 3.1 7.9 100.0 70 46.6 52.0 41.8 46.5 3.2 7.0 100.0 Females: diabetic, non-smokers 30 1.5 2.1 1.0 1.5 0.3 25.0 0.0 35 3.2 4.4 2.3 3.2 0.6 21.7 0.0 40 5.0 6.7 3.7 4.9 0.9 19.7 0.0 45 9.3 11.9 7.2 9.1 1.4 16.7 0.0 50 12.2 15.3 9.7 12.0 1.7 15.3 0.0 55 18.5 22.5 15.1 18.3 2.3 13.0 25.1 60 22.1 26.5 18.4 21.9 2.5 12.0 80.0 65 27.4 32.2 23.2 27.2 2.8 10.7 99.6 70 31.1 36.2 26.7 30.9 2.9 9.9 100.0 cardiovascular risk closely follows an inverse loglinear relationship. The relationship is slightly different for non-diabetic non-smokers (coefficient of variation: 0.0503 Log n (average cardiovascular risk) þ 0.0429; r 2 ¼ 0.994), but very similar for both smokers and diabetics (coefficient of variation for diabetics or smokers: 0.0478 Log n (average cardiovascular risk) þ 0.0500; r 2 ¼ 0.997). It is therefore possible to determine the coefficient of variation of 10-year cardiovascular risk for any individual.

Table 3 Distributional characteristics of 500 simulated 10-year cardiovascular risks in nine male and nine female diabetic non-smokers 635 Age (years) 10-year cardiovascular risk Percentage of 10-year cardiovascular risk estimates 420% Mean 95th percentile 5th percentile Median s.d. Coefficient of variation Males: diabetic, non-smokers 30 2.4 3.3 1.7 2.3 0.5 23.0 0.0 35 5.0 6.6 3.7 4.9 0.9 19.7 0.0 40 8.2 10.6 6.3 8.0 1.3 17.3 0.0 45 13.1 16.4 10.4 12.9 1.8 14.9 0.0 50 17.7 21.7 14.5 17.5 2.2 13.3 15.3 55 26.0 30.7 21.9 25.8 2.7 11.0 98.6 60 31.3 36.4 26.9 31.1 2.9 9.8 100.0 65 32.3 37.5 27.8 32.1 3.0 9.6 100.0 70 37.2 42.6 32.5 37.0 3.1 8.7 100.0 Females: diabetic, non-smokers 30 2.0 2.8 1.4 1.9 0.4 23.9 0.0 35 3.7 5.0 2.7 3.6 0.7 21.1 0.0 40 5.6 7.4 4.2 5.5 1.0 19.1 0.0 45 9.8 12.4 7.6 9.6 1.5 16.4 0.0 50 12.8 16.0 10.1 12.6 1.8 15.1 0.0 55 23.5 28.1 19.7 23.3 2.6 11.6 91.4 60 27.6 32.5 23.4 27.4 2.8 10.6 99.7 65 34.2 39.4 29.6 34.0 3.0 9.3 100.0 70 38.1 43.5 33.4 38.0 3.1 8.5 100.0 Source: see text. Ten-year CVD risk 40% 35% 30% 25% 20% 15% 10% 5% Age and intra-individual variation in ten-year CVD risk Average (men) 95th percentile (men) 5th percentile (men) Average (women) 95th percentile (women) 5th percentile (women) 0% 30 35 40 45 50 55 60 65 70 Age (years) Figure 1 The relationship between age and intra-individual variation in 10-year cardiovascular risk in non-smoking, nondiabetics with cholesterol levels and blood pressures. Frequency 100 90 80 70 60 50 40 30 20 10 0 5% 10% Distribution of CVD risks 15% 20% CVD risk (10 year) Figure 2 Distribution of 10-year cardiovascular risks in a 55-year-old male diabetic non-smoker. 25% Using this relationship, s.d. values were calculated for persons with a range of 10-year cardiovascular risks and from these s.d. values were derived the probabilities that 10-year cardiovascular risk would be found to exceed 20%. (Table 4) In a non-diabetic non-smoker, a risk of 15.0% has a 95% confidence interval (CI) (or prediction interval) from 10.9 to 19.1% and has a small probability (P ¼ 0.008) of exceeding 20%. In a nondiabetic non-smoker, a risk of 15% estimated risk has an almost identical 95% CI and a probability of 0.009 of exceeding 20%. Classification study Altogether, 25.7% (590 of 2292) of men and 8.3% (226 of 2726) of women aged 30 74 years without cardiovascular disease in the Health Survey for England 2003 are at high risk (420% 10-year cardiovascular risk) according to the Framingham risk model. Both the sensitivity and PPV of cardiovascular risk assessment increase with age and are higher in men than women (Table 5). In men and women combined, at ages 35 44 years sensitivity is 0.89 (95% CI: 0.59 1.00) and PPV 0.61 (95% CI: 0.59 0.64), whereas at ages 65 74 years sensitivity

636 is 0.92 (95% CI: 0.90 0.95) and PPV 0.94 (95% CI: 0.91 0.96). As the survey included no persons under 35 years at high risk, it is not possible to determine the test characteristics for this age; however, sensitivity and PPV are likely to be very low. Sensitivity analysis Allowing for greater variability of blood pressure and of cardiovascular risk estimates in persons with higher mean blood pressures has almost no effect on the test characteristics of cardiovascular risk assessment. Discussion Cardiovascular risk estimation in individuals is subjected to diagnostic error in the same way as Table 4 Estimated precision of 10-year cardiovascular risk estimates Estimated average 10-year cardiovascular risk 95% confidence intervals Lower Upper Probability of being at 420% 10-year cardiovascular risk 5 3 7 0 10 7 13 0 15 11 19 1 20 15 25 50 25 19 31 96 30 24 36 100 35 28 42 100 40 33 47 100 Source: see text. any method of categorization. Variability in estimated cardiovascular risk is greater than variability of either blood pressure or cholesterol levels. In age groups with a low prevalence of high risk, risk estimation misclassifies significant numbers of individuals but is more reliable in populations with a higher prevalence of high risk. A previous modelling study found a very similar CI for estimated coronary risk of among diabetic patients to be 15% (95% CI 9.9 20.1%). 18 The findings are likely to be similar with any multivariable risk equation using similar variable risk factors and in any population with a similar distribution of those risk factors. A model is dependent on its underlying assumptions. The assumption that blood pressure and cholesterol levels vary independently is probably reasonable. Within-individual variability of systolic blood pressure may be greater than that was assumed for this analysis. An individual patient data meta-analysis of clinical trials of blood pressure treatment found the coefficient of variation to be 9.9% (Additional information from Musini V, personal communication). 19 This degree of variability would increase the extent of misclassification. Most of the variability in risk is the result of variation in measured blood pressure and the classification study regards the survey blood pressure as individuals true mean blood pressures. However, they include both within-individual and between-individual variations. The true distribution of blood pressures is therefore somewhat narrower than that used here. Although it is possible to adjust the distribution of blood pressures in the survey to take account of within-individual variation, this would alter the relationship between blood pressure Table 5 Test characteristics of cardiovascular risk assessment in persons aged 30 74 years Age (years) 10-year cardiovascular risk (true) Sum of probabilities of being classified as at 420% 10-year cardiovascular risk Sensitivity Specificity PPV Prevalence 10-year cardiovascular risk (true) o20% X20% o20% X20% Men 30 34 255 0 0.0 0.0 1.000 0.000 0.000 35 44 627 4 3.6 1.6 0.893 0.999 0.688 0.000 45 54 499 60 50.1 8.7 0.835 0.980 0.852 0.025 55 64 265 247 219.9 23.4 0.890 0.899 0.904 0.091 65 74 56 279 265.1 9.2 0.950 0.770 0.966 0.365 Total 1702 590 538.6 43.0 0.913 0.970 0.926 0.083 Women 30 34 292 0 0.0 0.0 1.000 0.000 35 44 722 0 0.0 0.6 1.000 0.000 0.006 45 54 623 16 13.2 2.4 0.828 0.996 0.846 0.107 55 64 602 60 51.8 10.4 0.863 0.986 0.833 0.482 65 74 261 150 131.5 18.1 0.877 0.929 0.879 0.833 Total 2500 226 196.6 31.6 0.870 0.988 0.862 0.257 Abbreviation: PPV, positive predictive value. Source: See text.

and cardiovascular risk, complicating the calculation of cardiovascular risk. This analysis also ignores misclassification of smoking and diabetic status as sources of error. Both sources of misclassification would increase the variability of estimated cardiovascular risk. Their findings have a number of practical implications. It is possible to obtain more precise estimates of blood pressure and cholesterol levels by averaging multiple measurements. However, existing risk-prediction equations are derived from risk factor measurements that incorporate a degree of measurement error. They underestimate the relationship between a subject s perfectly measured risk factors and their risk of cardiovascular disease. This is called regression dilution bias. Therefore, using more precisely measured risk factors to calculate risk requires a recalibrated risk-prediction equation. Otherwise the equation will underestimate risk in patients with higher than average risk factor values and overestimate risk in patients with lower than average risk factor values. But there is no accepted method for recalibrating a multivariable statistical model. The fact that risk cannot be known precisely does not obviate the need to take clinical decisions, but greater weight could be given to patients preferences for treatment than to whether patients meet precise risk threshold levels. Risk information can be presented to patients in a way they can understand. 20 If the 55-year-old man in Figure 2 would choose treatment for 10-year risk reduction of 43%, we can advise him that it is likely that a drug offering a relative risk reduction of 0.25 will achieve at least this effect. Because it varies, repeated risk estimation will show regression to the mean high-risk patients will tend to have lower risks on reassessment that may change their apparent eligibility for treatment. But the change in risk is spurious and clinicians should avoid recalculating risk until the right answer is obtained. This is analogous to the situation with blood pressure, in which repeated measurement can be used to misclassify patients as eligible for treatment. 21,22 It is misleading to recalculate a patient s cardiovascular risk following intervention to estimate the benefits to an individual patient because changes in measured cardiovascular risk are affected by chance and by regression to the mean in addition to the effects of intervention. Diagnosis of high cardiovascular risk is most accurate when applied to a population with a high prevalence of high risk. Cardiovascular risk assessment in persons aged o45 years will misclassify many as high risk. Universal cardiovascular risk assessment is planned for all adults aged 40 74 years in the United Kingdom. 23 The likelihood of frequent misclassification of those in low-risk populations, in common with both the economics and practical evidence, argues against the universal cardiovascular risk factor assessment and for targeting those who are most likely to be at high risk. 23,24 Age and sex are strong predictors of cardiovascular risk and subject to little measurement error. Preselecting patients who are most likely to be at high risk on the basis of age and sex would greatly reduce misclassification. Clinicians should be aware that an estimated 10- year cardiovascular risk of 20% can be regarded as having a 95% CI from 13 to 27%. A diagnosis of high risk is most likely to be reliable in a population with a high prevalence of high risk. Cardiovascular assessment in young adults will commonly result in misdiagnosis of high risk. What is known about this topic K Blood pressure and cholesterol levels are known to vary from day to day within individual patients. This has the potential to affect categorization of patients as high risk. What this study adds K This paper determines the effects of risk factor variation on calculated cardiovascular risk. It also provides quantitative estimates of the probability that patients at a range of ages will be misdiagnosed as high risk. Conflict of interest The author declares no conflict of interest. Acknowledgements I thank Rebecca Taylor for commenting on an earlier draft of this paper. Tom Marshall obtained the data, carried out the analysis and wrote the paper. References 1 Jackson R, Barham P, Maling T, MacMahon S, Bills J, Birch B et al. The management of raised blood pressure in New Zealand. Br Med J 1993; 307: 107 110. 2 Anderson KM, Odell PM, Silson PWF, Kannel WB. Cardiovascular disease risk profiles. Am Heart J 1990; 121: 293 298. 3 Williams B, Poulter NR, Brown MJ, Davis M, McInnes GT, Potter JF et al. Guidelines for management of hypertension: report of the fourth working party of the British Hypertension Society, 2004 BHS IV. J Hum Hypertens 2004; 18: 139 185. 4 Developed by the Newcastle Guideline Development and Research Unit. Hypertension: Management of Hypertension in Adults in Primary Care. NICE: London, 2004. 5 Cooper A, Nherera L, Calvert N, O Flynn N, Turnbull N, Robson J et al. Clinical Guidelines and Evidence Review for Lipid Modification: Cardiovascular Risk Assessment and the Primary and Secondary Prevention of Cardiovascular Disease. National Collaborating Centre for Primary Care and Royal College of General Practitioners: London, 2008. 6 Scottish Intercollegiate Guidelines Network Risk estimation and the prevention of cardiovascular disease. 637

638 A national clinical guideline. Scottish Intercollegiate Guidelines Network, Edinburgh: SIGN; 2007 (SIGN Guideline no. 97) Available from url: http:// www.sign.ax.uk. 7 Conroy RM, Pyörälä K, Fitzgerald AP, Sans S, Menotti A, De Backer G, et al., on behalf of the SCORE project group. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J 2003; 24: 987 1003. 8 De Backer G, Ambrosioni E, Borch-Johnsena K, Brotonsh C, Cifkovae R, Dallongevillee J et al. Executive Summary: Third Joint Task Force of European and other Societies on Cardiovascular Disease Prevention in Clinical Practice European guidelines on cardiovascular disease prevention in clinical practice. Eur J Cardiovasc Prev Rehabil 2003; 10: S1 S10. 9 Thomsen TF, Davidsen M, Ibsen H, Jorgensen T, Jensen G, Borch-Johnsen K. A new method for CHD prediction and prevention based on regional risk scores and randomized clinical trials; PRECARD and the Copenhagen Risk Score. J Cardiovas Risk 2001; 8(5): 291 297. 10 Woodward M, Brindle P, Tunstall-Pedoe H. Adding social deprivation and family history to the cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC). Heart 2007; 2: 172 176. 11 Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, Minhas R, Sheikh A et al. Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2. Br Med J 2008; 336: a332. 12 Rosner B, Polk BF. The implications of blood pressure variability for clinical and screening purposes. J Chron Dis 1979; 32(6): 451 461. 13 Department of Health. Health Survey for England 1998 (http://www.data-archive.ac.uk/) (accessed on 25 May 2005). 14 Keenan K, Hayen A, Neal BC, Irwig L. Long term monitoring in patients receiving treatment to lower blood pressure: analysis of data from placebo controlled randomised controlled trial. Br Med J 2009; 338: b1492 (Published online 30 April 2009). 15 Ortola J, Castineiras MJ, Fuentes-Arderiu X. Biological variation data applied to the selection of serum lipid ratios used as risk markers of coronary heart disease. Clin Chem 1992; 38(1): 56 59. 16 Department of Health. Health Survey for England 2003 (http://www.data-archive.ac.uk/) (accessed on 25 May 2005). 17 Gordon T, Sorlie P, Kannel WB. Problems in the assessment of blood pressure: the Framingham Study. Int J Epidemiol 1976; 5(4): 327 334. 18 Reynolds TM, Twomey P, Wierzbicki AS. Accuracy of cardiovascular risk estimation for primary prevention in patients without diabetes. J Cardiovasc Risk 2002; 9(4): 183 190. 19 Wright JM, Musini VJ. Blood pressure variability: lessons learned from a systematic review. Poster presentation D20, 8th International Cochrane Colloquium, October 2000, Cape Town. 20 Bryan S, Gill P, Greenfield S, Gutridge K, Marshall T. Predictors of patients preferences for treatments to prevent heart disease. Heart 2006; 92: 1651 1655. 21 Lumley T, Rice KM, Psaty BM. Carryover effects after cessation of drug treatment: trophies or dreams? Am J Hypertens 2008; 21: 85 91. 22 Turner MJ, Van Schalkwyk JM. Blood pressure variability causes spurious identification of hypertension in clinical studies a computer simulation study. Am J Hypertens 2008; 21: 14 16. 23 Department of Health. Putting Prevention First. Vascular Checks: Risk Assessment and Management Department of Health: London 2008, available online: http://www.dh.gov.uk/en/publicationsandstatistics/ Publications/PublicationsPolicyAndGuidance/DH_ 083822. 24 Marshall T, Westerby P, Chen J, Fairfield M, Harding J, Westerby R et al. The Sandwell Project: a controlled evaluation of a programme of targeted screening for prevention of cardiovascular disease in primary care. BMC Public Health 2008; 8: 73.