ORIGINAL INVESTIGATION. Use of Clinical Prediction Rules in Detecting Osteoporosis in a Population-Based Sample of Postmenopausal Women

Transcription

1 ORIGINAL INVESTIGATION Use of Clinical Prediction Rules in Detecting Osteoporosis in a Population-Based Sample of Postmenopausal Women Karen F. Mauck, MD, MSc; Maria-Teresa Cuddihy, MD, MPH; Elizabeth J. Atkinson, MSc; L. Joseph Melton III, MD, MPH Background: Osteoporosis clinical prediction rules attempt to identify the postmenopausal women in whom, on the basis of individual risk factors, bone densitometry will detect low bone mass. We assessed and compared the diagnostic properties of the following 3 osteoporosis clinical prediction rules: the Simple Calculated Osteoporosis Risk Estimation, Osteoporosis Risk Assessment Instrument, and National Osteoporosis Foundation practice guidelines. Methods: Secondary data analysis of an existing population-based sample of postmenopausal women 45 years or older (N=202) in Rochester, Minn. Results: Sensitivity, specificity, positive (PPV) and negative (NPV) predictive values, and positive (LR+) and negative (LR ) likelihood ratios were calculated using the World Health Organization diagnosis of osteoporosis as the reference standard. The Simple Calculated Osteoporosis Risk Estimation had a sensitivity of 100%, specificity of 29%, PPV of 27%, NPV of 100%, LR+ of 1.4, and LR of 0. The Osteoporosis Risk Assessment Instrument had a sensitivity of 98%, specificity of 40%, PPV of 29%, NPV of 77%, LR+ of 1.4, and LR of 0.4. The National Osteoporosis Foundation practice guidelines had a sensitivity of 100%, specificity of 10%, PPV of 27%, NPV of 100%, LR+ of 1.1, and LR of 0. The Simple Calculated Osteoporosis Risk Estimation and Osteoporosis Risk Assessment Instrument were much more specific in postmenopausal women younger than 65 years compared with those 65 years or older. Conclusions: Our results suggest that these clinical prediction rules do not perform well as a general screening method to identify postmenopausal women who are more likely to have osteoporosis; however, the Osteoporosis Risk Assessment Instrument and Simple Calculated Osteoporosis Risk Estimation may be useful in identifying some women who need not undergo testing, especially younger postmenopausal women. Arch Intern Med. 2005;165: Author Affiliations: Division of General Internal Medicine, Department of Internal Medicine (Dr Mauck), and Divisions of Biostatistics (Ms Atkinson) and Epidemiology (Dr Melton), Department of Health Sciences Research, Mayo Clinic and Mayo Foundation, Rochester, Minn; and Division of General Medicine and Primary Care, Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, Mass (Dr Cuddihy). Financial Disclosure: Dr Cuddihy received an unrestricted research grant for postmenopausal women s health from Eli Lilly and Company in The grant is no longer active. THE PREVALENCE OF OSTEOporosis is rising as our population ages, and the associated increase in fragility fractures is an important public health concern. 1 An estimated 8 million women 50 years and older in this country had osteoporosis in 2002 and another 22 million had low bone mass, 2 with direct medical expenditures for treating osteoporotic fractures of about $17 billion annually. 3 Although there is general agreement that treatment should be considered in women who present with an osteoporotic fracture, 4 it is less certain how asymptomatic women with osteoporosis might best be identified. Osteoporosis is a disease in which screening may be beneficial, because of the long preclinical course before fracture, availability of bone densitometry to establish the diagnosis, and availability of pharmaceuticals that have been shown to reduce fracture risk. Indeed, the US Preventive Services Task Force has recently joined the National Osteoporosis Foundation (NOF) in recommending routine osteoporosis screening with bone mineral density (BMD) for all women 65 years and older and for those women aged 60 to 64 years who are at increased risk for osteoporotic fracture. 5,6 However, the exact risk factors that define increased risk for osteoporotic fracture in the women aged 60 to 64 years are difficult to specify on the basis of the evidence. 5 Furthermore, there are even fewer data available to guide clinicians on BMD testing for women younger than 60 years. Several clinical practice guidelines on the use of selective BMD testing in women with risk factors for osteoporosis, which are based on varying levels of scientific evidence and expert opinion, have been put forward Among these guidelines, there is consensus on the recommendation that BMD testing should be individualized, but 530

2 disagreement about how this individualized approach to screening should be achieved. Most guidelines recommend using risk factors to select patients for BMD testing, but because of inadequate data, there is no consensus on which risk factors to use. 5 Although hundreds of studies report clinical risk factors for osteoporosis and fractures, most of these are epidemiological studies. Very few studies evaluate how to use these risk factors to identify individual women who are at risk for fracture. 11 Clinicians are frequently faced with decisions about BMD testing in individual postmenopausal patients, most of whom have at least 1 of the several risk factors associated with increased risk of fracture. From the need to make this individualized approach to osteoporosis screening more practical and simplified for clinicians, several clinical prediction rules (CPRs) have been developed. Clinical prediction rules are designed to assist medical decision making. They stratify patients into risk subgroups on the basis of differing probabilities of disease as determined by summarizing risk factors with a point system. 12 A good CPR will differentiate women who are more likely to have low BMD from those who are more likely to have normal BMD when they undergo testing. Many CPRs have been developed, several that attempt to predict BMD outcomes and several that attempt to predict fracture outcomes The quality of most of these CPR development studies has been rated fair or poor, most often because of methodological limitations. 5,11,31 The 2 CPRs that were developed and tested in studies with good methodological ratings were the Simple Calculated Osteoporosis Risk Assessment Estimation (SCORE) 20 and the Osteoporosis Risk Assessment Instrument (ORAI). 22 However, the SCORE has been applied to different populations with inconsistent results, and the ORAI has never been validated in a population independent of that in which it was developed. No studies have compared these CPRs in an independent population-based sample of postmenopausal women. Therefore, we applied the SCORE, ORAI, and NOF guidelines to a previously characterized cohort of Rochester, Minn, women to assess the operating characteristics and clinical usefulness of each as an osteoporosis screening method. METHODS STUDY DESIGN AND SAMPLE POPULATION We performed a secondary data analysis of an existing population-based cohort of postmenopausal women in Rochester who are participating in an ongoing, prospective study designed to assess osteoporosis prevalence, risk factors, and outcomes. 36 These women were recruited from an age-stratified random sample of Rochester women using the medical records linkage system of the Rochester Epidemiology Project. 37 More than half of the Rochester population is seen annually in this system, and most are attended in any 3-year period. Thus, the enumerated population (Rochester women seen in 1990±1 year) approximates the underlying population of the community, including free-living and institutionalized individuals. A total of 938 women 20 years and older were approached for this study, but 126 were ineligible (89 were demented and could not give informed consent; 11 were pregnant; 9 were radiation workers; Table 1. Scoring System and Selection Cutoff Points for the SCORE and ORAI CPRs and the NOF Guidelines Guidelines/Rules (Cutoff Score) Scoring Systems SCORE ( 6) 3 Times the first digit of age in years; 5 points if not African American; 4 points if rheumatoid arthritis present; 4 points for each type of low-trauma fracture after 45 years of age*; 1 point if estrogen never used; 1 times the weight in pounds divided by 10 and truncated to an integer ORAI ( 9) 15 Points for age 75 y, 9 for y, and 5 for y; 9 points for weight 60 kg and 3 for kg; 2 points if not currently taking estrogen NOF guidelines ( 1) 1 Point each for age 65 y, weight 57.6 kg, history of fracture, family history of fracture, and current smoker Abbreviations: CPR, clinical prediction rule; NOF, National Osteoporosis Foundation 6 ; ORAI, Osteoporosis Risk Assessment Instrument 22 ; SCORE, Simple Calculated Osteoporosis Risk Estimation. 20 *Types of fractures were wrist, hip, or rib fracture; to a maximum of 12 points. For the purposes of this study, each factor was assigned 1 point. All patients with at least 1 of these factors were identified for testing, using the point system devised by Cadarette et al. 38 Includes any type of fracture occurring since age 40 years. Includes maternal and/or paternal history of a hip, wrist, or spine fracture at age 50 years or older. 8 were participants in an ongoing clinical trial of osteoporosis prophylaxis; and 9 died before they could be contacted). Of the 812 eligible women, 351 (43%) participated. About 50 women per decade of age from years to older than 80 years were enrolled. Participation rates per age group were 50%, 48%, 56%, 65%, 57%, 39%, and 22%, respectively. 36 All women provided written informed consent before entry into the study, which was conducted after approval from the Mayo Foundation Institutional Review Board. The subjects included 138 premenopausal women (mean±sd age, 35.0±8.6 years, range, years) and 213 postmenopausal women (mean±sd age, 67.8±13.2 years, range, years). For the present analysis, we used the baseline data and BMD measurements from the postmenopausal subset of women 45 years and older (N=202). Baseline data were collected by a single study nurse using a structured interview that was complemented by review of each subject s complete (inpatient and outpatient) medical record in the community. The study nurse also measured each subject s height with a stadiometer and weight (light clothing without shoes) on a balance-beam scale. All subjects then underwent BMD testing performed by a single research technician. Areal BMD was determined for the femoral neck and the anteriorposterior lumbar spine using dual-energy x-ray absorptiometry (QDR2000 instrument; Hologic, Waltham, Mass) and QDR2000 software version The coefficient of variation was 1.5% for the femoral neck BMD measurement and 0.6% for the anterior-posterior spine. APPLICATION OF THE CPRs The description of each CPR and its respective scoring system is outlined in Table 1. Each CPR has a prespecified number of points assigned by the developing authors as the cutoff point to be used for recommending BMD testing. For the SCORE, a result of 6 points or more was needed to recommend a woman for BMD testing, 20 whereas a total of 9 or more points was needed 531

3 Table 2. Summary of Descriptive Characteristics, Osteoporosis Risk Factors, and BMD of an Age-Stratified Sample of 202 Postmenopausal Women in Rochester, Minn Characteristics No. (%) Descriptive Age, y (39) (61) Weight, kg (29) (37) (35) Osteoporosis risk factors Estrogen use Never 120 (59) Ever 82 (41) Current 43 (21) Fracture history* Yes 42 (21) No 160 (79) Smoking status Never 118 (58) Ever 84 (42) Family history of fracture Yes 13 (6) No 189 (94) BMD Femoral neck T score Greater than (47) 2.0 or less 107 (53) 2.5 or less 69 (34) Age y 11 (5) Age 65 y 58 (29) Lumbar spine T score 2.5 or less 15 (7) Age y 3 (1) Age 65 y 12 (6) Abbreviation: BMD, bone mineral density. *Includes history of at least minimal trauma fracture of the wrist or forearm, hip, or spine after age 45 years. Includes history of osteoporotic fracture in first-degree relative. Calculated using BMD mean and standard deviation for Rochester women (aged years) as the young healthy reference population. Categories are not mutually exclusive. for the ORAI. 22 The NOF recommendations were not intended to be used as a scoring system, but for the purposes of comparison we used the point system devised by Cadarette et al 38 in which each NOF factor was assigned 1 point. Anyone with 1 point or more was recommended for BMD testing. Operating characteristics, including sensitivity, specificity, positive (PPV) and negative (NPV) predictive values, and positive (LR+) and negative (LR ) likelihood ratios, were calculated for each CPR using the recommended cutoff points. The reference standard for a positive test result was established using the World Health Organization definition of osteoporosis, specifically, femoral neck BMD level 2.5 SDs below the mean for healthy young women. 39 The reference mean femoral neck BMD (0.903 g/cm 2 ; SD, g/cm 2 ) for healthy young women was determined using Rochester women aged 20 to 29 years; the reference mean anterior-posterior lumbar spine BMD was g/cm 2 (SD, g/cm 2 ). 36 STATISTICAL ANALYSIS Basic demographic data and subject characteristics were reported as mean±sd for continuous variables and as percentages for categorical variables. Sensitivity, specificity, and their corresponding 95% confidence intervals (CIs) were calculated at the recommended cutoff point for each CPR. Sensitivity was defined as the proportion of women with osteoporosis at the femoral neck (T score of 2.5 SDs or less) for whom the decision rule recommended BMD testing. Specificity was defined as the proportion of women without osteoporosis at the femoral neck (T score of greater than 2.5 SDs) for whom the decision rule did not recommend testing. Because sensitivity and specificity are not that useful to the clinician, who is more interested in the likelihood that a patient has osteoporosis after having used the decision rule, we also calculated the PPV, NPV, LR+, and LR for each CPR to assess its clinical usefulness. The PPV was defined as the proportion of subjects with osteoporosis who had a positive test result or true-positive findings (positive test result and osteoporosis) divided by the number of subjects with a positive test result. The NPV was defined as the proportion of subjects without osteoporosis who had a negative test result or true-negative findings (negative test result and no osteoporosis) divided by the number of subjects with a negative test result. The LR+ was defined as sensitivity/(1 specificity), that is, the probability of a positive test result in subjects with osteoporosis divided by the probability of a positive test result in subjects without osteoporosis. The LR was defined as (1 sensitivity)/specificity, that is, the probability of a negative test result in subjects with osteoporosis divided by the probability of a negative test result in subjects without osteoporosis. We calculated 95% CIs using the method described by Simel et al. 40 Receiver operating characteristic (ROC) curves were constructed for each CPR using the method of DeLong et al, 41 and the areas under the ROC curves were statistically compared. By using the method of Obuchowski 42 for comparing these CPRs in the same set of 202 subjects (with a correlation between the areas estimated to be 0.7), we had greater than 90% power to detect a difference of 0.1 between these tools with respect to diagnostic accuracy. In addition, we also constructed ageadjusted ROC curves using a bootstrap method to compare the areas under the ROC curves. Because our sample was stratified by age, it is not, per se, representative of the general population. Therefore, the data were directly age adjusted to the population structure of US white women 45 years and older in After this adjustment, we recalculated all operating characteristics and CIs. RESULTS The study sample included 202 postmenopausal women (99% white) with mean age of 69.2±11.9 years and mean weight of 67.3±13.4 kg. The mean BMD at the femoral neck was 0.67±0.12 g/cm 2, and 34% of the women had osteoporosis as defined by the WHO reference standard (femoral neck BMD T score, 2.5 or less). The ageadjusted (to 1990 US white women aged 45 years) prevalence was 25%. If the lumbar spine measurements were used as the reference standard to establish the diagnosis of osteoporosis, only 7% of the women in this sample would have osteoporosis. Thus, we report additional analysis only for the femoral neck. A summary of the descriptive characteristics, osteoporosis risk factors that were used in the CPRs, and BMD measurements of the sample is provided in Table 2. In the unadjusted analysis, all 3 rules were found to be quite sensitive, but the specificities were not optimal 532

4 Table 3. Operating Characteristics of Each CPR for Osteoporosis at the Femoral Neck in the Age-Stratified Sample of 202 Postmenopausal Women in Rochester, Minn* Sensitivity, % (95% CI) Specificity, % (95% CI) Predictive Value, % (95% CI) LR (95% CI) PPV NPV LR+ LR Unadjusted Analysis SCORE Overall 100 (95-100) 25 (18-33) 41 (34-39) 100 (89-100) 1.3 ( ) 0.0 (NA) Age y 100 (72-100) 41 (29-54) 22 (11-35) 100 (88-100) 1.7 ( ) 0.0 (NA) Age 65 y 100 (94-100) 8 (3-17) 50 (40-59) 100 (48-100) 1.1 ( ) 0.0 (NA) ORAI Overall 99 (92-100) 36 (28-44) 44 (36-53) 98 (89-100) 1.5 ( ) 0.0 ( ) Age y 91 (59-100) 69 (57-80) 32 (17-51) 98 (89-100) 2.9 ( ) 0.1 ( ) Age 65 y 100 (94-100) 0 (0-6) 48 (38-57) NA 1.0 ( ) 0.0 (NA) NOF Overall 100 (95-100) 10 (5-16) 37 (30-44) 100 (75-100) 1.1 ( ) 0.0 (NA) Age y 100 (72-100) 19 (11-31) 17 (9-28) 100 (75-100) 1.2 ( ) 0.0 (NA) Age 65 y 100 (94-100) 0 (0-6) 48 (38-57) NA 1.0 ( ) 0.0 (NA) Age-Adjusted Analysis SCORE 100 (55-100) 29 (18-48) 27 (17-48) 100 (51-100) 1.4 ( ) 0.0 (NA) ORAI 98 (51-100) 40 (30-56) 29 (18-59) 77 (46-100) 1.4 ( ) 0.4 ( ) NOF 100 (55-100) 10 (4-29) 27 (17-41) 100 (30-100) 1.1 ( ) 0.0 (NA) Abbreviations: BMD, bone mineral density; CI, confidence interval; CPR, clinical prediction rule; LR, negative likelihood ratio; LR+, positive likelihood ratio; NA, not applicable; NOF, National Osteoporosis Foundation osteoporosis screening recommendations 6 ; NPV, negative predictive value; ORAI, Osteoporosis Risk Assessment Instrument 22 ; PPV, positive predictive value; SCORE, Simple Calculated Osteoporosis Risk Estimation. 20 *Indicates BMD T score of 2.5 or less. Directly age adjusted to 1990 US white women 45 years or older. Table 4. Areas Under the ROC Curves for Each CPR* ROC Area (95% CI) Analysis SCORE ORAI NOF Unadjusted Overall 0.87 ( ) 0.84 ( ) 0.70 ( ) Age y 0.85 ( ) 0.82 ( ) 0.69 ( ) Age 65 y 0.80 ( ) 0.79 ( ) 0.60 ( ) Age adjusted 0.85 ( ) 0.79 ( ) 0.65 ( ) overall Abbreviations: BMD, bone mineral density; CI, confidence interval; CPR, clinical prediction rule; NOF, National Osteoporosis Foundation Guideline 6 ; ORAI, Osteoporosis Risk Assessment Instrument 22 ; ROC, receiver operating characteristics; SCORE, Simple Calculated Osteoporosis Risk Estimation. 20 *Calculated using femoral neck BMD T score of 2.5 or less as the reference standard. Directly age adjusted to 1990 US population of white women 45 years or older. (Table 3). The SCORE had an overall sensitivity and specificity of 100% (95% CI, 95%-100%) and 25% (95% CI, 18%-33%), respectively, with a PPV of 41% (95% CI, 34%-49%) and NPV of 100% (95% CI, 89%-100%). The LR+ and LR were 1.3 (95% CI, ) and 0.0 (95% CI, not applicable), respectively. The ORAI ha an overall sensitivity and specificity of 99% (95% CI, 92%- 100%) and 36% (95% CI, 28%-44%), respectively, with a PPV of 44% (95% CI, 36%-53%) and NPV of 98% (95% CI, 89%-100%). The LR+ and LR were 1.5 (95% CI, ) and 0.0 (95% CI, ), respectively. The NOF guidelines had an overall sensitivity and specificity of 100% (95% CI, 95%-100%) and 10% (95% CI, 5%- 16%), respectively, with a PPV of 37% (95% CI, 30%- 44%) and NPV of 100% (95% CI, 75%-100%). The LR+ and LR were 1.1 (95% CI, ) and 0.0 (95% CI, not applicable), respectively. We also report in Table 3 the operating characteristics of each tool stratified by age group (45-64 vs 65 years). For the SCORE and ORAI, the specificity was higher in the younger postmenopausal women compared with the older women. All of the CPRs were quite sensitive in both subgroups. The PPVs for all 3 CPRs were higher in the older subgroup compared with the younger subgroup, whereas the NPVs of all 3 CPRs were similar in the younger and older subgroups. Because our age-stratified sample had a higher percentage of elderly women than the general population, we directly age adjusted the data to the 1990 US population of white women 45 years and older. Given the resulting increase in the influence of younger women, these CPRs were a bit more specific in identifying women with osteoporosis, whereas the sensitivities changed only minimally. The PPVs of all 3 CPRs were poor in the ageadjusted sample, whereas the NPVs remained high (Table 3). The 3 CPRs were further compared using areas under the ROC curves (Table 4). In the unadjusted analysis, the SCORE had an area under the ROC curve of 0.87 (95% CI, ); the ORAI had an area of 0.84 (95% CI, ); and the NOF guideline had an area of 0.70 (95% CI, ). There was no difference between the areas under the ROC curves for the SCORE and the ORAI (P=.13). The SCORE and the ORAI were found to have better discriminatory performance than the NOF guideline (P.001 for both comparisons). To further ex- 533

5 plore the accuracy of these tools in younger vs older women, we also calculated ROC curves for each CPR for the subset of women aged 45 to 64 years compared with those 65 years or older. For women aged 45 to 64 years (n=79), there was no difference between the areas under the ROC curves for the 3 CPRs (P=.23). For the subset of women 65 years or older (n=123), there was no difference between the areas under the ROC curve for the SCORE and the ORAI (P=.77), but the SCORE and ORAI had better discriminatory performance than the NOF guidelines (P.001 and P=.009, respectively). We also compared the areas under the ROC curves that were derived using an age-adjusted analysis (Table 4). The SCORE had an area of 0.85 (95% CI, ); the ORAI had an area of 0.79 (95% CI, ); and the NOF guidelines had an area of 0.65 (95% CI, ). There was a statistically significant difference between the areas under the curve for the SCORE compared with the ORAI and between the SCORE and ORAI compared with the NOF guidelines. COMMENT We applied the SCORE, ORAI, and NOF guidelines to an independent, population-based sample of postmenopausal women to compare the operating characteristics and to determine the clinical usefulness of each tool as an osteoporosis screening method in the general population. Our results suggest that these CPRs do not perform well as a general screening method to identify postmenopausal women who are more likely to have osteoporosis; however, the ORAI and SCORE may be useful in identifying some women who need not undergo testing, especially among younger postmenopausal women. A good screening test must have a high sensitivity, so that it does not miss the few cases of disease that are present, and a high specificity, to reduce the number of people with false-positive results who require further diagnostic testing. 43 The CPRs were quite sensitive in our population-based sample, but none was very specific. The SCORE would recommend BMD testing in 71% of women without osteoporosis, whereas the ORAI would recommend testing in 60% of women without osteoporosis. The NOF guidelines were the least specific in that they would recommend BMD testing in 90% of women without osteoporosis. However, in the younger postmenopausal women, the SCORE and ORAI recommended BMD testing in only 59% and 31% of women without osteoporosis, respectively, while maintaining a favorably high sensitivity. The findings we report herein are similar to those reported by Cadarette et al, 38 who compared the SCORE, ORAI, and NOF practice guidelines in a large sample of Canadian women and concluded that the SCORE and ORAI were superior to the NOF guidelines in correctly identifying high-risk women for BMD testing. Although that study included a large sample of postmenopausal women, it was limited in that the sample was not likely representative of the general population. Women who were taking hormone therapy for less than 5 years were excluded, and older age groups were oversampled without statistical adjustment in the analysis. Those authors reported sensitivities very similar to ours, but the specificities were lower in their study, likely reflecting an underrepresentation of younger women in their sample. Our results are also useful to help clarify some of the inconsistent results that have been shown with the SCORE. Since its development in 1998, the SCORE has been evaluated in several studies, with inconsistent results, 20,32-35 likely owing to differences in the sample populations. A CPR should be validated in a population similar to that in which it is meant to be used in the case of a CPR that will be used as an osteoporosis screening tool in the general population of postmenopausal women, the CPR should ideally be tested in a sample that is representative of this population. Lydick et al 20 described a sensitivity and specificity of 89% and 50%, respectively, in the development cohort (mean age, 61.5 years) and 91% and 40%, respectively, in the validation cohort (mean age, 63.1 years), using a T score of 2.0 or less at the femoral neck as the definition of osteoporosis. The development and validation cohorts had osteoporosis prevalences of 38% and 44%, respectively. However, when the SCORE was later applied to a sample of community-dwelling postmenopausal women in Rancho Bernardo, Calif (mean age, 72.5 years), with osteoporosis prevalence of 67% as defined by BMD T score of 2.0 or less at the femoral neck, 32 the sensitivity was 98% and the specificity was only 12.5%. Cadarette et al 33 applied the SCORE to a sample of 398 postmenopausal women participating in the large population-based Canadian Multicenter Osteoporosis Study. Those authors reported a sensitivity of 90% and a specificity of 32% in their population of postmenopausal women (mean age, 64.5 years) with an osteoporosis prevalence of 50% (using BMD T score of 2.0 or less at the femoral neck as the definition of osteoporosis). More recently, Cadarette et al 38 applied the SCORE to an even larger (N=2365) sample of the same study population (mean age, 66.4 years) and reported a sensitivity of 99.6% and a specificity of 17.9% (using BMD T score of 2.0 or less as the definition of osteoporosis, this sample had a prevalence of 25.4%; using a BMD T score of 2.5 or less, the prevalence was only 10%). Two other studies have also reported sensitivities and specificities for the SCORE; however, these sample populations consisted of postmenopausal women who were referred for BMD testing and thus were not representative of a true situation for which this tool would be used. 34,35 These inconsistencies can best be explained by the spectrum of patients to whom the SCORE was applied. The Rancho Bernardo study was a sample of community-dwelling women; however, there must have been patient selection bias because the prevalence of osteoporosis was so high and the average age was 10 years older than those in the original study by Lydick et al. 20 As patient age increases, the more likely the SCORE will produce false-positive results, because age is a major point contributor in the SCORE calculation, thus explaining why the specificity reported from the Rancho Bernardo study was so much lower than that reported by Lydick et al. 20 The 2 studies by Cadarette et al 33,38 nicely illustrate this point as well. The first study 33 with 398 women had an average age similar to the co- 534

6 horts studied by Lydick et al. 20 However, in the larger study of 2365 women, 38 the mean age was older and the specificity was lower. In our study, because the cohort was stratified by age, there was overrepresentation of the older women compared with that of the normal population, and therefore the mean age was 69.2 years. When the data were directly age adjusted, the sensitivity and specificity were 100% and 27%, respectively. It is difficult, however, to compare our results directly with those of the other studies because the BMD T score cutoff used to define osteoporosis is 2.0 or less in most of those studies, and we used the more conservative value of T score of 2.5 or less. In our study sample, the age-adjusted prevalence of osteoporosis as defined by BMD T score of 2.5 or less at the femoral neck was 25%, compared to a similar 22% figure for white women from the Third National Health and Nutrition Examination Survey data. 44 The Third National Health and Nutrition Examination Survey reports only prevalence of osteoporosis (BMD T score of 2.5 or less) and osteopenia (BMD T score of 1 or less to 2.5); it does not report a prevalence for a BMD T score of 2.0 or less to compare with those of the other SCORE studies. Our data clarify how these CPRs may best be applied in a clinical setting. In light of the recent US Preventive Service Task Force recommendation that all women 65 years and older should undergo screening for osteoporosis, 5 and the fact that Medicare now reimburses for BMD testing in estrogen-deficient women with osteoporosis risk factors, there is less ambiguity for the clinician about osteoporosis screening in this age group. However, for those postmenopausal women who are younger than 65 years, there remains uncertainty as to who should undergo screening. The SCORE and the ORAI perform better in the group of women aged 45 to 64 years and may help clinicians to identify those younger postmenopausal women who are higher risk. However, on the basis of the NPVs and LR in Table 3, it is evident that these tools are more helpful in that they identify those few women who do not need BMD testing rather than those who do. Although our study was limited by a small sample size, we believe this sample closely represents our population of postmenopausal women in whom these osteoporosis CPRs would be applied. However, one must keep in mind that even if these CPRs are useful in the general population, translating the results of population studies to the care and management of individual patients requires additional consideration. 11 The generalizability of these tools is currently limited until their applicability in the clinical setting can be tested in a prospective manner. In addition, most of these tools have been developed and tested in rather homogeneous cohorts of non- Hispanic white women, which obviously limits their use in more heterogeneous populations. CONCLUSIONS The limited performance of the currently available osteoporosis CPRs raises question about the clinical usefulness of such tools as an effective method for screening for osteoporosis. However, they may prove useful in aiding clinicians to select those few women who are younger than 65 years and have a negative CPR outcome, who do not need to be referred for BMD testing. Further studies in various clinical settings with more heterogeneous populations are warranted to prospectively validate the SCORE and the ORAI. Accepted for Publication: August 25, Correspondence: Karen F. Mauck, MD, MSc, Mayo Clinic, 200 First St SW, Rochester, MN Funding/Support: This study was supported in part by research grant AR from the National Institutes of Health, US Public Health Service, Bethesda, Md. Previous Presentation: Portions of this study were presented in poster form at the Fifth International Symposium on Clinical Advances in Osteoporosis; March 6-9, 2002; Honolulu, Hawaii. Acknowledgment: We thank Mark Liebow, MD, for his editorial support and valuable input regarding clinical prediction rules. REFERENCES 1. Cummings S, Melton LJ III. Epidemiology and outcomes of osteoporotic fractures. Lancet. 2002;359: National Osteoporosis Foundation. America s Bone Health: The State of Osteoporosis and Low Bone Mass in Our Nation. Washington, DC: National Osteoporosis Foundation; Ray NF, Chan JK, Thamer M, Melton LJ III. Medical expenditures for the treatment of osteoporotic fractures in the United States in 1995: report from the National Osteoporosis Foundation. J Bone Miner Res. 1997;12: Kanis J. Diagnosis of osteoporosis and assessment of fracture risk. Lancet. 2002; 359: Nelson HD, Helfand M, Woolf SH, Allen JD. Screening for postmenopausal osteoporosis: a review of the evidence for the US Preventive Services Task Force. Ann Intern Med. 2002;137: Johnston CC Jr, Cummings SR, Dawson-Hughes B, Lindsay R, Melton LJ III, Slemenda CW. Physician s Guide to Prevention and Treatment of Osteoporosis. Washington, DC: National Osteoporosis Foundation; NIH Concensus Panel. Osteoporosis Prevention, Diagnosis, and Therapy: NIH Consensus Development Statement 17. Bethesda, Md: National Institutes of Health; March 27-29, 2000: Hodgson SF, Watts NB, Bilezikan JP, et al; AACE Osteoporosis Task Force. American Association of Clinical Endocrinologists medical guidelines for clinical practice for the prevention and treatment of postmenopausal osteoporosis: 2001 edition, with selected updates for Endocr Pract. 2003;9: North American Menopause Society. Management of postmenopausal osteoporosis: position statement of the North American Menopause Society. Menopause. 2002;9: Committee on Gynecologic PracticeAmerican College of Obstetricians and Gynecologists. ACOG Committee opinion 270: bone density screening for osteoporosis. Obstet Gynecol. 2002;99: Nelson HD, Morris CD, Kraemer DF, et al. Osteoporosis in Postmenopausal Women: Diagnosis and Monitoring. Rockville, Md: Agency for Healthcare Research and Quality; Evidence Report/Technology Assessment Laupacis A, Sekar N, Stiell IG. Clinical prediction rules: a review and suggested modifications of methodological standards. JAMA. 1997;277: Slemenda CW, Hui SL, Longcope C, Wellman H, Johston CC Jr. Predictors of bone mass in perimenopausal women: a prospective population-based study of clinical data using photon absorptiometry. Ann Intern Med. 1990;112: Falch JA, Sandvik L, Van Beresteijn EC. Development and evaluation of and index to predict early postmenopausal bone loss. Bone. 1992;13: Ribot C, Pouilles JM, Bonneu M, Tremollieres F. Assessment of the risk of postmenopausal osteoporosis using clinical factors. Clin Endocrinol (Oxf ). 1992; 36: Elliot JR, Gilchrist NL, Wells JE, Ayling E, Turner J, Sainsbury R. Historical as- 535

7 sessment of risk factors in screening for osteopenia in a normal Caucasian population. Aust NZJMed. 1993;23: Michaelsson K, Bergstrom R, Mallmin H, Holmberg L, Wolk A, Ljunghall S. Screening for osteopenia and osteoporosis: selection by body composition. Osteoporos Int. 1996;6: Verhaar HJ, Koele JJ, Neijzen T, Dessens JA, Duursma SA. Are arm span measurements useful in the prediction of osteoporosis in postmenopausal women? Osteoporos Int. 1998;8: Ballard PA, Purdie DW, Langton CM, Steel SA, Mussurakis S. Prevalence of osteoporosis and related risk factors in UK women in the seventh decade: osteoporosis case finding by clinical referral criteria or predictive model? Osteoporos Int. 1998;8: Lydick E, Cook K, Turpin J, Melton M, Stine R, Byrnes C. Development and validation of a simple questionnaire to facilitate identification of women likely to have low bone density. Am J Manag Care. 1998;4: Goemaere S, Zegels B, Toye K, et al. Limited clinical utility of a self-evaluating risk assessment scale for postmenopausal osteoporosis: lack of predictive value of lifestyle-related factors. Calcif Tissue Int. 1999;65: Cadarette SM, Jaglal SB, Kreiger N, McIsaac WJ, Darlington GA, Tu JV. Development and validation of the Osteoporosis Risk Assessment Instrument to facilitate selection of women for bone densitometry. CMAJ. 2000;162: Kleerekoper M, Peterson E, Nelson D, et al. Identification of women at risk for developing postmenopausal osteoporosis with vertebral fractures: role of history and single photon absorptiometry. Bone Miner. 1989;7: Van Hemert AM, Vandenbroucke JP, Birkenhager JC, Valkenburg HA. Prediction of osteoporotic fractures in the general population by a fracture risk score: a 9-year follow-up among middle-aged women. Am J Epidemiol. 1990;132: Cooper C, Shah S, Hand DJ, et al; Multicentre Vertebral Fracture Study Group. Screening for vertebral osteoporosis using individual risk factors. Osteoporos Int. 1991;2: Wolinsky FD, Fitzgerald JF. The risk of hip fracture among noninstitutionalized older adults. J Gerontol. 1994;49:S165-S Johnell O, Gullberg B, Kanis JA, et al. Risk factors for hip fracture in European women: the MEDOS Study: Mediterranean Osteoporosis Study. J Bone Miner Res. 1995;10: Ranstam J, Elffors L, Kanis JA. A mental-functional risk score for prediction of hip fracture. Age Ageing. 1996;25: Tromp AM, Smit JH, Deeg DJ, Bouter LM, Lips P. Predictors for falls and fractures in the Longitudinal Aging Study Amsterdam. J Bone Miner Res. 1998; 13: Burger H, de Laet CE, Weel AE, Hofman A, Pols HA. Added value of bone mineral density in hip fracture risk scores. Bone. 1999;25: Harris RP, Hefland M, Woolf SH, et al; Methods Work Group, Third US Preventive Services Task Force. Current methods of the US Preventive Services Task Force: a review of the process. AmJPrevMed. 2001;20: Von Muhlen D, Lunde AV, Barrett-Connor E, Bettencourt R. Evaluation of the Simple Calculated Osteoporosis Risk Estimation (SCORE) in older Caucasian Women: the Rancho Bernardo Study. Osteoporos Int. 1999;10: Cadarette SM, Jaglal SB, Murray TM. Validation of the Simple Calculated Osteoporosis Risk Estimation (SCORE) for patient selection for bone densitometry. Osteoporos Int. 1999;10: Ben Sedrine W, Devogelaer JP, Kaufman JM, et al. Evaluation of the Simple Calculated Osteoporosis Risk Estimation (SCORE) in a sample of white women from Belgium. Bone. 2001;29: Russell AS, Morrison RT. An Assessment of the New SCORE Index as a predictor of osteoporosis in women. Scand J Rheumatol. 2001;30: Melton LJ III, Atkinson EJ, O Connor MK, O Fallon WM, Riggs BL. Bone density and fracture risk in men. J Bone Miner Res. 1998;13: Melton LJ III. History of the Rochester Epidemiology Project. Mayo Clin Proc. 1996;71: Cadarette SM, Jaglal SB, Murray TM, McIsaac WJ, Joseph L, Brown JP. Evaluation of decision rules for referring women for bone densitometry by dualenergy x-ray absorptiometry. JAMA. 2001;286: Kanis JA, Melton LJ III, Christiansen C, Johnston CC Jr, Khaltaev N. The Diagnosis of Osteoporosis. J Bone Miner Res. 1994;9: Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol. 1991;44: DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44: Obuchowski N. Computing sample size for receiver opererting characteristic studies. Invest Radiol. 1994;29: Fletcher RH, Fletcher SW, Wagner EH. Clinical Epidemiology: The Essentials. 3rd ed. Philadelphia, Pa: Lippincott Williams & Wilkins; Looker AC, Orwoll ES, Johnston CC Jr, et al. Prevalence of low femoral bone density in older US adults from NHANES III. J Bone Miner Res. 1997;12: