Robust and Expanded Norms for the Dementia Rating Scale

Archives of Clinical Neuropsychology 25 (2010) 347 358 Robust and Expanded Norms for the Dementia Rating Scale Otto Pedraza 1, *, John A. Lucas 1, Glenn E. Smith 2, Ronald C. Petersen 3, Neill R. Graff-Radford 4, Robert J. Ivnik 2 1 Department of Psychiatry and Psychology, Mayo Clinic, Jacksonville, FL, USA 2 Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, USA 3 Department of Neurology, Mayo Clinic, Rochester, MN, USA 4 Department of Neurology, Mayo Clinic, Jacksonville, FL, USA *Corresponding author at: Department of Psychiatry and Psychology, Mayo Clinic, Jacksonville, FL 32224, USA. Tel.: +1-904-953-7286; fax: +1-904-953-0461. E-mail address: otto.pedraza@mayo.edu (O. Pedraza). Accepted 26 March 2010 Abstract The Dementia Rating Scale (DRS) is a widely used measure of global cognition, with age- and education-corrected norms derived from a cross-sectional sample of adults participating in Mayo s Older Americans Normative Studies (MOANS). In recent years, however, studies have indicated that cross-sectional normative samples of older adults represent an admixture of individuals who are indeed cognitively normal (i.e., disease-free) and individuals with incipient neurodegenerative disease. Theoretically, the contamination of cross-sectional normative samples with cases of preclinical dementia can lead to underestimation of the test mean and overestimation of the variance, thus reducing the clinical utility of the norms. Robust norming, in which dementia cases are removed from the normative cohort through longitudinal follow-up, is an alternative approach to norm development. The current study presents a reappraisal of the original MOANS DRS norms, provides robust and expanded norms based on a sample of 894 adults age 55 and over, and critically evaluates the benefits of robust norming. Keywords: Dementia Rating Scale; DRS; Alzheimer s disease; Robust; Norms Introduction The Mattis Dementia Rating Scale (DRS) is a widely used measure of global cognition based on performance across five domain subtests (Attention, Initiation/Perseveration, Construction, Conceptualization, and Memory). Lucas and colleagues (1998) provided age- and education-corrected norms derived from a sample of 623 Caucasian adults participating in Mayo s Older Americans Normative Studies (MOANS), and these norms were subsequently adopted into the second edition of the test (Jurica, Leitten, & Mattis, 2001). In the years since the publication of the original MOANS DRS norms, several additional studies have contributed to the DRS normative literature. Lichtenberg and colleagues published age- and education-stratified norms for older Caucasian and African American orthopedic inpatients in an urban medical setting (Bank, Yochim, MacNeill, & Lichtenberg, 2000; Lichtenberg, Ross, Youngblade, & Vangel, 1998), whereas Marcopulos, McLain, and Giuliano (1997; Marcopulos & McLain, 2003) published DRS norms for rural-dwelling Caucasian and African American elders with little to no formal education. In 2005, Rilling and colleagues (2005) published DRS norms derived from 307 participants in Mayo s Older African American Normative Studies (MOAANS). Preliminary norms for Spanish-speaking U.S. residents (Lyness, Hernandez, Chui, & Teng, 2006, 2007) have also recently become available, and DRS performance has been evaluated among American Indians from a Northern Plains tribe in Colorado (Jervis, Beals, Fickensher, & Arciniegas, 2007). More recently, Pedraza and colleagues (2007) provided normative change scores for the DRS in the form of reliable change indices calculated from over 1,000 MOANS and MOAANS participants. # The Author 2010. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oxfordjournals.org. doi:10.1093/arclin/acq030 Advance Access publication on 28 April 2010

348 O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 Normative reference values for neuropsychological tests usually are obtained from cross-sectional samples of cognitively normal individuals. Cognitive normality is inferred based on clinical history or external criteria such as the absence of impaired scores on other cognitive measures, independence in instrumental activities of daily living, and/or statement of normal cognition obtained from the participant, informant, or primary care physician. Among older adults, however, crosssectional normative samples represent an admixture of individuals who are indeed normal (i.e., disease-free) and individuals with incipient neurodegenerative disease (Saxton et al., 2004; Sliwinski, Lipton, Buschke, & Stewart, 1996). Those at a preclinical stage of neurodegenerative dementia may obtain baseline test scores that are within the realm of expectation when compared with age peers, despite representing a downward cognitive trajectory for the individual. The unintended consequence of including these individuals into conventional normative studies is that it leads to underestimation of the test mean and overestimation of the variance (De Santi et al., 2008; Ritchie, Frerichs, & Tuokko, 2007; Sliwinski et al., 1996). Longitudinal robust norming is a method of establishing normative data that exclude individuals with preclinical dementia. This is accomplished through (a) longitudinal surveillance of all candidates considered at baseline for inclusion into a normative sample, (b) case ascertainment of individuals who change diagnosis away from normal at any time point during follow-up, and (c) exclusion from the normative sample of all cases diagnosed with dementia. Individuals lost to follow-up after their baseline assessment also may be excluded from robust normative samples, particularly if their baseline test scores contribute to a reduction in the test mean and overestimation of the variance (Holtzer et al., 2008). Compared with cross-sectional norms, longitudinal robust norms appear to have greater predictive value in identifying individuals who decline from normal to mild cognitive impairment (MCI) or Alzheimer s disease (AD). De Santi and colleagues (2008) created robust norms for a battery of neuropsychological tests derived from 113 individuals who retained a diagnosis of normal on at least three successive evaluations. These robust norms were then applied to the baseline test scores of an independent cohort of adults followed longitudinally, some of whom eventually declined from normal to MCI or AD. Compared with conventional norms derived from a cross-sectional sample of another 256 participants, robust norms identified a greater proportion of decliners as having cognitive impairment at baseline. Likewise, Holtzer and colleagues (2008) examined data from 1,326 older adults participating in the Einstein Aging Study and created robust norms from a subset of 307 individuals diagnosed as cognitively normal at baseline and during at least two annual follow-up visits. The robust norms identified a larger proportion of baseline cognitive impairment in incident dementia cases than a set of conventional norms. Although better at predicting who will eventually decline from normal cognition to the early stages of AD, the advantage of robust norms appears to diminish once patients advance to a diagnosis of MCI or dementia. Specifically, De Santi and colleagues (2008) found that both conventional and robust norms performed equally well at confirming cognitive impairment among patients with known AD as well as in patients with MCI who progressed to AD. Some studies have failed to identify any advantage to robust norms. Marcopulos and McLain (2003), for example, recalculated norms from a subsample of participants who had contributed to a conventional, cross-sectional normative sample 4 years earlier. Ninety-four of the original 131 participants were retested, and robust norms were derived from a subset of 81 individuals who demonstrated no significant decline when compared with their baseline test performance. The investigators observed that their revised norms did not differ appreciably from the norms calculated from the original conventional sample. They noted, however, that decline was defined psychometrically and no clinical or medical information was obtained to make a formal diagnosis of dementia. As such, it is unclear how many actual incident dementia cases were present in the original sample, the revised sample, or the excluded group of decliners. Ritchie and colleagues (2007) also found no significant difference in the accuracy of conventional versus robust norms derived from the Canadian Study of Health and Aging. This null result was attributed to an equal or lesser-than-expected incidence of dementia in their sample compared with the general population, resulting in minimal contamination in the normative cohort. The authors noted that robust norms may be most useful when the incidence of dementia in the normative sample exceeds that observed in the general population. In aggregate, these studies suggest that longitudinal robust norms are at least equally useful as cross-sectional conventional norms in detecting cognitive impairment among older adults and may be more accurate than conventional norms in predicting preclinical dementia cases. Moreover, robust norms are superior to conventional norms if there is reason to suspect that the incidence of dementia in the normative cohort may be greater than expected in the general population. With the exception of Marcopulos and McLain (2003), to our knowledge the DRS has not been included in any robust normative study. In light of the potential benefits of robust norms, the current study aims to retrospectively review the original MOANS DRS normative cohort, which was derived from a conventional, cross-sectional sample, and determine the proportion of preclinical dementia cases present in that sample. In addition, we update and improve upon the available normative data for the DRS by providing longitudinally robust norms derived from an expanded sample of Caucasian older adults.

O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 349 Materials and Methods Participants A retrospective review of the Mayo Clinic Alzheimer s Disease Research Center (ADRC) database was conducted to identify community-dwelling, independently functioning adults who met the following criteria at the time of their baseline assessment: (a) age 55 or older, (b) normal cognition based on consensus diagnostic opinion, and (c) administration of the DRS. A consensus diagnosis was rendered at every encounter by a team consisting of at least one behavioral neurologist, clinical neuropsychologist, and nurse or family physician. Normal cognition at baseline was defined based on (a) self, informant and physician reports; (b) capacity to independently perform activities of daily living, based on informant report; (c) no active or uncontrolled central nervous system, systemic, or psychiatric condition that would adversely affect cognition, based on physician report; and (d) no use of psychoactive medications in amounts that would be expected to compromise cognition or for reasons indicating a primary neurologic or psychiatric illness. Importantly, performance on the DRS did not contribute to the baseline diagnosis. Eligible participants with a diagnosis of normal cognition at baseline included 1,175 adults. Of these, 101 individuals were lost to follow-up after their baseline assessment and constitute the single encounter group. Another 180 individuals progressed to a consensus diagnosis other than normal at a follow-up encounter and constitute the preclinical dementia group. Diagnoses at follow-up in this group included MCI (n ¼ 119), AD (n ¼ 39), vascular/mixed dementia (n ¼ 7), dementia with Lewy bodies (n ¼ 3), and other conditions (n ¼ 12). The remaining 894 adults received a consensus diagnosis of normal cognition at every follow-up encounter and constitute the robust normal sample (Fig. 1). APOE genotype, an established risk factor for AD, was available on 99% of all participants (n ¼ 1,165). In addition, all 623 participants in the Lucas and colleagues (1998) normative cohort were specifically reviewed to determine how many remained cognitively normal during subsequent encounters, progressed to dementia, or were lost to follow-up after their baseline testing. Four-hundred and ninety adults (78.5%) out of 623 returned for at least one follow-up visit (range ¼ 1 16). Of these, 334 retained a consensus diagnosis of normal across all visits, 62 progressed to MCI, and 53 progressed to AD. The remaining 41 participants did not retain a primary diagnosis of normal cognition due to other medical conditions (e.g., intracerebral hemorrhage, dementia with Lewy bodies, vascular dementia, Parkinson s disease, posterior cortical atrophy). Overall, 76 (15.5%) out of 490 participants with follow-up encounters (or 12.2% out of all 623 participants) eventually received a primary diagnosis of dementia. Participants from this original cohort who remained cognitively normal during all follow-up visits (n ¼ 334) are included in the current, expanded normative set. That is, the current robust sample of 894 adults includes robust normal individuals (n ¼ 334) from the Lucas and colleagues article, plus a new sample of 560 subjects recruited during the intervening years. All data were obtained in full compliance with study protocols approved by the Mayo Clinic Institutional Review Board. Materials The DRS is a 144-point instrument used in clinical and research settings for the detection, differential diagnosis, and staging of dementia (Jurica et al., 2001). It measures attention, orientation, word fluency, motor initiation and perseveration, visuospatial construction, conceptualization, and memory, which are organized into five domain subtests (Attention, Initiation/ Perseveration, Construction, Conceptualization, and Memory). Test items are arranged hierarchically, and full credit is given to a section if the individual answers the initial items correctly. Administration time usually takes 20 40 min. Statistical Analyses Group differences for continuous variables were examined using ANOVA with post hoc Tukey s honestly significant difference tests. Group differences for categorical variables were examined with Pearson s chi-squared. Given the unique association Fig. 1. Schematic diagram of study participants.

350 O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 of education and DRS scores found in the previous Mayo normative study (Lucas et al., 1998) and other samples (Marcopulos et al., 1997; Schmidt et al., 1994; Smith et al., 1994), hierarchical linear regression was used to explore this relationship in the robust normal group. Age was entered first into the hierarchical model, followed by education. The methodology used to develop the current norms was similar to that used in previous Mayo normative studies (e.g., Ivnik et al., 1990; Lucas et al., 2005). Specifically, an a priori decision was made to include a minimum of 70 individuals within each age group to increase the likelihood of stable estimates. Individuals at the extreme ends of the age distribution were combined until the minimum sample size of 70 was reached. Overlapping midpoint age intervals were used to maximize the available information, with midpoints selected at 3-year intervals and a range around each midpoint of +5 years (Pauker, 1988). The distribution of raw scores within each midpoint age group was then normalized by assigning standard scores based on actual percentile ranks. This strategy provides a normative reference for adults surrounding a particular age point. For additional details regarding this methodology, see Ivnik and colleagues (1990). Results Demographic characteristics and mean DRS total scores for all 1,175 participants in the updated sample are presented in Table 1. The three groups differed on age, F(2, 1172) ¼ 9.46, p,.001, and education, F(2, 1172) ¼ 4.83, p,.01. Specifically, robust normal participants were marginally younger than single encounter (p ¼.05) and significantly younger than preclinical dementia (p,.001) participants. Robust normal participants had a significantly higher level of education than single encounter participants (p,.05), but not when compared with preclinical dementia participants. There was no significant difference between the groups on sex distribution, x 2 (2) ¼.57, p ¼.75. Robust normals had the lowest proportion of APOE 14 allele carriers (23.6%); however, this was not significantly different when compared with the proportion of APOE 14 carriers among single encounter, x 2 (1) ¼ 1.85, p ¼.17, or preclinical dementia, x 2 (1) ¼ 3.63, p ¼.06 groups. When considering only the robust normal sample, 11 adults (1.2%) were APOE 14/4 homozygotes. As expected, mean total DRS scores differed among the three groups, F(2, 1172) ¼ 16.30, p,.001, with robust normals obtaining a significantly higher mean DRS score compared with single encounter (p,.001) and preclinical dementia (p,.001) participants. Consistent with prior studies on the effects of robust norming, the conventional (full) sample of 1,175 participants (M ¼ 135.8, SD ¼ 5.8) underestimated the DRS mean and overestimated the variance when compared with the robust subsample. Moreover, this effect was also evident when comparing the current robust subsample with the mean DRS score (M ¼ 134.7, SD ¼ 6.8) calculated from the original subsample of 623 participants. Frequency distributions of demographic data and study encounters for the robust normative sample are presented in Table 2. Approximately 89% of the sample had at least two follow-up visits and almost half (45.3%) had a minimum of five follow-up visits during which a consensus diagnosis of normal was retained. Among preclinical dementia cases, the median number of follow-up visits was four and the mode was six (range ¼ 1 8). Single encounter participants were lost to follow-up for a variety reasons, but no formal attempt has been made to ascertain the specific factors contributing to their study withdrawal. Table 3 shows the association between demographic variables and DRS scores in robust normal participants. As expected, age and education were significantly associated with the majority of DRS subtest and total scores. Sex was associated only with the Construction subtest, accounting for less than 1% of variance (r 2 ¼.008). To determine if this association was sufficiently relevant to stratify the Construction subtest in our normative tables, we then analyzed the mean Construction scores between men and women across 5-year age bands. Mean Construction scores were significantly different for men and women only between the ages of 80 and 84, with women obtaining on average 0.12 points more than men. Across all ages, the mean Construction subtest score for men was 5.73 and women 5.81. Given the rather trivial relationship between sex and Construction subtest scores in our sample, and the lack of association to any other DRS subtest, it was not considered for the normative analyses. Table 1. Characteristics of robust normal (n ¼ 894), single encounter (n ¼ 101), and preclinical dementia (n ¼ 180) participants Robust normals Single encounter Preclinical dementia M SD M SD M SD Age 78.3 6.9 80.0 6.5 80.5 5.7 Education 13.4 2.8 12.5 2.7 13.6 3.4 DRS total 136.4 5.6 133.7 5.4 134.4 6.5 Men (%) 37.0 37.6 40.0 APOE 14 (%) 23.6 29.7 30.3 Note: DRS ¼ Dementia Rating Scale.

Table 2. Frequency distribution of robust normative sample (n ¼ 894) O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 351 n Relative frequency (%) Cumulative frequency (%) Age (years) 55 59 7 0.8 0.8 60 64 19 2.1 2.9 65 69 27 3.0 5.9 70 74 251 28.1 34.0 75 79 203 22.7 56.7 80 84 236 26.4 83.1 85 89 118 13.2 96.3 90 94 21 2.3 98.7 95+ 12 1.3 100.0 Education (years),8 5 0.6 0.6 8 11 123 13.8 14.3 12 275 30.8 45.1 13 15 262 29.3 74.4 16 17 150 16.8 91.2 18+ 79 8.8 100.0 Gender Men 331 37.0 37.0 Women 563 63.0 100.0 Follow-up encounters a 1 95 10.6 10.6 2 119 13.3 23.9 3 150 16.8 40.7 4 125 14.0 54.7 5 120 13.4 68.1 6 96 10.7 78.9 7 77 8.6 87.5 8 38 4.3 91.7 9 27 3.0 94.7 10 17 1.9 96.6 11 16 1.8 98.4 12 8 0.9 99.3 13 2 0.2 99.6 14 4 0.4 100.0 a Number of follow-up encounters in which a consensus diagnosis of normal cognition was rendered. Table 3. Correlation coefficients and shared variances of DRS subtest and total scores with demographic variables (n ¼ 894) Age Sex a Education r r 2 r r 2 r r 2 Attention 2.15**.02.03 0.17**.03 Initiation/Perseveration 2.22**.05.06 0.18**.03 Construction 2.06.00.09**.01.08*.01 Conceptualization 2.27**.07 2.01 0.28**.08 Memory 2.24**.06.03 0.13**.02 Total score 2.34**.12.05 0.31**.09 Note: DRS ¼ Dementia Rating Scale. a Point-biserial correlations. *p,.05. **p,.01. Normative data for DRS subtest and total scores are presented in Tables 4 13. Robust age-corrected scaled scores are presented in the leftmost column of each table, with corresponding percentile ranks in the rightmost column. To use these norms, first select the table corresponding to the patient s age at the time of test administration. Then search for the patient s raw score and refer across to the corresponding scaled score (M ¼ 10, SD ¼ 3) and percentile rank. The age range and sample size used to create norms for each group are provided beneath each table.

352 O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 Table 4. Robust norms for persons under age 67 2,31,28,3,29,19,123,1 3 31 28 29 3 4 29 31 19 123 126 1 4 30 32 20 127 128 2 5 32 31 33 21 129 130 3 5 6 33 32 33 5 34 131 134 6 10 7 34 34 36 35 36 22 135 11 18 8 23 136 137 19 28 9 35 37 138 29 40 10 36 37 6 38 24 139 140 41 59 11 141 60 71 12 39 142 72 81 13 37 25 82 89 14 143 90 94 15 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; Range ¼ 55 70, n ¼ 115. Table 5. Robust norms for persons of age 67 69 years 2,31,27,3,29,19,123,1 3 31 27 29 3 4 29 31 19 123 126 1 4 30 32 20 127 128 2 5 32 31 33 21 129 130 3 5 6 32 33 34 131 132 6 10 7 33 34 35 5 35 22 133 135 11 18 8 34 36 36 136 19 28 9 35 37 23 137 138 29 40 10 38 24 139 41 59 11 36 37 6 140 60 71 12 39 141 72 81 13 37 25 142 82 89 14 143 90 94 15 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; Range ¼ 63 73, n ¼ 262. Results from the hierarchical linear regression model showed education to contribute unique variance to DRS total scores, F(2, 891) ¼ 108.9, p,.001, with an increment from r 2 ¼.12 in the age-only model to r 2 ¼.20 in the age and education model. To aid clinicians and investigators using the DRS, robust age- and education-corrected scaled scores can be derived for the total raw score using the equation presented in Table 14. Scaling constraints due to marked deviation from normality precluded education adjustments for each DRS subtest. Finally, a preliminary post hoc analysis was performed of the incremental diagnostic validity and clinical utility of these robust norms in the detection of baseline cognitive impairment in preclinical dementia cases. Scaled scores were obtained for baseline DRS total scores from 49 preclinical dementia cases (39 AD, 10 with other dementia diagnoses) using robust and original norms. These scores were compared with the baseline scaled scores from 49 cognitively normal adults selected from the robust sample. To minimize the likelihood of spurious findings, 3 separate random samples (with replacement) of 49 cognitively normal adults were drawn. Cognitive impairment was defined as a scaled score lower than 7. Across the three

Table 6. Robust norms for persons of age 70 72 years O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 353 2,30,27,3,28,19,121,1 3 30 27 29 3 4 28 30 19 121 125 1 4 31 30 31 20 126 127 2 5 31 32 33 21 128 129 3 5 6 32 32 33 34 130 132 6 10 7 33 34 35 5 35 22 133 134 11 18 8 34 36 36 135 136 19 28 9 37 23 137 29 40 10 35 38 138 139 41 59 11 36 37 6 24 140 60 71 12 39 141 72 81 13 37 25 142 82 89 14 143 90 94 15 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; Range ¼ 66 76, n ¼ 358. Table 7. Robust norms for persons of age 73 75 years 2,29,27,3,28,19,121,1 3 29 30 27 29 3 4 28 30 19 121 125 1 4 30 31 20 126 127 2 5 31 31 32 33 21 128 129 3 5 6 32 32 33 34 130 131 6 10 7 33 34 35 5 35 22 132 134 11 18 8 34 36 36 135 19 28 9 37 23 136 137 29 40 10 35 38 138 139 41 59 11 36 37 6 24 140 60 71 12 141 72 81 13 37 39 25 142 82 89 14 143 90 94 15 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; Range ¼ 69 79, n ¼ 460. comparisons, use of the original norms resulted in sensitivity of 14.3%, whereas the new robust norms resulted in sensitivity of 24.5%. Specificity using original norms ranged from 91.8% to 95.9%, and using robust norms ranged from 89.8% to 93.9%. Positive predictive values ranged from 63.6% to 77.8% using the original norms and 70.6% to 80.0% using robust norms, an average increase of 3.2%. Negative predictive values ranged from 51.7% to 52.8% using original norms and 54.3% to 55.4% using robust norms, an average increase of 2.4%. Discussion The purpose of this study was twofold: First, to retrospectively review the original MOANS DRS normative sample and determine how many cases of preclinical dementia were present; and second, to update the available DRS norms with an expanded, longitudinally robust sample. Of the 490 adults in the original sample who returned for additional evaluations,

354 O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 Table 8. Robust norms for persons of age 76 78 years 2,28,27,3,28,19,120,1 3 28 29 27 29 3 4 28 29 19 120 122 1 4 30 30 30 20 123 124 2 5 31 31 31 32 125 128 3 5 6 32 32 33 33 21 129 130 6 10 7 33 34 35 5 34 35 22 131 133 11 18 8 34 36 36 134 19 28 9 23 135 136 29 40 10 35 37 137 138 41 59 11 36 37 6 38 24 139 140 60 71 12 141 72 81 13 39 25 142 82 89 14 37 143 90 94 15 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; Range ¼ 72 82, n ¼ 488. Table 9. Robust norms for persons of age 79 81 years 2,28,27,3,28,16,116,1 3 28 29 27 28 3 4 28 16 18 116 120 1 4 29 29 19 121 122 2 5 30 30 31 30 31 20 123 126 3 5 6 31 32 32 33 21 127 129 6 10 7 32 33 34 5 34 130 131 11 18 8 33 35 35 22 132 134 19 28 9 34 36 36 23 135 29 40 10 35 37 136 138 41 59 11 36 37 6 38 24 139 60 71 12 140 141 72 81 13 39 25 142 82 89 14 37 143 90 94 15 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; Range ¼ 75 85, n ¼ 472. 62 of them obtained a follow-up diagnosis of MCI and another 53 eventually progressed to AD. Considering the 1,074 adults in the expanded sample who had normal cognition at baseline and at least one follow-up visit, approximately 6% constituted cases of preclinical dementia. This rate is generally consistent with other robust normative studies in suggesting that cross-sectional norms may contain a non-trivial number of individuals at a preclinical stage of neurodegenerative dementia. For instance, Holtzer and colleagues (2008) reported a 4.6% rate of preclinical dementia cases, Saxton and colleagues (2004) reported a 10.4% rate of preclinical AD cases, and De Santi and colleagues (2008) reported a 16.1% rate of preclinical AD cases. Moreover, it is now clear that our original norms slightly underestimated the overall DRS mean and overestimated the variance when compared with a robust sample of cognitively normal adults. There are several strengths to the present investigation. First, by revisiting the original normative sample and conducting a critical reappraisal, we have confidence that the robust norms provided in this article represent an accurate depiction of DRS performance among cognitively normal (i.e., disease-free) older adults. Second, by excluding from the robust sample not only

Table 10. Robust norms for persons of age 82 84 years O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 355 2,28,26,3,24,15,114,1 3 28 29 26 27 3 4 24 27 15 17 114 115 1 4 28 28 18 116 119 2 5 30 29 30 29 30 19 120 123 3 5 6 31 31 31 32 20 124 127 6 10 7 32 32 34 5 33 34 21 128 130 11 18 8 33 35 35 22 131 132 19 28 9 34 36 36 133 135 29 40 10 35 37 23 136 137 41 59 11 36 37 6 38 24 138 139 60 71 12 140 72 81 13 39 141 82 89 14 37 25 142 90 94 15 143 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; range ¼ 78 88, n ¼ 418. Table 11. Robust norms for persons of age 85 87 years 2,28,24,3,24,15,113,1 3 28 29 24 26 3 4 24 26 15 113 114 1 4 27 27 16 17 115 2 5 30 28 29 28 29 18 19 116 121 3 5 6 31 30 31 30 31 20 122 126 6 10 7 32 32 33 5 32 33 21 127 129 11 18 8 33 34 35 34 35 22 130 131 19 28 9 34 36 36 132 134 29 40 10 35 37 23 135 137 41 59 11 36 37 6 38 24 138 60 71 12 139 140 72 81 13 39 141 82 89 14 37 25 142 90 94 15 143 95 97 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; range ¼ 81 91, n ¼ 309. individuals who have progressed to dementia but also those with MCI or a single encounter, we have minimized the likelihood that those with any incipient neurodegenerative process would be included. We are aware that not all individuals with MCI will progress inexorably toward dementia and many will revert back to normal. However, our conservative approach ensures that this normative cohort is as free of neurodegenerative disease as theoretically possible. Third, we considered the role of APOE in the selection of the normative sample. The proportion of APOE 14 carriers was not significantly different between the robust and preclinical dementia samples, although there was a trend toward more 14 carriers in the preclinical dementia group. Only 11 participants in the robust sample were 14 homozygotes, and their mean DRS score of 136.4 (SD ¼ 5.6) was similar to the mean DRS score for the entire robust sample. For this reason, we opted to keep these 11 individuals in the normative group. Fourth, the current study draws from a relatively large sample size and includes a substantial number of adults 80 years of age and older.

356 O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 Table 12. Robust norms for persons of age 88 90 years 2,28,21,2,22,13,111,1 3 28 29 21 25 2 4 22 24 13 15 111 112 1 4 26 25 16 113 114 2 5 30 27 29 26 28 17 18 115 118 3 5 6 31 30 29 30 19 20 119 124 6 10 7 32 31 32 5 31 33 21 125 127 11 18 8 33 33 34 34 128 130 19 28 9 34 35 36 35 22 131 133 29 40 10 35 36 37 23 134 136 41 59 11 36 6 24 137 138 60 71 12 37 38 139 72 81 13 140 82 89 14 37 39 25 141 90 94 15 142 143 95 97 16 98 17 144 99 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; range ¼ 84 94, n ¼ 175. Table 13. Robust norms for persons of age over 90 years 2,28,21,2,20,7,102,1 3 28 29 21 24 2 3 20 22 7 14 102 112 1 4 25 4 23 24 15 113 2 5 30 26 27 25 27 16 114 116 3 5 6 31 28 29 28 29 17 18 117 122 6 10 7 32 30 31 5 30 32 19 20 123 126 11 18 8 33 32 34 33 21 127 128 19 28 9 34 35 34 22 129 131 29 40 10 35 36 35 36 23 132 135 41 59 11 36 6 37 136 137 60 71 12 37 38 24 138 72 81 13 139 140 82 89 14 37 39 25 141 90 94 15 142 95 97 16 143 98 18 144.99 Notes: Init./Pers. ¼ Initiation/Perseveration; Const. ¼ Construction; Concept. ¼ Conceptualization; range ¼ 87 101, n ¼ 92. Table 14. Steps to obtain robust age- and education-corrected scaled scores for total DRS raw scores Obtain the robust age-corrected scaled score (racss) from the appropriate table (Tables 4 13) Determine the years of formal education completed (EDUC) Calculate the robust age- and education-corrected scaled score (raecss) using the following formula: raecss ¼ 2.86 + (1.16 racss) (0.32 EDUC) Note: DRS ¼ Dementia Rating Scale. Finally, a preliminary validation of the diagnostic and clinical utility of these updated, robust norms was performed. When considering the DRS scores of preclinical dementia cases at baseline, the robust norms result in an almost twofold increase in sensitivity with relatively minimal loss of specificity when compared with the original norms. Moreover, in this preliminary analysis, the use of the updated robust norms contributes to net gains in positive (3.2%) and negative predictive values (2.4%).

Although these gains are relatively modest, the reader is urged to remember that these are comparisons of baseline, preclinical DRS scores (i.e., prior to a clinical diagnosis of dementia). The modest magnitude of these gains suggests that in wellcharacterized, large normative cohorts in which the incidence of dementia does not exceed substantially that found in the general population, there is likely to be minimal contamination of test scores. As such, the extraordinary efforts and funding required to follow large cohorts longitudinally may not be practical for the sole purpose of deriving robust norms. Rather, the development of such norms may be most feasible in centers where longitudinal neuropsychological data are collected in service of other primary aims. As noted in the original DRS normative study, the validity of all norms depends on the extent to which the test-taker shares similarities with the normative sample. The robust MOANS sample in the current study is comprised of Caucasian adults predominantly living in economically stable areas in the Midwest region of the USA. The underrepresentation of participants with limited education warrants caution when applying these norms to those with fewer than 8 years of formal education. DRS normative data for African American older adults are also available (Rilling et al., 2005). Over the past two decades, investigators at the Mayo Clinic have provided normative data for a variety of neuropsychological tests under the auspices of the MOANS and MOAANS projects. It is hoped that the robust norms for the DRS presented in this article will be beneficial to clinicians and investigators in their evaluation of older adults. Funding This work was supported by the National Institutes of Health (NS054722 to OP, AG00831 to JAL, GES, NRG, RCP, RJI, AG016574 to JAL, GES, NRG, RCP, RJI, AG006786 to RCP, RJI); and the State of Florida Alzheimer s Disease Initiative (FL-2J-02 to JAL, NRG). Conflict of Interest None declared. Acknowledgements We are grateful for the assistance of staff members in the Psychological Assessment Laboratory at Mayo Clinic Alzheimer s Disease Research Center (ADRC) and the Memory Disorders Clinic at Mayo Clinic, Florida. We also want to thank Roger A. Mueller and Matthew R. Miller for their invaluable database assistance. References O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 357 Bank, A. L., Yochim, B. P., MacNeill, S. E., & Lichtenberg, P. A. (2000). Expanded normative data for the Mattis Dementia Rating Scale for use with urban, elderly medical patients. The Clinical Neuropsychologist, 14 (2), 149 156. De Santi, S., Pirraglia, E., Barr, W., Babb, J., Williams, S., Rogers, K., et al. (2008). Robust and conventional neuropsychological norms: Diagnosis and prediction of age-related cognitive decline. Neuropsychology, 22 (4), 469 484. Holtzer, R., Goldin, Y., Zimmerman, M., Katz, M., Buschke, H., & Lipton, R. B. (2008). Robust norms for selected neuropsychological tests in older adults. Archives of Clinical Neuropsychology, 23, 531 541. Ivnik, R. J., Malec, J. F., Tangalos, E. G., Petersen, R. C., Kokmen, E., & Kurland, L. T. (1990). The Auditory Verbal Learning Test (AVLT): Norms of ages 55 and older. Psychological Assessment, 2, 304 312. Jervis, L. J., Beals, J., Fickensher, A., & Arciniegas, D. B. (2007). Performance on the Mini-Mental State Examination and Mattis Dementia Rating Scale among older American Indians. The Journal of Neuropsychiatry and Clinical Neurosciences, 19, 173 178. Jurica, P. J., Leitten, C. L., & Mattis, S. (2001). Dementia Rating Scale-2: Professional manual. Lutz: Psychological Assessment Resources. Lichtenberg, P. A., Ross, T., Youngblade, L., & Vangel, S. J. (1998). Normative Studies Research Project test battery: Detection of dementia in African American and European American urban elderly patients. The Clinical Neuropsychologist, 12, 146 154. Lucas, J. A., Ivnik, R. J., Smith, G. E., Bohac, D. L., Tangalos, E. G., Graff-Radford, N. R., et al. (1998). Normative data for the Mattis Dementia Rating Scale. Journal of Clinical and Experimental Neuropsychology, 20, 536 547. Lucas, J. A., Ivnik, R. J., Willis, F. B., Ferman, T. J., Smith, G. E., Parfitt, F. C., et al. (2005). Mayo s Older African Americans Normative Studies: Normative data for commonly used clinical neuropsychological measures. The Clinical Neuropsychologist, 19, 162 183. Lyness, S. A., Hernandez, I., Chui, H. C., & Teng, E. L. (2006). Performance of Spanish speakers on the Mattis Dementia Rating Scale (MDRS). Archives of Clinical Neuropsychology, 21, 827 836. Lyness, S. A., Hernandez, I., Chui, H. C., & Teng, E. L. (2007). Erratum to Performance of Spanish speakers on the Mattis Dementia Rating Scale (MDRS). Archives of Clinical Neuropsychology, 22, 131. Marcopulos, B. A., & McLain, C. A. (2003). Are our norms normal? A 4-year follow-up study of a biracial sample of rural elders with low education. The Clinical Neuropsychologist, 17 (1), 19 33.

358 O. Pedraza et al. / Archives of Clinical Neuropsychology 25 (2010) 347 358 Marcopulos, B. A., McLain, C. A., & Giuliano, A. J. (1997). Cognitive impairment or inadequate norms? A study of healthy, rural, older adults with limited education. The Clinical Neuropsychologist, 11, 111 131. Pauker, J. D. (1988). Constructing overlapping cell tables to maximize the clinical usefulness of normative test data: Rationale and an example from neuropsychology. Journal of Clinical Psychology, 44, 930 933. Pedraza, O., Smith, G. E., Ivnik, R. J., Willis, F. B., Ferman, T. J., Petersen, R. C., et al. (2007). Reliable change on the Dementia Rating Scale. Journal of the International Neuropsychological Society, 13 (4), 716 720. Rilling, L. M., Lucas, J. A., Ivnik, R. J., Smith, G. E., Willis, F. B., Ferman, T. J., et al. (2005). Mayo s Older African American Normative Studies: Norms for the Mattis Dementia Rating Scale. The Clinical Neuropsychologist, 19 (2), 229 242. Ritchie, L. J., Frerichs, R. J., & Tuokko, H. (2007). Effective normative samples for the detection of cognitive impairment in older adults. The Clinical Neuropsychologist, 21, 863 874. Saxton, J., Lopez, O. L., Ratcliff, G., Dulberg, C., Fried, L. P., Carlson, M. C., et al. (2004). Preclinical Alzheimer s disease: Neuropsychological test performance 1.5 to 8 years prior to onset. Neurology, 63, 2341 2347. Schmidt, R., Freidl, W., Fazekas, F., Reinhart, B., Grieshofer, P., Koch, M., et al. (1994). The Mattis Dementia Rating Scale: Normative data from 1,001 healthy volunteers. Neurology, 44 (5), 964 966. Sliwinski, M., Lipton, R. B., Buschke, H., & Stewart, W. (1996). The effects of preclinical dementia on estimates of normal cognitive functioning in aging. Journal of Gerontology, Series B: Psychological Sciences and Social Sciences, 51 (4), 217 225. Smith, G. E., Ivnik, R. J., Malec, J. F., Kokmen, E., Tangalos, E., & Petersen, R. C. (1994). Psychometric properties of the Mattis Dementia Rating Scale. Assessment, 1 (2), 123 132.