Evaluation of Proxy Responses to the Stroke Impact Scale

Transcription

1 Evaluation of Proxy Responses to the Stroke Impact Scale Pamela W. Duncan, PhD, FAPTA; Sue Min Lai, PhD, MS, MBA; Denise Tyler, MA; Subashan Perera, PhD; Dean M. Reker, PhD, RN; Stephanie Studenski, MD, MPH Background and Purpose The purposes of this study were to compare proxy-patient responses on each domain of the Stroke Impact Scale (SIS) and the SIS-16, estimate the bias, and evaluate the validity of proxy scores. Methods Two hundred eighty-seven patient and proxy pairs from the Kansas City Stroke Registry participated in the study. All patients were assessed in their home or nursing facility between 90 and 120 days after stroke with the use of the modified Rankin Scale Motricity Index (strength), Barthel Index (activities of daily living), Lawton assessment (instrumental activities of daily living), Folstein Mini-Mental State Examination (cognition), and the SIS. Eligible proxies were individuals who were aged 18 years, had known the patient for at least 1 year, and saw the patient at least once each week. All proxy interviews were conducted within 7 days of (before or after) the patient s interview. Results Three hundred seventy-seven patients from the Kansas City Stroke Registry were eligible for the study. Seventy-seven patients or proxies refused participation. Thirteen patients of the consenting patient-proxy pairs were too aphasic or cognitively impaired to complete the interviews and were dropped from the study. Proxies scored patients as more severely affected than patients scored themselves on the SIS-16 and in 7 of 8 domains of the full SIS (5 were statistically significant at 0.05). The proxy bias toward overrating the severity of the patient s condition tended to increase as the severity of the stroke increased. However, the magnitude of the biases between patient and proxy means, as measured by effect size, was small (range, 0.1 to 0.4). The strength of the agreement, as measured by intraclass correlation coefficients, between proxy and patient ranged from 0.50 to Agreement was best for the observable physical domains. Both patient and proxy scores in all domains were significantly different across Rankin categories. Concurrent validity for both patient and proxy correlations with the Folstein Mini-Mental State Examination, Barthel Index, Lawton instrumental activities of daily living, and Motricity Index was good to excellent (range, 0.37 to 0.78). Conclusions Proxies provide valid information for assessment of stroke outcomes. There are significant differences between patient and proxy reporting on SIS domains and the SIS-16. However, the observed biases are small and not clinically meaningful. (Stroke. 2002;33: ) Key Words: disability evaluation outcome quality of life stroke The purpose of this study was to evaluate proxy-patient agreement on the Stroke Impact Scale (SIS). The SIS is a newly developed self-report outcome measure. 1 The SIS Version 3.0 includes 59 items and assesses 8 domains (strength, hand function, activities of daily living [ADL]/ instrumental activities of daily living [IADL], mobility, communication, emotion, memory and thinking, and social participation). 1a Sixteen items from 4 of the 8 domains can be combined to produce a short composite physical domain score. The abbreviated physical domain is called the SIS-16. 1b One of the limitations of the use of self-report measures to assess outcomes after stroke is that many stroke survivors have cognition and communication problems. In a previous stroke outcome study, 25% of the subjects were excluded from health-related quality of life assessments because of cognitive and language disorders. 2 In a large study that used mail-administered quality of life questionnaires, 50% of the stroke subjects were unable to complete the questionnaires by themselves. 3 Study results can be seriously compromised and misleading if subjects who are suffering from severe deficits are excluded. The inclusion of proxy data will increase sample size, improve generalizability of the studies, and reduce sample bias. 4 Good proxy-patient agreement is a necessary criterion for the usefulness of a stroke outcome measure. 5 The development of the SIS requires that the reliability of proxy-patient responses to each domain be evaluated. The purposes of this study were to compare proxy-patient responses on each domain of the SIS and the SIS-16, estimate the biases, and evaluate the validity of patient and proxy scores. In addition, patient and proxy characteristics that affected agreement or bias were also evaluated. Received April 2, 2002; final revision received May 28, 2002; accepted June 11, From the Brooks Center for Rehabilitation Studies, University of Florida, and Rehabilitation Outcomes Research Center, North Florida/South Georgia Department of Veteran Affairs, Gainesville, Fla (P.W.D.); Kansas City Department of Veterans Affairs Medical Center, Kansas City, Mo (D.T., D.M.R.); and Center on Aging, University of Kansas Medical Center, Kansas City, Ks (P.W.D., S.M.L., S.P., D.M.R., S.S.). Correspondence to Pamela W. Duncan, PhD, FAPTA, Brooks Center for Rehabilitation Studies, College of Health Professions, University of Florida, Health Science Center, Box , Gainsville, FL pwduncan@hp.ufl.edu 2002 American Heart Association, Inc. Stroke is available at DOI: /01.STR E 2593

2 2594 Stroke November 2002 Subjects and Methods Recruitment of Subjects All 300 patients taking part in this study were recruited through the Kansas City Stroke Registry. The Stroke Registry is funded by the National Institute of Aging Claude D. Pepper Older Americans Independence Center Grant and enrolls stroke patients from 17 Kansas City metropolitan area health facilities. Patients were enrolled if they were within 28 days of their stroke. Potential patients were identified in each of the 15 recruitment sites through review of daily admission/discharge records and by referrals from unit-based nurses. To be eligible for participation in the Stroke Registry, a patient had a documented diagnosis of stroke and 50 years. The World Health Organization definition of stroke was used for the purposes of this study. 6 A stroke was defined as symptoms of rapid onset and of vascular origin reflecting a focal disturbance of cerebral function, excluding isolated impairment of higher function. 6 These deficits must have persisted for 24 hours. In addition, patients could not have any of the following exclusion criteria: stroke onset 28 days, stroke due to subarachnoid hemorrhage, deficits from a previous stroke, not expected to live 1 year, New York Heart Association class IV heart failure, not community dwelling before stroke, not independent in basic ADL before stroke, living 50 miles from participating hospital, progressive or severe neurological disease, amputee, obtunded, comatose, or unable to follow a 3-step command. If, on review of the medical record, a patient was found to be eligible for the Stroke Registry, consent to approach the patient about the Stroke Registry was obtained from the primary physician. The Stroke Registry was then explained to the patient, and informed consent was obtained. Baseline Measures At enrollment, a baseline assessment conducted by the research staff of nurses and physical therapists assessed patients demographics, stroke type, prior functional status, and stroke severity with the use of the National Institutes of Health Stroke Scale 7 and Barthel Index. 8 Ninety-Day Follow-Up Assessments All Stroke Registry patients received a follow-up telephone assessment at 90 days after stroke. Data were collected from the patient or a proxy. This telephone call consisted of a brief cognitive screen, the Hodkinson Cognitive Screen, 9 to determine the patient s ability to accurately answer questions about health status. If the patient was unable to communicate or score 5 on the Hodkinson Cognitive Screen, 9 a proxy for the patient completed the telephone interview. During the telephone interview, the patient s basic ADL and IADL were assessed with the Barthel Index 8 and Lawton IADL. 10 At the conclusion of this call, patients were asked to participate in the present study. Those who agreed were asked to identify a proxy. Eligible proxies were individuals who were aged 18 years, had known the patient for at least 1 year, and saw the patient at least once each week. Patient Interview All patients were assessed in their home or nursing facility by a master s level research associate between 90 and 120 days after stroke. Patients 3-month stroke severity was characterized by the modified Rankin Scale. 11 Strength was measured by the Motricity Index. 12 The Folstein Mini-Mental State Examination (MMSE) was used to rate cognitive ability. 13 After these measures were gathered, patients were interviewed with the use of the SIS. Proxy Interview All proxy interviews were conducted within 7 days of (before or after) the patient s interview to minimize any actual change in the patient s status between interviews. Both the patients and the proxies were blinded to each other s responses. Before participation, each proxy signed an informed consent. Proxy demographics including age, sex, race, education, and relationship to the patient were gathered, as was information about the amount of time spent with the patient each week. Proxies were also asked to rate, on a scale of 0 to 100, how well they felt they knew the patient. Proxy mental status was then determined with the Folstein MMSE. 13 Proxy health status was assessed by an interviewer-administered Medical Outcome Survey 36-item short-form health survey (SF-36). 14,15 After this information was gathered, proxies were interviewed about patients stroke recovery with the SIS. Data Analysis Descriptive statistics were used to characterize the patients, proxies, and their relationships. Several analytical strategies were used to examine patient-proxy agreement. First, mean responses of the patients and proxies were compared for each of the individual SIS domains with the use of a paired-samples Student s t test. To examine systematic bias, effect size was calculated by dividing the mean difference score by the standard deviation of the difference score. 16 An effect size of 0.2 was considered a small bias, 0.5 a moderate bias, and 0.8 a large bias. 17 Second, intraclass correlation coefficients (ICCs) between patient and proxy SIS assessments were computed with the use of the SAS VARCOMP procedure and minimum variance quadratic unbiased estimation. Guidelines used for the ICC as a measure of the strength of agreement were as follows: 0.40, poor agreement; 0.40 to 0.75, fair to good agreement; and 0.75 to 1.00, excellent agreement. 18 Third, ANOVA was used to examine whether differences between proxy and patient assessments varied across the range of stroke severity (Rankin Scale 0 to 5). Finally, we used 17 regression models with interaction for each SIS domain to identify any patient and proxy characteristics that may have affected patient-proxy differences after controlling for the patient-proxy average SIS score. To evaluate discriminant validity of patient and proxy scores, we examined differences in mean scores on each domain of the SIS across Rankin grades using ANOVA. We also assessed relationships between standard measures of stroke outcomes and select SIS domain scores with Pearson correlation coefficients. SAS version 8.00 was used for all statistical analyses. Results Three hundred seventy-seven patients from the Kansas City Stroke Registry were eligible to be included in this study. Fifty-seven patients refused to participate in additional assessments, and 20 proxies refused to respond to interviews. Three hundred stroke patients and their proxies took part in this study, representing 80% of all eligible patient and proxy pairs. There were no significant differences between those who refused and those who participated in terms of age ( and years, respectively; P ), sex (53.3% and 53.3% female, respectively; P ), or National Institutes of Health Stroke Scale score ( and , respectively; P ). Thirteen of the 300 patients who consented were too aphasic or cognitively impaired to complete the SIS interview (Table 1), and therefore this analysis is based on 287 patient and proxy pairs. Demographic characteristics of patients and proxies are shown in Table 2. The characteristics of the patients and proxies are presented in Tables 3 and 4. Comparison of Patient and Proxy Responses Agreement between patient and proxy SIS domain scores and the SIS-16 was examined in 287 patients for whom both patient and proxy information was available. Table 5 presents patient and proxy mean scores, patient-proxy differences, the magnitude of the differences (bias), and ICCs between patient and proxy reporting. Differences between patient and proxy

3 Duncan et al Evaluation of Proxy Responses to Stroke Impact Scale 2595 TABLE 1. Clinical Profile of 13 Subjects Who Could Not Respond to SIS Item Mean (SD) Folstein MMSE score 7.8 (7.0) Barthel Index score 42.9 (35.3) Lawton IADL score 11.8 (2.9) Rankin Scale score 4.0 (0.8) Proxy SIS assessment Strength 42.3 (33.1) Memory 42.3 (27.5) Emotion 70.5 (12.5) Communication 45.3 (23.0) ADL/IADL 24.4 (21.0) Mobility 28.7 (27.2) Hand function 21.2 (30.6) Social participation 29.7 (22.5) SIS-16 physical 31.7 (27.1) information were statistically different for 5 of the 8 SIS domains and for the SIS-16. In all 5 of these domains, the proxies rated the patients as more impaired than the patients rated themselves. However, the biases between patient and proxy means scores were low ( 0.1 to 0.4). The strength of the agreement between proxy and patient reporting ranged from moderate to excellent (ICCs ranged from 0.50 to 0.83). The best agreements were for domains that represented observable physical behaviors, and the worst agreements were on more subjective domains (eg, memory and thinking, communication, emotion, and strength). Factors That Affect Patient-Proxy Differences In patients with more severe stroke (Rankin Scale 4 to 5), the differences in patient-proxy reporting for ADL/IADL and TABLE 2. Demographic Characteristic Demographic Characteristics of Patients and Proxies Patients (n 287) Proxies (n 287) Age Sex Male 135 (47.0%) 78 (27.2%) Female 152 (53.0%) 209 (72.8%) Race White 240 (83.6%) 237 (82.6%) Black 43 (15.0%) 42 (14.6%) Other 4 (1.4%) 8 (2.8%) Education Grades (2.4%) 2 (0.7%) Grades (9.8%) 14 (4.9%) Grades (10.1%) 19 (6.6%) High school/ged 163 (56.8%) 162 (56.5%) College 37 (12.9%) 61 (21.3%) Postgraduate studies 23 (8.0%) 29 (10.1%) GED indicates general equivalency diploma. Values are mean SD or number (%). TABLE 3. Patient Characteristics (n 287) Characteristics Mean SD or No. (%) Baseline Stroke type Ischemic 268 (93.4%) Hemorrhagic 18 (6.3%) Uncertain 1 (0.3%) Stroke location Right hemisphere 123 (42.9%) Left hemisphere 113 (39.4%) Cerebellar 12 (4.2%) Bilateral 4 (1.4%) Brain stem 34 (11.9%) Uncertain 1 (0.3%) SF-36 prior physical function Baseline Barthel Index score Baseline NIHSS score (47.7%) (43.6%) (7.0%) 22 3 (1.1%) Not assessed 2 (0.1%) 3mo Rankin Scale score 0 10 (3.5%) 1 61 (21.3%) 2 90 (31.4%) 3 67 (23.3%) 4 56 (19.5%) 5 3 (1.1%) Folstein MMSE score Barthel Index score Lawton IADL score Motricity Index NIHSS indicates National Institutes of Health Stroke Scale. SIS-16 were significantly larger than in individuals with less severe stroke. Stroke severity did not affect patient-proxy differences for the other SIS domains (Table 6). We used 17 regression models with interaction for each SIS domain to assess multiple patient and proxy characteristics (eg, age, sex, education, cognitive function, mental health, relationships, and time spent with the patients), which may affect patientproxy differences. The results of these analyses did not systematically identify any patient or proxy factors that affected the observed differences. Validity of Patient and Proxy Ratings The relationships between patient and proxy SIS domains and some relevant standardized measures are reported in Table 7. The correlations between the Barthel Index and ADL/IADL domains and mobility domains of the SIS were very strong for both patient and proxy reporting. Agreement between Lawton IADL and SIS ADL/IADL domains was also excel-

4 2596 Stroke November 2002 TABLE 4. Proxy Characteristics (n 287) Characteristic Mean SD or No. (%) Folstein MMSE score SF-36 physical function SF-36 mental health Relationship to patient Spouse 138 (48.1%) Daughter 75 (26.1%) Friend 18 (6.3%) Son 22 (7.7%) Other family member 20 (7.0%) Parent 5 (1.7%) Sibling 7 (2.4%) Other 2 (0.7%) Live with patient Yes 185 (64.5%) No 102 (35.5%) Time spent with patient Does not live with patient 102 (35.5%) 8 h/d 22 (7.7%) 8 12 h/d 28 (9.8%) 12 h/d 135 (47.0%) Days of visitation 1 d/wk 15 (5.3%) 2 3 d/wk 38 (13.2%) 4 6 d/wk 21 (7.3%) Every day 28 (9.8%) Live with patient 185 (64.5%) Average hours per visit 1 35 (12.2%) (18.5%) (3.5%) (0.7%) 13 2 (0.7%) % Knowledge about patient lent. The correlations between both proxy and patient reporting of memory functions and the Folstein MMSE were moderate (0.37 and 0.42, respectively). The mean scores for TABLE 5. Comparison of Patient and Proxy SIS Responses (n 287) both patient and proxy reporting on all SIS domains and SIS-16 are depicted in Table 8. Both patient and proxy scores were significantly different across Rankin categories of stroke severity (0/1, 2, 3, and 4/5). The differences across Rankin categories were large for the physical domains but smaller for the memory, emotion, and communication domains. Discussion Although the necessity of including proxy responses to self-reported stroke outcome measures is clear, the reliance on proxy responses is valid only if the proxy responses are reliable and not compromised by systematic bias. The reliability of proxy responses has been assessed in studies of elderly subjects and in stroke survivors. Several findings are consistent across all studies of proxy respondents. First, proxy-patient ratings are more consistent when rating observable, concrete behaviors (eg, mobility and ADL). Agreement decreases when subjective judgment or estimation on behalf of the proxy (eg, questions pertaining to cognition or emotion or estimation of participation in activities outside the home) is required. Second, proxies tend to rate the subjects as more impaired or with a lesser quality of life than the subjects rate themselves. Third, lower levels of proxy agreement occur among severely affected subjects for whom proxy responses are the most needed. 19,20 Agreement between stroke survivors and their proxies has been examined in 5 previous studies with the use of 6 different self-report measures. In a small study (n 38) of interviewer-administered assessments of chronic stroke survivors, Segal and Schall 5 reported that proxy agreement was excellent (ICC 0.91) for the physical domain of the Functional Independence Measure but lower for the socialcognitive domain (ICC 0.61). Proxy agreement on IADL, as measured by the Frenchay Activities Index, was excellent (ICC 0.81) but was very poor for the SF-36 (average ICC 0.32; range, 0.67 for physical function to 0.15 for emotional role function). 21 In a subsequent study of 25 of the subjects enrolled in the previous study, Segal and Schall 5 compared proxy-patient agreement for telephone administration of the Functional Independence Measure. These subjects were assessed 18 months after stroke. Paralleling the results found for the in-person administration of the Functional Independence Measure at 6 months after stroke, the patient- SIS Domain Patients, Mean (SD) Proxies, Mean (SD) Patient-Proxy Difference, Mean (SD) t Effect Size P ICC Strength 61.9 (22.0) 57.2 (23.0) 4.6 (19.3) Memory 77.8 (19.1) 74.3 (22.1) 3.5 (20.5) Emotion 74.3 (18.1) 73.0 (18.7) 1.2 (17.9) Communication 81.0 (19.1) 82.1 (19.4) 1.5 (18.5) ADL/IADL 66.5 (23.2) 61.4 (26.8) 4.9 (16.2) Mobility 60.2 (23.1) 54.2 (24.8) 5.7 (17.4) Hand function 55.9 (34.5) 49.1 (36.6) 6.3 (19.6) Social participation 58.9 (25.7) 57.8 (25.9) 0.8 (24.0) SIS-16 physical 67.5 (21.2) 61.8 (24.1) 5.4 (14.7)

5 Duncan et al Evaluation of Proxy Responses to Stroke Impact Scale 2597 TABLE 6. Patient-Proxy Differences by Rankin Scale Category Rankin 0 1 Rankin 2 Rankin 3 Rankin 4 5 F P Strength 0.9 (20.0) 6.9 (17.7) 3.6 (17.1) 6.8 (22.4) Memory/thinking 0.1 (15.2) 5.4 (20.9) 3.0 (22.2) 5.1 (23.1) Emotion 0.6 (14.9) 3.9 (17.0) 0.5 (19.4) 0.2 (20.6) Communication 2.7 (12.1) 0.2 (18.2) 0.9 (23.3) 3.4 (19.2) ADL/IADL 1.5 (10.7) 2.9 (15.5) 6.2 (17.4) 10.7 (19.5) Mobility 2.3 (18.1) 5.6 (16.4) 8.7 (17.8) 6.9 (17.0) Hand function 3.2 (19.0) 7.8 (21.5) 7.3 (22.3) 6.8 (12.8) Social participation 0.3 (20.8) 0.8 (21.5) 1.81 (26.5) 5.1 (28.1) Physical function 2.0 (11.7) 4.5 (14.3) 6.7 (15.1) 9.6 (17.0) Rankin values are mean (SD). proxy agreement was 0.91 for the physical domain and was lower for the social-cognitive domain (0.52). Sneeuw et al 22 compared proxy-patient responses for a group of stroke survivors on the Sickness Impact Profile. ICCs were high (0.85) for the physical domains and moderate for the psychosocial domains (0.61). Systematic differences were observed between patient and proxy responses. Proxies rated patients as having more impairments than the patients rated themselves. The tendency of proxies to rate patients as more impaired was most pronounced in the more severely affected patients, but the bias was small. The proxy Sickness Impact Profile scores were significantly different across Rankin categories, which supports the validity of the proxy scores. 22 Dorman et al 23 compared proxy and patient responses for a group of stroke survivors on the EuroQol. They reported that proxy-patient agreements were best for self-care and physical function yet not much better than chance for psychosocial domains. Patients reported that their health states were better than the assessment of the proxies. Assessment of proxy-patient agreement on a telephone-administered community integration measure, the CHART, revealed that in a sample of 177 stroke patients the correlations were moderate to excellent for most domains but were lower for estimates of social integrations (ICC range, 0.44 to 0.72). 24 The proxies were systematically more likely to rate the patients as more impaired, but the differences were small. The proxy-patient agreements for stroke survivors were similar to those for other disability groups. 24 The results of the current comparison of patient and proxy reporting on the SIS are consistent with previously reported studies in the elderly and in individuals with stroke Proxy and patient reports on the SIS domains are significantly TABLE 7. Concurrent Validity: Pearson Correlations Between Selected SIS Domains and Other Assessments Patient Assessment Proxy Assessment Folstein MMSE and SIS memory domain Barthel Index and SIS ADL/IADL domain Barthel Index and SIS mobility domain Lawton IADL and SIS ADL/IADL domain Motricity and SIS strength domain different, and proxies report the patients to be more impaired than the patients report themselves. However, the magnitude of the differences (bias) is small and not clinically meaningful. The average patient-proxy differences for SIS-16 range from 1.5 to 6.3 (Table 5); however, the differences across Rankin severity levels for both patient and proxy reporting are large (Table 8). For example, the differences in scores for the SIS-16 physical domain across adjacent Rankin categories range from 11.9 to The agreement between patient and proxy reporting is best for observable domains of ADL/IADL, mobility, hand function, and SIS-16. Agreements decrease when subjective judgment is required to assess strength, memory, emotion, communications, and social participation. The agreements for the subjective domains of the SIS are better than those reported for the subjective domains of the SF-36 5 and the EuroQol 23 and are equally as good as patient-proxy agreement on the social-cognitive domain of the Functional Independence Measure. 5 Similar to the findings of Sneeuw et al 22 for the Sickness Impact Profile, a factor that affects patient-proxy agreement is stroke severity. In the most severely affected patients, the differences between patient-proxy reporting were greatest in the ADL/IADL and SIS-16 physical domains. However, the maximum average difference between patient-proxy reports (10.7 points), which occurred in the ADL/IADL domain, was less than half of the difference (22.8 points) between Rankin levels 3 and 4/5 for that domain. Both patient and proxy ratings on the SIS are valid. Patient and proxy ratings are strongly correlated with clinician-administered standardized measures (Table 7). The weakest correlation was between the memory domain and the Folstein MMSE. This weak correlation may be due to 2 factors: (1) the low variance in Folstein MMSE scores and self-report memory deficits and (2) the fact that only 2 of the items of the Folstein MMSE capture memory. The between-level differences in Rankin Scale severity are significant for all domains of the SIS. As expected, given the emphasis of the Rankin Scale on physical function, the between-level differences were larger for the physical domains than for the memory, communication, and emotion domains. Conclusions The evaluation of proxy-patient agreement on the SIS suggests that proxies may provide valid information for assess-

6 2598 Stroke November 2002 TABLE 8. Validity Check: ANOVA of SIS Assessments by Regrouped Rankin Category SIS Domain Rankin 0/1 Rankin 2 Rankin 3 Rankin 4/5 F P Patient Strength 76.9 (16.7) 67.0 (14.8) 59.0 (20.0) 39.2 (20.4) Memory 85.7 (13.0) 80.2 (15.7) 68.8 (21.5) 75.0 (22.3) Emotion 83.4 (15.6) 76.7 (15.9) 70.1 (18.1) 64.4 (18.2) Communication 90.2 (11.7) 83.5 (15.0) 70.6 (25.0) 78.0 (17.8) ADL/IADL 88.8 (10.3) 73.6 (14.8) 57.0 (16.4) 38.9 (18.1) Mobility 77.4 (15.8) 65.9 (16.0) 58.9 (17.7) 31.2 (18.3) Hand function 86.0 (17.0) 66.4 (25.2) 45.2 (29.6) 14.2 (20.3) Social participation 80.0 (19.4) 60.6 (20.4) 49.2 (23.7) 41.1 (23.4) SIS-16 physical 86.0 (10.8) 73.4 (13.7) 63.2 (15.4) 40.2 (16.8) Proxy Strength 76.1 (16.1) 59.9 (16.7) 55.4 (17.7) 32.4 (20.7) Memory 85.7 (14.9) 74.8 (21.1) 65.8 (24.2) 69.3 (22.8) Emotion 84.0 (13.9) 72.8 (19.2) 65.7 (18.1) 63.9 (17.6) Communication 92.4 (9.9) 83.4 (17.4) 71.5 (23.3) 80.0 (19.6) ADL/IADL 87.3 (11.9) 70.7 (16.6) 50.9 (19.4) 27.9 (17.2) Mobility 75.2 (18.2) 60.3 (19.5) 50.1 (16.0) 24.0 (14.8) Hand function 82.7 (21.8) 58.5 (27.8) 37.9 (31.7) 7.2 (15.2) Social participation 80.3 (17.7) 59.8 (21.8) 50.5 (23.7) 35.6 (19.6) SIS-16 physical 84.1 (12.6) 68.9 (16.3) 56.6 (16.0) 30.3 (16.1) Rankin values are mean (SD). ment of stroke outcomes. This study provides further evidence that there are acceptable levels of proxy and patient agreement for observable physical behaviors and that the bias observed is not clinically meaningful. Clinicians and researchers should exercise more caution when proxy responses are used to assess the more subjective domains of emotion, memory, and communication. However, our estimates of agreement on the more subjective domains may be conservative because of the lower variability in scores in these domains in our sample. The results of this study have implications for designing stroke outcome studies. It is appropriate to use proxy assessment; however, the researcher must be aware of the biases introduced with proxy responders. Proxies will report more limitations in function. Therefore, if an intervention improves outcomes and patients are more likely to be able to respond in the treatment group, the magnitude of the effect of the intervention may be exaggerated compared with the control group. This difference, however, may not affect the direction of the treatment effect. Acknowledgments This study was supported by the American Heart Association Pharmaceutical Roundtable Patient Care and Outcome Research Grant ( N) and the Claude D. Pepper Older Americans Independent Center Grant (AG ). The following health facilities in the greater Kansas City area collaborated with us for patient recruitment: Baptist Medical Center, Bethany Hospital, Department of Veterans Affairs Medical Center at Kansas City, Independence Regional Health Center, John Knox Village Care Center, Liberty Hospital, Life Care Center of Grandview, Menorah Medical Center, Mid-America Rehabilitation Hospital, Overland Park Regional Medical Center, Rehabilitation Institute, Research Medical Center, Shawnee Mission Medical Center, Saint Luke s Medical Center, Saint Joseph Health Center, Trinity Lutheran Hospital, and University of Kansas Medical Center. References 1. Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster L. The Stroke Impact Scale Version 2.0: evaluation of reliability, validity, and sensitivity to change. Stroke. 1999;30: a. Duncan PW, Lai SM, Bode RK, Perera S. Rasch analysis of a new stroke specific outcome scale: the Stroke Impact Scale. Arch Phys Med Rehabil. In press. 1b.Duncan PW, Lai SM, Bode RK, Perera S, DeRosa JT. Stroke Impact Scale-16: a brief assessment of physical function. Neurology. In press. 2. DeHaan R, Limburg M, vander Meulen J, Jacobs H, Aaronson N. Quality of life after stroke: impact of stroke type and lesion location. Stroke. 1995;26: Dorman PJ, Slattery J, Farrell B, Dennis MS, Sandercock PA, for the United Kingdom Collaborators in the International Stroke Trial. A randomised comparison of the EuroQol and Short-Form 36 after stroke. BMJ. 1997;315: Magaziner J, Simonsick EM, Kashner TM, Hebel JR. Patient-proxy response comparability on measures of patient health and functional status. J Clin Epidemiol. 1988;41: Segal ME, Schall RR. Determining functional/health status and its relation to disability in stroke survivors. Stroke. 1994;25: World Health Organization. Proposal for the Multinational Monitoring of Trends and Determinants in Cardiovascular Disease (MONICA Project). Rev ed 1. Geneva, Switzerland: World Health Organization; WHO/ MNC/ Brott T, Adams H, Olinger C. Measurements of acute cerebral infarction: a clinical examination scale. Stroke. 1989;20: Mahoney P. Functional evaluation: the Barthel Index. Md State Med J. 1965;14: Qureshi KN, Hodkinson H. Evaluation of ten-question mental test in the institutionalized elderly. Age Ageing. 1974;3: Lawton M, Brody E. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9:

7 Duncan et al Evaluation of Proxy Responses to Stroke Impact Scale van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJA, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19: Collin C, Wade D. Assessing motor impairment after stroke: a pilot reliability study. J Neurol Neurosurg Psychiatry. 1990;53: Folstein M, Folstein S, McHugh P. Mini-Mental State: a practical guide for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;53: Ware JE, Sherbourne CD. MOS-36 item short form health survey (SF-36): conceptual framework and item selection. Med Care. 1992;30: Ware JE. SF-36 Health Survey: Manual and Interpretation Guide. Boston, Mass: The Health Institute, New England Medical Center; Marshall GN, Hayes RD, Nicholas R. Evaluating agreement between clinical assessment methods. Int J Methods Psychiatr Res. 1994;4: Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NY: Lawrence Eribaum Associates; 1988: Rosner B. Fundamentals of Biostatistics. Pacific Grove, Calif: Duxbury; 2000: Weinberger M, Samsa GP, Schmader K, Greenberg SM, Carr DB, Wildman DS. Comparing proxy and patients perceptions of patients functional status: results from an outpatient geriatric clinic. J Am Geriatr Soc. 1992;40: Neumann PJ, Araki SS, Gutterman EM. The use of proxy respondents in studies of older adults: lessons, challenges and opportunities. J Am Geriatr Soc. 2000;48: Segal ME, Gillard M, Schall RR. Telephone and in-person proxy agreement between stroke patients and caregivers for the Functional Independence Measure. Am J Phys Med Rehabil. 1996;8: Sneeuw K, Aaronson N, DeHaan R, Limburg M. Assessing quality of life after stroke. Stroke. 1997;28: Dorman P, Waddell F, Slattery J, Dennis M, Sandercock P. Are proxy assessments of health status after stroke with the EuroQol questionnaire feasible, accurate, and unbiased? Stroke. 1997;28: Cusick CP, Brooks CA, Whiteneck GG. The use of proxies in community integration research. Arch Phys Med Rehabil. 2001;82: