People engage in daily social interactions and seek relationships with others

Similar documents
APSYCHOMETRIC STUDY OF THE MODEL OF HUMAN OCCUPATION SCREENING TOOL (MOHOST)

Critical Review: Group Therapy for Post-Stroke Aphasia Rehabilitation

Clinical utility of the Mellville-Nelson Self- Identified Goals Assessment

LOTCA Assessment review. Georgina Wrack. University of the Sunshine Coast

The ultimate outcome of TBI rehabilitation: Successful and satisfying community participation (McCabe, 2007)

Comparison of Predicted-difference, Simple-difference, and Premorbid-estimation methodologies for evaluating IQ and memory score discrepancies


COGNITION PART TWO HIGHER LEVEL ASSESSMENT FUNCTIONAL ASSESSMENT

ASHA Comments* (ASHA Recommendations Compared to DSM-5 Criteria) Austism Spectrum Disorder (ASD)

For the OT2019 Class of MScOT students entering fall 2017: Occupational Therapy Year One Course Descriptions 44 credits

Who is goal-setting? Characteristics of people who set goals using RAID Ladders in brain injury inpatient rehabilitation.

THE ESSENTIAL BRAIN INJURY GUIDE

***This is a self-archiving copy and does not fully replicate the published version*** Auditory Temporal Processes in the Elderly

Create an awareness of how Occupational Therapy approaches can promote independence for adults on the autistic spectrum. Sandra Gasson.

Autism Spectrum Disorders: An update on research and clinical practices for SLPs

Presented By: Yip, C.K., OT, PhD. School of Medical and Health Sciences, Tung Wah College

March 2010, 15 male adolescents between the ages of 18 and 22 were placed in the unit for treatment or PIJ-prolongation advice. The latter unit has

COMPACT Orientation & Procedure Manual

Occupational Therapy (OTHR)

Comparing accuracy of knowledge of functional effects of schizophrenia and brain injury

Evaluating the Effectiveness of a Goal-Directed Intervention on the Social Interaction of Children with Neurodevelopmental Disabilities

CRITICALLY APPRAISED PAPER (CAP)

MEASURING AFFECTIVE RESPONSES TO CONFECTIONARIES USING PAIRED COMPARISONS

Behavioral Intervention Rating Rubric. Group Design

Chapter Three BRIDGE TO THE PSYCHOPATHOLOGIES

Neuropsychological Testing (NPT)

MEDICAL POLICY SUBJECT: COGNITIVE REHABILITATION. POLICY NUMBER: CATEGORY: Therapy/Rehabilitation

A Coding System to Measure Elements of Shared Decision Making During Psychiatric Visits

AOTA S EVIDENCE EXCHANGE GUIDELINES TO CRITICALLY APPRAISED PAPER (CAP) WORKSHEET

The purpose of this study was to examine the discriminant

Interrater and Intrarater Reliability of the Assisting Hand Assessment

Geriatric Certification

DESIGN TYPE AND LEVEL OF EVIDENCE: Randomized controlled trial, Level I

Validation of an Analytic Rating Scale for Writing: A Rasch Modeling Approach

The Functional Outcome Questionnaire- Aphasia (FOQ-A) is a conceptually-driven

CRITICALLY APPRAISED PAPER (CAP)

Occupational Therapy & Physiotherapy Assistant

Can Licensed Mental Health Counselors Administer and Interpret Psychological Tests?

CHAPTER VI RESEARCH METHODOLOGY

The Impact of Tele-Rehabilitation System on. in Community settings

FOCUSSED CLINICAL QUESTION:

Running head: CPPS REVIEW 1

Students With Attention Deficit Hyperactivity Disorder

Asperger s Syndrome (AS)

SUMMER 2011 RE-EXAM PSYF11STAT - STATISTIK

RATER EFFECTS AND ALIGNMENT 1. Modeling Rater Effects in a Formative Mathematics Alignment Study

COGNITIVE FUNCTION. PROMIS Pediatric Item Bank v1.0 Cognitive Function PROMIS Pediatric Short Form v1.0 Cognitive Function 7a

A new scale for the assessment of competences in Cognitive and Behavioural Therapy. Anthony D. Roth. University College London, UK

Quantitative Methods in Computing Education Research (A brief overview tips and techniques)

2013 Supervisor Survey Reliability Analysis

Agitation Following TBI

Reliability. Internal Reliability

Copyright is owned by the Author of the thesis. Permission is given for a copy to be downloaded by an individual for the purpose of research and

Counseling Clients With Late-Life Depression

Cognitive-Behavioral Assessment of Depression: Clinical Validation of the Automatic Thoughts Questionnaire

Wednesday 8 March Behaviours of concern following traumatic brain injury Presenters:

Measure #106 (NQF 0103): Adult Major Depressive Disorder (MDD): Comprehensive Depression Evaluation: Diagnosis and Severity

by Peter K. Isquith, PhD, Robert M. Roth, PhD, Gerard A. Gioia, PhD, and PAR Staff

Update on the Developments in the Assessment of Neurobehavioural Disability: SASNOS

Book review. Conners Adult ADHD Rating Scales (CAARS). By C.K. Conners, D. Erhardt, M.A. Sparrow. New York: Multihealth Systems, Inc.

Process of a neuropsychological assessment

Comparison of Clinic & Home Observations of Social Communication Red Flags in Toddlers with ASD

The Myers Briggs Type Inventory

The Effects of Physical Attractiveness on Perceptions of Mental Illness

INTEGRATING REALISTIC RESEARCH INTO EVERY DAY PRACTICE

Behavioral Intervention Rating Rubric. Group Design

Charles P. Sabatino ABA Commission on Law and Aging May 20, 2009

Chapter 1 Applications and Consequences of Psychological Testing

Occupational Therapy for First Episode Psychosis

Chapter 1. Overview. General Description. Test Developers. Purpose and Use. Qualifications of Users. Limitations. Communication. General Description

The Predictive Validity of the Test of Infant Motor Performance on School Age Motor Developmental Delay

Julie Bolton M.Cl.Sc (SLP) Candidate University of Western Ontario: School of Communication Sciences and Disorders

Report of Recovery Star Research Seminar

CRITICALLY APPRAISED PAPER

Physical Therapist Practice and The Movement System

Communication Skills Assessment

Business Research Methods. Introduction to Data Analysis

Ability to link signs/symptoms of current patient to previous clinical encounters; allows filtering of info to produce broad. differential.

Professional Doctorate in Counselling Psychology

Career Counseling and Services: A Cognitive Information Processing Approach

CLINICAL BOTTOM LINE Early Intervention for Children With Autism Implications for Occupational Therapy

PROCEEDINGS JOURNAL OF EDUCATION, PSYCHOLOGY AND SOCIAL SCIENCE RESEARCH

Conceptualising computerized adaptive testing for measurement of latent variables associated with physical objects

CRITICALLY APPRAISED PAPER (CAP)

Dynamic Lowenstein Occupational Therapy Cognitive Assessment Geriatric Version (DLOTCA G): Assessing Change in Cognitive Performance

School Psychologist Evaluation Rubric

Calculating clinically significant change: Applications of the Clinical Global Impressions (CGI) Scale to evaluate client outcomes in private practice

SUPPLEMENTARY INFORMATION

Implications of Sensory Defensiveness in a College Population

Assessing & Enhancing Readiness for Career Decision Making: Implications from Recent Research

NICE Guidelines in Depression. Making a Case for the Arts Therapies. Malcolm Learmonth, Insider Art.

Social Cognitive Deficits and Lack of Insight in Schizophrenia Patients

32.5. percent of U.S. manufacturers experiencing unfair currency manipulation in the trade practices of other countries.

What you should know before you collect data. BAE 815 (Fall 2017) Dr. Zifei Liu

Practical measures for evaluating outcomes: Australian Therapy Outcome Measures (AusTOMs)

9 - SCREENING MEASURES FOR PERSONALITY DISORDERS

The Rorschach Performance Assessment System (R-PAS): Overview and Case Illustrations

Admission Criteria Continued Stay Criteria Discharge Criteria. All of the following must be met: 1. Member continues to meet all admission criteria

Questionnaire on Anticipated Discrimination (QUAD)(1): is a self-complete measure comprising 14 items

Casual conversations between individuals with traumatic brain injury (TBI) and their friends

Transcription:

Sensitivity of the Evaluation of Social Interaction Measures Among People With and Without Neurologic or Psychiatric Disorders Mette Søndergaard, Anne G. Fisher KEY WORDS interpersonal relations mental disorders nervous system diseases personality assessment sensitivity and specificity OBJECTIVE. To determine whether the Evaluation of Social Interaction (ESI) is sensitive enough to differentiate between people without identified diagnoses and those with neurologic or psychiatric disorders in terms of their observed quality of social interaction. METHOD. Participants were age 16 69 and were without identified diagnoses (n 5 304) or had neurologic (n 5 77) or psychiatric (n 5 104) disorders. They were evaluated using the ESI. RESULTS. Nonparametric Kruskal Wallis tests and post hoc Mann Whitney U tests revealed that the group without identified diagnoses had significantly better quality of social interaction than did either group with disabilities (Us 5 3,172 and 3,189, respectively; p.001). CONCLUSION. The ESI is sensitive with regard to detecting differences in quality of social interaction among groups expected to differ, suggesting that it is valid for use when the desired purpose is to identify people with diminished quality of social interaction. Søndergaard, M., & Fisher, A. G. (2012). Sensitivity of the Evaluation of Social Interaction measures among people with and without neurologic or psychiatric disorders. American Journal of Occupational Therapy, 66, 356 362. http:// dx.doi.org/10.5014/ajot.2012.003582 Mette Søndergaard, MS, OT, is Private Practitioner, Copenhagen, Denmark. Anne G. Fisher, ScD, OT, is Professor, Division of Occupational Therapy, Department of Community Medicine and Rehabilitation, Umeå University, Umeå, Sweden, and Director, AMPS Project International, PO Box 271928, Fort Collins, CO 80527; anne.fisher@ampsintl. com People engage in daily social interactions and seek relationships with others both known and previously unknown to them (Englund, 1997). Social interaction skills have been defined as the individual actions or units of social behavior that are observable within the ongoing stream of occupation that involves social interaction (i.e., a social exchange) (Fisher & Griswold, 2010, p. 1-6). Social interaction involves a give-and-take exchange of both verbal and nonverbal messages between the social partners (Fisher & Griswold, 2010). Segrin and Giverts (2003) noted that an overwhelming body of evidence indicates that the possession of adequate social skills is necessary for maintaining social, psychological, and in many cases, occupational well-being (p. 135), and Englund, Bernspång, and Fisher (1995) wrote that having diminished social skills can contribute to lower quality of life and relapse among people with mental illness. Performance of daily life tasks that involve social interaction skills is, therefore, one of the most important types of occupational performance a person must master. Assessments of Social Interaction Although social interaction has always been an important behavioral domain of concern for occupational therapy, occupational therapists have reported that they lack a standardized tool to evaluate social interaction skills (Doble, Bonnell, & Magill-Evans, 1991; Doble & Magill-Evans, 1992). Doble et al. (1991) carried out a survey of 64 occupational therapists to identify their perceptions of the importance of evaluating social skills in their practice and to determine how 356 May/June 2012, Volume 66, Number 3

they evaluated clients social skills. Of those who responded, 79% indicated that social skills evaluations were relevant, but only 29% used some type of formal evaluation; most reported that informal clinical observations were used almost exclusively for assessment. Although other professionals (e.g., psychologists) have a long history of evaluating social skills for purposes of identifying general and specific social difficulties as well as evaluating treatment outcomes, their evaluation methods typically include self-reports of social functioning, informant ratings or checklists of social performance (i.e., proxy report), performance evaluations based on role play, and direct observations of underlying body functions or isolated skills (Sheridan & Walker, 1999). In contrast, occupational therapists often evaluate the quality of people s daily task performances, including tasks that involve social interaction, by implementing evaluations based on direct observation as people are engaged in naturalistic daily life tasks that they have identified as meaningful and important for their fullest possible participation in society (Fisher, 2009). According to Fisher and Griswold (2010), the evaluation of social interaction skill in the natural context of engagement in occupation is what differentiates the occupational therapist s assessment from that of other professionals. To date, two standardized observation-based occupational therapy evaluations of social interaction have been developed: (1) the Assessment of Communication and Interaction Skills (ACIS; Forsyth, 1996; Forsyth, Lai, & Kielhofner, 1999, Forsyth, Salamy, Simon, & Kielhofner, 1998) and (2) the Evaluation of Social Interaction (ESI; Fisher & Griswold, 2010). The ACIS includes 20 items that are categorized into three theoretical domains: (1) physicality, (2) information exchange, and (3) relations. The ESI includes 27 items that are categorized into seven domains: (1) initiating and terminating social interaction, (2) producing social interaction, (3) physically supporting social interaction, (4) shaping content of social interaction, (5) maintaining flow of social interaction, (6) verbally supporting social interaction, and (7) adapting social interaction. The items in both tools are scored using a 4-point rating scale based on whether the skill observed is competent or supports ongoing social action, is questionable, interferes with social action, or is unacceptable or causes breakdown of the ongoing social interaction. When the ACIS is administered, the person evaluated can be observed during either naturalistic situations or during role play, and the occupational therapist often becomes a social partner. The person is evaluated in more than one situation, and four social situations are suggested: (1) open, unstructured situations; (2) parallel tasks in which people work individually on tasks but in the presence of others; (3) cooperative groups, in which all social partners are working together toward a common goal; and (4) one on one, in which the person interacts with one other person (Forsyth, 1996; Forsyth et al., 1998, 1999). In contrast, the ESI always involves direct observation of the person s quality of social interaction during at least two naturalistic, real-life social exchanges with typical social partners. The occupational therapist is always an unobtrusive observer, and the types of social exchange that can be observed are virtually unlimited (Fisher & Griswold, 2010). When the ESI is administered, the familiarity and status of the primary social partner, the familiarity of the context, the primary social partner s overall quality of social interaction, the person s overall quality of social interaction, and the comfort level of the social interaction are also rated for each social exchange observed. Perhaps the biggest difference between the two instruments, however, is that raters who have trained and calibrated as reliable and valid ESI raters are able to use their individual copies of the ESI scoring software, which incorporates a many-facet Rasch analysis program (Linacre, 1993) to generate linearized quality of social interaction measures. These linearized ESI measures can be interpreted from a criterion-based and a norm-based perspective. Criterion-based interpretations include determining whether a person s quality of social interaction measure is above or below a 1.0-logit competence cutoff on the ESI scale that delineates that the person s observed quality of social interaction was likely competent during all observed social exchanges (Fisher & Griswold, 2010). Norms are available for people age 2 yr and older, and existing evidence has supported the validity and reliability of ESI measures and scales (Fisher & Griswold, 2010). Client Groups That Experience Social Interaction Difficulties Occupational therapy clients who often have problems related to social interaction include those with neurologic (e.g., stroke, traumatic brain injury [TBI]) and psychiatric (e.g., depression, schizophrenia) disorders. For example, people with schizophrenia are often unable to fulfill basic social roles and have significant problems with social relationships, and their social networks are often small (Harvey, Velligan, & Bellack, 2007; Yilmaz, Josephsson, Danermark, & Ivarsson, 2008). Among a wide range of interpersonal or social skills deficits that have been reported among people with schizophrenia are diminished The American Journal of Occupational Therapy 357

eye contact and use of expressive gestures, inappropriate voice volume, and diminished verbal fluency (Halford & Hayes, 1995; Smith, Bellack, & Liberman, 1996). When a group of people with schizophrenia was compared with a control group (without identified diagnoses) using a performance-based measure, the group of people with schizophrenia demonstrated significantly more social skills deficits than did the control group (Patterson, Moscona, McKibbin, Davidson, & Jeste, 2001). Similar results were found by Sitzer, Twamley, Patterson, and Jeste (2008). Both Patterson et al. (2001) and Sitzer et al. used assessments that involved observation of role plays, not naturalistic social exchanges. People with TBI have also been reported to often have problems with social interaction (Bornhofen & McDonald, 2008; Dahlberg et al., 2007; McDonald & Flanagan, 2004; McDonald et al., 2008; Robertson & Knight, 2008). People with TBI often have difficulty recognizing emotions, particularly negative emotions, communicated using facial expressions and tone of voice, and they are significantly slower than are people without identified diagnoses in initiating conversation. Inappropriate social communications by people with TBI have been shown to interfere with social reintegration for as long as 10 15 yr after a severe head injury, and loss of social contact with others has been described as the most disabling handicap in daily life (Dahlberg et al., 2007). Although research has revealed that people with neurologic or psychiatric disorders often have problems with social interaction, studies based on standardized observation of quality of naturalistic social interaction of people with neurologic or psychiatric disorders have been lacking. They have most commonly been evaluated using role play, self-reports, and interviews. To better understand the unique needs of people with neurologic or psychiatric disorders, it is important that they be evaluated on the basis of direct observation and using a standardized tool. A recent study has shown that the ESI measures are sensitive enough to differentiate quality of social interaction between participants with and participants without a disability (Simmons, Griswold, & Berg, 2010) and between an age-matched sample of people without identified diagnoses and people with neurologic or psychiatric disorders (n 5 18 in each group; Søndergaard, 2009, cited by Fisher & Griswold, 2010). However, cross-validation of Søndergaard s pilot evidence is needed using a larger sample and confirming that the ESI measures are sensitive enough to differentiate among people without identified diagnoses and people with either neurologic or psychiatric disorders, two important diagnostic groups who often demonstrate diminished quality of social interaction and who receive services from occupational therapists. Such evidence would further support the validity of the ESI measures when used with these client groups to identify people with diminished quality of social interaction. Therefore, we addressed the research question, Do people with psychiatric or neurologic disorders have significantly lower mean quality of social interaction than do people with no identified diagnoses or disabilities? Method Research Design This study was a descriptive group comparison design based on retrospective data. Ethical approval was obtained from the Scientific Ethical Committee of Copenhagen. Participants The participants included 485 people from Denmark in the ESI database who had been evaluated as of September 2010, were between ages 16 and 69, and either (1) were healthy adults with no known diagnosis or disability (n 5 304) or (2) had a diagnosed neurologic (n 5 77) or psychiatric (n 5 104) disorder (without any other diagnosed secondary disorder). Eight people, ages 70 90, were excluded because the ESI database had no potential Danish participants with neurologic disorders ³ age 70 yr. Instrumentation The ESI was administered by trained and calibrated occupational therapists according to the standardized procedures described in the ESI manual (Fisher & Griswold, 2010). All raters had demonstrated acceptable levels of inter- and intrarater reliability and had calibrated as valid ESI raters. As noted earlier, Fisher and Griswold (2010) documented that evidence of the validity and reliability of ESI measures is growing. More specifically, studies have shown that quality of social interaction among people without identified diagnoses age 2 78 demonstrates a significant high curvilinear relationship with age (R 2 5.80), that quality of social interaction does not differ significantly between genders, and that no evidence exists for gender-related differential item functioning among the ESI items. The ESI measures are sensitive enough to differentiate (1) among adults without identified diagnoses who differ in global quality of observed social interaction and (2) between typically developing children and children at risk for or with mild disability. Finally, 358 May/June 2012, Volume 66, Number 3

among a sample of 98 raters, 96 (98%) demonstrated high inter- and intrarater reliability. The parallel-forms reliability among different types of social exchanges (e.g., engaging in casual conversation vs. collaboratively working together) was r 5.86, the many-facet Rasch equivalent of Cronbach s a was r 5.93, and the mean standard error of the ESI measures was 0.17 logit, supporting high reliability of the ESI measures (Fisher & Griswold, 2010). Procedures and Data Analysis In the first phase of our data analysis, we performed a oneway analysis of variance (ANOVA) to confirm that no significant age effect existed among people without an identified diagnosis or disability. Because we found no age effect among the control group, we then implemented another one-way ANOVA to evaluate for significant differences in quality of social interaction between the control group and the groups with neurologic or psychiatric disorders. We did not consider gender because prior analyses have revealed no significant difference between genders in quality of social interaction (Fisher & Griswold, 2010). The level of significance for all analyses was set at p.05, and all analyses were performed using PASW Statistics, Version 17.0 (formerly SPSS; IBM Corporation, Armonk, NY). Results The demographic characteristics of the sample are shown in Tables 1 and 2. Most of the participants were people without identified diagnoses, and among the control group, most were female. The gender distribution within the groups with neurologic or psychiatric disorders was more equal. Most people with neurologic disorders had had a stroke or acquired brain injury, and most people with psychiatric disorders had thought (e.g., schizophrenia) or affective disorders. The mean age and ESI quality of social interaction measures for each group are shown in Table 3. The group with psychiatric disorders was younger on average than the other two groups. As expected, the results of the first ANOVA revealed no significant age effect among the control group (F[4, Table 2. Number of Participants by Neurologic or Psychiatric Diagnosis Group and Diagnosis n Neurologic Acquired brain injury 15 Left hemisphere stroke 18 Right hemisphere stroke 13 Stroke, other 14 Other neurologic disorder 17 Psychiatric Thought disorder 42 Affective disorder 30 Personality disorder 4 Asperger syndrome/autism 19 Other psychiatric disorder 9 299] 5 0.83, p 5.51); a Levene s test of homogeneity of variance among age groups for this sample revealed no violations of the assumption of equality. We therefore proceeded to evaluate for significant differences in quality of social interaction between the control group and the group with psychiatric or neurologic disorders. The results of the second ANOVA revealed a significant group effect (F[2, 482] 5 193.58, p <.001). Because the Levene s test for homogeneity of variance among diagnostic groups was significant (F[2, 482] 5 29.11, p <.001) and our group sizes were unequal, we elected to use a nonparametric Kruskal Wallis test followed by post hoc Mann Whitney U tests because they are more robust when both group sizes and variances differ among groups (Stevens, 1999). The results of the Kruskal Wallis test were also significant (x 2 [2] 5 202.6, p <.001), and the post hoc Mann Whitney U tests revealed that the group without identified diagnoses had significantly higher quality of social interaction (U 5 3,172, p <.001) than did the group with psychiatric or neurologic disorders (U 5 3,189, p <.001; see Table 3). Figure 1 graphically compares the quality of social interaction among people without identified diagnoses and people with psychiatric or neurologic disorders. Although the three groups showed some overlap, almost Table 1. Age and Gender of the Participants by Diagnostic Group Control Neurologic Psychiatric Age (yr) Male; n 5 90 Female; n 5 214 Male; n 5 40 Female; n 5 37 Male; n 5 60 Female; n 5 44 16 30 20 49 5 5 27 16 31 40 30 52 8 4 15 11 41 50 13 49 9 16 15 10 51 60 20 35 13 12 2 6 61 70 7 29 5 0 1 1 The American Journal of Occupational Therapy 359

Table 3. Mean Age and ESI Quality of Social Interaction Measure and Percentage of Participants in Each Group Who Demonstrated Competent Quality of Social Interaction During Both Observed Social Exchanges Control Neurologic Psychiatric Variable M SD M SD M SD Age; yr 41.9 13.6 44.9 11.9 35.5 11.1 ESI measure; logits 1.2 0.3 0.6 0.4 0.5 0.5 Competent; n (%) 215 (70.7) 18 (23.4) 14 (13.5) Note. When the ESI is administered, the occupational therapist rates the person s overall quality of social interaction using a five-category scale: competent, questionable, minimally inappropriate, moderately inappropriate, or markedly inappropriate. This global rating is not to be confused with the individual ratings given for each of the ESI items scored for each observed social interaction (Fisher & Griswold, 2010). ESI 5 Evaluation of Social Interaction; M 5 mean; SD 5 standard deviation. 75% of the control group had ESI measures above the ESI s 1.0-logit competence cutoff (Fisher & Griswold, 2010). In contrast, >75% of the people with neurologic or psychiatric disorders had ESI measures below this 1.0- logit cutoff, indicating they most likely had observed quality of social interaction that was at least mildly inappropriate or ineffective. More specifically, when we examined the occupational therapists ratings of the participants quality of social interaction during each observed social exchange, we found that among the control group (i.e., the group with no identified diagnoses), 215 of 304 (70.7%) demonstrated competent quality of social interaction during both social exchanges observed, whereas only 18 of 77 (23.4%) people with neurologic disorders and 14 of 104 (13.5%) people with psychiatric disorders demonstrated competent quality of social interaction during both observed social exchanges (see Table 3). Finally, Figure 1 also shows that the sample with psychiatric disorders varied more in quality of social interaction than did the sample with neurologic disorders. An advantage of using the ESI is that it is a standardized tool, and using standardized tools better enables both clinicians and researchers to interpret and explain evaluation results to others. As noted by Doble and Magill-Evans (1992), because of the lack of standardized evaluation tools designed to evaluate a person s quality of social interaction, occupational therapists have mostly used informal clinical observations. With the ESI, the occupational therapist is able to implement a standardized evaluation that yields valid and reliable measures that can be interpreted from both criterion-based and normbased perspectives. This study highlights the use of criterion-referenced interpretations of a person s ESI results. That is, the person s ESI measure, generated by the occupational therapist using his or her individual copy of the ESI software, can be compared with an overall criterion of competence social interaction that was mature, polite, and respectful. On the basis of this study s results, healthy adults without identified diagnoses most often demonstrate competent quality of social interaction, but they sometimes also demonstrate questionable or mild problems with quality of social interaction. This finding can be compared with that of people with neurologic or psychiatric disorders, who most often demonstrate mildly to markedly diminished quality of social interaction. As has been noted in earlier research, some people with neurologic or psychiatric disorders do demonstrate competent quality of social interaction (Bornhofen & McDonald, 2008; Burleigh, Farber, & Gillard, 1998; Fisher & Griswold, 2010; McDonald & Discussion Our finding that people with neurologic or psychiatric disorders have lower quality of social interaction than do people without identified diagnoses is congruent with the theoretical view that people with neurologic or psychiatric disorders often have problems with social interaction that have an impact on their daily lives (Yilmaz et al., 2008). This finding, therefore, supports the validity of the ESI quality of social interaction measure in terms of its ability to detect significant differences between groups. That is, our results support the sensitivity of the ESI measure with regard to detecting differences in quality of social interaction among groups known to differ. Figure 1. Boxplots showing the median (dark horizontal bar) and range of ESI measures for each group. The shaded boxes represent 50% of the sample within each group; the upper end of the box delineates the 75th percentile, and the lower end delineates the 25th percentile. The 1.0-logit cutoff for competent quality of social interaction is delineated by the horizontal dashed line. 360 May/June 2012, Volume 66, Number 3

Flanagan, 2004; McDonald et al., 2008; Robertson & Knight, 2008). Consistent with an occupational therapy perspective on assessment, the ESI is designed to assess a person s quality of social interaction as he/she engages in real interactions, with client-specific intended purposes, and with social partners [with] whom the person would typically need or want to interact (Fisher & Griswold, 2010, p. 1-3). An important feature of the ESI is that it is used to evaluate the quality of a person s social interaction in the natural context of everyday doing. Other professionals most often evaluate with different kinds of assessments, especially self- and proxy reports and role play. Direct observations of naturalistic performance are rarely used because they are viewed as being more time consuming. In contrast, Coster (2008) advocated that occupational therapists need to use valid and reliable criterion-referenced assessments administered in the natural context of everyday life. The ESI meets this need. The findings of this study that people with neurologic or psychiatric disorders often demonstrate challenges with social interaction support the role of occupational therapy in addressing problems with social interaction that affect the person s full participation in needed or desired occupation. For many such people, diminished social skills mean that they withdraw from social interactions and, in the long term, become increasingly isolated and no longer interact with others (Dahlberg et al., 2007). Implications for Occupational Therapy Practice The results of this study have the following implications for occupational therapy practice: The ESI measures are valid for identifying people with psychiatric or neurologic disorders who have observable problems with social interaction as they engage in natural, everyday social interactions with typical social partners. The identification of diminished quality of social interaction during occupational performance among people with psychiatric or neurologic disorders supports the need for occupational therapists to evaluate for problems of social interaction that affect such persons full participation in needed and desired occupations. Limitations The groups were not matched for age because we found no relation between ESI quality of social interaction and age in the sample without identified diagnoses or disabilities. Thus, we judged the risk of an age effect to be minimal. Similarly, gender distribution within groups varied across our three groups, but again, this variance was likely not a risk because of the evidence supporting lack of gender differences or bias in ESI measures. Another potential limitation to consider is the lack of available knowledge of the overall level of functioning of this study s participants and our subsequent inability to match them on any external variable related to level of functioning. Thus, the possibility exists that one of the two groups with neurologic or psychiatric disorders was more disabled than the other. We do believe, however, that our results confirm that both groups have lower quality of social interaction than do adults without identified diagnoses, which was the focus of this study. Future Research Future research might include replication of this study with the inclusion of a concurrent measure of each person s overall level of functioning. Additional studies that focus on other groups of people who often display diminished quality of social interaction are also needed. Finally, another future line of research might be to examine the relation between ESI quality of performance measures and social isolation. For example, identifying a risk zone for isolation along the continuum of quality of social interaction, where social isolation is likely to become an issue of concern, may be possible. Conclusion People without identified diagnoses and people with neurologic and psychiatric disorders differ in their quality of social interactions, and people with psychiatric disorders appear to have greater variability in their quality of social interaction than do people with neurologic disorders. These results support the sensitivity of the ESI quality of social interaction measures with regard to detecting differences in quality of social interaction among groups known to differ. s Acknowledgments We thank Lou Ann Griswold for her comments on an earlier version of this article. We also express appreciation to the Danish occupational therapists who have used the ESI in practice and who submitted data to the ESI database. References Bornhofen, C., & McDonald, S. (2008). Emotion perception deficits following traumatic brain injury: A review of the evidence and rationale for intervention. Journal of the The American Journal of Occupational Therapy 361

International Neuropsychological Society, 14, 511 525. http://dx.doi.org/10.1017/s1355617708080703 Burleigh, S. A., Farber, R. S., & Gillard, M. (1998). Community integration and life satisfaction after traumatic brain injury: Long-term findings. American Journal of Occupational Therapy, 52, 45 52. doi: 10.5014/ajot.52.1.45 Coster, W. J. (2008). Embracing ambiguity: Facing the challenge of measurement (Eleanor Clarke Slagle Lecture). American Journal of Occupational Therapy, 62, 743 752. http://dx.doi.org/10.5014/ajot.62.6.743 Dahlberg, C. A., Cusick, C. P., Hawley, L. A., Newman, J. K., Morey, C. E., Harrison-Felix, C. L., et al. (2007). Treatment efficacy of social communication skills training after traumatic brain injury: A randomized treatment and deferred treatment controlled trial. Archives of Physical Medicine and Rehabilitation, 88, 1561 1573. http://dx.doi. org/10.1016/j.apmr.2007.07.033 Doble, S. E., Bonnell, J. E., & Magill-Evans, J. (1991). Evaluation of social skills: A survey of current practice. Canadian Journal of Occupational Therapy, 58, 241 249. Doble, S. E., & Magill-Evans, J. (1992). A model of social interaction to guide occupational therapy practice. Canadian Journal of Occupational Therapy, 59, 141 150. Englund, B., (1997). BSI: Bedömning av social interaction [BSI: Assessment of Social Interaction]. Unpublished test manual. Englund, B., Bernspång, B., & Fisher, A. (1995). Development of an instrument for assessment of social interaction skills in occupational therapy. Scandinavian Journal of Occupational Therapy, 2, 17 23. http://dx.doi.org/10. 3109/11038129509106794 Fisher, A. G. (2009). Occupational Therapy Intervention Process Model: A model for planning and implementing top down, client-centered, and occupation-based interventions. Ft. Collins, CO: Three Star Press. Fisher, A. G., & Griswold, L. A. (2010). Evaluation of Social Interaction (2nd ed.). Ft. Collins, CO: Three Star Press. Forsyth, K. (1996). Validity of the Assessment of Communication and Interaction Skills. Unpublished master s thesis, Department of Occupational Therapy, University of Illinois at Chicago. Forsyth, K., Lai, J., & Kielhofner, G. (1999). The Assessment of Communication and Interaction Skills (ACIS): Measurement properties. British Journal of Occupational Therapy, 62, 69 74. Forsyth, K., Salamy, M., Simon, S., & Kielhofner, G. (1998). A user s guide to the Assessment of Communication and Interaction Skills (ACIS) (Version 4). Chicago: Model of Human Occupation Clearinghouse. Halford, W. K., & Hayes, R. L. (1995). Social skills in schizophrenia: Assessing the relationship between social skills, psychopathology and community functioning. Social Psychiatry and Psychiatric Epidemiology, 30, 14 19. http://dx. doi.org/10.1007/bf00784429 Harvey, P. D., Velligan, D. I., & Bellack, A. S. (2007). Performance-based measures of functional skills: Usefulness in clinical treatment studies. Schizophrenia Bulletin, 33, 1138 1148. http://dx.doi.org/10.1093/schbul/sbm040 Linacre, J. M. (1993). Many-facet Rasch measurement (2nd ed.). Chicago: MESA Press. McDonald, S., & Flanagan, S. (2004). Social perception deficits after traumatic brain injury: Interaction between emotion recognition, mentalizing ability, and social communication. Neuropsychology, 18, 572 579. http://dx.doi. org/10.1037/0894-4105.18.3.572 McDonald, S., Tate, R., Togher, L., Bornhofen, C., Long, E., Gertler, P., et al. (2008). Social skills treatment for people with severe, chronic acquired brain injuries: A multicenter trial. Archives of Physical Medicine and Rehabilitation, 89, 1648 1659. http://dx.doi.org/10.1016/j.apmr.2008.02.029 Patterson, T. L., Moscona, S., McKibbin, C. L., Davidson, K., & Jeste, D. V. (2001). Social skills performance assessment among older patients with schizophrenia. Schizophrenia Research, 48, 351 360. http://dx.doi.org/101016/s0920-9964(00)00109-2 Robertson, R. H., & Knight, R. G. (2008). Evaluation of social problem solving after traumatic brain injury. Neuropsychological Rehabilitation, 18, 236 250. http://dx.doi.org/ 10.1080/09602010701734438 Segrin, C., & Giverts, M. (2003). Methods of social skills training anddevelopment.inj.o.greene & B. R. Burleson (Eds.), Handbook of communication and social interaction skills (pp. 135 149). Mahwah, NJ: Erlbaum. Sheridan, S. M., & Walker, D. (1999). Social skills in context: Considerations for assessment, intervention, and generalization. In C. R. Reynolds & T. B. Gutkin (Eds.), The handbook of school psychology (3rd ed., pp. 686 708). New York: Wiley. Simmons, C. D., Griswold, L. A., & Berg, B. (2010). Evaluation of social interaction during occupational engagement. American Journal of Occupational Therapy, 64, 10 17. http://dx.doi.org/10.5014/ajot.64.1.10 Sitzer, D. I., Twamley, E. W., Patterson, T. L., & Jeste, D. V. (2008). Multivariate predictors of social skills performance in middle-aged and older out-patients with schizophrenia spectrum disorders. Psychological Medicine, 38, 755 763. http://dx.doi.org/10.1017/s0033291707001304 Smith, T. E., Bellack, A. S., & Liberman, R. P. (1996). Social skills training for schizophrenia: Review and future directions. Clinical Psychology Review, 16, 599 617. doi: 10. 1016/S0272-7358(96)00025-6 Stevens, J. P. (1999). Intermediate statistics: A modern approach (2nd ed.). Oxford, England: Routledge. Yilmaz, M., Josephsson, S., Danermark, B., & Ivarsson, A. (2008). Participation by doing: Social interaction in everyday activities among persons with schizophrenia. Scandinavian Journal of Occupational Therapy, 15, 162 172. http://dx.doi.org/10.1080/11038120802022102 362 May/June 2012, Volume 66, Number 3