Comparison of Clinical and Patient-Based Measures to Assess Medium-Term Outcomes Following Shoulder Surgery for Disorders of the Rotator Cuff

Similar documents
The use of a patient-based questionnaire (the Oxford Shoulder Score) to assess outcome after rotator cuff repair

Outcome analysis of surgery for disorders of the rotator cuff

The range of the Oxford Shoulder Score in the asymptomatic population: a marker for postoperative improvement

The development and validation of a patientreported questionnaire to assess outcomes of elbow surgery

Preliminary Report Choosing Wisely Identifying Musculoskeletal Interventions with Limited Levels of Efficacy in the Shoulder & Elbow.

Corticosteroid injection for shoulder pain: single-blind randomized pilot trial in primary care. Holt et al.

ROTATOR CUFF INJURIES / IMPINGEMENT SYNDROME

Evaluation of Rotator Cuff Repair Using Korean Shoulder Scoring System

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /bjsports

An examination of bias in shoulder scoring instruments among healthy collegiate and recreational athletes

Intraarticular corticosteroid injection in adhesive capsulitis: are two doses better than a single dose? a randomized prospective study

REPRODUCIBILITY AND RESPONSIVENESS OF EVALUATIVE OUTCOME MEASURES

internal consistency SDQ-UK w1 patients no no?? yes score GP-patients > score community ; ceiling 54; 67

The Patient-Rated Elbow Evaluation (PREE) User Manual. June 2010

THE BATH ANKYLOSING SPONDYLITIS PATIENT GLOBAL SCORE (BAS-G)

Rotator cuff disease accounts

A Patient s Guide to Rotator Cuff Tendinitis or Shoulder Impingement

The Oxford shoulder score revisited

Patients perception of outcome in arthroscopic subacromial decompression using proms scores

Considerations 3/9/2018. Asheesh Bedi, MD. I have no disclosures or conflicts of interest related to the content of this presentation.

Rotator Cuff Repair Outcomes. Patrick Birmingham, MD

Prognostic blood biomarkers in shoulder surgery. Dr Simon Jenkin Sport & Exercise Medicine Registrar Sport Exercise Movement, Perth WA

Thousand Oaks High School AP Research STEM

Clinical Scenario. Focused Clinical Question. Summary of Search, Best Evidence Appraised, and Key Findings

ASSESSMENT OF THE RELIABILITY AND VALIDITY OF THE ARTHRITIS IMPACT MEASUREMENT SCALES FOR CHILDREN WITH JUVENILE ARTHRITIS

Impingement syndrome. Clinical features. Management. Rotator cuff tear diagnosed. Go to rotator cuff tear

Arthroscopic Decompression in Stage II Subacromial Impingement Five to Twelve Years Follow up

ROTATOR CUFF DISORDERS/IMPINGEMENT

Prospective Evaluation of Quality of Life After Conventional Abdominal Aortic Aneurysm Surgery

Improving Thoracic Mobility

Disorders of the Rotator Cuff and Acromio-clavicular Joint

Hip Arthroscopy in Patients with Mild to Moderate Dysplasia: When do they Fail?

Rotator Cuff Tears: Surgical Treatment Options

It is estimated that between

The impact of the Belgian workers compensation system on return to work after rotator cuff surgery

Development of a self-reported Chronic Respiratory Questionnaire (CRQ-SR)

Copyright General Practice Airways Group Reproduction Prohibited

Inserting a biodegradable subacromial spacer for rotator cuff tears

Reliability, validity, and responsiveness of the Japanese version of the patient-rated elbow evaluation

Effectiveness Of Manual Physical Therapy For Painful Shoulder Conditions A Systematic Review

How repaired rotator cuff function influences Constant scoring

St. George s Shoulder Unit Patient Information

Shoulder Surgery. Gregory M. Behm, MD Ravalli Orthopedics & Sports Medicine

The EuroQol and Medical Outcome Survey 36-item shortform

Anatomy Your shoulder is made up of three bones: your upper arm bone (humerus), your shoulder blade (scapula), and your collarbone (clavicle).

REVIEW. Methods of assessing health-related quality of life and outcome for plastic surgery

Protocol for the United Kingdom Rotator Cuff Study (UKUFF)

Augmented Glenoid Component for Bone Deficiency in Shoulder Arthroplasty

The Results of Rotator Cuff Disease Treated by Arthroscopic Subacromial Decompression


Cover Page. The handle holds various files of this Leiden University dissertation

Latest technology in the treatment of chronic recalcitrant tendinopathy

Ultrasound-guided suprascapular nerve block for orthopaedic patients with. persistent shoulder pain and stiffness. StR Trauma and Orthopaedics

Intraarticular platelet-rich plasma injection in the treatment of knee osteoarthritis: review and recommendations.

Acromioplasty, Mumford, Biceps What s the Indication with Rotator Cuff Tears?

Northumbria Healthcare NHS Foundation Trust. Shoulder Subacromial Pain. Issued by Physiotherapy Department

Acupuncture and electro-acupuncture for people diagnosed with subacromial pain syndrome: a multicentre randomized trial

Can PROMs be used to make decisions about individual patients?

Frozen Shoulders FAQs. Dr Kelvin TAM

ABSTRACT. Shoulder & Elbow. ISSN

The Efficacy of the Back School

Welcome to White Rock Orthopaedic Surgery Centre

Subacromial Decompression

Survey Results. Survey Results. What we will cover today? An evidence-based approach to rotator cuff disease

A comparison of global questions versus health status questionnaires as measures of the severity and impact of asthma

ADHESIVE CAPSULITIS (FROZEN SHOULDER)

PATIENT EDUCATION. Why Let Shoulder Pain Hold You Back? Embrace life with a ROTATOR CUFF REPAIR

Two Rotator Cuff Disease Specific Outcome Measures, The RC-QOL And the WORC Exhibit Similar Construct Validity And Responsiveness

Shoulder Injuries: Treatments that Work, Do Not Work, and When ENOUGH is Enough? Mark Ganjianpour, M.D. Beverly Hills, CA April 20, 2012

Psychometric Evaluation of Self-Report Questionnaires - the development of a checklist

Responsiveness of the Numeric Pain Rating Scale in Patients With Shoulder Pain and the Effect of Surgical Status

Setting The setting was outpatient clinics. The economic analysis was conducted in Boston, USA.

Extracorporeal shock wave treatment for chronic calcific rotator cuff tendonitis.

continued TABLE E-1 Outlines of the HRQOL Scoring Systems

NATIONAL INSTITUTE FOR HEALTH AND CARE EXCELLENCE

ARTHROSCOPIC DEBRIDEMENT VERSUS OPEN REPAIR FOR ROTATOR CUFF TEARS. From the University of Toronto and the Toronto Hospital, Canada

RATING OF A RESEARCH PAPER. By: Neti Juniarti, S.Kp., M.Kes., MNurs

Subacromial Impingement of Shoulder Orthopaedic Department Patient Information Leaflet

Acute Tears of the Rotator Cuff

Linköping University Post Print. Attitudes toward management of patients with subacromial pain in Swedish primary care

Orthopaedic Shoulder (and Anatomical Arm) Referral Guidelines

ProDisc-C versus fusion with Cervios chronos prosthesis in cervical degenerative disc disease: Is there a difference at 12 months?

Demographic Trends and Complication Rates in Arthroscopic Elbow Surgery

GLOSSARY OF GENERAL TERMS

Psychometric properties of the Chinese quality of life instrument (HK version) in Chinese and Western medicine primary care settings

Quality of life defined

Platelet-Rich Plasma Compared With Other Common Injection Therapies in the Treatment of Chronic Lateral Epicondylitis

Draft Policy Template: Subacromial decompression in the treatment of subacromial shoulder pain. Version Date Notes

S houlder problems are common, with up to 47% of adults

Importance of sensitivity to change as a criterion

S ystematic reviews of randomised controlled trials evaluating

Consumption of medical resources and outcome of shoulder disorders in primary health care consulters

NHS Fylde and Wyre Clinical Commissioning Group. Policies for the Commissioning of Healthcare. Policy for surgical treatment of carpal tunnel syndrome

Health-Related Quality of Life in Adolescents with Wheezing Attacks

Goals and Objectives for the Orthopaedic Surgery Resident McGill Orthopaedic Sports Medicine and Minimally Invasive (MGH & Shriners) Junior Residents

11/13/2017. Disclosures: The Irreparable Rotator Cuff. I am a consultant for Arhtrex, Inc and Endo Pharmaceuticals.

Retrospective Analysis of Arthroscopic Management of Glenohumeral Degenerative Disease

The St. Leger total knee replacement: a false economy Westwood M J, White S P, Bannister G C

Comparison of functional training and strength training in improving knee extension lag after first four weeks of total knee replacement.

Transcription:

Arthritis & Rheumatism (Arthritis Care & Research) Vol. 47, No. 5, October 15, 2002, pp 513 519 DOI 10.1002/art.10659 2002, American College of Rheumatology ORIGINAL ARTICLE Comparison of Clinical and Patient-Based Measures to Assess Medium-Term Outcomes Following Shoulder Surgery for Disorders of the Rotator Cuff JILL DAWSON, 1 GRAHAM HILL, 2 RAY FITZPATRICK, 3 AND ANDREW CARR 2 Objective. To compare different assessments following shoulder surgery for impingement syndrome with or without rotator cuff tear or repair. Methods. A prospective study of 93 patients was conducted. Standard assessments were performed before, at, and at following shoulder surgery using the patient-based Oxford Shoulder Score (OSS), the Medical Outcomes Study Short Form-36 (SF-36) questionnaire, and a surgeon-assessed Constant Shoulder Score. Patients were categorized according to the surgery received in relation to the presence of cuff tears: full repair, partial repair, cuff tear/no repair, no tear/no repair. Results. Most patients (57%) received subacromial decompression for impingement with no cuff tear. This group had the fewest pre- and postoperative symptoms. The category of patients who received only partial repair of a cuff tear had worse scores on all outcome assessments compared with other groups. Patient-based measures were more stable over time than the Constant. Conclusion. The shoulder-specific measures had greater sensitivity than the SF-36 in registering significant differences in outcomes between comparison groups at and. KEY WORDS. Shoulder; Outcomes; Rotator cuff tear; Shoulder score. INTRODUCTION Although shoulder disorders may produce little discomfort in a minority of individuals, they almost always impair activities of daily living and frequently are associated with substantial pain and disability (1). Most shoulder pain is caused by disorders of periarticular soft tissue, in particular disorders affecting the rotator cuff, such as impingement syndrome and rotator cuff tears (2). In general, considerable uncertainty exists regarding the management Supported by grants from Oxford Regional Health Authority (Audit) and The Medical Research Fund Committee, Faculty of Clinical Medicine, Oxford University. 1 Jill Dawson, DPhil: Oxford Brookes University, Oxford, UK; 2 Graham Hill, FRCS (Orth), Andrew Carr, FRCS: Nuffield Orthopaedic Centre, Oxford, UK; 3 Ray Fitzpatrick, PhD: University of Oxford, Oxford, UK. Address correspondence to Jill Dawson, DPhil (Senior Research Fellow), OCHRAD, School of Health Care, Oxford Brookes University, 44, London Road, Oxford OX3 7PD, UK. E-mail: jdawson@brookes.ac.uk. Submitted for publication April 5, 2001; accepted in revised form January 19, 2002. and effectiveness of medical and surgical interventions for these conditions (3). With regard to surgery, outcomes following intervention are best assessed in the long term. There is little evidence on long-term results of shoulder treatment, and the quality of much of the published research has been questioned (3). One major weakness common to most studies of outcomes following shoulder surgery has been the lack of appropriate independent methods of assessing outcome. Patients can provide reliable and valid judgments of health status and of the benefits of treatment (4), and in the context of surgery, provide evidence that is independent of clinical opinion (5 8). Such judgments incorporate measures of disability that accompany the underlying condition and that often are neglected by clinical measures while being of utmost importance to patients. In addition, in a number of outcomes studies in both medical and surgical contexts, patient-based measures of health-related quality of life have been shown to increase the feasibility of conducting large-scale trials and studies with long-term outcomes of interest (9 11). There are 2 main types of patient-based measures: generic instruments intended to be applicable to a wide 513

514 Dawson et al range of health problems, and condition-specific instruments designed to address patients perceptions in relation to a single condition. Such condition-specific instruments are intended to be maximally sensitive to the outcomes of concern of more narrowly defined patient groups. The latter also tend to be shorter and more sensitive to the specific changes in health produced by a particular intervention (12). Sensitivity to change (also referred to as responsiveness) is considered to be one of the most important measurement properties of a health outcome measure (13). The purpose of this study was to compare different forms of assessment: a standard clinical assessment and 2 validated patient-based measures one specific and one generic with regard to their performance and usefulness in assessing longer-term outcomes following shoulder surgery for impingement syndrome with or without rotator cuff tear or repair. In particular, the aims were to examine the sensitivity to change of 3 different forms of assessment with reference to each other and among subgroups defined on the basis of 4 broad types of surgery received in relation to the presence of cuff tears: full repair, partial repair, cuff tear/no repair, no tear/no repair. It was hypothesized a priori that the group of patients who had no evidence of a cuff tear would have better postsurgical outcomes than any of the other groups, at least in the short term, if only because their surgery was generally less invasive. PATIENTS AND METHODS A prospective study included consecutive patients who underwent surgery for shoulder pain with a provisional preoperative diagnosis of subacromial impingement, partial- or full-thickness rotator cuff tear, or any combination of these. All patients had received previous treatment consisting of intraarticular steroid injections, physiotherapy, or both. In many cases, the treatment had been initiated by the patients general practitioner. Failure of the nonsurgical treatment to alleviate symptoms beyond a short period of time was an indication for surgery. Surgical details were obtained from operative notes by the surgeon using a standard questionnaire, at the time of the 6-month postoperative assessment. Surgical procedures can be summarized as including arthroscopic or open subacromial decompression with or without partial or complete repair of any tendon tears comprising the rotator cuff. Ninety-three patients were originally recruited in a preadmission assessment clinic at a specialist orthopedic hospital between mid-april 1994 and mid-august 1995. No patients refused to participate. Patients completed a variety of assessments at the preadmission clinic. These were repeated in an outpatient clinic at and once again at an average of following surgery. Assessments included the Constant Shoulder Score (14), which was assessed by one of 2 orthopedic surgeons blinded to the results of the previous assessment, and 2 patient-based measures: the Oxford Shoulder Score (OSS) (15) and the Medical Outcomes Study Short Form-36 (SF-36) general health survey (16). A proportion of patients who were unable (or refused) to attend any of the postoperative surgical assessments received their followup assessment by postal questionnaire only (identical to the one completed by those who came to the hospital). Preoperative and postoperative assessments. (Assessments are described in greater detail elsewhere [15]). The Constant Shoulder Score (14) contains subjective assessments of pain and activities of daily living that are allocated 15 and 20 points respectively (out of a total of 100). In addition, objective measurements of active range of motion and power are allocated 40 and 25 points, respectively. Low scores denote poor function and greater severity of symptoms. The OSS (15) is a condition-specific questionnaire that is completed by patients unaided. It was originally generated from interviews with patients and contains 12 items, each of which has 5 response categories. Scores from items are summed to produce a single score with a range from 12 (least difficulties) to 60 (most difficulties). It has been shown to be internally consistent, reliable (reproducible), valid, and sensitive to clinical change (responsive) at 6 months following surgery. Similar to the Constant Shoulder Score, the OSS is inappropriate in conditions of instability (17). The SF-36 (16) is a 36-item questionnaire that is widely used as a general health status instrument. It provides scores on 8 dimensions: physical functioning, social functioning, role limitations due to physical problems, role limitations due to emotional problems, general mental health, energy, bodily pain, and general health perceptions. In addition, health change is measured by a single item asking patients to compare their current health status with that of one year ago. Scores for each dimension range from 0 (poor health) to 100 (good health). With regard to all the above methods of assessment, on the infrequent occasion that a patient or surgeon missed a questionnaire item(s), the dimension comprising those items (e.g., physical function) was not computed. This explains some of the slight variation in the numbers reported in tables. In addition to the measures already described, administered at both followup stages, 1 questionnaire item asked patients to appraise the success of their shoulder surgery and offered 4 possible response categories ranging from very successful to very disappointing. Two items asked patients to judge the degree of change in their problems related to their shoulder and day-to-day life following surgery and offered 5 possible responses: much better, slightly better, no change, slightly worse, or much worse than before the operation. The 4-year followup questionnaire also added a question regarding the length of time during which the shoulder had been satisfactory since surgery. Group comparisons have been made using change scores (absolute score at time 1 minus absolute score at time 2). Although the distribution of absolute scores tends to be quite skewed, change scores are particularly useful, as they generally approximate a normal distribution. In addition, effect sizes were calculated for the Constant Shoul-

Clinical Versus Patient Outcome Measures After Shoulder Surgery 515 Table 1. Details of surgical procedures performed in relation to whether or not the rotator cuff was torn* Surgical procedure(s) der Score, OSS, and SF-36 dimensions to assess the extent of change in patients clinical condition between the preoperative stage and each of the postsurgical assessments. Effect size is a standardization procedure that allows the extent of change measured by different instruments to be compared directly (18). It is calculated as the difference between the sample s mean presurgical and postsurgical scores, divided by the standard deviation of presurgical scores. Effect sizes of 0.2, 0.5, and 0.8 are typically regarded as indicating small, medium, and large degrees of change, respectively. Chi-square and analysis of variance (ANOVA) were used to test for statistical significance ( 0.05). RESULTS Evidence of rotator cuff tear (n 36) Diagnosis No evidence of cuff tear (n 53) Arthroscopic subacromial 9 (25) 45 (85) decompression (SAD) Open SAD and complete 18 (50) cuff tear repair Open SAD and 6 (17) incomplete cuff tear repair Open SAD only 2 (11) 0 (0) Repair of cuff tear only 1 (3) Acromioplasty 0 (0) 1 (2) Other shoulder surgery (e.g., manipulation, distension) 3 (8) 10 (19) * Values are number (%). Patients could have more than 1 procedure performed. The 93 patients were grouped into diagnostic categories according to whether or not they had a rotator cuff tear based on preoperative ultrasound reports in conjunction with perioperative reports of any cuff tear repair procedures. By this method, 36 patients (39%) were diagnosed as having evidence of a complete or partial rotator cuff tear. In 53 patients (57%), there was evidence to support a diagnosis of no rotator cuff tear. Information was missing or inconclusive on 4 patients. The majority of patients had signs of impingement preoperatively. At the time of surgery, the median age of the 92-person sample was 58. (mean 57.8, range 22.3 83.7; SD 12.4) and comprised 61 men and 31 women (66% and 34%, respectively). Operative procedures in relation to rotator cuff tears were categorized as follows: complete repair of full- or partial-thickness cuff tear (n 19; 21%), partial repair of full- or partial-thickness tear (n 6; 7%), no repair attempted of full- or partial-thickness tear (n 12; 13%), no cuff tear/no repair (n 53; 59%). The second and most recent followup assessment was carried out during 1999 and occurred at a median of 3.9 years following the patients original shoulder surgery (range 2.2 5.6 years). By this stage, of the original 93 patients 1 patient had died, 6 were lost to followup, 4 refused to participate, 82 completed the patient-based questionnaire, and 61 attended for full clinical assessment. The proportion of patients who received a clinical examination as part of the 4-year assessment (n 61) was compared with those who were assessed by questionnaire alone (n 21) according to 4 diagnostic/operative groupings: whether patients had received a full repair of a cuff tear, a partial repair of a tear, no repair of an identified tear, or no repair/no tear present. No significant differences were found. Fewer of the clinically assessed individuals said that their shoulder had never been satisfactory since the operation (4/61, 7% versus 3/21, 14%) and a larger proportion of the clinically assessed rated the success of their shoulder treatment as either very successful or fairly successful (51/61, 84% versus 16/21, 76%). Nevertheless, none of these differences approached statistical significance. A comparison of preoperative and postoperative OSS scores also revealed no differences between these 2 groups. Table 1 provides details of the surgical procedures that were performed according to whether or not the patient s rotator cuff was torn, and Table 2 provides additional details regarding the size of cuff tears in relation to whether or not repair procedures were attempted (where details were available on this subgroup). Massive tears ( 5 cm and/or involving 3 tendons) were significantly less likely to be repaired (and certainly not fully) than smaller tears ( 2 14.3, 6 degrees of freedom [df]; P 0.05). Table 2. Relationship between size of rotator cuff tear and extent of repair* Extent of repair Size of tear Full (n 16) Partial (n 6) None (n 11) 3 cm (small), n 8 5 (63) 0 (0) 3 (38) 3 to 5 cm (medium), n 6 5 (83) 1 (17) 0 (0) 5 cm and/or 2 tendons (large), n 3 3 (100) 0 (0) 0 (0) 5 cm and/or 3 tendons (massive), n 16 3 (19) 5 (31) 8 (50) * Values are number (%).

516 Dawson et al Preoperative and postoperative health status scores. Presurgical, 6-month, and 4-year postsurgical health status scores and effect sizes were compared for patients categorized according to the 4 broad types of surgery received in relation to the presence/absence of cuff tears: full repair, partial repair, cuff tear/no repair, no tear/no repair. None of the preoperative scores revealed any significant differences between the 4 groups based on this form of categorization, although patients who received a partial cuff repair most usually associated with a massive cuff tear generally had poorer preoperative scores (worse pain/disability) than any of the other 3 groups. Constant assessment scores were consistently poorer at than at : the Constant mean score (SD) at / for full repair was 67.9 (19.1)/86.7 (17.0); for partial repair it was 56.0 (19.5)/62.2 (31.3); for no repair it was 72.7 (14.0)/83.7 (26.2); for no tear it was 78.8 (18.2)/ 88.6 (15.6). Patient-based scores appeared remarkably stable when comparing 6-month and 4-year postoperative scores on the same scoring systems and relevant domains: OSS mean score (SD) at / for full repair was 21.9 (9.4)/22.0 (8.2); for partial repair it was 35.5 (13.6)/35.4 (16.8); for no repair it was 24.4 (10.5)/21.2 (6.2); and for no tear it was 19.7 (9.4)/21.4 (8.3). The SF-36 mean physical activity score (SD) at / for full repair was 73.3 (23.9)/71.9 (27.8); for partial repair it was 61.3 (37.1)/47.0 (34.9); for no repair it was 50.0 (25.0)/47.7 (28.4); and for no tear it was 53.3 (17.2)/66.8 (27.0). The SF-36 mean pain score (SD) at / was for full repair 60.8 (31.5)/65.5 (22.5); for partial repair it was 46.3 (30.2)/42.2 (28.8); for no repair it was 54.4 (15.2)/60.0 (34.8); and for no tear it was 65.0 (26.7)/61.0 (25.4). The SF-36 mean social function score (SD) at / was for full repair 79.7 (27.0)/77.2 (24.1); for partial repair it was 63.0 (38.9)/44.4 (31.4); for no repair it was 83.8 (19.5)/65.6 (42.7); and for no tear it was 83.2 (24.1)/80.4 (27.3). The 6-month postoperative Constant and OSS scores, and SF-36 physical activity and social function domain scores were consistently and significantly worse for the group of patients who received a partial repair for a rotator cuff tear by comparison to all other groups (where F is the ratio of the between-groups versus within-groups variability in which the null hypothesis ratio should equal 1; ANOVA: Constant F 3.6, P 0.05; OSS F 4.0, P 0.05; SF-36 physical activity F 2.9, P 0.05; SF-36 social function F 2.8, P 0.05). This group s scores were also poor in absolute terms, and additional evidence for the relatively poor outcome that this group experienced was obtained with reference to the effect sizes where, for all scores and domains that showed significant differences between the 4 groups, the effect size was either moderate ( 0.5) or small ( 0.2) for the partial repair group by comparison with enormous effect sizes ( 1) for the other 3 groups. The only very large effect size (of 1.17) for this group occurred at in relation to the social function domain of the SF-36. However, in this instance, the effect size represented deterioration rather than improvement (the mean score having fallen from 79.6 at the preoperative state to 44.4 at postsurgery). At following surgery, only the Constant and OSS shoulder-specific measures revealed any differences between the 4 groups (mean scores and SDs given above). Once again, the patients who had received a partial repair of a rotator cuff tear had the poorest scores and effect sizes relative to the other groups and in absolute terms. Effect sizes at representing the magnitude of change from the preoperative score: Constant full repair 0.06, partial repair 0.14, no repair 1.02, no tear 1.22; OSS full repair 1.88, partial repair 0.14, no repair 1.02, no tear 1.55. Success rating and transition items. The majority of patients ( 80%) rated their operation as either very successful or fairly successful at both 6-month and 4-year followup assessments, and also responded that their shoulder problems and changes in day-to-day life were either much better or slightly better since having their shoulder surgery (Table 3). There were 7 patients for whom this information was unavailable at. We first examined the relationship between these responses and the perioperative assessment of the size of patients cuff tears (defined as in Table 2: none, small, medium, large, massive). There was no correspondence between the size of a tear and patient s appraisal of their outcome at or the success of the operation at 4 years. However, at, those who had had the largest cuff tears were less likely than others to say that their shoulder problem or day-to-day life was much better or slightly better since surgery (shoulder problems much/ slightly better: no cuff tear 33 [73%], small 5 [71%], medium 6 [100%], large 2 [67%], massive 5 [33%], 2 12.80, 4 df, P 0.012; day-to-day life much/slightly better: no cuff tear 37 [82%], small 5 [71%], medium 6 [100%]; large 1 [33%]; massive 7 [47%], 2 12.56, 4 df, P 0.014). Table 4 presents a breakdown of the responses to success and transition items obtained at and in relation to the 4 surgical groupings previously described. Overall, the poorest outcomes are represented by the small group of patients who underwent a partial repair of their cuff tear (plus subacromial decompression). More than one-half of these patients said that their shoulder problems and day-to-day life were the same or worse at 4 years following surgery. The other 3 groups exhibited variable amounts of change in their responses spanning 4 years. Those who had undergone subacromial decompression with no evidence of a cuff tear represented the only group where the small number who experienced deterioration following surgery had reduced at rather than increased. DISCUSSION The purpose of this study was to compare different forms of assessment: a standard clinical assessment and 2 validated patient-based measures (one specific and one generic) with regard to their performance and usefulness in assessing longer-term outcomes following shoulder surgery for impingement syndrome with or without rotator cuff tear or repair.

Clinical Versus Patient Outcome Measures After Shoulder Surgery 517 Table 3. Patients ratings of the success of treatment and change in relevant health status* Question and response How successful would you say your shoulder surgery has been? Very successful 38 (43) 38 (46) Fairly successful 38 (43) 29 (35) Not very successful 7 (8) 10 (12) Very disappointing 6 (7) 5 (6) How have the problems related to your shoulder changed since having the operation? Much better 53 (58) 24 (29) Slightly better 25 (28) 32 (39) No change 6 (7) 14 (17) Slightly worse 4 (4) 8 (10) Much worse 3 (3) 5 (6) How has the shoulder operation changed your day-to-day life? Much better 50 (55) 50 (61) Slightly better 22 (24) 12 (15) No change 14 (15) 13 (16) Slightly worse 3 (3) 4 (5) Much worse 2 (2) 3 (4) * Values are number (%). Results presented here are not intended to influence how surgeons might treat shoulder impingement conditions with or without rotator cuff tears. Such a study would require a much larger sample size with exacting measurement of the amount of rotator cuff damage carried out prospectively. If feasible, randomization of treatment allocation would, of course, enormously increase the confidence attached to any such study findings. It is hoped that those who carry out future larger-scale clinical trials of alternative forms of treatment might benefit from the evidence presented here in choosing the most appropriate outcome measures. One of the problems in assessing the effectiveness of treatment for shoulder conditions concerns the long-term nature of outcomes of importance. Aside from the additional cost to the health service of providing extra clinic appointments, patients are frequently unable or unwilling to return to the hospital for a followup assessment some years after treatment. In addition increasing numbers of patients move away or are likely to be lost to followup over time. Another problem in assessing the effectiveness of treatment has been the lack of appropriate independent methods of assessing outcome. Although a number of shoulder assessment questionnaires have been developed in recent years (19 22), it is rare for these instruments to be generated from interviews with patients in addition to their demonstrating necessary measurement properties comprising reliability, validity, and responsiveness to clinical change. In addition, the assessment of responsiveness, where demonstrated at all, has a tendency to be carried out in the short term following an intervention. All of the health status measures employed here have been evaluated in previous studies for use as outcome measures in the short term. This study addresses specific aspects of the usefulness, particularly in relation to responsiveness, of these measures over a longer period of time. The patient-based measures had a much higher response rate than the clinical measure, due to the ability of these measures to be completed by mail. This is an obvious advantage, and an important one; however, an even more important issue concerns the competence of the patientbased measures to judge outcomes satisfactorily by comparison with a clinical assessment. The clinical categorization system adopted here is far from perfect, but is nevertheless a useful device for the purpose of comparing the sensitivity of different measures. According to this schema, the majority of patients (57%) in the sample had subacromial impingement with no evidence of a rotator cuff tear. These patients received a combination of surgical techniques by arthroscopic means: subacromial decompression/acromioplasty, plus or minus distension or manipulation. All other patients (further subdivided into 3 groups) had evidence of a complete or partial rotator cuff tear, generally in addition to having signs of impingement, and only one-quarter of these patients received surgery by arthroscopic means. One-third of the patients with a cuff tear had no repair attempted. It had been anticipated that those without a cuff tear would have better postoperative outcomes. This group had the least severe symptoms at the preoperative stage according to all forms of assessment and did indeed have better absolute scores at the 6-month assessment and at the 4-year assessment. They did not necessarily experience the greatest degree of change in their symptoms, as evidenced by effect sizes. A more striking finding concerned the very small number of patients who had had a cuff tear only partially repaired. This group had markedly poorer

518 Dawson et al Table 4. Patients overall judgment of the success of their shoulder surgery and retrospective assessment of change in their condition* Tear fully repaired Tear partially repaired Tear not repaired No tear/no repair Statistical significance ( 2 ) Question and response (n 18) (n 17) (n 5) (n 6) (n 12) (n 12) (n 52) (n 46) comparison comparison How successful do you feel your shoulder operation has been? Very or fairly successful 17 (94) 16 (94) 2 (50) 3 (50) 11 (92) 7 (67) 44 (85) 39 (85) Not very successful or 1 (6) 1 (6) 2 (50) 3 (50) 1 (8) 4 (33) 8 (15) 7 (15) NS 2 7.8 P 0.05 very disappointing How have the problems related to your shoulder changed since you had your operation? Much better 12 (63) 12 (71) 0 (0) 1 (17) 8 (67) 8 (67) 31 (60) 34 (74) Slightly better 5 (26) 3 (18) 4 (80) 1 (17) 2 (17) 1 (8) 14 (27) 8 (17) NS 2 15.0 P 0.05 Same or worse 2 (11) 2 (12) 1 (20) 4 (67) 2 (17) 3 (25) 7 (14) 4 (9) How has your shoulder operation changed your day-to-day life so far? Much better 8 (42) 11 (65) 1 (20) 1 (17) 10 (83) 7 (58) 30 (58) 30 (65) Slightly better 8 (42) 2 (12) 1 (20) 1 (17) 0 (0) 1 (8) 12 (23) 8 (17) 2 13.2 P 0.05 NS Same or worse 3 (16) 4 (24) 3 (60) 4 (67) 2 (17) 4 (33) 10 (19) 8 (17) * Values are number (%). Missing data on success ratings and transition items at affected 2 groups based on tear size: the group who had a tear that was fully repaired (information missing on 1 patient) and those who had no tear/no repair (information missing on 6 further patients). Test of significance for 3 sets of responses ( how successful, shoulder problems, day-to-day life ) obtained at postsurgery in relation to patients surgical grouping. Test of significance for 3 sets of responses ( how successful, shoulder problems, day-to-day life ) obtained at postsurgery in relation to patients surgical grouping.

Clinical Versus Patient Outcome Measures After Shoulder Surgery 519 scores postoperatively by comparison with all other surgical groups. They also experienced the least amount of change in their symptoms. The effect sizes were particularly helpful in highlighting this finding. The size of the tear was a likely confounder here because the largest tears were most commonly only partially repaired or not repaired at all. At following surgery, only the Constant and OSS shoulder-specific measures exhibited sufficient sensitivity to reveal any differences between the 4 defined clinical groups. This finding was not surprising because the SF-36 is a generic measure and, as such, will measure change due to the occurrence of any changes in health ( noise ) affecting any parts of the body (9). Such interference might have been expected after a period of. Overall, the patient-based measures exhibited considerable stability between the 2 followup assessments. The Constant clinical assessment resulted in poorer average scores for all patient groups at the 4-year assessment than had been the case at postsurgery. More than 80% of patients rated their operation as at least fairly successful at both 6-month and 4-year followup assessments. The majority of patients also said that their shoulder problems were better than before surgery. A comparison of patients responses to these satisfaction and transition items according to their surgical categorization produced a similar picture to impressions obtained using the other forms of assessment but particularly the patient-based measures. That is, outcomes were fairly stable between and with improvement more likely than deterioration after ; furthermore, people undergoing partial repair of a cuff tear experienced the least likelihood of improvement in the short or medium term. This article underlines the importance of using condition-specific measures when patients are to be assessed beyond the short term. It also contributes additional evidence of construct validity of the OSS to previously published work (15). The OSS achieved a high response rate, in common with the SF-36 generic patient-based measure. In addition, it shared with the clinical assessment a high degree of responsiveness over time. ACKNOWLEDGMENTS We wish to thank Vicky Bloomfield and Kim Clipsham for their assistance with conducting this study together with all nursing staff in the preadmission and other outpatient clinics at the Nuffield Orthopaedic Centre. We also wish to thank individual patients for giving their valuable time. REFERENCES 1. Fuchs S, Chylarecki C, Langenbrinck A. Incidence and symptoms of clinically manifest rotator cuff lesions. Int J Sports Med 1999;20:201 5. 2. Uhthoff HK, Sarkar K. An algorithm for shoulder pain caused by soft-tissue disorders. Clin Orthop 1990;254:121 7 3. Green S, Buchbinder R, Glazier R, Forbes A. Interventions for shoulder pain. Cochrane Database Syst Rev 2000;2:CD00156. 4. Fitzpatrick R, Fletcher A, Gore S, Jones D, Spiegelhalter D, Cox D. Quality of life measures in health care. I. Applications and issues in assessment. BMJ 1992;305:1074 7. 5. MacDonald D. The shoulder and elbow. In: Pynsent P, Fairbank J, Carr A, editors. Outcome measures in orthopaedics. Oxford: Butterworth-Heinemann Ltd; 1993. 6. Van der Windt DA, van der Heijden GJ, Scholten RJ, Koes BW, Bouter LM. The efficacy of non-steroidal anti-inflammatory drugs (NSAIDS) for shoulder complaints: a systematic review. J Clin Epidemiol 1995;48:691 704. 7. Van der Heijden GJ, van der Windt DA, Kleijnen J, Koes BW, Bouter LM. Steroid injections for shoulder disorders: a systematic review of randomized clinical trials. Br J Gen Pract 1996;46:309 16. 8. Dawson J, Fitzpatrick R, Murray D, Carr A. Comparison of measures to assess outcomes in total hip replacement surgery. Qual Health Care 1996;5:81 8. 9. Dawson J, Fitzpatrick R, Murray D, Carr A. The problem of noise in monitoring patient-assessed outcomes: generic, disease-specific and site-specific instruments for total hip replacement. J Health Serv Res and Policy 1996;1:224 31. 10. Bombardier C, Ware J, Russell IJ, Larson M, Chalmers A, Read JL. Auranofin therapy and quality of life in patients with rheumatoid arthritis: results of a multicenter trial. Am J Med 1986;81:565 78. 11. Guyatt GH, Townsend M, Pugsley SO, Keller JL, Short HD, Taylor DW, et al. Bronchodilators in chronic air-flow limitation: effects on airway function, exercise capacity, and quality of life. Am Rev Respir Dis 1987;135:1069 74. 12. Patrick DL, Deyo RA. Generic and disease-specific measures in assessing health status and quality of life. Med Care 1989; 27:S217 232. 13. Guyatt GH, Feeny DH, Patrick DL. Measuring health-related quality of life. Ann Intern Med 1993;118:622 9. 14. Constant CR, Murley AH. A clinical method of functional assessment of the shoulder. Clin Orthop 1987;214:160 4. 15. Dawson J, Fitzpatrick R, Carr A. Questionnaire on the perceptions of patients about shoulder surgery. J Bone Joint Surg Br 1996;78:593 600. 16. Ware JEJ, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 1992;30:473 83. 17. Conboy VB, Morris RW, Kiss J, Carr AJ. An evaluation of the Constant-Murley shoulder assessment. J Bone Joint Surg Br 1996;78:229 32. 18. Kazis LE, Anderson JJ, Meenan RF. Effect sizes for interpreting changes in health status. Med Care 1989;27:S178 89. 19. Hudak PL, Amadio PC, Bombardier C, for the Upper Extremity Collaborative Group (UECG). Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. [published erratum appears in Am J Ind Med 1996 Sep;30(3):372]. Am J Ind Med 1996;29:602 8. 20. Winters JC, Sobel JS, Groenier KH, Arendzen JH, Meyboom DJ. A shoulder pain score: a comprehensive questionnaire for assessing pain in patients with shoulder complaints. Scand J Rehabil Med 1996;28:163 7. 21. Roach KE, Budiman ME, Songsiridej N, Lertratanakul Y. Development of a shoulder pain and disability index. Arthritis Care Res 1991;4:143 9. 22. Jacob MC, Kerns RD, Rosenberg R, Haythornthwaite J. Chronic pain: intrusion and accommodation. Behav Res Ther 1993;31:519 27.