TRAUMA SURGERY WAS ONE OF

Transcription

1 ORIGINAL ARTICLE Expert Consensus vs Empirical Estimation of Injury Severity Effect on Quality Measurement in Trauma Laurent G. Glance, MD; Turner M. Osler, MD; Dana B. Mukamel, PhD; Wayne Meredith, MD; Andrew W. Dick, PhD Objective: To determine the extent to which the Injury Severity Score () and Trauma Mortality Probability Model (), a new trauma injury score based on empirical injury severity estimates, agree on hospital quality. Design, Setting, and Patients: Retrospective cohort study based on patients in 68 hospitals. Four riskadjustment models based on either or were constructed, with or without physiologic information. Main Outcome Measures: Hospital quality was measured using the ratio of the observed-to-expected mortality rates. Pairwise comparisons of hospital quality based on augmented vs augmented were performed using the intraclass correlation coefficient and the statistic. Results: There was almost perfect agreement for the ratios of the observed to expected mortality rates based on the vs the when physiologic information was included in the model (intraclass correlation coefficient,.93). There was substantial agreement on which hospitals were identified as high-, intermediate-, and lowquality hospitals ( =.79). Excluding physiologic information decreased the level of agreement between the and the (intraclass correlation coefficient,.88 and =.58). Conclusions: The choice of expert-based or empirical Abbreviated Injury Score severity scores for individual injuries does not seem to have a significant effect on hospital quality measurement when physiologic information is included in the prediction model. This finding should help to convince all stakeholders that the quality of trauma care can be accurately measured and has face validity. Arch Surg. 29;144(4): Author Affiliations: Department of Anesthesiology, University of Rochester School of Medicine, Rochester, New York (Dr Glance); Department of Surgery, University of Vermont College of Medicine, Burlington (Dr Osler); Center Health Policy Research, Department of Medicine, Wake Forest University School of Medicine, Winston-Salem, North Carolina (Drs Mukamel and Meredith); and RAND Health, RAND Corporation, Pittsburgh, Pennsylvania (Dr Dick). TRAUMA SURGERY WAS ONE OF the first medical specialties to develop initiatives to improve the quality of care by systematically measuring outcomes and regionalizing care to dedicated specialized trauma centers. 1 More than 2 years ago, the American College of Surgeons Committee on Trauma coordinated the Major Trauma Outcome See Invited Critique at end of article Study 2 to establish national norms for trauma care to evaluate hospital care and to improve quality. Yet, most hospitals caring for trauma patients still do not have access to benchmarking information, despite the fact that most trauma centers participate in trauma registries. 3 To compare trauma center performance, risk adjustment is necessary to adjust for differences in patient case mix across hospitals. One of the central challenges in trauma research has been to develop a parsimonious model that can accurately predict mortality given the many ( 14) possible injuries. The Achilles heel of injury modeling is that the large number of possible injuries has made it impossible to specify each injury as a separate condition within a single model. This problem can be solved by mapping each injury to a scalar measure of injury severity and then combining these into 1 or more summary measures that can be used as predictors in a regression model. Accurately specifying injury severity is a critical component of any injury severity model. Injury scores are based on 1 of the following 2 coding schemes: the Abbreviated Injury Score (AIS) or the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes. The AIS assigns each injury a descriptive 6-digit numeric AIS code describing the body region and the type of and specific anatomic injury. Each injury is also assigned, by expert consensus, an AIS using an ordinal scale of injury severity ranging from 1 (minor) to 6 (currently untreatable). The Injury Severity Score (), which remains the gold standard for measuring overall injury severity, summa- (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.

2 rizes all patient injuries into a single anatomic severity score based on the AIS. The is then calculated by taking the sum of squares of the AIS of the 3 body regions with the highest AIS. The most important limitation of the is that the AIS for each of the 14 injuries is based on expert opinion rather than on actual outcomes of patients with these injuries. In a manner analogous to AIS codes, ICD-9-CM codes can be used to describe patient injury. For each ICD- 9-CM code, the proportion of survivors is used to estimate the survival risk ratio for each injury. Unlike AIS, survival risk ratios are calculated using actual data. The main criticism of survival risk ratios is that many patients sustain more than 1 injury. Therefore, survival risk ratios for individual ICD-9-CM codes are contaminated with information from other injuries. Overall injury severity is based on the product of a patient s survival risk ratios. Most trauma surgeons believe that the AIS lexicon more accurately describes patient injuries because the AIS lexicon was designed specifically for traumatic injuries, whereas ICD-9-CM codes were designed to be used for billing purposes. The Agency for Healthcare Research and Quality has recently funded our investigations, in collaboration with the American College of Surgeons Committee on Trauma, to assess the effect of nonpublic report cards on trauma outcomes by randomizing hospitals to receive or not to receive feedback on their risk-adjusted mortality rates for trauma patients. To that end, we have developed the Trauma Mortality Probability Model (). This model is based on AIS coding. However, unlike the and other AIS-based models, AIS in the is empirically estimated using regression modeling, as opposed to being based on expert consensus. It has previously been shown that the has superior discrimination and is better calibrated than the. 4 Before adopting a new injury model, it is important to consider whether a new model (ie, the ) leads to differences in hospital ranking. Virtually every study examining the effect of risk adjustment on quality measurement has shown that hospital quality ranking depends on the choice of the risk-adjustment model. 5 Because there is no gold standard that we can use to measure trauma center quality, it is impossible to know which of these 2 riskadjustment models (the vs the ) most accurately measures quality. A priori, because the exhibits better model fit than the, 4 we believe that hospital quality measures based on the should be a less biased measure of true quality. In this study, our goal is to determine the extent to which the and the agree on hospital quality. Although we expect that these 2 scoring systems will not agree on the quality ratings for many of the hospitals, the finding that hospital quality does not depend substantially on the choice of the injury model would provide strong support for the validity of hospital quality measurement in trauma. METHODS PATIENT POPULATION This analysis was conducted using data from the National Trauma Data Bank (NTDB). The American College of Surgeons created the NTDB to serve as the principal national repository for trauma center registry data. 6 Data elements in the NTDB include patient demographics, hospital demographics, AIS codes, mechanism of injury (based on ICD-9-CM codes), encrypted hospital identifiers, physiologic values, and outcomes. This analysis was based on patients admitted in 25. Only hospitals that had annual patient volumes of at least 25 in 25 and assigned valid AIS codes to at least 95% of trauma patients were included in this study. Hospitals missing the Glasgow Coma Scale (GCS) motor component on more than 2% of the patients were excluded. Patients younger than 1 year, with nontraumatic diagnoses or missing information on age or sex, or who were dead on arrival or who were transferred to another facility were excluded from the analysis. The final data set included patients in 68 hospitals. TRAUMA MORTALITY PREDICTION MODEL The development and validation of the have been described by Osler et al. 4 Because of the many possible injuries (147 possible individual AIS codes) and the fact that more than 5% of the injuries occurred fewer than 1 times in the entire NTDB (and 14% occurred 1 times), a simple prediction model in which each injury is specified as a binary predictor leads to imprecise coefficient estimates for many injuries. The current standard, the, collapses AIS-based injury severities for the 3 most severe injuries into a single scalar measure of injury severity. 7 The is based on individual AIS injury severities assigned by a panel of experts. In contrast, the is based on empirical estimates of injury severity derived using the NTDB. Empirical estimates of injury severity for each AIS code were initially estimated using probit regression in which each injury is coded as a binary predictor. Because some of the injuries are sparsely populated, a second regression model collapsed the 147 possible AIS codes into 49 regional severity codes (based on the 9 AIS body regions and the 6 expert-based possible AIS injury severities [not every body region had injuries in all 6 severity strata]). The AIS injury severities were then calculated by taking a weighted sum of the coefficients estimated using these 2 separate models. The final model, the, uses the 5 most severe injuries (coded using empirical estimates of injury severity) as predictors of mortality. AUGMENTED INJURY MODELS We constructed the following 4 probit regression models to predict inhospital mortality: (1) the augmented with age, sex, and mechanism of injury; (2) the augmented with age, sex, mechanism of injury, and the motor component of the GCS; (3) the augmented with age, sex, and mechanism of injury; and (4) the augmented with age, sex, mechanism of injury, and the motor component of the GCS. A priori, we limited the physiologic information in our model to the motor component of the GCS because the motor component contributes most of the information in the GCS 8 and is less sensitive to initial therapy than the verbal and eye components of the GCS. We have assumed that all patients can be assigned a GCS motor component; patients who are pharmacologically paralyzed are assumed to have been assessed before the administration of neuromuscular blockers. Blood pressure and respiratory rate were not included as predictor variables because it is impossible to distinguish a respiratory rate or blood pressure of zero from a missing value in the NTDB. The decision to exclude respiratory rate from the prediction model was also made to avoid excluding intubated patients from the risk-adjustment model. Multiple imputation was used to impute missing values of the motor component of the GCS using the STATA (StataCorp LP, College (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.

3 Table 1. Model Performance With the publication of the seminal Institute of Medicine report Crossing the Quality Chasm, 16 there is increasing recognition that medical care is neither always safe nor always effective. Bridging the quality chasm requires the development of robust outcome measures to guide quality improvement by identifying and then learning from high-quality hospitals. 17 Long before quality measurement became the mantra of health care reform, trauma surgeons championed the development of trauma outcome registries and conducted research on injury scoring. After more than 2 years of research, no injury scoring system has yet replaced the venerable. We have proposed a new injury scoring system, the, which replaces the consensus-based AIS used in the with empirical AIS. When injury alone is used to predict mortality, it has been shown that the significantly outperforms the. 4 However, the addition of demographic variables, mechanism of injury, and physiologic informa- Model C Statistic Hosmer- Lemeshow Statistic with age, sex, injury mechanism with age, sex, injury mechanism, GCS motor component with age, sex, injury mechanism with age, sex, injury mechanism, GCS motor component Abbreviations: GCS, Glasgow Coma Scale;, Injury Severity Score;, Trauma Mortality Probability Model. Station, Texas) implementation 9 of the MICE (Multivariate Imputation by Chained Equations) method of multiple imputation described by van Buuren et al. 1 Using Monte Carlo simulation, we have previously shown that multiple imputation can be used to impute missing data and results in hospital quality measures that are almost identical to those based on a data set without missing values. 11 The method of fractional polynomials was used to determine the optimal transformation for age. 12 Robust variance estimators 13 were used because the outcomes of patients treated at the same hospital may be correlated. Model discrimination was evaluated using the C statistic, and calibration was evaluated using the Hosmer-Lemeshow statistic. 14 IDENTIFICATION OF HOSPITAL QUALITY OUTLIERS The expected mortality rate for each hospital was calculated using each of the 4 models. Hospital quality was quantified using the ratio of the observed to expected mortality rates (O/E ratio). Hospitals whose O/E ratio was significantly less than 1 were classified as high-quality outliers, whereas hospitals whose O/E ratio was significantly greater than 1 were classified as lowquality outliers. The 95% confidence interval around the point estimate for the O/E ratio was constructed using the normal approximation of the binomial distribution. 15 STATISTICAL ANALYSIS We performed 2 different hospital-level analyses to examine the level of agreement between the risk-adjusted measures of hospital quality based on the augmented vs the augmented. We assessed the level of agreement for (1) O/E ratios using the intraclass correlation coefficient and (2) categorical measures of hospital quality using the statistic. All statistical analyses were performed using commercially available software (STATA SE/MP version 1., StataCorp LP). RESULTS DATABASE DESCRIPTION The analysis was based on patients in 68 hospitals. Sixty-five percent of the patients were male, and the median patient age was 37 years. Forty-three percent of the patients sustained blunt trauma, 29% were in motor vehicle crashes, 11% had low falls, and the remainder of trauma injuries were caused by gunshot wounds, pedestrian accidents (ie, automobile and vehicle crashes involving a pedestrian), or stab wounds. The cohort mortality rate was 4.22%. Approximately 5% of the patients were missing the motor component of the GCS score. The hospital rate of missing data for the motor component of the GCS varied between % and 2%. MODEL PERFORMANCE Each of the models exhibited excellent discrimination (Table 1). For the sake of comparison, we have also included the C statistic and the Hosmer-Lemeshow statistic for the injury models without any additional risk factors. The calibration curves are shown in Figure 1. DATA Figure 2 shows the level of agreement for the OE ratios based on the augmented vs the OE ratios based on the augmented. The intraclass correlation coefficient of.93 indicates almost perfect agreement between the and the when the GCS motor component was included in the model. Excluding the GCS motor component as a predictor reduced the intraclass correlation coefficient to.88. There was substantial agreement between the augmented andtheaugmentedonwhichhospitalswereidentified as high, intermediate, and low quality when the GCS motor component was included in the prediction models ( =.79) (Table 2). Omitting the GCS motor component in the prediction models caused the statistic to decrease to.58, indicating moderate agreement between the augmented and the augmented (Table 3). The caterpillar graph, which shows the OE ratios for each of the hospitals as a function of the vs the, also illustrates the high level of agreement between these 2 different scoring systems on hospital quality assessment (results for injury model augmented with age, sex, injury mechanism, and GCS motor component are shown). These results are shown in Figure 3. COMMENT (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.

4 A Observed Mortality Rate, % B 1 (augmented with age, sex, and injury mechanism) 1 (augmented with age, sex, and injury mechanism) 8 8 Observed Mortality Rate, % C 1 (augmented with age, sex, injury mechanism, and GCS motor component) 1 (augmented with age, sex, injury mechanism, and GCS motor component) 8 8 Observed Mortality Rate, % Predicted Mortality Rate, % Predicted Mortality Rate, % Figure 1. Calibration curves for the Trauma Mortality Probability Model () and the Injury Severity Score () as a function of additional risk predictors. A, Injury model without additional risk factors. B, Injury model with age, sex, and injury mechanism. C, Injury model with age, sex, injury mechanism, and Glasgow Coma Scale (GCS) motor component. The 95% confidence intervals are based on the binomial distribution. tion causes both models to exhibit similar levels of statistical performance. In the present study, we compared hospital quality based on the augmented vs the augmented and found that they exhibited almost perfect agreement on the quality of trauma centers when physiologic information is included in the model. This finding is especially surprising given that the and the are based on 2 different approaches to injury severity modeling. Our study has important implications for the measurement of trauma center quality. In the recent Institute of Medicine report Performance Measurement: Accelerating Improvement, Birkmeyer argues that, although hospital performance measures will never be perfect, 18(p192) health care leaders will need to make decisions about when imperfect measures are good enough to act upon. 18(p192) In her seminal article on risk adjustment, Iezonni 5 showed that different risk-adjustment models often led to different conclusions regarding hospital quality and that the main risk of risk adjustment is that different quality yardsticks will not always agree on hospital quality. How good does risk adjustment need to be before we can evaluate hospital qual- (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.

5 A 2. vs (augmented with age, sex, and injury mechanism) Table 2. Hospital Quality Outliers in the Injury Models Augmented With Age, Sex, Injury Mechanism, and Glasgow Coma Scale Motor Component O/E Ratio ICC =.88 Augmented Quality Augmented Quality High Intermediate Low High 4 1 Intermediate Low 11 Abbreviations:, Injury Severity Score;, Trauma Mortality Probability Model. Table 3. Hospital Quality Outliers in the Injury Models Augmented With Age, Sex, and Injury Mechanism B 2. vs (augmented with age, sex, injury mechanism, and GCS motor component) Augmented Quality Augmented Quality High Intermediate Low High 6 3 Intermediate Low O/E Ratio 1. ICC =.93 Abbreviations:, Injury Severity Score;, Trauma Mortality Probability Model O/E Ratio Figure 2. Hospital ratios of the observed to expected mortality rates (O/E ratio) based on the augmented Trauma Mortality Probability Model () vs the augmented Injury Severity Score (). A, Injury model with age, sex, and injury mechanism. B, Injury model with age, sex, injury mechanism, and Glasgow Coma Scale (GCS) motor component. ICC indicates intraclass correlation coefficient. ity using risk-adjusted outcomes? We propose to set the bar for trauma to a level where hospital quality becomes insensitive to the choice of risk-adjustment model. In the case of trauma, we believe that our findings that the augmented and the augmented agree on hospital quality suggest that injury scoring based on empirical injury severities, in combination with patient demographic and physiologic information, is sufficiently robust to serve as the basis for evaluating trauma center quality. Previous comparisons of trauma scoring systems have focused on the statistical performance of competing trauma scoring systems, as opposed to assessing the effect of the choice of risk adjustment on hospital quality assessment. To our knowledge, an earlier study 24 examining whether the Trauma Injury Severity Score methods 7 and a severity characterization of trauma 25 ranked hospitals differently is the only study of its type in the trauma literature. In that study using the original model coefficients for each of these prediction models, a substantial level of disagreement was found between the Trauma Injury Severity Score and a severity characterization of trauma on the identity of high- and lowquality trauma centers. The fact that both models were poorly calibrated in the hospital cohort used in that study may have been an important factor in these findings. The most feasible explanation for our results in the present study is that the and the have almost equivalent model fit when age, sex, mechanism of injury, and physiologic information are added to the injury models. The addition of the motor component of the GCS markedly improved the appearance of the calibration curve for the to the extent that the calibration curves for the augmented and the augmented were virtually indistinguishable. Coupled with the almost perfect discrimination of both models, it is not unreasonable for both prediction models to exhibit such a high level of agreement on hospital quality assessment. It is likely that the motor component of the GCS is a sufficiently powerful predictor that adding it to the final models blurred the previously significant differences in model performance between the and the. Our finding that excluding physiologic information in the prediction model reduces the extent of agreement between the and the on hospital quality also has important implications for benchmarking. When physiologic information is excluded in the prediction model, the discrimination and calibration of the are significantly better than those of the. We strongly discourage the use of the for benchmarking hospital performance when physiologic information is unavailable because without this information the significantly outperforms the. This study has several potentially significant limitations. First, the NTDB is not population based but instead represents a convenience sample of self-selected hospitals. Furthermore, our study is based on a small cohort of hospitals within the NTDB that coded more than 95% of their patients using AIS codes and were missing GCS (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.

6 3 2 O/E Ratio 1 Hospital Identification Figure 3. Hospital quality as a function of the augmented Trauma Mortality Probability Model () vs the augmented Injury Severity Score () (augmented with age, sex, injury mechanism, and Glasgow Coma Scale motor component). Vertical bars represent 95% confidence interval around the point estimate of the hospital ratio of the observed to expected mortality rates (O/E ratio). data on less than 5% of their patients. Therefore, our study is not necessarily generalizable outside of the study data set and needs to be replicated. Second, we used multiple imputation to impute missing GCS data. Multiple imputation assumes that patients have missing data conditional on their observed risk factors. If the missing data also depend on unmeasured risk factors, then multiple imputation may be biased. However, this assumption (whether the missing data are also a function of unobserved factors) is not testable, and multiple imputation may still be preferable to other approaches designed for situations where the assumption underlying multiple imputation is not entirely valid. 26,27 Third, we were unable to include other potentially important predictors such as blood pressure and comorbidities because of coding issues and missing data in the NTDB. In conclusion, trauma center quality can be assessed using injury scoring augmented with demographic information, mechanism of injury, and physiologic information. The choice of expert-based or empirical AIS for individual injuries does not seem to have a significant effect on hospital quality measurement when physiologic information is included in the prediction model. This finding should help convince all stakeholders that the quality of trauma care can be accurately measured and has face validity. Accepted for Publication: March 15, 28. Correspondence: Laurent G. Glance, MD, Department of Anesthesiology, University of Rochester School of Medicine, 61 Elmwood Ave, Box 64, Rochester, NY (Laurent_Glance@urmc.rochester.edu). Author Contributions: Study concept and design: Glance, Osler, Mukamel, Meredith, and Dick. Analysis and interpretation of data: Glance, Osler, and Mukamel. Drafting of the manuscript: Glance and Mukamel. Critical revision of the manuscript for important intellectual content: Glance, Osler, Mukamel, Meredith, and Dick. Statistical analysis: Glance, Osler, Mukamel, and Dick. Obtained funding: Glance and Meredith. Administrative, technical, and material support: Glance. Financial Disclosure: None reported. Funding/Support: This study was supported by grant R1 HS from the Agency for Healthcare and Quality Research. Disclaimer: The views presented in this article are those of the authors and may not reflect those of the Agency for Healthcare and Quality Research or of the American College of Surgeons Committee on Trauma. REFERENCES 1. Maier RV. Trauma: the paradigm for medical care in the 21st century. J Trauma. 23;54(5): Champion HR, Copes WS, Sacco WJ, et al. The Major Trauma Outcome Study: establishing national norms for trauma care. J Trauma. 199;3(11): MacKenzie EJ, Hoyt DB, Sacra JC, et al. National inventory of hospital trauma centers. JAMA. 23;289(12): Osler T, Glance LG, Buzas JS, Mukamel D, Wagner J, Dick A. A trauma mortality prediction model based on the anatomic injury scale. Ann Surg. 28;247(6): Iezzoni LI. The risks of risk adjustment. JAMA. 1997;278(19): Clarke DE, Fantus RJ, eds. National Trauma Data Bank (NTDB) Annual Report 27. Chicago, IL: American College of Surgeons; 27. (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.

7 7. Boyd CR, Tolson MA, Copes WS. Evaluating trauma care: the TR method: trauma score and the Injury Severity Score. J Trauma. 1987;27(4): Healey C, Osler TM, Rogers FB, et al. Improving the Glasgow Coma Scale score: motor score alone is a better predictor. J Trauma. 23;54(4): Royston P. Multiple imputation of missing values. Stata J. 24;4(3): van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18(6): Glance LG, Osler TM, Mukamel DB, Meredith JW, Dick AW. Impact of statistical approaches for handling missing data on trauma center quality. Ann Surg. In press. 12. Royston P, Altman DG. Regression using fractional polynomials of continuous covariates: parsimonious parametric modeling. Appl Stat. 1994;43(3): White H. A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica. 198;48(4): Hosmer DW, Lemeshow S. Applied Logistic Regression. 2nd ed. New York, NY: Wiley-Interscience Publication; Ash AS, Shwartz M, Pekoz EA. Comparing outcomes across providers. In: Iezzoni LI, ed. Risk Adjustment for Measuring Health Care Outcomes. Chicago, IL: Health Administration Press; 23: Institute of Medicine. Crossing the Quality Chasm. Washington, DC: National Academy Press; Fernandopulle R, Ferris T, Epstein A, et al. A research agenda for bridging the quality chasm. Health Aff (Millwood). 23;22(2): Institute of Medicine. Performance Measurement: Accelerating Improvement. Washington, DC: National Academies Press; Hannan EL, Waller CH, Farrell LS, Cayten CG. A comparison among the abilities of various injury severity measures to predict mortality with and without accompanying physiologic information. J Trauma. 25;58(2): Kilgo PD, Osler TM, Meredith W. The worst injury predicts mortality outcome the best: rethinking the role of multiple injuries in trauma outcome scoring. J Trauma. 23;55(4): Stephenson SC, Langley JD, Civil ID. Comparing measures of injury severity for use with large databases. J Trauma. 22;53(2): Sacco WJ, MacKenzie EJ, Champion HR, Davis EG, Buckman RF. Comparison of alternative methods for assessing injury severity based on anatomic descriptors. J Trauma. 1999;47(3): Meredith JW, Evans G, Kilgo PD, et al. A comparison of the abilities of nine scoring algorithms in predicting mortality. J Trauma. 22;53(4): Glance LG, Osler TM, Dick AW. Evaluating trauma center quality: does the choice of the severity-adjustment model make a difference? J Trauma. 25;58(6): Champion HR, Copes WS, Sacco WJ, et al. A new characterization of injury severity. J Trauma. 199;3(5): Heitjan DF. Annotation: what can be done about missing data? approaches to imputation. Am J Public Health. 1997;87(4): Sinharay S, Stern HS, Russell D. The use of multiple imputation for the analysis of missing data. Psychol Methods. 21;6(4): INVITED CRITIQUE G lance et al have produced an important article that outlines a new and useful trauma quality method, the, that compares favorably with the in terms of predicting mortality. The is based on the ICD-CM-9 diagnosis codes, which are used for the hospital administrative data set as part of the hospital billing process. Conversely, the, currently used by many trauma centers, is derived from the AIS, requiring a more labor-intensive coding and trauma database process. The authors further demonstrated that the and could be improved (augmented and ) by inclusion of 3 patient-specific factors to the calculation (age, sex, and the motor component of the GCS), resulting in almost identical conclusions regarding trauma mortality. Why are these important findings? America spent $72.5 billion in 25 on trauma care, ranking second only to expenditures for heart conditions. 1 Pay for performance and value-based purchasing programs now exist as keystones of many federal and commercial insurance health care programs to reduce costs and to promote quality. 2 These programs will surely expand to grade trauma outcomes for this costly disease. Therefore, hospitals and trauma systems will find increased need for a low-cost but accurate tool to measure and report quality data for their trauma programs. The seems to fit the bill, as it can be calculated using data already collected for hospital billing and thus readily available for little incremental cost. For the augmented, only the motor component of the GCS would need to be collected and added (age and sex of the patient are already contained in the administrative data set). For those hospitals currently using the, augmenting its calculation using the 3 variables will give the same results as the. Therefore, using the results of this study, hospitals and trauma systems should now be able to accurately calculate predicted mortality at lower incremental costs. However, there is more work to be done. The and the are mortality measures, and nationally only 4.4% of trauma patients reaching a hospital die. 3 Urgently needed for trauma quality improvement is a mechanism that will predict morbidity and resource consumption (cost) for most patients surviving trauma. Because trauma survivors account for the bulk of health care costs, having a mechanism to predict resource consumption for a given level of trauma will be essential for cost reduction of trauma care, while improving quality. This study provides a great platform to begin that search for a morbidity-based outcomes cost metric. Charles D. Mabry, MD Correspondence: Dr Mabry, Department of Surgery, University of Arkansas for Medical Sciences, 181 W 4th, Ste 7B, Pine Bluff, AR 7163 (mabrycharlesd@uams.edu). Financial Disclosure: None reported. 1. Agency for Healthcare Research and Quality Web site. Medical Expenditure Panel Survey: table 3: total expenses for selected conditions by type of service: United States, _compendia_hh_interactive.jsp?_service=mepssocket& _PROGRAM=MEPSPGM.TC.SAS&File=HCFY25&Table=HCFY25 %5FCNDXP%5FC&_Debug=. Accessed September 12, Medicare Payment Advisory Commission. Report to the Congress: Medicare Payment Policy. Washington, DC: Medicare Payment Advisory Commission; March American College of Surgeons National Trauma Data Bank Web site. National Trauma Data Bank annual report 27: version Accessed September 12, 28. (REPRINTED) ARCH SURG/ VOL 144 (NO. 4), APR Downloaded From: on 12/12/ American Medical Association. All rights reserved.