Evaluating Surrogate Measures of Renal Dysfunction After Cardiac Surgery

Transcription

1 Evaluating Surrogate Measures of Renal Dysfunction After Cardiac Surgery Duminda N. Wijeysundera, MD*, Vivek Rao, MD, PhD, FRCSC, W. Scott Beattie, MD, PhD, FRCPC, Joan Ivanov, RN, MSc, PhD, and Keyvan Karkouti, MD, MSc, FRCPC *Department of Anaesthesia, University of Toronto; Division of Cardiac Surgery, Toronto General Hospital, University Health Network; Department of Anaesthesia, University Health Network, University of Toronto; and Department of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada Renal insufficiency after cardiac surgery is associated with increased mortality, morbidity, and length of intensive care unit stay. A convenient surrogate measure would facilitate the evaluation of renal-protective therapies. We evaluated two measures: the 72-h change in serum creatinine (Cr) ( Cr 72h ) and the percentage 72-h change in calculated (Cockcroft-Gault equation) Cr clearance (% CrCl 72h ). We randomly selected 2000 individuals who underwent aortocoronary bypass, valve surgery, or both at the Toronto General Hospital between May 1999 and August The variables were analyzed with frequency histograms and normal probability plots. Their association with dialysis, mortality, and prolonged intensive care unit stay was determined by using receiver operating characteristic (ROC) curves. Cr 72h was skewed to the right, whereas % CrCl 72h was normally distributed. ROC curve areas showed Cr 72h to be a good predictor of dialysis (0.98), death (0.83), and prolonged hospitalization (0.74). % CrCl 72h had similar ROC curve areas for predicting dialysis (0.97), death (0.82), and prolonged hospitalization (0.74). ROC curve areas did not differ significantly with respect to mortality (P 0.89), dialysis (P 0.49), or prolonged hospitalization (P 0.85). Both variables were correlated with patient-relevant outcomes. Mathematical transformation of Cr 72h to % CrCl 72h results in a normal distribution that is amenable to parametric statistical tests. Cr 72h and % CrCl 72h may be used as surrogate outcomes in future trials. (Anesth Analg 2003;96: ) Renal insufficiency after cardiac surgery is associated with increased mortality, morbidity, and intensive care unit (ICU) stay (1,2). The preoperative predictors of postoperative dialysis have been identified in large studies that encompassed up to 43,000 patients (1,2). In contrast, research into strategies to prevent renal insufficiency has been limited. An important reason for this discrepancy is the infrequent incidence of postoperative dialysis (1% to 2%) in this patient population (1,2). Clinical trials therefore require large sample sizes to detect changes in dialysis rates with adequate power. Dr. Wijeysundera is the recipient of the Allan K. Laws Clinician Scientist Fellowship from the University of Toronto. Presented in part at the meeting of the Canadian Cardiovascular Congress, Edmonton, AB, Canada, October 27, Accepted for publication January 3, Address correspondence and reprint requests to Vivek Rao, MD, PhD, FRCSC, Division of Cardiac Surgery, Department of Surgery, University of Toronto, EN , Toronto General Hospital, University Health Network, 200 Elizabeth St., Toronto, Ontario, M5G 2C4, Canada. Address to vivek.rao@uhn.on.ca. DOI: /01.ANE Surrogate measures of perioperative renal dysfunction are therefore needed for the preliminary evaluation of new renal-protective therapies using feasible sample sizes. The ideal surrogate measure should be easily measured and correlate with patient-relevant outcomes. It should also have distributional properties suited to parametric statistical tests, which are generally more powerful than nonparametric equivalents (3). If a therapy beneficially alters an ideal surrogate measure, there is justification for then studying its effects on patientrelevant outcomes (dialysis, mortality, and length of stay) in an adequately powered larger study. The surrogate measures presently in use include urinary protein markers, serum creatinine (Cr) concentration, and Cr clearance (CrCl) (measured and calculated). Urinary levels of 1 -microglobulin, 2 -microglobulin, and N-acetyl- -d-glucosaminidase are sensitive markers of real tubular injury. However, there is no evidence that perioperative increases of these markers are associated with postoperative morbidity or mortality (4). Furthermore, antifibrinolytics (e.g., -aminocaproic acid, tranexamic acid, and aprotinin) cause microglobulinuria independent of renal injury (5) by the International Anesthesia Research Society /03 Anesth Analg 2003;96:

2 1266 CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL. ANESTH ANALG MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY 2003;96: Serum Cr concentration has been used as a measure of overall renal function. It is easily measured and has a small interassay coefficient of variation ( 5% at our institution). However, Cr concentrations are affected by factors aside from renal function, namely, sex, age, and muscle mass (6). Investigators have usually either used Cr concentration as a continuous variable or dichotomized it to define clinically significant changes in renal function. Definitions of clinically significant perioperative changes in Cr concentration have been largely arbitrary. The most common definition, an increase more than 44.2 mol/l (0.5 mg/dl) over 48 to 72 h (7,8), was obtained from the contrast-induced nephropathy literature (9). The significance of a 44.2 mol/l perioperative increase in serum Cr is unknown. Measured CrCl has been used to estimate glomerular filtration rate (GFR), but its accuracy and precision have generally been low (10). Other disadvantages include increased personnel time and costs that are needed for accurate collection of timed urine samples. The shorter collection times used in perioperative trials (11) may further magnify inaccuracies in urine volume measurement. GFR can also be estimated by calculated CrCl. The latter estimates GFR through an equation that accounts for an individual s age, sex, weight, and serum Cr (12). It has advantages over both measured Cl and serum Cr. Calculated Cl estimates GFR and measured Cl in critically ill patients admitted to medical and cardiac surgical ICUs (13,14), even during conditions of changing renal function (14). Furthermore, calculated Cl does not require the collection of cumbersome timed urine samples. Cr concentrations and calculated CrCl are convenient, reproducible, and inexpensive surrogate measures. However, the prognostic significance and distributional properties of perioperative changes in these measures remain unclear. We therefore evaluated the surrogate measures in 2000 patients undergoing coronary artery bypass grafting, valve surgery, or both. We also sought to identify the appropriate perioperative changes in Cr and CrCl for defining clinically significant changes in renal function. We limited postoperative measurements of renal function to the 72 h after surgery, a previously defined period (15) that would capture changes in function attributable to surgery itself. We used the percentage change in CrCl to better relate the perioperative change in Cl to preoperative renal function. Methods Preoperative, intraoperative, and postoperative information is prospectively collected for patients undergoing cardiac surgery at the Toronto General Hospital (TGH) (Toronto, ON, Canada). Documented information includes weight (kg), postoperative dialysis, inhospital mortality, and ICU length of stay. This database has previously been described (16). Variables are defined in Appendix 1. We identified all individuals who underwent coronary artery bypass grafting, valve surgery, or both between May 1, 1999, and August 31, Patients were excluded if they required dialysis before surgery or died during surgery. Assuming a dialysis rate of 0.75%, the sample size of 2000 was estimated to provide sufficient outcomes (death or dialysis) for logistic regression modeling (i.e., 10 outcomes per independent variable) (17) and 95% confidence intervals (CI) more precise than 0.10 during receiver operating characteristic (ROC) curve analysis. CIs were calculated by using the methods of Hanley and McNeil (18), assuming a ROC curve area of The sample size was also deemed to be feasible for manual retrieval of laboratory data. We randomly selected 2000 individuals from the 3077 patients identified previously, by using a computergenerated random-number table (SAS 8.02; SAS Institute, Cary, NC). The Cr concentrations of patients undergoing cardiac surgery at TGH are routinely measured before surgery (within 30 days) and then daily after surgery until discharge or the fifth postoperative day. After obtaining approval from the TGH Research Ethics Board, we manually reviewed medical charts to obtain these results. The preoperative Cr concentration (Cr preop ) was defined as the value recorded closest to surgery but not on the day of the procedure itself. The maximal 72-h Cr concentration (Cr 72hmax ) was defined as the largest postoperative measurement between Days 0 and 3. All in-hospital measurements were performed at Toronto Medical Laboratories (Toronto, ON, Canada) with the Bayer Advia 1650 autoanalyzer (Bayer Inc., Tarrytown, NY), which has an interassay coefficient of variation 5%. Of Cr preop measurements, 97% were measured at Toronto Medical Laboratories. The overall results were not qualitatively altered when we excluded the 3% with preoperative measurements at facilities other than Toronto Medical Laboratories. Preoperative measurements were performed on the day before surgery for 63% (n 1267) of the study sample. The duration between the preoperative measurement and surgery ranged from 1 to 27 days (mean, 5 days; 25th percentile, 1 day; 75th percentile, 11 days). The 72-h change in Cr concentration ( Cr 72h ) was defined as the difference between preoperative and postoperative concentrations ( Cr 72h Cr 72hmax Cr preop ). Preoperative (CrCl preop ) and smallest 72-h postoperative (CrCl 72h ) CrCl were calculated with the Cockcroft-Gault equation (12):

3 ANESTH ANALG CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL ;96: MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY 1. Men: CrCl [(140 age) weight 1.2] serum Cr 2. Women: CrCl [(140 age) weight] serum Cr Units for age, weight, and Cr were years, kilograms, and micromoles per liter, respectively. The Cockcroft- Gault equation was selected given its superior performance relative to other equations (19). The absolute 72-h change in CrCl ( CrCl 72h ) was calculated by using preoperative and postoperative CrCl: CrCl 72 h (CrCl 72 h CrCl preop ). The percentage 72-h change in CrCl (% CrCl 72h ) was subsequently determined: % CrCl 72 h ( CrCl 72 h /CrCl preop ) 100%. Patients who needed postoperative dialysis received either intermittent hemodialysis or continuous venovenous hemodialysis. Decisions on implementing dialysis were made by a consulting nephrologist. Analyses were performed with SAS All tests of significance were two tailed, with P values less than 0.05 considered statistically significant. The distributions of Cr 72h and % CrCl 72h were assessed by using frequency histograms and normal probability plots. We assessed the distributions of the percentage change in Cr concentration, % Cr (% Cr Cr 72 h /Cr preop 100%), and the absolute change in CrCl ( CrCl 72h ) to ensure that differences in their distributions were not due to % CrCl 72h being a percentage. We also determined whether any mathematical transformations (logarithmic, etc.) converted Cr 72h or % CrCl 72h to symmetric, bell-shaped distributions. ROC curves (18) were plotted for the relationship of Cr 72h and % CrCl 72h with postoperative dialysis, in-hospital mortality, and prolonged ICU length of stay. Prolonged ICU stay was defined as more than or equal to 5 days (95th percentile for the study sample). The methods of Hanley and McNeil (18) were used to calculate areas under each ROC curve with 95% CI. The ROC curve area gives a global assessment of the performance of Cr 72h or CrCl 72h in discriminating between individuals who do or do not have an outcome. Measures that perform no better than chance have ROC curve areas of 0.50; measures with perfect discrimination have areas of 1.0. The measures ROC curve areas were compared by using the methods of Hanley and McNeil (20). We developed several alternative definitions of clinically significant changes in perioperative renal function by dichotomizing Cr 72h and % CrCl 72h along convenient cut-points, including a 72-h increase in Cr concentration more than 44.2 mol/l (0.5 mg/dl). We used the ROC curves to identify the cut-points that resulted in the optimal balance of sensitivity and specificity for predicting postoperative dialysis. We also measured the correlation of Cr 72h and % CrCl 72h with dialysis, mortality, and prolonged ICU stay by using univariate logistic regression modeling. The statistical significance of the relationship of Cr 72h or % CrCl 72h (as continuous variables) with these outcomes was assessed by using the Wald statistic (21). Odds ratios with 95% CI were calculated. The discrimination and calibration of the regression models were determined with the c statistic and the Hosmer-Lemeshow goodness-of-fit statistic, respectively (21). Discrimination refers to a model s ability to assign higher probabilities to individuals who sustain outcomes as opposed to those who do not (22). Calibration describes the degree to which models predicted probabilities compare against actual outcomes (22). The effect of perioperative changes on renal function may be affected by the presence of preoperative renal dysfunction. We therefore determined the predictive performance of Cr 72h and % CrCl 72h in two strata defined by CrCl preop. Only two strata were used, given the limited statistical power of a 2000-patient sample. We initially plotted an ROC curve comparing CrCl preop and postoperative dialysis; this curve was subsequently used to identify the CrCl preop value with the optimal balance of sensitivity and specificity for predicting dialysis. The sample was then divided into two strata (normal and reduced preoperative renal function) on the basis of this CrCl preop value. ROC curves were subsequently plotted comparing Cr 72h and % CrCl 72h with dialysis within each stratum. Results The study sample (Table 1) had an in-hospital mortality rate of 1.1% (n 21). The median ICU length of stay was 1 day (25th percentile, 1 day; 75th percentile, 2 days). The incidence of postoperative dialysis and prolonged ICU stay was 1.0% (n 20) and 6.3% (n 126), respectively. The distribution of Cr 72h (Fig. 1) was skewed to the right (median, 3 mol/l; 25th percentile, 5 mol/l; 75th percentile, 14 mol/l). The variable was not normally distributed on a normal probability plot. The transformation to % Cr (median, 3%; 25th percentile, 5%; 75th percentile, 15%) was also skewed to the right and not normally distributed. Transformation of Cr 72h to the difference between the reciprocals of preoperative and postoperative Cr concentrations (1/ Cr preop 1/Cr 72hmax ) resulted in a more symmetric, bell-shaped distribution. Cr 72h was correlated with postoperative dialysis (ROC area, 0.98; 95% CI, ), mortality (ROC area, 0.83; 95% CI, ), and prolonged ICU stay (ROC area, 0.74; 95% CI, ). The sensitivity, specificity, and prevalence of several cut-points in Cr 72h are presented in Table 2. The cut-point that resulted in the optimal balance of sensitivity and specificity was an increase in Cr concentration more than

4 1268 CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL. ANESTH ANALG MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY 2003;96: Table 1. Study Sample Characteristic Entire cohort (n 2000) Men (n 1498) Women (n 502) Mean age (yr) Weight (kg) Mean serum creatinine ( mol/l) Mean creatinine clearance (ml/min) Timing Elective 53% (n 1052) 52% (n 785) 53% (n 267) Semiurgent 40% (n 808) 41% (n 616) 38% (n 192) Urgent 6% (n 126) 6% (n 88) 8% (n 38) Emergent 1% (n 14) 1% (n 9) 1% (n 5) Ejection fraction (%) 60% 41% (n 827) 38% (n 566) 52% (n 261) % (n 781) 40% (n 604) 35% (n 177) % (n 349) 19% (n 290) 12% (n 59) 20 2% (n 43) 3% (n 38) 1% (n 5) Preoperative IABP 3% (n 54) 2% (n 36) 3% (n 13) Repeat operation 7% (n 130) 6% (n 94) 7% (n 35) Diabetes mellitus 28% (n 550) 27% (n 397) 30% (n 153) Hypertension 53% (n 1051) 51% (n 757) 59% (n 294) Peripheral vascular disease 13% (n 256) 13% (n 192) 13% (n 64) Chronic obstructive pulmonary disease 5% (n 89) 4% (n 66) 5% (n 23) Intraoperative and postoperative details Procedure type Isolated CABG 80% (n 1608) 84% (n 1254) 71% (n 354) Isolated valve 13% (n 261) 10% (n 154) 21% (n 107) CABG and valve 7% (n 131) 6% (n 90) 8% (n 41) On-pump cases 94% (n 1870) 93% (n 1400) 94% (n 470) CPB Mean CPB time a (min) Mean cross-clamp time a (min) Postoperative IABP 3% (n 51) 2% (n 35) 3% (n 16) Low cardiac output syndrome 5% (n 90) 4% (n 61) 6% (n 29) Perioperative myocardial infarction 3% (n 58) 2% (n 36) 4% (n 22) Data are mean sd unless otherwise noted. IABP intraaortic balloon pump; CPB cardiopulmonary bypass; CABG coronary artery bypass grafting. a Calculated with CPB cases only. 50 mol/l, which had a prevalence of 5.5%. Cr 72h was also associated with clinical outcomes in univariate logistic regression models (Table 3). All models had good discrimination (Table 3). The models were also well calibrated, aside from the model predicting prolonged ICU stay (Table 3). The % CrCl 72h used here was a mathematical transformation of Cr 72h. The distribution of % CrCl 72h (Fig. 1) was approximately normal (mean, 5.1%; sd, 16.4%). The distribution of the absolute change in CrCl, CrCl 72h, was more symmetric and bell shaped than that of Cr 72h. However, normal probability plots showed that the transformation of CrCl 72h to % CrCl 72h resulted in a closer approximation to the normal distribution. % CrCl 72h was correlated with postoperative dialysis (ROC area, 0.97; 95% CI, ), mortality (ROC area, 0.82; 95% CI, ), and prolonged ICU stay (ROC area, 0.74; 95% CI, ). The ROC curve areas were not significantly different from Cr 72h with respect to death (P 0.89), dialysis (P 0.49), or prolonged ICU stay (P 0.85). The sensitivity, specificity, and prevalence of several cut-points in % CrCl 72h are presented in Table 2. The cut-point that resulted in the optimal balance of sensitivity and specificity was a decrease in CrCl more than 25%, which had a prevalence of 10.2%. % CrCl 72h was also associated with clinical outcomes in univariate logistic regression models (Table 3). All models had good discrimination (Table 3). The models were well calibrated, except the model predicting prolonged ICU stay (Table 3). The area under the ROC curve relating CrCl preop and postoperative dialysis was 0.77 (95% CI, ). The optimal definition of preoperative renal dysfunction was a CrCl 60 ml/min, which had a prevalence of 27% (n 538). The relative risk for dialysis among individuals with preoperative renal dysfunction was 5.0 (95% CI, ; P ). The ROC curves relating Cr 72h and % CrCl 72h with postoperative dialysis in the entire cohort and two subgroups are presented in Figures 2 and 3.

5 ANESTH ANALG CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL ;96: MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY Figure 1. Distributions of absolute 72-h change in creatinine concentration (top) and percentage 72-h change in creatinine clearance (bottom). For individuals with normal preoperative renal function, the ROC curve areas relating dialysis with Cr 72h and % CrCl 72h were 0.99 (95% CI, ) and 0.99 (95% CI, ), respectively. An increase in Cr concentration more than 50 mol/l, which had a prevalence of 4% (n 53), was associated with a sensitivity and specificity for dialysis of 97% and 100%, respectively. By comparison, a decrease in CrCl larger than 25%, which had a prevalence of 9% (n 127), had a sensitivity of 92% and specificity of 100%.

6 1270 CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL. ANESTH ANALG MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY 2003;96: Table 2. Clinically Significant Changes in Perioperative Renal Function: Characteristics of Alternative Definitions with Cr 72h and % CrCl 72h Outcome Change Prevalence Mortality Dialysis Extended ICU stay Sensitivity Specificity Sensitivity Specificity Sensitivity Specificity Cr 72h 0 mol/l 57% (n 1148) 90.5% 43.0% 100% 43.0% 81.0% 44.2% Cr 72h 25 mol/l 14% (n 274) 66.7% 87.0% 95.0% 87.3% 48.4% 88.8% Cr 72h 44 mol/l 7% (n 129) 61.9% 94.1% 95.0% 94.4% 37.3% 95.6% (0.5 mg/dl) Cr 72h 50 mol/l 6% (n 110) 61.9% 95.1% 95.0% 95.4% 36.5% 96.6% Cr 72h 100 mol/l 2% (n 43) 23.8% 98.1% 70.0% 98.5% 21.4% 99.1% % CrCl 72h 0% 57% (n 1148) 90.5% 43.0% 100% 43.0% 81.0% 44.2% % CrCl 72h 15% 22% (n 444) 66.7% 78.3% 95.0% 78.5% 58.7% 80.3% % CrCl 72h 25% 10% (n 203) 57.1% 90.3% 95.0% 90.7% 46.8% 92.3% % CrCl 72h 50% 2% (n 39) 23.8% 98.3% 55.0% 98.6% 17.5% 99.1% Cr creatinine; Cl clearance; ICU intensive care unit. Table 3. Logistic Regression Models Relating Cr 72h and % CrCl 72h to Dialysis, Death, and Prolonged Intensive Care Unit Stay Outcome % CrCl 72h (per 10% reduction) Cr 72h (per 10 mol/l increase) Dialysis Odds ratio 3.19 (95% CI, ) 1.42 (95% CI, ) c Statistic Calibration a 2 2.6; P ; P 0.96 Mortality Odds ratio 1.90 (95% CI, ) 1.17 (95% CI, ) c Statistic Calibration a 2 9.4; P ; P 0.13 Prolonged ICU stay Odds ratio 2.34 (95% CI, ) 1.35 (95% CI, ) c Statistic Calibration a ; P ; P Cr creatinine; Cl clearance; CI confidence interval; ICU intensive care unit. a Hosmer-Lemeshow statistic. The ROC curve areas relating postoperative dialysis with Cr 72h and % CrCl 72h for individuals with preoperative renal dysfunction were 0.96 (95% CI, ) and 0.95 (95% CI, ), respectively. An increase in Cr concentration more than 50 mol/l, which had a prevalence of 11% (n 57), was associated with a sensitivity of 91% and a specificity of 92%. A decrease in CrCl more than 25%, which had a prevalence of 14% (n 76), had a sensitivity and specificity of 88% and 92%, respectively. Discussion We evaluated the performance of two simple surrogate measures that can be readily used in clinical trials: the 72-hour changes in Cr concentration and calculated CrCl. Both were highly correlated with postoperative dialysis, death, and prolonged ICU stay. ROC analysis did not demonstrate any significant differences between the measures with regard to predicting clinical outcomes. Their performance was similar regardless of whether preoperative renal function was normal or abnormal. Preexisting renal dysfunction, as defined by CrCl less than 60 ml/min, itself increased the risk of postoperative dialysis fivefold; these findings mirror those of other investigators (1). Calculated CrCl is a mathematical transformation of Cr concentration. Nonetheless, this transformation resulted in a normally distributed and clinically meaningful variable that retained high correlation with patient-relevant outcomes. The other mathematical transformation that resulted in a symmetric, bellshaped distribution was the difference between the reciprocals of preoperative and postoperative Cr concentrations. This alternative transformation is difficult to interpret. We suspect that clinicians will more readily interpret 95% CI for a proportionate change in calculated CrCl than for a difference in reciprocals. Both Cr concentrations and calculated CrCl may be used as continuous outcome variables. In this situation, CrCl has an important advantage over Cr concentration. Parametric statistical tests (e.g., Student s

7 ANESTH ANALG CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL ;96: MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY Figure 2. Receiver operating characteristic curves relating the 72-h change in serum creatinine ( Cr 72h ) with postoperative dialysis for the entire cohort (O), the subgroup with normal preoperative renal function (- ----),and the subgroup with preoperative renal dysfunction ( -- ). The cut-point for Cr 72 greater than 50 mol/l is indicated for all three curves Figure 3. Receiver operating characteristic curves relating the percentage 72-h change in calculated creatinine clearance (% CrCl 72h ) with postoperative dialysis for the entire cohort (O), the subgroup with normal preoperative renal function (- ----), and the subgroup with preoperative renal dysfunction ( -- ). The cut-point for % CrCl 72 less than 25% is indicated for all three curves. t-tests and analysis of variance) all assume that the outcome variable conforms to an approximately normal distribution. Whereas CrCl has a symmetric, bellshaped distribution, serum Cr has a skewed distribution. The symmetric distribution of CrCl did not simply reflect its use as a percentage. The percentage change in Cr concentration (% Cr 72h ) did not have a normal distribution. When performing statistical analyses on Cr concentration, one must therefore either apply nonparametric tests or transform the data such that they follow a normal distribution. The sd and 95% CI from analyses of transformed data are often difficult to interpret (23). In contrast, one can immediately apply convenient parametric statistical tests to CrCl and derive results that are readily understandable to clinicians. This difference in distributions will therefore simplify statistical analyses during preliminary sample size calculations and final data analyses (3). Both Cr and CrCl can also be dichotomized to define clinically significant changes in perioperative renal function. We analyzed the most common definition of perioperative renal dysfunction, a 0.5 mg/dl (44 mol/l) increase in serum Cr, and determined its predictive performance for dialysis (sensitivity, 95.0%; specificity, 61.9%), mortality (sensitivity, 61.9%; specificity, 94.1%), and prolonged ICU stay (sensitivity, 37.3%; specificity, 95.6%). ROC analysis suggested that a clinically significant change in renal function should be defined as either an increase in serum Cr concentration more than 50 mol/l or a decrease in CrCl

8 1272 CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL. ANESTH ANALG MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY 2003;96: more than 25%. The latter definition is more conveniently used during clinical trials because of its higher prevalence (10.2% vs 5.5%). A clinical trial that defines clinically significant renal dysfunction as a decrease in CrCl more than 25% would therefore need only half as many patients to develop statistical power equivalent to that in a trial that defines clinically significant dysfunction as an increase in serum Cr more than 50 mol/l. There is limited prior information on surrogate measures of perioperative renal function. Charlson et al. (24) used ROC analysis to evaluate the performance of changes in serum Cr concentrations. However, they related changes in Cr to postoperative measured CrCl, not clinical end-points (e.g., death, dialysis, or prolonged ICU stay). There are several limitations to this study. First, postoperative CrCl was calculated by using preoperative weights. Given that the Cockcroft-Gault equation uses weight to estimate muscle mass, our calculations assumed that muscle mass did not significantly change over the first 72 postoperative hours. However, surgical stress increases protein catabolism. The urinary excretion of 3-methylhistidine, a marker of skeletal muscle protein catabolism, increases up to 40% in the early postoperative period after elective surgery (25). Nonetheless, it is unlikely that remeasuring weight on each postoperative day would have significantly improved the accuracy of our results. Immediate postoperative weight increases above preoperative values because of IV fluid administration. The Cockcroft-Gault equation would interpret this additional weight as increased muscle mass, when muscle mass is likely to have decreased. Using preoperative weights will therefore lead to less overestimation of postoperative GFR than using serial postoperative weights. Second, these results demonstrate a close statistical association of these outcome measures with dialysis, death, and prolonged ICU stay. Although the relationship has biological plausibility, a cause-effect relationship must be validated prospectively. Future clinical trials of interventions that alter Cr or CrCl must also demonstrate similar changes in these clinical outcomes. In conclusion, both Cr concentration and calculated CrCl are surrogate measures of perioperative renal function that are convenient, inexpensive, and highly correlated with patient-relevant clinical outcomes (mortality, dialysis, and prolonged hospitalization). Other surrogate outcomes now in use (e.g., measured CrCl and urinary protein markers) do not share all these characteristics. CrCl has the additional advantage of a symmetric, bell-shaped distribution amenable to parametric statistical tests. Either measure may be used to define a clinically significant change in perioperative renal function. The most appropriate definitions appear to be either an increase in serum Cr concentration 50 mol/l or a decrease in CrCl more than 25%. We propose that that Cr concentration and calculated CrCl be used as surrogate measures of renal function during initial clinical trials of novel renalprotective drugs. Demonstration of the benefit of such drugs on these surrogate measures is necessary before progressing to the large studies needed for evaluating effects on the outcomes themselves. The authors acknowledge the superb data collection and management of Susan Collins at the University Health Network. Appendix 1: Definitions of Perioperative Variables Timing of operation: semiurgent (cannot leave hospital without surgery), urgent (surgery required within 72 h of presentation), and emergent (surgery required within 12 h of presentation). Diabetes mellitus: preoperative diagnosis of diabetes mellitus treated with insulin, oral hypoglycemic drugs, or diet. Hypertension: preoperative systemic hypertension necessitating medical treatment. Peripheral vascular disease: known carotid, aortoiliac, or femoropopliteal disease operating room cases in which the patient had a previous carotid endarterectomy or peripheral vascular operation. Chronic obstructive pulmonary disease: severe chronic obstructive pulmonary disease requiring daily inhaled or oral medication to improve symptoms. Low cardiac output syndrome: need for intraaortic balloon pump support in the operating room or the intensive care unit or need for inotropic medication (dopamine 4 g kg 1 min 1, dobutamine, milrinone, or epinephrine) for at least 30 min to maintain the systolic blood pressure 90 mm Hg and the cardiac output 2.2 L min 1 m 2 in the ICU. Perioperative myocardial infarction: a new Q wave on the postoperative electrocardiogram. A myocardial infarction was also diagnosed if the MB isoenzyme (CK-MB) of creatine kinase (CK) exceeded 50 U/L, the CK-MB/CK ratio exceeded 5%, and the postoperative electrocardiogram showed a new left bundle branch block, loss of R-wave progression, or changes in the ST segment or T wave. References 1. Chertow GM, Lazarus JM, Christiansen CL, et al. Preoperative renal risk stratification. Circulation 1997;95:

9 ANESTH ANALG CARDIOVASCULAR ANESTHESIA WIJEYSUNDERA ET AL ;96: MEASURING PERIOPERATIVE RENAL DYSFUNCTION AFTER CARDIAC SURGERY 2. Mangano CM, Diamondstone LS, Ramsay JG, et al. Renal dysfunction after myocardial revascularization: risk factors, adverse outcomes, and hospital resource utilization. Ann Intern Med 1998;128: Greenhalgh T. How to read a paper: statistics for the nonstatistician. I. Different types of data need different statistical tests. BMJ 1997;315: Baines AD. Strategies and criteria for developing new urinalysis tests. Kidney Int Suppl 1994;47:S Smith MS. Antifibrinolytic agents make 1 - and 2 - microglobulinuria poor markers of postcardiac surgery renal dysfunction. Anesthesiology 1999;90: Levey AS, Perrone RD, Madias NE. Serum creatinine and renal function. Annu Rev Med 1988;39: Lassnigg A, Donner E, Grubhofer G, et al. Lack of renoprotective effects of dopamine and furosemide during cardiac surgery. J Am Soc Nephrol 2000;11: Story DA, Poustie S, Liu G, McNicol PL. Changes in plasma creatinine concentration after cardiac anesthesia with isoflurane, propofol, or sevoflurane: a randomized clinical trial. Anesthesiology 2001;95: Solomon R, Werner C, Mann D, et al. Effects of saline, mannitol, and furosemide on acute decreases in renal function induced by radiocontrast agents. N Engl J Med 1994;331: Walser M. Assessing renal function from creatinine measurements in adults with chronic renal failure. Am J Kidney Dis 1998;32: Cittanova ML, Zubicki A, Savu C, et al. The chronic inhibition of angiotensin-converting enzyme impairs postoperative renal function. Anesth Analg 2001;93: Cockcroft DW, Gault MH. Prediction of creatinine clearance from serum creatinine. Nephron 1976;16: Robert S, Zarowitz BJ, Peterson EL, Dumler F. Predictability of creatinine clearance estimates in critically ill patients. Crit Care Med 1993;21: Bloor GK, Welsh KR, Goodall S. Comparison of predicted with measured creatinine clearance in cardiac surgical patients. J Cardiothorac Vasc Anesth 1996;10: Hou SH, Bushinsky DA, Wish JB, et al. Hospital-acquired renal insufficiency: a prospective study. Am J Med 1983;74: Rao V, Ivanov J, Weisel RD, et al. Predictors of low cardiac output syndrome after coronary artery bypass. J Thorac Cardiovasc Surg 1996;112: Concato J, Feinstein AR, Holford TR. The risk of determining risk with multivariable models. Ann Intern Med 1993;118: Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: Spinler SA, Nawarskas JJ, Boyce EG, et al. Predictive performance of ten equations for estimating creatinine clearance in cardiac patients. Ann Pharmacother 1998;32: Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983;148: Hosmer DW, Lemeshow S. Applied logistic regression. New York: Wiley, Ash AS, Shwartz M. Evaluating the performance of riskadjustment methods: dichotomous outcomes. In: Iezzoni LI, ed. Risk adjustment for measuring healthcare outcomes. Chicago: Health Administration Press, 1997: Bland JM, Altman DG. The use of transformation when comparing two means. BMJ 1996;312: Charlson ME, MacKenzie CR, Gold JP, Shires GT. Postoperative changes in serum creatinine: when do they occur and how much is important? Ann Surg 1989;209: Gross E, Holbrook IB, Irving MH. The effect of elective surgery on 3-methylhistidine excretion. Br J Surg 1978;65:663 5.