ORIGINAL INVESTIGATION. lessthan4hoursfortheempirical. is one of the core measures by which hospitals and physicians are evaluated for the

Similar documents
Community-Acquired Pneumonia OBSOLETE 2

Delayed Administration of Antibiotics and Atypical Presentation in Community-Acquired Pneumonia*

NQF-ENDORSED VOLUNTARY CONSENSUS STANDARDS FOR HOSPITAL CARE. Measure Information Form

NQF-ENDORSED VOLUNTARY CONSENSUS STANDARDS FOR HOSPITAL CARE. Measure Information Form

Making the Right Call With. Pneumonia. Community-acquired pneumonia (CAP) is a. Community-Acquired. What exactly is CAP?

Antimicrobial Stewardship in Community Acquired Pneumonia

To develop guidelines for the use of appropriate antibiotics for adult patients with CAP and guidance on IV to PO conversion.

Role of Chest Low-dose Computed Tomography in Elderly Patients with Suspected Acute Pulmonary Infection in the Emergency Room

Clinical Features And Correlates Of Bacteremia Among Urban Minority New Yorkers Hospitalized With Community Acquired Pneumonia

Pneumonia and influenza combined are the fifth leading

Community Acquired Pneumonia

WORKSHOP. The Multiple Facets of CAP. Community acquired pneumonia (CAP) continues. Jennifer s Situation

Repeated Pneumonia Severity Index Measurement After Admission Increases its Predictive Value for Mortality in Severe Community-acquired Pneumonia

Epidemiology and Etiology of Community-Acquired Pneumonia 761 Lionel A. Mandell

SCORES FOR 4 TH QUARTER, RD QUARTER, 2014

KAISER PERMANENTE OHIO COMMUNITY ACQUIRED PNEUMONIA

Community Acquired Pneumonia: Measures to Improve Management and Healthcare Quality

Late diagnosis of influenza in adult patients during a seasonal outbreak

2018 MIPS Reporting Family Medicine

Appendix G Explanation/Clarification Summary

TECHNICAL NOTES APPENDIX SUMMER

Supplementary Appendix

COPD exacerbation. Dr. med. Frank Rassouli

Community Acquired Pneumonia. Abdullah Alharbi, MD, FCCP

Standards of excellence

Trial protocol - NIVAS Study

The County of Santa Clara

CEDR 2018 QCDR Measures for CMS 2018 MIPS Performance Year Reporting

Predictors of Outcomes of Community Acquired Pneumonia in Egyptian Older Adults

Care Guideline DRAFT for review cycle 08/02/17 CARE OF THE ADULT PNEUMONIA PATIENT

NATIONAL INSTITUTE FOR HEALTH AND CARE EXCELLENCE SCOPE

CARE OF THE ADULT PNEUMONIA PATIENT

TECHNICAL NOTES APPENDIX SUMMER

JAMA, January 11, 2012 Vol 307, No. 2

Appendix. Potentially Preventable Complications (PPCs) identify. complications that can occur during an admission. There are 64

Chapter 13. Respiratory Emergencies

Key Findings. Mortality Rates

Interventional procedures guidance Published: 20 December 2017 nice.org.uk/guidance/ipg600

CLINICAL USE CASES FOR RMT

Hospital-wide Impact of Mandatory Infectious Disease Consultation on Staphylococcus aureus Septicemia

Key Points. Angus DC: Crit Care Med 29:1303, 2001

2017 ACCP/SCCM Critical Care Preparatory Review and Recertification Course Learning Objectives

NQF-ENDORSED VOLUNTARY CONSENSUS STANDARDS FOR HOSPITAL CARE. Measure Information Form Collected For: CMS Outcome Measures (Claims Based)

Quality & Hospital Acquired Conditions

UPDATE IN HOSPITAL MEDICINE

Chapter 22. Pulmonary Infections

Supplementary Online Content

BELLWORK page 343. Apnea Dyspnea Hypoxia pneumo pulmonary Remember the structures of the respiratory system 1

Commissioning for Better Outcomes in COPD

PROFILE OF PNEUMONIA IN COPD

NQF-ENDORSED VOLUNTARY CONSENSUS STANDARDS FOR HOSPITAL CARE

NQF-ENDORSED VOLUNTARY CONSENSUS STANDARD FOR HOSPITAL CARE. Measure Information Form Collected For: CMS Outcome Measures (Claims Based)

Acute Respiratory Infection. Dr Anthony Gibson

Problem Based Learning Session. Mr Robinson is a 67 year old man. He visits the GP as he has had a cough and fever for 5 days.

A Place For Airway Clearance Therapy In Today s Healthcare Environment

Prescribe appropriate immunizations for. Prescribe childhood immunization as per. Prescribe influenza vaccinations in high-risk

K L Buising, K A Thursky, J F Black, L MacGregor, A C Street, M P Kennedy, G V Brown...

Respiratory Failure & Pneumonia Definitions Workgroup

Rapid Response Teams. January 17, Safe Table Webinar

Supplementary Online Content

Page 126. Type of Publication: Original Research Paper. Corresponding Author: Dr. Rajesh V., Volume 3 Issue - 4, Page No

Upper...and Lower Respiratory Tract Infections

Community-acquired pneumonia in adults

Chapter 10 Respiratory System J00-J99. Presented by: Jesicca Andrews

Respiratory Diseases and Disorders

EAJEM-22932: Araştırma Makalesi. Acute onset of breathlessness in emergency department. Page 1 / 15. JournalAgent powered by LookUs

Challenges in Diagnosis, Surveillance and Prevention of Ventilator-associated pneumonia

MDR AGENTS: RISK FACTORS AND THERAPEUTIC STRATEGIES

Pneumonia Severity Scores:

Andrea Blotsky MDCM FRCPC General Internal Medicine, McGill University Thursday, October 15, 2015

Chronic Obstructive Pulmonary Disease (COPD) Clinical Guideline

Emergency Medicine High Velocity Nasal Insufflation (Hi-VNI) VAPOTHERM POCKET GUIDE

Patient information: Pneumonia in adults (Beyond the Basics)

New Surveillance Definitions for VAP

Diagnostic Approach to Pleural Effusion

Update in Hospital Medicine. Update in Hospital Medicine 2009

Oxygen prescription and administration at the Emergency Department and medical wards in Mater Dei Hospital

Quality Outcomes and Financial Benefits of Nutrition Intervention. Tracy R. Smith, PhD, RD, LD Senior Clinical Manager, Abbott Nutrition

Endobronchial valve insertion to reduce lung volume in emphysema

Standard emergency department care vs. admission to an observation unit for low-risk chest pain patients. A two-phase prospective cohort study

A Study Conducted At A Tertiary Care Teaching Institute in Chennai, on The Clinical And Etiological Profile Of Patients With Acute Heart Failure.

TENNCARE Bundled Payment Initiative: Description of Bundle Risk Adjustment for Wave 4 Episodes

Non-Invasive PCO 2 Monitoring in Infants Hospitalized with Viral Bronchiolitis

ACG Clinical Guideline: Management of Acute Pancreatitis

ACUTE HEART FAILURE in the ED. Pr. Samir Nouira Emergency Department Fattouma Bourguiba University Hospital Monastir Tunisia

Community-Acquired Acinetobacter baumannii Pneumonia: Initial Chest Radiographic Findings and Follow-up CT Findings in Helping Predict Patient Outcome

In-Patient Sleep Testing/Management Boaz Markewitz, MD

Pneumonia in the Hospitalized

TENNCARE Bundled Payment Initiative: Description of Bundle Risk Adjustment for Wave 8 Episodes

Chapter 10: Diseases of the Respiratory System J 00-J99

Quality Data on Core Measures

AECOPD: Management and Prevention

Management of Acute Exacerbations of COPD

ICD-10 Physician Education. Palliative Care SIP

TOTAL HIP AND KNEE REPLACEMENTS. FISCAL YEAR 2002 DATA July 1, 2001 through June 30, 2002 TECHNICAL NOTES

COPD Management in LTC: Presented By: Jessica Denney RRT

PULMONARY MEDICINE BOARD REVIEW. Financial Conflicts of Interest. Question #1: Question #1 (Cont.): None. Christopher H. Fanta, M.D.

Yale New Haven Health Services Corporation/Center for Outcomes Research and Evaluation (YNHHSC/CORE)

Transcription:

ORIGINAL INVESTIGATION Antibiotic Timing and Errors in Diagnosing Pneumonia James A. Welker, DO; Michelle Huston, MD; Jack D. McCue, MD Background: The percentage of patients with community-acquired pneumonia (CAP) whose time to first antibiotic dose (TFAD) is less than 4 hours of presentation to the emergency department (ED) has been made a core quality measure, and public reporting has been instituted. We asked whether these time pressures might also have negative effects on the accuracy of diagnosis of pneumonia. Methods: We performed a retrospective review of adult admissions for CAP for 2 periods: group 1, when the core quality measure was a TFAD of less than 8 hours; and group 2, when the TFAD was lowered to less than 4 hours. We examined the accuracy of diagnosis of CAP by ED physicians. Results: A total of 548 patients diagnosed as having CAP were studied (255 in group 1 and 293 in group 2). At admission, group 2 patients were 39.0% less likely to meet predefined diagnostic criteria for CAP than were group 1 patients (odds ratio, 0.61; 95% confidence interval, 0.42-0.86) (P=.004). At discharge, there was agreement between the ED physician s diagnosis and the predefined criteria for CAP in 62.0% of group 1 and 53.9% of group 2 patients (P=.06) and between the ED physician s admitting diagnosis and that of the discharging physician in 74.5% of group 1 and 66.9% of group 2 patients (P=.05). The mean (SD) TFAD was similar in group 1 (167.0 [118.6] minutes) and group 2 (157.8 [96.3] minutes). Conclusion: Reduction in the required TFAD from 8 to 4 hours seems to reduce the accuracy by which ED physicians diagnose pneumonia, while failing to reduce the actual TFAD achieved for patients. Arch Intern Med. 2008;168(4):351-356 Author Affiliations: Department of Medicine, University of Maryland School of Medicine, and Franklin Square Clinical Research Center, Franklin Square Hospital Center, Baltimore (Dr Welker); Department of Emergency Medicine, Franklin Square Hospital Center (Dr Huston); and Department of Medicine, University of California, San Francisco (Dr McCue). A DOOR-TO-NEEDLE TIME OF lessthan4hoursfortheempirical administration of antibiotics for communityacquired pneumonia(cap) is one of the core measures by which hospitals and physicians are evaluated for the quality of their care by the Centers for Medicare& MedicaidServices, thehospitalqualityalliance,andthejointcommission 1 (data For editorial comment see page 347 available at http://www.jointcommission.org/performancemeasurement/ [accessed February 11, 2007]). The percentage of patients with CAP with a time to first antibiotic dose (TFAD) within 4 hours of presentation is publicly reported for individual hospitals on the Internet at sites such as http://www.hospitalcompare.hhs.gov/ (accessed February 11, 2007). Hospitals with lower scores may suffer in reputation and reimbursement, 2 which may create a sense of urgency for making a diagnosis and instituting antibiotic therapy in emergency department (ED) patients with respiratory symptoms. 3-5 This decision to make TFAD for CAP a core quality measure was based on retrospective analyses 6-9 that showed improved outcomes in patients who received antibiotics within 8 or 4 hours of presentation. Time pressures to reduce TFAD, however, can lead to errors in diagnosis that could result in unnecessary antibiotic use for patients who do not have CAP, premature closure in decision making, and biasing of subsequent clinical problem solving. 10 Potential gains in morbidity and mortality by prompt antibiotic therapy could be counterbalanced by inappropriate treatment of patients misdiagnosed as having CAP and by delays and added costs in making the correct diagnosis. Indeed, the excessive use of a hospital s new pneumonia care plan may have contributed to a severe outbreak of Clos- 351

tridium difficile infection. Medical record review of this outbreak identified that half of the patients being treated for pneumonia may not have had pneumonia. 11 These unintended consequences of performance measurements must be considered when governmental agencies choose how to measure and reward institutions. We describe a retrospective analysis of patients admitted to a medium-size community teaching hospital with a diagnosis of CAP in 2 periods of time: one period in which the TFAD quality standard was less than 8 hours and one period after the TFAD standard had been lowered to less than 4 hours. We asked whether the pressure to decrease the TFAD from 8 to 4 hours might adversely affect accuracy of diagnosis and could paradoxically increase overall morbidity of patients empirically treated for CAP. METHODS A retrospective medical record analysis included patients older than 18 years who were diagnosed by the ED physician as having pneumonia and who were admitted to Franklin Square Hospital Center from November 1, 2003, through April 30, 2004 (group 1), and from November 1, 2004, through April 30, 2005 (group 2). These periods were chosen to correspond to the Maryland Healthcare Association s quality initiatives, in which the recommended TFAD for pneumonia was 8 and 4 hours from arrival at the hospital, respectively. In addition, an educational initiative regarding the new 4-hour TFAD expectation and responsibility for achieving it was given to the ED physicians in October 2004. Because we were aware that this period experiences hospital censuses exceeding capacity and that patients have an increased prevalence of respiratory symptoms that may influence the diagnostic accuracy rates, we controlled for this effect by choosing identical periods during the years studied for our comparison groups. Franklin Square Hospital Center is a 365-bed university-affiliated community teaching hospital in a socioeconomically diverse area of Baltimore, with approximately 100 000 ED visits each year, of which nearly 8000 result in admission to the acute care medical wards. Patients with pneumonia who were admitted to the hospital through the ED were identified according to the ED physicians admission diagnoses of pneumonia. However, an ED patient care associate is responsible for entering the ED physician s admission diagnosis into the hospital database (a potential source of error). Once entered, this admission diagnosis cannot be edited. Patients were identified via a query of this hospital admission diagnosis database using the search terms pneumonia, CAP, and NHAP (nursing home acquired pneumonia). From an alphabetical list of all patients with an admission diagnosis of pneumonia, every other patient was chosen for the medical record review. Patients with more than 1 hospitalization for pneumonia during one of the specified 6-month periods had only their first hospitalization during that period reviewed. Data were abstracted from electronic and paper medical records by 2 attending physicians ( J.A.W. and M.H.) and 2 medical students supervised by those same physicians. Length of stay and charges were obtained from the database of CareScience (Philadelphia, Pennsylvania). Interobserver variability was minimized by the use of an Internet database with electronic tools that identified potentially inaccurate entries and the senior author s review ( J.A.W.) of each record for completeness and accuracy before locking the database. The primary outcome measured was to test the null hypothesis that the accuracy of the ED physicians admission diagnoses of pneumonia would not change before and after the core quality measure reduction of the goal: TFAD from less than 8 hours to less than 4 hours from arrival at the ED. The secondary outcome was to test the null hypothesis that efforts to administer antibiotics within 4 hours of admission would not have an adverse effect in patients who were misdiagnosed as having pneumonia by the ED physicians during the 2 periods. Examining whether earlier administration of antibiotics was beneficial in patients who were accurately diagnosed as having pneumonia was not an outcome measured in this study. Precise criteria for the diagnosis of pneumonia are not available and had to be developed. We based our criteria on those found in Food and Drug Administration directed clinical trials. Pneumonia was considered present when the medical record documented the presence of all 3 of the following criteria: (1) the presence of a new or increasing infiltrate by chest radiograph or computed tomographic scan; (2) plus a temperature greater than 38.0 C or less than 35.1 C or a total white blood cell count greater than 10/µL or less than 4.5/µL (to convert to cell count 10 9 /L, multiply by 0.001), or immature polymorphonuclear leukocytes (bands) greater than 15%; and (3) plus 2 of cough, dyspnea, pleuritic chest pain, tachypnea with respirations of 30/ min or greater, hypoxia with pulse oximetry of less than 90% or PaO 2 of less than 60 mm Hg, auscultatory findings of pneumonia, including rales, dullness of percussion, bronchial breath sounds, or egophony, or newly required mechanical ventilation by either intubation or noninvasive ventilation. The primary outcome was tested in 3 ways: (1) Did the patient have a diagnosis of pneumonia at discharge? (2) Did the patient meet our predetermined diagnostic criteria for the diagnosis of pneumonia at admission? (3) At discharge, did the patient s entire medical record support the admission diagnosis of pneumonia according to our predefined criteria? Secondary outcomes were assessed by examining antibioticassociated adverse events, including allergic reactions, iatrogenic injuries, and associated morbidity and mortality; length of stay and charges; and delays in documenting the patient s correct diagnosis. Morbidity was broadly defined as any adverse outcome that resulted from a treatment either provided or withheld while the patient was incorrectly diagnosed as having CAP. This includes a reaction or adverse effect to a medication given for CAP or an outcome that is likely the result of the delay in treatment (ie, an antibiotic-associated adverse drug reaction or increasing ventilator support requirements of a patient with congestive heart failure who was given intravenous fluids rather than diuretics). A diagnostic delay was recorded when the diagnosis that persisted through hospital discharge was recorded in the medical record by a physician more than 24 hours after the admission history and physical were completed. Because all patients were admitted by a medical resident, a hospitalist, or a physician s assistant, the medical history and physical examination were routinely completed within 6 hours of admission. All patients were seen by an attending physician within 24 hours and typically in less than 8 hours of arrival to the ED. Delay in diagnosis was considered not to be present if the correct diagnosis was documented anywhere in the medical record in the first 24 hours of hospitalization or in any of the admission history and physical notes on the first or second days of hospitalization. The sample size determination used a commercially available software program (SPSS for Windows; SPSS Inc, Chicago, Illinois [available at http://www.spss.com/spss/ and accessed February 11, 2005]) to calculate a required sample size of 393 subjects. This is assuming =.05 (accepted type I error), power=0.80, =0.10 (detectable difference would be a 10% change in misdiagnosis rate), =0.5 (standard deviation within a sample population), and m=1 (ratio of study-control population). This also assumed the use of an independent t test. The 352

calculation offered an 80% chance of detecting an increase in error of admitting diagnosis that might be attributable to efforts to treat patients in less than 4 hours. Based on a preliminary assessment that demonstrated that, on average, 3 to 4 adults are admitted daily with pneumonia during the winter at Franklin Square Hospital Center, an estimated 500 or more study subjects were expected within each of the 6-month periods from November through April. Statistical analysis of baseline characteristics and outcomes included 2 analysis for categorical data. Continuous data were compared by t test, unless there was a large discrepancy from normal distribution, in which case a Mann-Whitney test was performed. The nonparametric Mann-Whitney test was required for the average time to antibiotics, average doses of antibiotics, average number of days patients received antibiotics, length of stay, and charges. RESULTS The total study population comprised 627 patients with an ED admission diagnosis of pneumonia, 286 who were admitted between November 1, 2003, and April 31, 2004 (group 1), and 341 who were admitted between November 1, 2004, and April 31, 2005 (group 2). Our medical record review, however, revealed that only 255 (89.2%) of the 2003-2004 patients and 293 (85.9%) of the 2004-2005 patients had actually been diagnosed as having CAP by the ED physician. This discrepancy represents a data entry error rate of 10.8% and 14.1% by our ED patient care associates, respectively, which was not statistically significantly different for the 2 periods. We also did a random sampling of 100 admissions of patients who arrived during the 2 periods and had a diagnosis assigned by the ED patient care associate other than CAP, and found no instances in which the ED physician had actually diagnosed CAP. The CAP admissions we studied constituted 255 of 7060 (3.6%) and 293 of 7743 (3.8%) of the total ED admissions during the 2 fiscal periods. The annualized estimate of total numbers of admissions for CAP (applying the 89.2% and 85.9% correction factors for incorrect assignment of diagnosis by ED patient care associates) was 1020 of 7060 (14.4%) and 1172 of 7743 (15.1%) for fiscal years 2004 and 2005, respectively. The baseline characteristics of the 2 patient populations were similar at presentation to the ED (Table 1), and there was no difference in TFAD between group 1 and group 2. The agreement of the ED admission diagnosis with predefined criteria for CAP (Table 2) was poor in group 1 ( 8-hour TFAD expectation) and group 2 ( 4-hour TFAD expectation) patients: when compared with predefined diagnostic criteria for CAP at admission, the ED physician s diagnosis was accurate 45.9% of the time from November 2003 to April 2004 and 33.8% of the time from November 2004 to April 2005. The odds ratio of the ED physician s diagnosis satisfying the predefined diagnostic criteria for CAP at admission was 0.61 (95% confidence interval, 0.42-0.86) when comparing group 2 with group 1 patients, indicating that admissions were 39.0% less likely to meet predefined diagnostic criteria for CAP when diagnosed during the less than 4-hour TFAD as opposed to the less than 8-hour TFAD. Table 1. Baseline Characteristics of 548 Patients Admitted With an ED Diagnosis of CAP in 2 Periods a Characteristic Group 1 (n=255) Group 2 (n=293) P Value Age range, y 18-98 19-101 NA Age, y b 70.04 (16.1) 68.66 (17.1).32 Male sex 124 (48.6) 142 (48.5).97 Nursing home residence 40 (15.7) 40 (13.7).51 CPR status was full 227 (89.0) 255 (87.0).48 code Dementia 29 (11.4) 40 (13.7).42 Asthma 26 (10.2) 39 (13.3).32 Chronic obstructive 111 (43.5) 112 (38.2).21 pulmonary disease Lung cancer 13 (5.1) 16 (5.5).84 History of other lung 48 (18.8) 51 (17.4).66 disease Recent admission for 37 (14.5) 37 (12.6).52 CAP Tobacco use 138 (54.1) 158 (53.9).96 Alcoholism 9 (3.5) 21 (7.2).06 Intravenous drug use 6 (2.4) 10 (3.4).46 Coronary artery disease 90 (35.3) 103 (35.2).97 Congestive heart failure 61 (23.9) 75 (25.6).65 Chronic renal disease 25 (9.8) 32 (10.9).67 Liver disease 6 (2.4) 3 (1.0).22 Nonlung neoplastic 28 (11.0) 21 (7.2).19 disease Stroke (past or present) 39 (15.3) 54 (18.4).33 Diabetes mellitus type 1 68 (26.7) 85 (29.0).54 or 2 Immunocompromise 26 (10.2) 46 (15.7).06 PORT score b 120.88 (46.2) 114.71 (45.0).12 PORT score 90 186 (72.9) 196 (66.9).12 TFAD, min b 167.7 (118.6) 157.8 (96.3).55 Patients with TFAD 4 h 208 (81.6) 250 (85.3).21 In-hospital mortality 21 (8.2) 19 (6.5).43 Antibiotic therapy, 5.35 5.39.72 average, d Patients not receiving 7 (2.7) 3 (1.0).13 antibiotics in the ED Hospital length of stay, d b 5.0 (4.8) 5.4 (5.4).64 Hospital charges, $ b 10 212 (15 135) 11 374 (15 951).22 Abbreviations: CAP, community-acquired pneumonia; CPR, cardiopulmonary resuscitation; ED, emergency department; NA, data not applicable; PORT, Pneumonia Outcomes Research Trial 12 ; TFAD, time to first antibiotic dose. a Data are given as number (percentage) of each group unless otherwise indicated. Group 1 was studied from November 1, 2003, through April 30, 2004; and group 2, from November 1, 2004, through April 30, 2005. b Data are given as mean (SD). When the agreement with predefined criteria for CAP was assessed using all information available at discharge, the ED physician s diagnosis met the predefined criteria for CAP 62.0% of the time in group 1 and 53.9% of the time in group 2 patients, a difference that approached statistical significance (Table 2). When comparing agreement between the ED physician s admitting diagnosis and that of the discharging physician, there was congruence in 74.5% of group 1 and 66.9% of group 2 patients. Notably, most of the non-cap discharge diagnoses are illnesses that receive no benefit from CAP antibiotics (Table 3). Patients who were admitted with a diagnosis of CAP but discharged with another diagnosis were more likely 353

Table 2. Accuracy of CAP Diagnosis by Emergency Department Physicians Variable Group 1 (n=255) a Group 2 (n=293) a P Value Discharge diagnosis of CAP 190 (74.5) 196 (66.9).05 Predefined criteria for diagnosis 117 (45.9) 99 (33.8).004 of CAP met at admission Predefined criteria for diagnosis of CAP met at discharge 158 (62.0) 158 (53.9).06 Abbreviation: CAP, community-acquired pneumonia. a Data are given as number (percentage) of each group. Group 1 was studied from November 1, 2003, through April 30, 2004; and group 2, from November 1, 2004, through April 30, 2005. Table 3. Correct Diagnosis as Identified by Physician at Discharge a Discharge Diagnosis Patients, % Acute bronchitis 25.2 Congestive heart failure 17.7 COPD exacerbation 17.0 Influenza 8.2 Urinary tract infection 3.4 Asthma exacerbation 2.7 Pulmonary embolism 2.7 Stroke syndrome or TIA 2.0 Short-term exacerbation of chronic bronchitis 1.4 Constipation 1.4 Endocarditis 1.4 Gastroenteritis 1.4 Pancreatitis 1.4 Pneumothorax 1.4 Rheumatoid lung disease 1.4 Amiodarone lung toxicity 0.7 Anorexia following recent abdominal surgery 0.7 Aspiration without pneumonia 0.7 Atrial fibrillation 0.7 Brachial plexus neuropathy 0.7 Bronchiolitis obliterans organizing pneumonia 0.7 Catheter-associated bacteremia 0.7 Clostridium difficile colitis 0.7 Drug overdose 0.7 Hepatic encephalopathy 0.7 Inactive tuberculosis 0.7 Mental retardation without acute illness 0.7 Pleural effusion 0.7 Pulmonary granulomas 0.7 Sinusitis 0.7 Squamous cell lung cancer 0.7 Streptococcal pharyngitis 0.7 Abbreviations: COPD, chronic obstructive pulmonary disease; TIA, transient ischemic attack. a There was benefit from community-acquired pneumonia antibiotics for urinary tract infection, endocarditis, catheter-associated bacteremia, sinusitis, and streptococcal pharyngitis. Benefit was debatable for COPD exacerbation and short-term exacerbation of chronic bronchitis. to experience a delay in diagnosis in group 2 compared with group 1: 20.1% vs 13.3% (P=.03). Analysis of the mortality and morbidity of the 232 patients who were judged not to have had CAP at discharge when the predefined criteria were applied (Table 4) revealed no significant differences between the 2 groups. While there Table 4. Mortality and Morbidity of the Patients Who Were Admitted With an Emergency Department Diagnosis of CAP but Who Did Not Have a Diagnosis of CAP at Discharge by Predefined Diagnostic Criteria Variable Antibiotic-associated adverse drug events Delay in making the correct diagnosis Delay in treating the correct diagnosis Morbidity associated with delay in making the correct diagnosis Mortality in patients with delay in making the correct diagnosis are no benchmarks for comparison, it is notable that 28.0% of these patients experienced a delay in the establishment of the correct diagnosis. COMMENT Group 1 (n=97) a Group 2 (n=135) a Total b 4 (4.1) 2 (1.5) 6 (2.6) 24 (24.7) 41 (30.4) 65 (28.0) 10 (10.3) 9 (6.7) 19 (8.2) 3 (3.1) 1 (0.7) 4 (1.7) 1 (1.0) 2 (1.5) 3 (1.3) Abbreviation: CAP, community-acquired pneumonia. a Data are given as number (percentage) of each group. Group 1 was studied from November 1, 2003, through April 30, 2004; and group 2, from November 1, 2004, through April 30, 2005. b Data are given as number (percentage) of the total 232 patients. (These patients constituted 42.3% of the total 548 patients studied.) We examined the accuracy of diagnosis of CAP by ED physicians, as well as patient care outcomes, during 2 periods just before and just after the Centers for Medicare & Medicaid Services/Joint Commission standard for the treatment of CAP was tightened from a TFAD of less than 8 hours to a TFAD of less than 4 hours for patients admitted from the ED with a diagnosis of CAP. In particular, we asked whether the behavioral result of pressures to improve a TFAD, that might already have been optimal, could have undermined any positive outcomes. We were concerned that the new TFAD was inadvertently creating a time pressure by adding a deadline to the physicians decision-making process and thereby influencing the quality of their decisions. As Metersky et al 13 noted, when hospital reputation and pay-for-performance are at stake, only 100% adherence can ensure an institution is not outperformed by others. We demonstrated that only 70.4% of 548 patients with an ED admission diagnosis of CAP were discharged with a primary or secondary diagnosis of CAP, 39.4% had signs and symptoms that fulfilled the predefined criteria for CAP at admission, and 42.3% had clinical findings of CAP that met the predefined criteria at discharge. Therefore, depending on the rigor with which one assigns the diagnosis of CAP, nearly one-third to two-thirds of patients who were admitted and empirically treated for CAP seem not to have had that diagnosis at discharge. We also showed that accuracy of diagnosis of CAP by the ED physician, whether judged by predefined criteria or by the discharging physician s diagnosis, deteriorated in the period that had a less than 4-hour TFAD goal (group 2) (Table 2). 354

The mean (SD) TFAD was similar and substantially less than the core measure goals for group 1 (167.0 [118.6] minutes vs the goal of 480 minutes) and group 2 (157.8 [96.3] minutes vs the goal of 240 minutes); the percentage of patients who received antibiotics in less than 4 hours did show a minor increase from 81.3% to 85.6% that was not statistically significant. We believe that the 2 TFADs may well represent the best achievable in our ED and that the pressure to achieve a shorter TFAD in group 2 patients reduced the accuracy of diagnosis by ED physicians without significantly shortening the TFAD (Table 2). While instituting antibiotic therapy for CAP earlier likely generates better patient outcomes, the consequences of pressuring physicians and hospitals to administer antibiotics in less than 4 hours have not been tested prospectively. Consider that a TFAD of less than 4 hours has only been shown to benefit patients older than 65 years who have not received treatment before arrival at the ED. 5 While for hospital operations it is understandable to use this goal for all patients, from a quality viewpoint one must consider the unintended consequences of the universal application of this performance measurement. Our study adds to other recent studies 13,14 that challenge unquestioning acceptance of the validity and expectations set on hospitals of this well-meaning, but perhaps hastily implemented, criterion for quality of care. Furthermore, by identifying that 10 of 232 patients (4.3%) incorrectly diagnosed as having pneumonia will have an antibiotic-associated adverse drug reaction or other morbidity following a delay in arriving at the correct diagnosis, our study suggests that anecdotes of patients experiencing morbidity while incorrectly labeled as having CAP may be valid (Table 4). The fundamental problem in any study of pneumonia is that there are no gold standards or universally accepted criteria for the diagnosis of CAP. Consider the association of a prolonged hospital length of stay with an increased TFAD. 15 In their study, patients were considered to have CAP based on the diagnosis of the ED physician, and the influence of the decreased diagnostic accuracy we found associated with a decreased TFAD is unknown. For example, if patients with a shorter TFAD were more likely to have bronchitis rather than CAP, this may shorten this group s length of stay. A strength of our study is that we examined outcomes for patients meeting predefined criteria for the diagnosis of CAP based on requirements in Food and Drug Administration approved studies for enrollment of patients into trials of new antibiotics for respiratory tract infections. Prior studies have typically required only a physician s working diagnosis of pneumonia at admission and a chest radiograph indicating a new infiltrate. 16 We believe that these are inadequate diagnostic criteria for CAP for modern hospital medicine. It was our experience in enrolling patients into clinical trials that the predefined criteria we used were, in fact, flexible, reasonable, and accurate diagnostic standards. We question, moreover, whether most patients who do not fulfill these criteria can legitimately be considered to have a secure enough diagnosis of pneumonia to justify treatment with empirical antibiotics for that diagnosis. Other strengths of our study are that the cases were drawn from an urban and a suburban population that was racially and socioeconomically balanced and that considerable effort was put into ensuring accuracy of data collection. Although we took steps to minimize interobserver reliability, the absence of statistics documenting this result is a study weakness. Another weakness is the retrospective design of this study; as Houck 3 points out, however, it may no longer be ethically possible to perform a prospective study of timing of antibiotics for CAP. Recently, the appropriateness of a performance target of 100% has been challenged by Metersky et al, 13 and the scientific basis for asserting that a TFAD is a modifiable predictor of CAP-related morbidity and mortality has been challenged by Waterer et al. 14 By suggesting that time pressures from implementation of a TFAD quality standard of less than 4 hours failed to improve the TFAD, but was responsible for a deterioration in diagnostic accuracy of pneumonia in our ED, our data support their skepticism. Consistent with these concerns, the latest version of guidelines for the management of adult patients with CAP by the Infectious Diseases Society of America/American Thoracic Society 17 has advised that patients receive antibiotics in the ED, rather than specifying a number of hours for the TFAD. The potential morbidity and mortality resulting from an increased number of incorrect diagnoses, inappropriate antibiotic therapy, and delays in establishing the correct diagnosis in patients who do not have CAP must be considered if a TFAD of less than 4 hours is considered to be a core quality measure. We conclude that the lack of prospective trials, the lack of prior consideration of the effect of inaccurate diagnoses of CAP resulting from pressure to decrease TFAD, and the lack of a credible gold standard for the diagnosis of pneumonia cast doubt on the validity of TFAD as a reliable criterion of quality of care. Accepted for Publication: August 6, 2007. Correspondence: James A. Welker, DO, Franklin Square Hospital Center, 9000 Franklin Square Dr, Baltimore, MD 21237 (jimwelker@hotmail.com). Author Contributions: All authors had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Welker, Huston, and McCue. Acquisition of data: Welker, Huston, and McCue. Analysis and interpretation of data: Welker, Huston, and McCue. Drafting of the manuscript: Welker and McCue. Critical revision of the manuscript for important intellectual content: Welker, Huston, and McCue. Statistical analysis: Welker and Huston. Obtained funding: Welker. Administrative, technical, and material support: Welker, Huston, and McCue. Study supervision: Welker, Huston, and McCue. Financial Disclosure: None reported. Funding/Support: This study was supported by an unrestricted research grant from Pfizer US Pharmaceuticals. Role of the Sponsor: The funding body had no role in the design and conduct of the study; in the collection, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript. 355

Additional Contributions: Medical students Katherine Sullivan and Christopher Mitchell spent countless hours participating in the medical record review process; and Norman Dubin, PhD, provided statistical analysis. REFERENCES 1. Rollow W, Lied TR, McGann P, et al. Assessment of the Medicare quality improvement organization program. Ann Intern Med. 2006;145(5):342-353. 2. Lindenauer PK, Remus D, Roman S, et al. Public reporting and pay for performance in hospital quality improvement. N Engl J Med. 2007;356(5):486-496. 3. Houck PM. Antibiotics and pneumonia: is timing everything or just a cause of more problems? Chest. 2006;130(1):1-3. 4. Houck PM, Bratzler DW. Administration of first hospital antibiotics for communityacquired pneumonia: does timeliness affect outcomes? Curr Opin Infect Dis. 2005; 18(2):151-156. 5. Houck PM, Bratzler DW, Nsa W, Ma A, Bartlett JG. Timing of antibiotic administration and outcomes for Medicare patients hospitalized with communityacquired pneumonia. Arch Intern Med. 2004;164(6):637-644. 6. Houck PM, Bratzler DW, Niederman M, Bartlett JG. Pneumonia treatment process and quality. Arch Intern Med. 2002;162(7):843-844. 7. Meehan TP, Fine MJ, Krumholz HM, et al. Quality of care, process, and outcomes in elderly patients with pneumonia. JAMA. 1997;278(23):2080-2084. 8. Kahn KL, Keeler EB, Sherwood MJ, et al. Comparing outcomes of care before and after implementation of the DRG-based prospective payment system. JAMA. 1990;264(15):1984-1988. 9. McGarvey RN, Harper JJ. Pneumonia mortality reduction and quality improvement in a community hospital. QRB Qual Rev Bull. 1993;19(4):124-130. 10. Kassirer JP, Gorry GA. Clinical problem solving: a behavioral analysis. Ann Intern Med. 1978;89(2):245-255. 11. Polgreen PM, Chen YY, Cavanaugh JE, et al. An outbreak of severe Clostridium difficile associated disease possibly related to inappropriate antimicrobial therapy for community-acquired pneumonia. Infect Control Hosp Epidemiol. 2007; 28(2):212-214. 12. Fine MJ, Smith MA, Carson CA, et al. Prognosis and outcomes of patients with community-acquired pneumonia: a meta-analysis. JAMA. 1996;275(2):134-141. 13. Metersky ML, Sweeney TA, Getzow MB, Siddiqui F, Nsa W, Bratzler DW. Antibiotic timing and diagnostic uncertainty in Medicare patients with pneumonia: is it reasonable to expect all patients to receive antibiotics within 4 hours? Chest. 2006;130(1):16-21. 14. Waterer GW, Kessler LA, Wunderink RG. Delayed administration of antibiotics and atypical presentation in community-acquired pneumonia. Chest. 2006; 130(1):11-15. 15. Battleman DS, Callahan M, Thaler HT. Rapid antibiotic delivery and appropriate antibiotic selection reduce length of hospital stay of patients with communityacquired pneumonia: link between quality of care and resource utilization. Arch Intern Med. 2002;162(6):682-688. 16. Metersky ML, Ma A, Bratzler DW, Houck PM. Predicting bacteremia in patients with community-acquired pneumonia. Am J Respir Crit Care Med. 2004;169 (3):342-347. 17. Mandell LA, Wunderink RG, Anzueto A, et al; Infectious Diseases Society of America; American Thoracic Society. Infectious Diseases Society of America/American Thoracic Society Consensus Guidelines on the Management of Community- Acquired Pneumonia in Adults. Clin Infect Dis. 2007;44(suppl 2):S27-S72. 356