CLINICAL SCIENCES. Cost-Utility Analysis of Telemedicine and Ophthalmoscopy for Retinopathy of Prematurity Management

Transcription

1 CLINICAL SCIENCES Cost-Utility Analysis of Telemedicine and Ophthalmoscopy for Retinopathy of Prematurity Management Kevin M. Jackson, OD, MPH; Karen E. Scott, MD, MBA; Joshua Graff Zivin, PhD; David A. Bateman, MD; John T. Flynn, MD; Jeremy D. Keenan, MD, MPH; Michael F. Chiang, MD Objective: To evaluate the cost-effectiveness of telemedicine and standard ophthalmoscopy for retinopathy of prematurity (ROP) management. Methods: Models were developed to represent ROP examination and treatment using telemedicine and standard ophthalmoscopy. Cost-utility analysis was performed using decision analysis, evidence-based outcome data from published literature, and present value modeling. Visual outcome data were converted to patient preference based time trade-off utility values based on published literature. Costs of disease management were determined based on 2006 Medicare reimbursements. Costs per quality-adjusted life year gained by telemedicine and ophthalmoscopy for ROP management were compared. One-way sensitivity analysis was performed on the following variables: discount rate (0%-7%), incidence of treatment-requiring ROP (1%-20%), sensitivity and specificity of ophthalmoscopic diagnosis (75%- 100%), percentage of readable telemedicine images (75%- 100%), and sensitivity and specificity of telemedicine diagnosis (75%-100%). Results: For infants with birth weight less than 1500 g using a 3% discount rate for costs and outcomes, the costs per quality-adjusted life year gained were $3193 with telemedicine and $5617 with standard ophthalmoscopy. Sensitivity analysis resulted in ranges of costs per qualityadjusted life year from $1235 to $ for telemedicine and from $2171 to $ for ophthalmoscopy. Conclusions: Telemedicine is more cost-effective than standard ophthalmoscopy for ROP management. Both strategies are highly cost-effective compared with other health care interventions. Arch Ophthalmol. 2008;126(4): Author Affiliations: Department of Health Policy and Management, Mailman School of Public Health (Drs Jackson and Graff Zivin), and Division of Neonatology (Drs Scott and Bateman) and Departments of Ophthalmology (Drs Flynn, Keenan, and Chiang) and Biomedical Informatics (Dr Chiang), College of Physicians and Surgeons, Columbia University, New York, New York. RETINOPATHY OF PREMATUrity (ROP) is a vasoproliferative disease affecting infants with low birth weight (BW). Progress has occurred in validation of treatment modalities through the Cryotherapy for ROP 1 (CRYO-ROP) and Early Treatment for ROP 2 studies and in development of an international classification system. 3,4 However, ROP continues to be a leading cause of childhood blindness throughout the world. Current diagnostic methods consisting of ophthalmoscopic examinations at the neonatal intensive care unit bedside are logistically difficult and often impractical. Retinopathy of prematurity presents a growing medical and public health problem. Recently published guidelines have expanded the number of infants requiring surveillance. 5,6 The rate of premature births in the United States has risen from 9.4% to 12.7% since 1981, 7 and worldwide ROP incidence has increased as neonatal mortality declines. 8,9 Furthermore, fewer physicians are available to perform these examinations. A 2006 American Academy of Ophthalmology survey found that only 50% of pediatric ophthalmologists and retinal specialists are managing ROP and that more than 20% plan to stop because of concerns about medicolegal liability and inadequate reimbursements. 10 Store-and-forward telemedicine is an emerging technology in which medical data are captured for subsequent interpretation by a remote expert. 11 Studies have shown that telemedicine has extremely high accuracy and reliability for identification of clinically significant ROP, including when images are captured by trained neonatal personnel. 20,21 This suggests that telemedicine might play a role in improving delivery of ROP care. However, most American telemedicine projects conducted before 1990 were discontinued after their initial funding ran out, largely because they were too expensive to be self-sustaining. 11,22,23 Research involving the cost-effectiveness of telemedicine has been very limited This is an 493

2 Interpretable Referral [+] Treatment No treatment Correctly treated Incorrectly treated Correctly untreated Incorrectly untreated Telemedicine No referral Correctly untreated Incorrectly untreated All infants Not interpretable [+] Ophthalmoscopy [+] Figure. Decision-analysis tree for retinopathy of prematurity management using telemedicine and standard ophthalmoscopy. Published literature is used to assign outcome probabilities at each branch point and to determine visual outcome utility values at the right side of the terminal nodes (triangles). The bottom 2 legs follow a path identical to that of the Referral leg above ( ). Table 1. Key Clinical and Economic Assumptions for Cost-Utility Analysis of Retinopathy of Prematurity Management Using Telemedicine and Standard Ophthalmoscopy Assumption Infants require an average of 5 examinations to determine whether treatment-requiring ROP develops. A telemedicine system would refer all cases of type 2 prethreshold disease or worse to an experienced ophthalmologist for examination. Infants found to have treatment-requiring ROP receive 1 session of laser photocoagulation to the affected eye(s), and visual outcomes are modeled based on results from published literature. Sensitivity and specificity of telemedicine and standard ophthalmoscopy for detection of treatment-requiring ROP are imperfect and are modeled based on results from published literature. Telemedicine imaging by trained, nonophthalmic staff produces photographs of acceptable quality for bilateral interpretation in 95% of patients. Visual acuity in the study population remains stable throughout life, and all patients have an average life expectancy of 77.5 y. Abbreviation: ROP, retinopathy of prematurity. important gap in knowledge because long-term viability of telemedicine systems will likely depend on economic and cost-benefit tradeoffs. Cost-utility analysis is a method that quantifies costs against value gained by medical interventions. 27,28 Utility values are established to represent the patientperceived quality of life associated with a disease state, ranging from 1.0 (perfect health) to 0.0 (death). These utilities have high construct validity and are stable across sex, ethnicity, education, medical specialty, and presence of comorbidities. 28 The value resulting from an intervention is expressed in quality-adjusted life years (QALYs), which are defined as improvement in utility multiplied by the duration of benefit. 29 This article describes a cost-utility analysis comparing telemedicine with standard ophthalmoscopy for ROP management as measured by dollars expended per QALY gained. METHODS OVERVIEW This study was approved by the Columbia University Institutional Review Board. Two ROP management strategies were analyzed from a third-party payer perspective compared with no intervention: (1) standard examinations by an experienced ophthalmologist; and (2) telemedicine examinations by nonophthalmic personnel using wide-angle imaging devices (RetCam- II; Clarity Medical Systems, Pleasanton, California) with interpretation by a remote ophthalmologist. Software from TreeAge, Inc (Williamstown, Massachusetts) was used to create decision tree models for each scenario (Figure). Patients enter the tree at the left side and progress along 1 path until reaching a terminal node on the right side. Probabilities at each branch point along with visual outcomes and associated utility values at terminal nodes are based on published literature. Table 1 shows key clinical and economic assumptions. PATIENT POPULATION The CRYO-ROP and Early Treatment for ROP trials provided data regarding visual outcomes, disease incidence, and natural history for patients with BW less than 1251 g. 1,2,30-32 However, current guidelines state that all infants with BW less than 1500 g or gestational age of 30 weeks or less require examination. 6 In this study, baseline analysis is performed for infants with BW less than 1251 g and results are extrapolated for infants with BW less than 1500 g. Among infants with BW less than 1251 g, the CRYO-ROP trial found that 65.8% had ROP, 17.8% had prethreshold disease or worse, and 6.0% had threshold disease. 31 The Early Treatment for ROP trial determined that 49.3% of prethreshold ROP was type We define treatment-requiring ROP as threshold 494

3 or type 1 disease, which represents 11.9% (where 6.0% [0.493 (17.8% 6.0%)]=11.9%) of infants with BW less than 1251 g. Premature infants are typically examined every 1 to 2 weeks until diagnosis of either full vascularization or treatmentrequiring ROP. 6 This study assumes that all infants receive a total of 5 examinations and that infants with telemedicine who develop type 2 ROP or worse receive 3 telemedicine examinations before referral, followed by 2 ophthalmoscopic examinations. ACCURACY OF TELEMEDICINE AND OPHTHALMOSCOPIC EXAMINATIONS A practical telemedicine strategy would likely require image capture by trained neonatal personnel using a commercially available camera. One study 15 showed that 6% of photographs captured using the RetCam were unreadable on initial imaging, and another 16 showed that 95.4% of patients had acceptable images captured within the first 2 attempts. Therefore, this study assumes that readable images are captured in 95% of patients and that infants with unreadable images are referred for standard ophthalmoscopy. In our telemedicine model, all patients believed by remote experts to have type 2 ROP or worse are referred for ophthalmoscopy and further appropriate management. We have previously shown that the mean sensitivity and specificity for detection of treatment-requiring ROP, when remote graders believe that images represent type 2 ROP or worse, are and 0.902, respectively. 13 Based on an 11.9% incidence of treatmentrequiring ROP among patients with BW less than 1251 g, 31,32 the positive predictive value among these referrals (ie, the fraction of patients referred for type 2 ROP or worse who truly have treatment-requiring ROP) was calculated by Bayes theorem to be Similarly, the negative predictive value (ie, the fraction of patients not referred who truly do not have treatmentrequiring ROP) was calculated to be Although ophthalmoscopic examination is a standard technique, 5,6 we have shown that there is significant variability in accuracy and agreement, even among recognized experts, for identifying treatment-requiring ROP. 34,35 Following previously used methods, 24 this study assigns sensitivity and specificity for ophthalmoscopic diagnosis of treatment-requiring ROP equal to those of diagnosis by image interpretation (0.867 and 0.962, respectively). 12 VISUAL OUTCOMES AND UTILITY SCORES Table 2. Weighted Visual Acuity Outcome Levels and Associated Utility Values Used to Calculate Cost-Effectiveness of Telemedicine and Standard Ophthalmoscopic Retinopathy of Prematurity Examinations a Outcome Visual Acuity Utility Value Correctly treated b 20/ Correctly untreated c 20/ Incorrectly treated c 20/ Incorrectly untreated d 20/ a Correctly treated means that an infant with treatment-requiring retinopathy of prematurity received laser photocoagulation. Correctly untreated means that an infant without treatment-requiring retinopathy of prematurity did not receive laser photocoagulation. Incorrectly treated means that an infant without treatment-requiring retinopathy of prematurity received laser photocoagulation. Incorrectly untreated means that an infant with treatment-requiring retinopathy of prematurity did not receive laser photocoagulation. Data are obtained from published literature and are shown in this table for a population of infants with birth weight less than 1500 g. b Data are from the article by Ng et al. 36 c Data are from the article by the Cryotherapy for Retinopathy of Prematurity Cooperative Group. 37 d Data are from the article by Palmer et al. 30 Four possible outcomes were defined (Table 2): (1) correctly treated (infant with treatment-requiring ROP received laser photocoagulation), which were assigned visual outcomes based on the study by Ng et al 36 that reported results 10 years after laser photocoagulation; (2) correctly untreated (infant without treatment-requiring ROP did not receive laser photocoagulation), which were assigned outcomes based on a natural history CRYO-ROP patient cohort with 5.5 years follow-up 37 ; (3) incorrectly treated (infant without treatment-requiring ROP received laser photocoagulation), which were assigned the same visual acuity outcomes as the correctly untreated group based on the assumption that laser photocoagulation for non treatment-requiring ROP neither improves nor worsens visual outcome on average; and (4) incorrectly untreated (infant with treatment-requiring ROP did not receive laser photocoagulation), which were assigned outcomes based on the CRYO-ROP untreated control group with 15 years follow-up. 30 Visual outcomes in the better-seeing eye were used for analysis based on findings from the CRYO-ROP study that 82.5% of infants with threshold ROP have bilateral disease. For the remaining 17.5% of infants with unilateral threshold disease, visual outcome in the untreated eye was assigned a value equal to that of the correctly untreated group described earlier. 37 Snellen visual acuities were converted to decimal visual acuities, which were then converted to utilities based on a published formula: utility=0.374x 0.514, where x is the decimal visual acuity. 38 For example, a Snellen visual acuity of 20/50 would have a decimal visual acuity of 0.4 and a utility of 0.664, and a Snellen visual acuity of 20/200 would have a decimal visual acuity of 0.1 and a utility of Based on published guidelines, 38,39 visual acuities reported as counting fingers, fix and follow, or centered, steady, maintained were assigned a decimal visual acuity of (utility, 0.523); visual acuities reported as hand motions or unsteady, unmaintained were assigned a decimal visual acuity of (utility, 0.519); and visual acuities of no light perception were assigned a decimal visual acuity of 0.0 (utility, 0.514). ADJUSTMENTS FOR INFANTS WITH BW LESS THAN 1500 g Adjustment for the population of infants with BW less than 1500 g required the following. First, ROP incidence was adjusted using BW data from the Vermont Oxford Network, a worldwide collaboration of more than 600 neonatal intensive care units. 40 From the Vermont Oxford Network registry, the ratio of infants with BW less than 1500 g to those with BW less than 1251 g is Because the percentage of infants with BW between 1251 and 1500 g who develop treatment-requiring ROP is extremely low, 42,43 we calculated an approximately 8.1% (or 11.9%/1.46) incidence of treatment-requiring ROP among infants with BW less than 1500 g. Second, positive and negative predictive values of telemedicine and ophthalmoscopy were recalculated using this 8.1% incidence. 33 Third, visual outcomes for the natural history cohort were adjusted with Vermont Oxford Network data, which show that 86% of infants with BW between 1251 and 1500 g have no ROP. 41 COSTS Medicare reimbursements from 2006 were used 44 because this is the most standard system for representing medical costs in 495

4 Table 3. Costs for Retinopathy of Prematurity Management Using Telemedicine and Standard Ophthalmoscopy Service CPT Code the United States. 27,28,38,45-47 Costs were determined by multiplying the 2006 conversion factor ( ) by the relative value unit of particular Current Procedural Terminology (CPT) codes. Specific costs were modeled (Table 3). First, ophthalmoscopy was represented as an inpatient consultation (CPT ) for initial examinations, as subsequent hospital care (CPT-99233) for follow-up examinations, and with extended ophthalmoscopy (CPT-92225/92226) for half of all examinations. Second, management of treatment-requiring ROP was represented as laser photocoagulation (CPT-67228), which was modeled as bilateral for 82.5% of patients and unilateral for 17.5%. 1 It was assumed that no additional hospitalization costs were associated with ROP care and that no costs would accrue after initial treatment because laser codes have a 3-month postoperative period. 44 Third, telemedicine examinations were represented as technical and professional fees for fundus photography (CPT-92250) COST-UTILITY AND PRESENT VALUE ANALYSIS Based on the probabilities and visual outcomes described earlier, the expected utility value of each strategy was determined. Costs per QALY gained from telemedicine and ophthalmoscopy compared with no intervention were determined. This benefit was applied over the lifetime of patients assuming that average life expectancy is 77.5 years and is unaffected by having treatment-requiring ROP. 51 It is well established in health care economic analysis that future outcomes must be discounted to their net present value because good present health can be used to generate future value In this study, all of the ROP management costs are modeled to occur in the present and all of the QALY outcomes are discounted at a 3% rate based on recommendations from the Panel on Costeffectiveness in Health and Medicine. 29,45 SENSITIVITY ANALYSIS Cost, 2006 USD Telemedicine Fundus photography, technical TC Fundus photography, professional Standard ophthalmoscopy Inpatient consultation a Subsequent hospital care a Extended ophthalmoscopy a Subsequent extended ophthalmoscopy a Laser retinal photocoagulation Abbreviation: CPT, Current Procedural Terminology. a Initial examinations are modeled as inpatient consultations, follow-up examinations are modeled as subsequent hospital care, and extended ophthalmoscopy is modeled in half of all of the examinations. Sensitivity analysis was used to determine the effect of changes in the baseline values described earlier on the costeffectiveness of each strategy. This was performed for discount rate (0%-7%), incidence of treatment-requiring ROP (1%- 20%), sensitivity and specificity for ophthalmoscopic detection of treatment-requiring ROP (75%-100%), percentage of readable telemedicine images (75%-100%), and sensitivity and specificity for remote detection of treatment-requiring ROP based on referral at a cutoff of type 2 disease or worse (75%-100%). Table 4. Reference Case Cost-Effectiveness in Costs per Quality-Adjusted Life Year Gained by Telemedicine and Standard Ophthalmoscopy for Retinopathy of Prematurity Management a Intervention All Infants With BW 1251 g One-way sensitivity analysis was performed for the population of infants with BW less than 1500 g. When changes in one variable inevitably affected values of other variables (eg, changes in sensitivity and specificity must affect positive and negative predictive values, changes in ROP incidence must affect outcome utility values), this was incorporated into the analysis. RESULTS Among infants with BW less than 1500 g, the discounted lifetime costs per QALY gained by telemedicine and ophthalmoscopy were $487/ ($3193/ QALY) and $646/ ($5617/QALY), respectively. Among infants with BW less than 1251 g, the discounted lifetime costs per QALY gained by telemedicine and ophthalmoscopy were $559/ ($2807/ QALY) and $703/ ($4410/QALY), respectively (Table 4). For infants with BW less than 1500 g, 1-way adjustments in parameter values resulted in costs per QALY gained from $1235 to $ for telemedicine and from $2171 to $ for ophthalmoscopy (Table 5). The telemedicine strategy was more cost-effective than ophthalmoscopy across all of the lower and upper limits of variables tested. COMMENT $/QALY Gained All Infants With BW 1500 g Telemedicine Standard ophthalmoscopy Abbreviations: BW, birth weight; QALY, quality-adjusted life year. a Data are shown for strategies in which all infants with BW less than 1251 g or less than 1500 g are examined for retinopathy of prematurity. Our key finding is that telemedicine is more costeffective than standard ophthalmoscopy for ROP management. This is the first study to our knowledge that has compared the cost-effectiveness of these 2 strategies from a third-party insurer perspective. As early as the 1950s, telemedicine pilot programs have been implemented using support from government agencies. Although these projects demonstrated clinical and technical feasibility of telemedicine, virtually all were terminated after their initial funding period because they were not economically self-sustaining. 23 In the United States, Medicare reimburses predominantly for realtime telemedicine encounters in rural areas, and many payers reimburse for store-and-forward interpretations in specialties such as radiology Not surprisingly, successful existing telemedicine programs have been established in locations where it is economically advanta- 496

5 Table 5. One-Way Sensitivity Analysis of Cost-Effectiveness of Telemedicine and Standard Ophthalmoscopy for Retinopathy of Prematurity Management Among All Infants With Birth Weight Less Than 1500 g % (Telemedicine/Ophthalmoscopy, $ per QALY Gained) Variable Reference Value Low Value High Value Sensitivity of telemedicine a 93.3 (3193/5617) 75 (5175/5617) 100 (3531/5617) Specificity of telemedicine a 90.2 (3193/5617) 75 (4124/5617) 100 (3670/5617) Sensitivity of ophthalmoscopy b 86.7 (3193/5617) 75 (3455/7703) 100 (3361/4246) Specificity of ophthalmoscopy b 96.2 (3193/5617) 75 (2835/4305) 100 (4070/7959) Incidence of disease c 8.1 (3193/5617) 1 (18 898/27 215) 20 (2548/3711) % of readable images 95 (3193/5617) 75 (3707/5617) 100 (3076/5617) Discount rate for utility 3 (3193/5617) 0 (1235/2171) 7 (6733/11 842) Abbreviation: QALY, quality-adjusted life year. a For image-based detection of treatment-requiring retinopathy of prematurity based on referral at a cutoff of type 2 disease or worse. b For ophthalmoscopic detection of treatment-requiring retinopathy of prematurity. c Incidence of treatment-requiring retinopathy of prematurity. *References 2, 6, 12-14, 20, 21, 30-32, 36, 37. geous, such as military and prison settings. 22 Given the shortcomings of current ROP management strategies, 7-10 telemedicine may represent an alternative approach that third-party payers will consider reimbursing because of its demonstrated cost-effectiveness. Cost-utility analysis incorporates medical outcomes using evidence-based data and patient-perceived value. Because utility values transcend demographic characteristics and allow for direct comparison across different medical specialties, this method has been proposed as a strategy for allocation of health care resources. 27,28 Javitt et al 52 reported that the cost-effectiveness of standard ophthalmoscopy and cryotherapy for ROP care was $2488/QALY to $6045/QALY in 1988 dollars depending on the exact examination strategy. Brown et al 39 found that the cost of laser treatment and cryotherapy for threshold ROP, without considering costs of ophthalmoscopic examination, was $678/QALY gained in 1998 dollars. Our study models both ROP examination and treatment using laser photocoagulation, incorporates results from recent guidelines and outcome studies,* and is consistent with these earlier findings. It is also useful to compare with studies regarding cost-utility of other medical interventions. Within ophthalmology, laser treatment of threshold ROP has been shown to be among the most cost-effective interventions ($678/QALY), whereas anterior chamber paracentesis with carbon dioxide and oxygen therapy for central retinal artery occlusion is among the least ($6.5 million/qaly). 46 Within general medicine, cost-utilities have been found to be $6880/QALY for coronary bypass graft surgery for left artery main disease and $ /QALY for liver transplant. 47 It is proposed that $ /QALY gained should represent a cost-effective intervention 53 and that $50 000/ QALY gained should represent a highly cost-effective intervention. 28,54,55 Using these criteria, both telemedicine ($3193/QALY) and standard ophthalmoscopy ($5617/ QALY) for ROP management would be considered highly cost-effective (Table 4). An important component of this study is that numerical values are assigned to represent accuracy of ROP examinations. The underlying scientific background warrants explanation. Sensitivity and specificity of telemedical ROP diagnosis have been thoroughly characterized against ophthalmoscopy as an assumed reference standard, and the most detailed of those results are applied to the current study We previously studied agreement and accuracy of plus disease diagnosis by a group of 22 recognized ROP experts and found to be 0.19 to 0.66, sensitivity 30.8% to 100%, and specificity 57.1% to 100%. 34,35 Finally, we have shown that agreement between telemedical and ophthalmoscopic ROP examinations is extremely high when images are captured by a trained neonatal nurse, that neither modality has a systematic tendency to overdiagnose or underdiagnose ROP, and that telemedicine may actually be more accurate in some cases. 20,21 These findings support the notion that neither telemedicine nor ophthalmoscopy has perfect accuracy. For these reasons and because studies designed to measure accuracy of ophthalmoscopy by multiple examiners would likely be impractical owing to infant safety concerns, 56 we believe it is most reasonable to assume that the accuracy of ophthalmoscopy is equal to that of image-based ROP examination. 24 We emphasize that our sensitivity analysis (Table 5) demonstrates that telemedicine continues to have greater cost-effectiveness than ophthalmoscopy across a range of parameter values, including wide variations in diagnostic accuracy of both telemedicine and ophthalmoscopy. This advantage persists in a population of infants with BW less than 1251 g (data not shown). Taken together, these results demonstrate that our cost-utility findings are highly robust. This analysis is performed from the third-party insurer perspective, meaning that only direct medical costs and outcomes are considered. Although it excludes a number of societal costs and benefits, this third-party perspective is widely used throughout the ophthalmic literature because there is no consensus about which societal factors to include. 27,28,38,46 In a telemedicine strategy, benefits to ophthalmologists might include decreased travel, opportunity cost savings, and qualitative matters such as satisfaction. Images could also be used for secondary purposes such as teaching, research, and improved clinical care through comparison with prior photographs. These factors are not relevant to direct medical spending be- 497

6 cause they are not generally reimbursed, and they are therefore excluded from our analysis. However, we note that they may favor telemedicine. Also, study costs were derived from Medicare reimbursement values because this standardized payment system is a reasonable proxy for costs and allows for comparison with most studies in the ophthalmic literature. 27,28 We emphasize that this is the accepted method for performing health care costeffectiveness analysis 27-29,38,45,46 but acknowledge that these Medicare charges may not capture the true cost of ROP management. For example, some physicians negotiate retainer fees from hospitals in addition to receiving thirdparty payments for ophthalmoscopic examinations. If this factor were considered, it might further favor the telemedicine strategy. Moreover, the costs of telemedicine imaging devices and the salaries of personnel operating them are excluded from this analysis. In standard costutility analysis, it is assumed that these latter costs are recovered through technical fees associated with procedures. Finally, in cost-utility analysis, the ramifications of infants incorrectly untreated by telemedicine or ophthalmoscopy are considered to be fully represented by the decreased utility outcome in that group (Table 2). Specifically, this study is not intended to quantify the financial effect of medicolegal liability, and it is not necessarily clear which strategy would be more affected in these situations. In a telemedicine strategy, the availability of photographic documentation could protect physicians from liability or could increase medicolegal risk by subjecting images to heavy scrutiny. A related study examined the cost-effectiveness of photographic ROP screening in the United Kingdom from a societal perspective, with mixed results depending on the approach used. 24 Further studies may elucidate the cost-benefit effect of these societal factors. Several additional limitations should be noted. Ocular and systemic complications of ROP treatment were not modeled. It was felt that these complications are infrequent and that they would be unlikely to affect infants with telemedicine and those with ophthalmoscopy differently. In the current ROP care paradigm, infants are frequently transferred between hospitals to receive secondopinion ophthalmoscopic examinations or to undergo laser photocoagulation. These costs are not included in the study and would likely favor telemedicine. Previous studies involving cataract surgery and age-related macular degeneration have examined the cost-benefit effect of treating the first eye compared with the second eye. 57,58 We chose to model management of all of the affected eyes because we feel that the risks of infancy-acquired blindness are too great to consider intentionally excluding examination or treatment of 1 eye. 52 This study was not designed to examine workflow engineering issues related to real-world telemedicine systems, such as turnaround time of image interpretation or interstate medical licensure. 59 These must be understood before the widespread adoption of telemedicine to ensure that patient care is not compromised. Overall, this study shows that telemedicine is more cost-effective than standard ophthalmoscopy for ROP management. If workflow, reliability, medicolegal, reimbursement, and acceptability issues can be addressed, then telemedicine may become a useful strategy for improving ROP care while decreasing costs. Submitted for Publication: June 30, 2007; final revision received August 24, 2007; accepted August 29, Correspondence: Michael F. Chiang, MD, Department of Ophthalmology, Columbia University College of Physicians and Surgeons, 635 W 165th St, Box 92, New York, NY (chiang@dbmi.columbia.edu). Author Contributions: Dr Chiang had full access to all of the data in the study and takes responsibility for the integrity of the data and accuracy of the data analysis. Financial Disclosure: Dr Chiang is an unpaid member of the Scientific Advisory Board for Clarity Medical Systems, Pleasanton, California. Funding/Support: This work was supported by a Career Development Award from Research to Prevent Blindness, New York, New York (Dr Chiang) and by grant EY13972 from the National Eye Institute, Bethesda, Maryland (Dr Chiang). Role of the Sponsors: The sponsors had no role in the design and conduct of the study; in the collection, analysis, and interpretation of data; or in the preparation, review, or approval of the manuscript. Disclaimer: The views expressed in this article are those of the authors and do not necessarily reflect the official policy or position of the Department of the Navy, the Department of Defense, or the US government. REFERENCES 1. Cryotherapy for Retinopathy of Prematurity Cooperative Group. Multicenter trial of cryotherapy for retinopathy of prematurity: preliminary results. Arch Ophthalmol. 1988;106(4): Early Treatment for Retinopathy of Prematurity Cooperative Group. Revised indications for the treatment of retinopathy of prematurity: results of the Early Treatment for Retinopathy of Prematurity randomized trial. Arch Ophthalmol. 2003; 121(12): Committee for the Classification of Retinopathy of Prematurity. An international classification of retinopathy of prematurity. Arch Ophthalmol. 1984;102(8): International Committee for the Classification of Retinopathy of Prematurity. The international classification of retinopathy of prematurity revisited. Arch Ophthalmol. 2005;123(7): American Academy of Pediatrics, Section on Ophthalmology. Screening examination of premature infants for retinopathy of prematurity. Pediatrics. 2001; 108(3): Section on Ophthalmology American Academy of Pediatrics; American Academy of Ophthalmology; American Association for Pediatric Ophthalmology and Strabismus. Screening examination of premature infants for retinopathy of prematurity [published correction appears in Pediatrics. 2006;118(3):1324]. Pediatrics. 2006;117(2): Hamilton BE, Martin JA, Ventura SJ. Births: preliminary data for http: // Accessed February 7, Gilbert C, Fielder A, Gordillo L, et al. Characteristics of infants with severe retinopathy of prematurity in countries with low, moderate, and high levels of development: implications for screening programs. Pediatrics. 2005;115(5):e518- e Gilbert C, Rahi J, Eckstein M, et al. Retinopathy of prematurity in middle-income countries. Lancet. 1997;350(9070): American Academy of Ophthalmology. Ophthalmologists warn of shortage in specialists who treat premature babies with blinding eye condition. Accessed January 5, Bashshur RL, Reardon TG, Shannon GW. Telemedicine: a new health care delivery system. Annu Rev Public Health. 2000;21: Chiang MF, Keenan JD, Starren JB, et al. Accuracy and reliability of remote retinopathy of prematurity diagnosis. Arch Ophthalmol. 2006;124(3):

7 13. Chiang MF, Starren JB, Du YE, et al. Remote image based retinopathy of prematurity diagnosis: a receiver operating characteristic analysis of accuracy. Br J Ophthalmol. 2006;90(10): Chiang MF, Keenan JD, Du YE, et al. Assessment of image-based technology: impact of referral cutoff on accuracy and reliability of remote retinopathy of prematurity diagnosis. AMIA Annu Symp Proc. 2005: Ells AL, Holmes JM, Astle WF, et al. Telemedicine approach to screening for severe retinopathy of prematurity: a pilot study. Ophthalmology. 2003;110(11): Wu C, Petersen RA, Vanderveen DK. Retcam imaging for retinopathy of prematurity screening. J AAPOS. 2006;10(2): Yen KG, Hess D, Burke B, et al. Telephotoscreening to detect retinopathy of prematurity: preliminary study of the optimum time to employ digital fundus camera imaging to detect ROP. J AAPOS. 2002;6(2): Lorenz B, Bock M, Muller HM, Massie NA. Telemedicine based screening of infants at risk for retinopathy of prematurity. Stud Health Technol Inform. 1999; 64: Schwartz SD, Harrison SA, Ferrone PJ, Trese MT. Telemedical evaluation and management of retinopathy of prematurity using a fiberoptic digital fundus camera. Ophthalmology. 2000;107(1): Chiang MF, Wang L, Busuioc M, et al. Telemedical retinopathy of prematurity diagnosis: accuracy, reliability, and image quality. Arch Ophthalmol. 2007; 125(11): Scott KE, Kim D, Wang L, et al. Telemedical retinopathy of prematurity diagnosis: agreement between ophthalmoscopic and image-based examinations. Ophthalmology. In press. 22. Grigsby J, Sanders JH. Telemedicine: where it is and where it s going. Ann Intern Med. 1998;129(2): Perednia DA, Allen A. Telemedicine technology and clinical applications. JAMA. 1995;273(6): Castillo-Riquelme MC, Lord J, Moseley MJ, et al. Cost-effectiveness of digital photographic screening for retinopathy of prematurity in the United Kingdom. Int J Technol Assess Health Care. 2004;20(2): Whited JD, Datta SK, Aiello LM, et al. A modeled economic analysis of a digital teleophthalmology system as used by three federal healthcare agencies for detecting proliferative diabetic retinopathy. Telemed J E Health. 2005;11(6): Whitten PS, Mair FS, Haycox A, et al. Systematic review of cost effectiveness studies of telemedicine interventions. BMJ. 2002;324(7351): Brown MM, Brown GC, Sharma S, et al. Health care economic analyses and valuebased medicine. Surv Ophthalmol. 2003;48(2): Brown GC, Brown MM, Sharma S, et al. Health care economic analyses. Retina. 2004;24(1): Siegel JE, Weinstein MC, Russell LB, Gold MR. Recommendations for reporting cost-effectiveness analyses: panel on cost-effectiveness in health and medicine. JAMA. 1996;276(16): Palmer EA, Hardy RJ, Dobson V, et al; Cryotherapy for Retinopathy of Prematurity Cooperative Group. 15-year outcomes following threshold retinopathy of prematurity: final results from the multicenter trial of cryotherapy for retinopathy of prematurity. Arch Ophthalmol. 2005;123(3): Palmer EA, Flynn JT, Hardy RJ, et al; Cryotherapy for Retinopathy of Prematurity Cooperative Group. Incidence and early course of retinopathy of prematurity. Ophthalmology. 1991;98(11): Good WV, Hardy RJ, Dobson V, et al; Early Treatment for Retinopathy of Prematurity Cooperative Group. The incidence and course of retinopathy of prematurity: findings from the early treatment for retinopathy of prematurity study. Pediatrics. 2005;116(1): Sox HC, Blatt MA, Higgins MC, Marton KI. Medical Decision Making. Boston, MA: Butterworth-Heinemann; Chiang MF, Jiang L, Gelman R, et al. Interexpert agreement of plus disease diagnosis in retinopathy of prematurity. Arch Ophthalmol. 2007;125(7): Gelman R, Jiang L, Du YE, Martinez-Perez ME, Flynn JT, Chiang MF. Plus disease in retinopathy of prematurity: pilot study of computer-based and expert diagnosis. J AAPOS. 2007;11(6): Ng EYJ, Connolly BP, Mcnamara JA, et al. A comparison of laser photocoagulation with cryotherapy for threshold retinopathy of prematurity at 10 years, part 1: visual function and structural outcome. Ophthalmology. 2002;109(5): Cryotherapy for Retinopathy of Prematurity Cooperative Group. Multicenter trial of cryotherapy for retinopathy of prematurity: natural history ROP: ocular outcome at 5(1/2) years in premature infants with birth weights less than 1251 g. Arch Ophthalmol. 2002;120(5): Brown GC. Vision and quality-of-life. Trans Am Ophthalmol Soc. 1999;97: Brown GC, Brown MM, Sharma S, et al. Cost-effectiveness of treatment for threshold retinopathy of prematurity. Pediatrics. 1999;104(4):e Vermont Oxford Network. Vermont Oxford Network Web page. Accessed October 12, Horbar J. Vermont Oxford Network Annual VLBW Database Summary, Infants 501 to 1500 Grams Born in Burlington, VT: Vermont Oxford Network; Chiang MF, Arons RR, Flynn JT, Starren JB. Incidence of retinopathy of prematurity from 1996 to 2000: analysis of a comprehensive New York State patient database. Ophthalmology. 2004;111(7): Yanovitch TL, Siatkowski RM, McCaffree M, Corff KE. Retinopathy of prematurity in infants with birth weight or=1250 grams: incidence, severity, and screening guideline cost-analysis. J AAPOS. 2006;10(2): Centers for Medicare and Medicaid Services. PFS relative value files. Accessed December 15, Gold MR, Siegel JE, Russell LB, Weinstein MC, eds. Cost-effectiveness in Health and Medicine. New York, NY: Oxford University Press; 1996: Brown GC, Brown MM, Sharma S, et al. Value-based medicine and ophthalmology: an appraisal of cost-utility analyses. Trans Am Ophthalmol Soc. 2004; 102: Membreno JH, Brown MM, Brown GC, et al. A cost-utility analysis of therapy for amblyopia. Ophthalmology. 2002;109(12): California Telemedicine and ehealth Center. Telemedicine reimbursement handbook. Accessed December 27, Spooner SA, Gotlieb EM; Committee on Clinical Information Technology; Committee on Medical Liability. Telemedicine: pediatric applications. Pediatrics. 2004; 113(6):e639-e Centers for Medicare and Medicaid Services. Medicare telehealth services. http: // Accessed December 27, Arias E. United States life tables, Natl Vital Stat Rep. 2006;54(14): Accessed December 15, Javitt J, Cas RD, Chiang Y. Cost-effectiveness of screening and cryotherapy for threshold retinopathy of prematurity. Pediatrics. 1993;91(5): Laupacis A, Feeny D, Detsky AS, et al. How attractive does a new technology have to be to warrant adoption and utilization? tentative guidelines for using clinical and economic evaluations. CMAJ. 1992;146(4): Kallmes DF, Kallmes MH. Cost-effectiveness of angiography performed during surgery for ruptured intracranial aneurysms. AJNR Am J Neuroradiol. 1997; 18(8): Smith KJ, Roberts MS. Antiviral therapies for herpes zoster infections: are they economically justifiable? Pharmacoeconomics. 2000;18(2): Laws DE, Morton C, Weindling M, Clark D. Systemic effects of screening for retinopathy of prematurity. Br J Ophthalmol. 1996;80(5): Busbee BG, Brown MM, Brown GC, Sharma S. Cost-utility analysis of cataract surgery in the second eye. Ophthalmology. 2003;110(12): Sharma S, Brown GC, Brown MM, Hollands H, Shah GK. The cost-effectiveness of photodynamic therapy for fellow eyes with subfoveal choroidal neovascularization secondary to age-related macular degeneration. Ophthalmology. 2001; 108(11): Tang RA, Morales M, Ricur G, Schiffman JS. Telemedicine for eye care. J Telemed Telecare. 2005;11(8):