The practice of surgical pathology relies on image-based

Similar documents
Virtual Microscopy: Express Surgical Pathology Consultation. Mercè Jordà, University of Miami, Florida

The use of scanned, high-resolution, digital images of

A nationwide telepathology consultation and quality control program in China: implementation and result analysis

Interpretation of Breast Pathology in the Era of Minimally Invasive Procedures

Digital Pathology Diagnosis Assistance System

Digital Pathology - moving on after implementation. Catarina Eloy, MD, PhD

Lessons learned in the use of digital imaging at Memorial Sloan Kettering Cancer Center

Concordance with Breast Cancer Pathology Reporting Practice Guidelines

Quantitative Image Analysis of HER2 Immunohistochemistry for Breast Cancer

Added benefits of computer-assisted analysis of Hematoxylin-Eosin stained breast histopathological digital slides

04/10/2018 HIGH RISK BREAST LESIONS. Pathology Perspectives of High Risk Breast Lesions ELEVATED RISK OF BREAST CANCER HISTORICAL PERSPECTIVES

Interpretive Diagnostic Error Reduction in Surgical Pathology and Cytology

Is digital pathology ready for use in routine histopathology? Dr David Snead University Hospitals of Coventry and Warwickshire NHS Trust Coventry UK

COMPUTER-AIDED HER-2/neu EVALUATION IN EXTERNAL QUALITY ASSURANCE (EQA) OF BREAST CANCER SCREENING PROGRAMME

The role of the cytologist in breast cancer screening

Ritu Nayar, MD Professor and Vice Chair of Pathology Northwestern University, Feinberg School of Medicine Chicago, IL

RSNA, /radiol Appendix E1. Methods

Digital Pathology in the NHS : The Evidence Base, Validation and Deployment

Cleveland Clinic Laboratories. Anatomic Pathology

A re-audit of Prostate biopsies from January to December 2010 and 2013.

Flat Epithelial Atypia

Surgical Pathology Issues of Practical Importance

Pathology of Lobular & Ductal Preneoplasia. Syed A Hoda, MD Weill-Cornell, New York, NY

Minimizing Errors in Diagnostic Pathology

INTRA-OPERATIVE CYTOLOGY AND FROZEN SECTIONS OF BREAST LESIONS: A COMPARISON FROM A SAUDI TEACHING HOSPITAL

Quality assurance and quality control in pathology in breast disease centers

1 NORMAL HISTOLOGY AND METAPLASIAS

Papillary Lesions of the Breast A Practical Approach to Diagnosis. (Arch Pathol Lab Med. 2016;140: ; doi: /arpa.

Implementation of whole slide imaging in surgical pathology: A value added approach

Atypical proliferative lesions diagnosed on core biopsy - 6 year review

Advocating Nonsurgical Management of Patients With Small, Incidental Radial Scars at the Time of Needle Core Biopsy. A Study of 77 Cases

Treatment options for the precancerous Atypical Breast lesions. Prof. YOUNG-JIN SUH The Catholic University of Korea

Received: 11 Feb. 2013; Accepted: 7 Jun. 2013

Frozen Section Library: Lung

Utility of Adequate Core Biopsy Samples from Ultrasound Biopsies Needed for Today s Breast Pathology

Observer Performance Using Virtual Pathology Slides: Impact of LCD Color Reproduction Accuracy

Accuracy and Reproducibility of Telecytology Diagnosis of Cervical Smears A Tool for Quality Assurance Programs

Epithelial Columnar Breast Lesions: Histopathology and Molecular Markers

Telepathology consultation for frozen section diagnosis in China

Benign Breast Disease and Breast Cancer Risk

Although current American Cancer Society guidelines

CAP Companion Meeting at USCAP Quality and Patient Safety in Anatomic Pathology: Practical Solutions. Surgical Pathology

Williams B J, Hanby A, Millican-Slater R, Nijhawan A, Verghese E & Treanor D (2018) Histopathology 72,

GOALS AND OBJECTIVES BREAST PATHOLOGY

Repeat Thyroid Nodule Fine-Needle Aspiration in Patients With Initial Benign Cytologic Results

Case #1: 75 y/o Male (treated and followed by prostate cancer oncology specialist ).

Palpable Breast Lesions Cytomorphological Analysis and Scoring System with Histopatholgical Correlation

MBP AP 3 Core Curriculum

Immunohistochemical studies (ER & Ki-67) in Proliferative breast lesions adjacent to malignancy

ACCME/Disclosures. Diagnosing Mesothelioma in Limited Tissue Samples. Papanicolaou Society of Cytopathology Companion Meeting March 12 th, 2016

Optical Intra-operative Assessment of Breast Tumor Margins

Proliferative Epithelial lesions of the Breast. Sami Shousha, MD, FRCPath Charing Cross Hospital & Imperial College, London

Breast Specimen Processing and Reporting With an Emphasis on Margin Evaluation. A College of American Pathologists Survey of 866 Laboratories

Original Articles. Quality Assurance in Breast Pathology. Lessons Learned From a Review of Amended Reports

Analysis of Immunohistochemical Stain Usage in Different Pathology Practice Settings

COMPANION MEETING BREAST. Auditorium 11:15 1:00 am. Convenor: A/Professor Gelareh Farshid, SA Pathology, SA

Fine Needle Aspiration Cytology Of Breast Lumps With Histopathological Correlation: A Four Year And Eight Months Study From Rural India.

A712(18)- Test slide, Breast cancer tissues with corresponding normal tissues

Evolution of diagnostic ultrasound systems Current achievements in breast ultrasound

6/3/2010. Outline of Talk. Lobular Breast Cancer: Definition of lobular differentiation. Common Problems in Diagnosing LCIS in Core Biopsies

Telepathology 2/17/2011. and The Future of Pathology (or Why did we change our Practice Model) University Health Network IMAGINE3: 3 IMAGINE 2!

Policy #: 120 Latest Review Date: June 2009

Papillary Lesions of the Breast

Atypical Ductal Hyperplasia and Papillomas: A Comparison of Ultrasound Guided Breast Biopsy and Stereotactic Guided Breast Biopsy

Handheld Radiofrequency Spectroscopy for Intraoperative Assessment of Surgical Margins During Breast-Conserving Surgery

Case study 1. Rie Horii, M.D., Ph.D. Division of Pathology Cancer Institute Hospital, Japanese Foundation for Cancer Research

CASE REPORT Malignant transformation of breast ductal adenoma: a diagnostic pitfall

Proliferative Breast Disease: implications of core biopsy diagnosis. Proliferative Breast Disease

Pathology Student Interest Group. Sponsored by the College of American Pathologists

ACRIN 6666 Therapeutic Surgery Form

Papillary Lesions of the breast

CNB vs Surgical Excision

How to Best Prepare for Digital Pathology: A Primer on Technologies, Applications, and Clinical Contributions. Disclosures

Enterprise Interest None

FAQs for UK Pathology Departments

College of American Pathologists. Pathology Performance Measures included in CMS 2012 PQRS

Study of Fine Needle Aspiration Cytology of Breast Lump: Correlation of Cytologically Malignant Cases with Their Histological Findings

Pathology Report Patient Companion Guide

Frozen Section Library: Pleura

Preface to the Second Edition

Reviewer's report. Version: 1 Date: 24 May Reviewer: Cathy Moelans. Reviewer's report:

Atypical And Suspicious Categories In Fine Needle Aspiration Cytology Of The Breast

Handheld Radiofrequency Spectroscopy for Intraoperative Assessment of Surgical Margins During Breast-Conserving Surgery

Diagnosis of Lentigo Maligna Melanoma. Steven Q. Wang, M.D. Memorial Sloan-Kettering Cancer Center Basking Ridge, NJ

Evaluation of Mitotic Activity Index in Breast Cancer Using Whole Slide Digital Images

Utilization of Virtual Microscopy in a Cooperative Group Setting

Applying Risk Management Principles to QA in Surgical Pathology: From Principles to Practice

INTRADUCTAL LESIONS OF THE PROSTATE. Jonathan I. Epstein

Breast Lesion Excision System-Intact (BLES): A Stereotactic Method of Biopsy of Suspicius Non-Palpable Mammographic Lesions.

Optimal algorithm for HER2 testing

Look differently. Invenia ABUS. Automated Breast Ultrasound

Modern Pathology (2011) 24, & 2011 USCAP, Inc. All rights reserved /11 $

Original Article. Spontaneous Healing of Breast Cancer

A712(19)- Test slide, Breast cancer tissues with corresponding normal tissues

Root Cause Analysis of Problems in the Frozen Section Diagnosis of In Situ, Minimally Invasive, and Invasive Adenocarcinoma of the Lung

Intraductal carcinoma of the prostate on needle biopsy: histologic features and clinical significance

Updated Molecular Testing Guideline for the Selection of Lung Cancer Patients for Treatment with Targeted Tyrosine Kinase Inhibitors

Immunohistochemical Expression of Hormone Receptors and The Histological Characteristics of Biochemically Hormone Receptor Negative Breast Cancers

NPQR Quality Payment Program (QPP) Measures 21_18247_LS.

Atypical ductal hyperplasia diagnosed at ultrasound guided biopsy of breast mass

Transcription:

Multi-Institutional Comparison of Whole Slide Digital Imaging and Optical Microscopy for Interpretation of Hematoxylin-Eosin Stained Breast Tissue Sections Savitri Krishnamurthy, MD; Kurt Mathews, MD; Steven McClure, MD; Melissa Murray, DO; Michael Gilcrease, MD, PhD; Constance Albarracin, MD, PhD; John Spinosa, MD, PhD; Bernard Chang, MD; James Ho, MD; John Holt, MD; Arthur Cohen, MD; Dilip Giri, MD; Karuna Garg, MD; Roland L Bassett Jr, MS; Kevin Liang, PhD Context. Whole slide imaging (WSI) is now used for educational purposes, for consultation, and for archiving and quantitation of immunostains. However, it is not routinely used for the primary diagnosis of hematoxylineosin stained tissue sections. Objective. To compare WSI using the Aperio digital pathology system (Aperio Technologies, Inc, Vista, California) with optical microscopy (OM) for the interpretation of hematoxylin-eosin stained tissue sections of breast lesions. Design. The study was conducted at 3 clinical sites; 3 breast pathologists interpreted 150 hematoxylin-eosin stained slides at each site, 3 times each by WSI and 3 times each by OM. For WSI, slides were scanned using an Aperio ScanScope and interpreted on a computer monitor using Aperio ImageScope software and Aperio Spectrum data management software. Pathologic interpretations were recorded using the College of American Pathologists breast checklist. WSI diagnoses were compared with OM diagnoses for accuracy, precision (interpathologist variation), and reproducibility (intrapathologist variation). Results were considered accurate only if the interpretation matched exactly between WSI and OM. The proportion of accurate results reported by each pathologist was expressed as a percentage for the comparison of the 2 platforms. Results. The accuracy of WSI for classifying lesions as not carcinoma or as noninvasive (ductal or lobular) or invasive (ductal, lobular, or other) carcinoma was 90.5%. The accuracy of OM was 92.1%. The precision and reproducibility of WSI and OM were determined on the basis of pairwise comparisons (3 comparisons for each slide, resulting in 36 possible comparisons). The overall precision of WSI was 90.5% in comparison with 92.1% for OM; reproducibility of WSI was 91.6% in comparison with 94.5% for OM, respectively. Conclusions. In this study, we demonstrated that WSI and OM have similar accuracy, precision, and reproducibility for interpreting hematoxylin-eosin stained breast tissue sections. Further clinical studies using routine surgical pathology specimens would be useful to confirm these findings and facilitate the incorporation of WSI into diagnostic practice. (Arch Pathol Lab Med. 2013;137:1733 1739; doi: 10.5858/arpa.2012-0437-OA) Accepted for publication February 19, 2013. Published as an Early Online Release August 15, 2013. From the Department of Pathology, The University of Texas MD Anderson Cancer Center, Houston (Drs Krishnamurthy, Gilcrease, and Albarracin and Mr Bassett); the Laboratory Diagnostics Medical Group, Scripps Memorial Hospital, La Jolla, California (Drs Mathews, Spinosa, and Chang); the Department of Pathology and Lab Medicine, Presbyterian Hospital, Charlotte, North Carolina (Drs McClure, Holt, and Cohen); the Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York (Drs Murray and Giri); Genoptix Medical Laboratory, Carlsbad, California (Dr Ho); the Department of Pathology, University of California at San Francisco School of Medicine (Dr Garg); and MileStone Research Organization, San Diego, California (Dr Liang). Dr Liang is a clinical consultant for Aperio Technologies Inc, Vista, California. The other authors have no relevant financial interest in the products or companies described in this article. Presented at the annual meeting of the United States and Canadian Academy of Pathology; March 2012; Vancouver, British Columbia, Canada. Reprints: Savitri Krishnamurthy, MD, Department of Pathology, The University of Texas MD Anderson Cancer Center, 1515 Holcombe Blvd, Unit 0053, Houston, TX 77030 (e-mail: skrishna@ mdanderson.org). The practice of surgical pathology relies on image-based light microscopy diagnosis, which enables the detailed evaluation of the cytologic and architectural features of hematoxylin-eosin (H&E) stained tissue sections. Significant recent technological advancements have allowed for the acquisition and storage of high-quality digital images. Several commercially available platforms are available for scanning H&E-stained tissue sections, generating digital whole slide images (WSI) for viewing and interpretation. 1 The field of digital pathology is rapidly evolving toward the creation of a digital environment for interpreting and managing pathologic information contained in a glass slide. Several applications of digital pathology are currently being embraced by pathologists. Whole slide imaging is commonly used for pathology education in medical school, pathology workshops, and slide conferences. 2 7 It is also gaining popularity for multidisciplinary tumor board presentations at several institutions, and a digital breast histopathology atlas is available online. 8 Whole slide imaging is also useful for remotely reading intraoperative Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al 1733

frozen sections, for evaluating surgical pathology quality assurance programs, and for proficiency testing. 9 14 Another routine application in many clinical pathology laboratories is to analyze immunostained slides to determine the protein expression of markers such as estrogen receptor, progesterone receptor, and human epidermal growth factor receptor 2, which are routinely evaluated for selecting patients with breast cancer for targeted therapy. 15 Whole slide imaging is also becoming popular for obtaining second opinions from expert pathologists. 16,17 Several applications for WSI exist in surgical pathology, but it is not routinely used to render primary histologic diagnoses. Whole slide imaging s diagnostic utility and acceptability by pathologists depend on its performance compared with conventional optical microscopy (OM). Interpretive concordance is crucial for the adoption of the WSI platform in routine surgical pathology practice. To this end, we conducted a multiinstitutional study to determine the accuracy, precision, and reproducibility of WSI using the Aperio Digital Pathology System (Aperio Technologies, Inc, Vista, California) compared with those of conventional OM; the same tissue sections were used, representing a variety of benign and malignant breast lesions. MATERIALS AND METHODS This study was conducted at 3 Clinical Laboratory Improvement Amendments qualified clinical sites (2 major academic cancer centers and 1 large community hospital) with institutional review board approved protocols and waiver of informed consent from the patients. The Aperio Digital Pathology System was used to scan and store WSI. This system included a ScanScope XT digital slide scanner, Spectrum software (to store, manage, and access digital slides), ImageScope software (to view digital slide images), a digital slide repository server, and viewing workstations, including liquid crystal display monitors. The ScanScope XT instrument is a purpose-built slide scanner, whereas the server and monitors were off-shelf commercial products provided by Aperio as standard components. The images were captured at a magnification of 320 or 340 with a 320/0.75 NA Plan Apo objective. The resolution of the captured images was 0.50 lm/pixel for 320 and 0.25 lm/pixel for 340 magnification. The eslide file formats included standard pyramid-tiled TIFF (SVS) with JPEG2000 or JPEG compression. At each site, pathologists used their own OMs. The study included the participation of 3 board-certified pathologists with special expertise in breast pathology, 1 of whom served as the principal investigator at each site. One or more laboratory technicians or research assistants at each site, under the direction of the principal investigator, pulled, labeled, and scanned slides to create digital slide images. At each site, 150 good-quality H&Estained breast tissue sections (optimally cut and stained, without artifacts) were used. These cases represented normal tissue and benign and malignant breast lesions: consecutively accessioned breast specimens from routine workflow in 1 site and archived specimens in the pathology laboratory in 2 sites. For the 2 sites at which slides were chosen from the archives, the principal investigator at the site chose a cross-section of cases representative of the different possible categories in the College of American Pathologists breast checklist. The cases were chosen to maximize the possibility that cases representing each possible interpretation in the checklist were selected for the study. For both archival and routine work flow cases, one representative well-cut and -stained H&E-stained tissue section of each accession was used in the study. We used H&E-stained tissue sections prepared from core needle biopsies, surgical excisions, and mastectomy specimens. Digital WSI were obtained by scanning H&E-stained slides of breast tissue with the Aperio ScanScope instrument; digital images were managed by Aperio Spectrum and evaluated using Aperio Image- Scope software on a computer monitor. Each slide was diagnosed 3 times using WSI and 3 times using OM by each pathologist. After the slides had been evaluated using one modality, the label and sequence were randomized for interpretation by the alternate modality to avoid interpretation bias. A washout period of at least 7 days was required between reads. A diagnostic recording method was created to record the primary histologic diagnosis on the basis of the College of American Pathologists breast cancer checklist. Table 1 shows the College of American Pathologists breast checklist that was used to record the results in the study. Adhering to this checklist enabled consistent recordings and comparisons using WSI and OM. A diagnosis comparison method was also created to allow any 2 diagnoses to be compared in a consistent manner. The raw data captured from the studies were collected in an XML database, as created and updated using the diagnosis recording tool. We compared the WSI and OM interpretations for accuracy, precision (interpathologist variation), and reproducibility (intrapathologist variation) at classifying breast tissue as no evidence of carcinoma, noninvasive carcinoma, or invasive carcinoma. All interpretations made using WSI were compared, pairwise, with those made using OM. The percentage of agreement was computed as WSI accuracy. Similarly, all OM interpretations were compared, pairwise, with all other OM diagnoses of the same slide. The percentage of agreement was computed as the measurement of OM accuracy. All interpretations made using WSI by each pathologist were compared, pairwise, with all other WSI interpretations of the same slide made by other pathologists. The percentage of agreement was computed as the interpathologist variation (precision). Similarly, all OM interpretations made by each pathologist were compared, pairwise, with all other OM interpretations of the same slide made by other pathologists. The percentage of agreement was computed as the OM interpathologist variation. All WSI interpretations were compared, pairwise, with all other WSI interpretations made of the same slide by the same pathologist. The percentage of agreement was computed as the WSI intrapathologist variation (reproducibility). All OM interpretations made by the same pathologist were evaluated to determine OM precision. The percentage of agreement was computed as the OM intrapathologist variation (reproducibility). We recorded only the interpretation of the slides using the College of American Pathologists breast checklist; the time taken for the interpretation using WSI or OM was not recorded in this study. We also assessed Cohen j statistics to summarize the interrater agreement between WSI and OM with respect to the 3 groups of no carcinoma, noninvasive carcinoma, and invasive carcinoma among the readers. RESULTS This study included 150 H&E-stained breast tissue slides from the routine workflow at 1 clinical site and the pathology archives at the other 2 sites. The determination of accuracy of WSI in comparison with OM resulted from making 9 comparisons per slide per pathologist at each site, amounting to a total of 81 comparisons per slide for all the pathologists at all sites. The accuracy of OM was determined by comparing the reads made using OM with each other, including 3 pairwise comparisons per slide per pathologist at each site, resulting in 36 possible comparisons. The accuracy of WSI compared with OM ranged from 85.8% to 97.2%; that of OM compared with itself ranged from 86.7% to 98.7%. These results are summarized in Table 2 and depicted in Figures 1 and 2. Precision (interpathologist variation) was determined by comparing the 3 reads per slide per pathologist using WSI and OM; this resulted in 36 pairwise comparisons. The precision of each pathologist for WSI ranged from 83.5% to 96.4%; that of OM ranged from 86.7% to 98.7%. These results are summarized in Table 3. 1734 Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al

Table 1. The College of American Pathologists (CAP) Breast Checklist Used for Recording the Results in the Study Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al 1735

Reproducibility of WSI ranged from 83.5% to 96.1% and that of OM ranged from 91.8% to 97.3% (Table 4). The accuracy, precision, and reproducibility of WSI diagnoses compared with OM reads, for all pathologists, are summarized in Table 5. Overall, the WSI reads corresponded with the OM reads at a rate of 90.5%, and the OM reads corresponded with themselves at a rate of 92.1%. For precision, 92.1% of the pairwise OM comparisons were the same, and 90.5% of the WSI comparisons were the same. For reproducibility, 94.5% were similar for OM and 91.6% for WSI. The j statistics averaged across 3 readings indicating the agreements between the diagnosis rendered using WSI and that rendered using OM were 0.89, 1.00, and 0.95 for the 3 pathologists in site 1; 0.95, 0.82, and 0.87 in site 2; and 0.79, 0.79, and 0.78 in site 3. Figure 3 illustrates these averaged j statistics. These results indicate substantial agreement between the 2 modalities for the interpretation of H&Estained tissue sections of different types of breast lesions. A detailed analysis of the cases that were associated with variability in the readings using the same platform or between the 2 platforms enabled us to determine the types of lesions that resulted in the differential diagnoses. Discrepancy in interpretations between reads using either WSI or OM by the same pathologist and between pathologists occurred with selected lesions such as florid hyperplasia, atypical ductal hyperplasia, ductal carcinoma in situ with or without microinvasion, and papillary lesions. Figure 4, A, through C, illustrates some of the cases that led to discrepancy between the reads using either WSI or OM. Focal changes of in situ and invasive carcinoma in a tissue section were prone to be missed using either of the 2 platforms. The discrepancy in interpretations among different reads by the same pathologists and by different pathologists at each site occurred with both platforms. However, such discrepancies occurred slightly more often with WSI than with OM, resulting in marginally superior results of accuracy, precision, and reproducibility of OM in comparison with WSI. COMMENT Conventional OM allows viewing of fields representing areas of a stained tissue section by manually navigating rapidly through the slide by panning through the fields at different magnifications to evaluate the histologic features in the tissue section. Several factors must be considered when making a histologic interpretation from a slide, including the nature and quality of the image, the experience of the examiner, and the ease of navigation. When viewed at high resolution, a single stained tissue section in a slide has literally thousands of individual fields that are potentially available for inspection. In the reading process, the tissue section is viewed at low resolution, and areas to examine at Figure 1. Illustration of the accuracy of whole slide imaging in comparison with optical microscopy for each of the 3 pathologists in the 3 sites in the study. Figure 2. Illustration of the accuracy of optical microscopy in comparison with itself for the 3 pathologists in each of the 3 sites in the study. Figure 3. Illustration of the j statistics between whole slide imaging and optical microscopy for the 3 pathologists at each of the 3 sites in the study. 1736 Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al

Table 2. Accuracy of Whole Slide Imaging (WSI) As Compared With Optical Microscopy (OM) and for OM As Compared With Itself for Each Pathologist at Each Site, and Overall for All Pathologists at Each Site Site 1 Site 2 Site 3 Pathologist WSI-OM, % OM-OM, % WSI-OM, % OM-OM, % WSI-OM, % OM-OM, % 1 92.9 94.7 86.2 86.7 91.7 92.9 2 97.2 96.8 86.7 87.7 92.7 92.6 3 95.8 98.7 85.8 91.3 90.0 94.4 Overall 94.8 95.8 86.2 87.4 91.4 92.9 Table 3. Precision of Whole Slide Imaging (WSI) and Optical Microscopy (OM) for Each Pathologist at Each Site, and Overall for All Pathologists at Each Site Site 1 Site 2 Site 3 Pathologist WSI-WSI, % OM-OM, % WSI-WSI, % OM-OM, % WSI-WSI, % OM-OM, % 1 92.1 94.7 85.8 86.7 92.1 92.9 2 96.4 96.8 90.2 87.7 92.4 92.6 3 96.1 98.7 83.5 91.3 91.3 94.4 Overall 93.3 95.8 87.1 87.4 92.2 92.9 Table 4. Reproducibility of Whole-Slide Imaging (WSI) and Optical Microscopy (OM) for Each Pathologist at Each Site, and Overall for All Pathologists at Each Site Site 1 Site 2 Site 3 Pathologist WSI-WSI, % OM-OM, % WSI-WSI, % OM-OM, % WSI-WSI, % OM-OM, % 1 92.2 95.0 94.6 90.4 91.2 94.6 2 96.1 98.2 83.5 93.8 94.5 93.8 3 89.3 98.7 91.2 91.3 91.3 94.4 Overall 94.2 97.3 89.1 91.8 92.3 94.3 Table 5. Overall Accuracy, Precision, and Reproducibility of Whole-Slide Imaging (WSI) in Comparison With Optical Microscopy (OM) in the Study Accuracy, % Precision, % Reproducibility, % WSI-OM OM-OM WSI-WSI OM-OM WSI-WSI OM-OM 90.5 92.1 90.5 92.1 91.6 94.5 higher magnifications are selected. A digital pathology system provides similar magnification and navigation capabilities to those of OM, with the help of a navigation aid such as a mouse. However, the means of displaying images differs in that a computer monitor is used instead of the eyepiece of an OM. The mechanisms for navigating the image also differ between the 2 platforms, in that physical knobs operated with the hand are used with the former and a computer keyboard and mouse are used with the latter. The Aperio Digital Pathology System used in our multiinstitutional study was perceived by the study pathologists to be user friendly and easy to become familiar with. The much larger field of vision at any given magnification, a wider range of magnification, and the ease of measuring and annotating any given area of interest in the tissue section were recognized as distinct advantages of the digital platform. The image quality of the H&E-stained tissue sections was similar to that of traditional light microscopy, with insignificant differences in sharpness and resolution. Minor reductions in sharpness or depth of focus with WSI did not pose significant problems and were not considered confounding factors for rendering pathologic interpretations in the study. However, WSI was perceived to be more time consuming than was OM, perhaps because of the inherent learning curve associated with the new technology. Because the exact time taken to render a histologic interpretation was not recorded in this study, a strict comparison between the 2 platforms could not be made. The time factor was recognized by all study pathologists as a potential limitation that may discourage pathologists from adopting the digital platform in routine surgical pathology practice. In this large multi-institutional study, we demonstrated that WSI and OM have similar performance, with substantial equivalence, in interpreting H&E-stained tissue sections of benign and malignant breast lesions. The overall accuracy, precision, and reproducibility of the histologic interpretations were only marginally higher with OM than with WSI. The discrepancies could have resulted fromfailuretoidentifyfocalchangesintissuesectionsor from general variability in categorization. The latter issue led to discrepancies in diagnosing florid hyperplasia, atypical ductal hyperplasia, ductal carcinoma in situ with microinvasion, and papillary lesions and is well recognized in the field of breast pathology. The subjectivity of Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al 1737

Figure 4. Illustration of some of the cases causing discrepancy in the reads between the 2 platforms and within each platform. A, The tissue section of a core needle biopsy of a breast lesion was read as atypical in some reads and as ductal carcinoma in situ in other reads. B, This tissue section obtained from a surgical excision of the breast was interpreted as benign in some reads and as ductal carcinoma in situ in a few other reads. C, A single focus of lobular carcinoma in situ in a tissue section was identified in some but not all of the reads using either whole slide imaging or optical microscopy (hematoxylin-eosin, original magnifications 310 [A], 320 [A inset, B, and C], and 340 [B inset]). interpreting breast lesions when quantitative criteria are used (atypical ductal hyperplasia versus ductal carcinoma in situ and papilloma versus papilloma with atypia or papillary carcinoma) has been well addressed in the pathology literature. 18 20 The cases that were discrepant in our study were the types of lesions that generally cause variability in interpretation. It is to be noted that variability in the histologic interpretations, which resulted from failure to recognize focal tissue changes or changes in the final categorization between reads, occurred in both WSI and OM. However, these variations occurred more often with WSI than with OM; thus, OM performed slightly better than did WSI overall. Several previous studies have compared the performance of pathologists using WSI and OM. These studies used tissue from different anatomic sites, such as the breast, prostate, skin, lungs, and stomach. 21 26 Similar to that in our study, the interpretive agreement between the 2 platforms was high: more than the 90th percentile. The concordance between WSI and OM was reported to be lower for nonneoplastic lesions and inflammatory lesions in previous studies. This was previously attributed to the difficulty in identifying finer details such as the nature of inflammatory cells, nuclear atypia, and the presence of apoptotic bodies because of reduced image resolution at higher magnifications with older imaging technologies. The less-equivalent image quality of digital images was cited by many investigators in these previously reported studies as the major cause of WSI s slightly poorer diagnostic performance. We did not find that image quality was a major factor in diagnostic discrepancy between the 2 platforms in this current investigation. The same H&E-stained tissue sections resulted in diagnostic variation using both platforms. The cause of the higher discrepancy rate for WSI than for OM in this study is not entirely clear but is most likely related to the use of a new modality for interpretation instead of the familiar and routinely used light microscope. On the basis of the available evidence from studies of WSI and OM for making primary histologic diagnoses, WSI seems to be at least a suitable adjunct to OM for making a primary histologic diagnosis. The evolving roles of WSI for the remote interpretation of frozen sections, intraoperative histologic diagnosis, and surgical management of patients, with a high diagnostic accuracy, are encouraging. Similarly, the increasing popularity of WSI for second opinion consultation of expert pathologists is testimony to the fact that WSI can be used successfully for interpreting stained tissue sections. Familiarizing pathologists with digital pathology and the incremental step-by-step use of WSI for interpreting specimens such as core biopsies in the first step may facilitate the incorporation of a digital platform for routine surgical pathology workflow. This multi-institutional study is one of the largest systematic studies of WSI compared with OM for making histologic interpretations of breast tissue stained with H&E. This study provides valuable data on the comprehensive evaluation of accuracy, precision, and reproducibility of WSI compared with OM. Although we found the performance of the pathologists using WSI to be comparable with that using OM, OM was marginally superior to WSI. However, our study did not address the time taken to diagnose using WSI compared with OM, which needs to be considered in future studies. Other discreet components of digital pathology, such as scanning, data storage, and integration with existing laboratory informatics systems, should be studied in the 1738 Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al

future as well. Several reviews have addressed the benefits and issues related to incorporating digital pathology into an anatomic pathology practice. 27 32 Our large validation study demonstrates substantial equivalence between the 2 platforms in key interpretive areas. Prospective studies using a design similar to that of our large multi-institutional study are needed to further validate our data regarding the comparison of WSI with OM in different tissue types. References 1. Rojo MG, García GB, Mateos CP, et al. Critical comparison of 31 commercially available digital slide systems in pathology. Int J Surg Pathol. 2006; 14(4):285 305. 2. Kronz JD, Silberman MA, Allsbrook WC. A web-based tutorial improves practicing pathologists Gleason grading of images of prostate carcinoma specimens obtained by needle biopsy: validation of a new medical education paradigm. Cancer. 2000;89(8):188 1823. 3. Hamza S, Anderson P, Reddy VV. Use of the internet in pathology resident training and education. Adv Anat Pathol. 2001;8(5):290 297. 4. Marchevsky AM, Relan A, Baillie S, Self-instructional virtual pathology laboratories using web-based technology enhance medical school teaching of pathology. Hum Pathol. 2003;34(5);423 429. 5. Helin H, Lundin M, Lundin J, et al. Web-based virtual microscopy in teaching and standardizing Gleason grading. Hum Pathol. 2005;36(4):381 386. 6. Lundin M, Szymas J, LinderLuider E, et al. A European network for virtual microscopy design, implementation and evaluation of performance. Virchows Arch. 2009;454(4):421 429. 7. Dee FR. Virtual microscopy in pathology education. Hum Pathol. 2009; 40(8):1112 1121. 8. Lundin M, Lundin J, Helin H, et al. A digital atlas of breast histopathology: an application of web based virtual microscopy. J Clin Pathol. 2004;57(12):1288 1291. 9. Tsuchihashi Y, Takamatsu T, Hashimoto Y, et al. Use of virtual slide system for quick frozen intra-operative telepathology diagnosis in Kyoto, Japan. Diagn Pathol. 2008;3(suppl 1):S6. 10. Evans AJ, Chetty R, Clarke BA, et al. Primary frozen section diagnosis by robotic microscopy and virtual slide telepathology: the University Health Network experience. Semin Diagn Pathol. 2009;26(4):165 176. 11. Park KJ, Reuter V. The use of digital microscopy for frozen section diagnosis: a validation study from Memorial Sloan Kettering Cancer Center, New York. Poster presented at: Pathology Visions 2009 Conference; September 3 15, 2009; San Diego, California. Abstract 13. 12. Ho J, Parwani AV, Jukic DM, et al. Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. Hum Pathol. 2006;37(3):322 331. 13. Graham AR, Bhattacharya AK, Scott KM, et al. Virtual slide telepathology for an academic teaching hospital surgical pathology quality assurance program. Hum Pathol. 2009;40(8):1129 1136. 14. Lopez AM, Graham AR, Barker GP, et al. Virtual slide telepathology enables an innovative telehealth rapid breast clinic. Hum Pathol 2009;40(8): 1082 1091. 15. Bloom K, Harrington D. Enhanced accuracy of HER-2/neu immunohistochemical scoring using digital microscopy. Am J Clin Pathol. 2004;121(5):620 630. 16. Wilbur DC, Madi K, Colvin RB, et al. Whole-slide imaging digital pathology as a platform for teleconsultation: a pilot study using paired subspecialist correlations. Arch Pathol Lab Med. 2009;133(12):1949 1953. 17. Rodriguez-Urrego PA, Cronin AM, Al-Ahmadie HA, et al. Interobserver and intraobserver reproducibility in digital and routine microscopic assessment of prostate needle biopsies. Hum Pathol. 2011;42(1):68 74. 18. Elston CW, Sloane JP, Amendoeira I, et al. Causes of inconsistency in diagnosing and classifying intraductal proliferations of the breast: European Commission working group on breast screening pathology. Eur J Cancer. 2008; 36(14):769 1772. 19. Ghofrani M, Tapia B, Tavassoli FA. Discrepancies in the diagnosis of intraductal proliferative lesions of the breast and its management implications: results of a multinational survey. Virchows Arch. 2006;449(6):609 616. 20. Jain RK, Mehta R, Dimitrov R, et al. Atypical ductal hyperplasia: interobserver and intraobserver variability. Mod Pathol. 2011;24(7):917 923. 21. Weinstein RS, Descour MR, Liang C, et al. An array microscope for ultrarapid virtual slide processing and telepathology: design, fabrication, and validation study. Hum Pathol. 2004;35(11):1303 1314. 22. Gilbertson JR, Ho J, Anthony L, et al. Primary histologic diagnosis using automated whole slide imaging: a validation study. BMC Clin Pathol. 2006;6:4. 23. Velez N, Jukic D, Ho J. Evaluation of 2 whole-slide imaging applications in dermatopathology. Hum Pathol. 2008;39(9):1341 1349. 24. Fine JL, Grzybicki DM, Silowash R, et al. Evaluation of whole slide image immunohistochemistry interpretation in challenging prostate needle biopsies. Hum Pathol. 2008;39(4):564 572. 25. Molnar B, Berczi L, Ficsor L, et al. Digital slide and virtual microscopybased routine and telepathology evaluation of gastrointestinal biopsy specimen. In: Kumar S, Dunn BE, eds. Telepathology. Berlin, Germany: Springer; 2009:5 18. 26. Krenacs T, Zsakovics I, Diczhazi C, et al. The potential of digital microscopy in breast pathology. Pathol Oncol Res. 2009;15(1):55 58. 27. Wienert S, Beil M, Saeger K, et al. Integration and acceleration of virtual microscopy as the key to successful implementation into routine diagnostic process. Diagn Pathol. 2009;4:3. 28. Guzman M, Judkins AR. Digital pathology: a tool for 21st century neuropathology. Brain Pathol. 2009;19(2):305 316. 29. Weinstein RS, Graham AR, Richter LC, et al. Overview of telepathology, virtual microscopy, and whole slide imaging: prospects for the future Hum Pathol. 2009;40(8):1057 1069. 30. Rocha R, Vassallo J, Soares F, et al. Digital slides: present status of a tool for consultation, teaching and quality control in pathology. Pathol Res Pract. 2009; 205(11):735 741. 31. Jara-Lazano AR, Thamboo TP, Teh M, et al. Digital pathology: exploring its application in diagnostic surgical pathology practice. Pathology. 2010;42(6):512 518. 32. Hedvat CV. Digital microscopy: past, present, and future. Arch Pathol Lab Med. 2012;134(11):1666 1670. Arch Pathol Lab Med Vol 137, December 2013 Digital Imaging for Histologic Diagnosis Krishnamurthy et al 1739