CME/SAM. Abstract. Anatomic Pathology / Image Analysis of HER2 Immunostaining

Similar documents
Welcome! HER2 TESTING DIAGNOSTIC ACCURACY 4/11/2016

CME/SAM. Abstract. Anatomic Pathology / HER2/neu Results in Breast Cancer

MEDICAL POLICY. Proprietary Information of YourCare Health Plan

Kristen E. Muller, DO, Jonathan D. Marotti, MD, Vincent A. Memoli, MD, Wendy A. Wells, MD, and Laura J. Tafe, MD

MEDICAL POLICY. Proprietary Information of Excellus Health Plan, Inc. A nonprofit independent licensee of the BlueCross BlueShield Association

2017 OPTIONS FOR INDIVIDUAL MEASURES: REGISTRY ONLY. MEASURE TYPE: Process

HER2/neu Evaluation of Breast Cancer in 2019

Priti Lal, MD, 1 Paulo A. Salazar, 1 Clifford A. Hudis, MD, 2 Marc Ladanyi, MD, 1 and Beiyun Chen, MD, PhD 1. Abstract

Quantitative Image Analysis of HER2 Immunohistochemistry for Breast Cancer

2019 COLLECTION TYPE: MIPS CLINICAL QUALITY MEASURES (CQMS) MEASURE TYPE: Process High Priority

CANCER. Clinical Validation of Breast Cancer Predictive Markers

Product Introduction

Comparison of Immunohistochemical and Fluorescence In Situ Hybridization Assessment of HER-2 Status in Routine Practice

A Study Comparing Conventional Brightfield Microscopy, Image Analysis-Assisted Microscopy, and Interobserver Variation

T he HER2/neu type 1 tyrosine kinase growth factor

TrainableImmunohistochemicalHER2/neu Image Analysis. A Multisite Performance Study Using 260 Breast Tissue Specimens

Journal of Breast Cancer

COMPUTER-AIDED HER-2/neu EVALUATION IN EXTERNAL QUALITY ASSURANCE (EQA) OF BREAST CANCER SCREENING PROGRAMME

Optimal algorithm for HER2 testing

HER2 status assessment in breast cancer. Marc van de Vijver Academic Medical Centre (AMC), Amsterdam

Enhanced Accuracy and Reliability of HER-2/neu Immunohistochemical Scoring Using Digital Microscopy

Assessing the Potential Cost-Effectiveness of Retesting IHC0, IHC11, or FISH-Negative Early Stage Breast Cancer Patients for HER2 Status

2018 OPTIONS FOR INDIVIDUAL MEASURES: REGISTRY ONLY. MEASURE TYPE: Process

HER2+ Breast Cancer Review of Biologic Relevance and Optimal Use of Diagnostic Tools

Determination of HER2 Amplification by In Situ Hybridization. When Should Chromosome 17 Also Be Determined?

Dr. dr. Primariadewi R, SpPA(K)

Assessment Run B HER2 IHC

NIH Public Access Author Manuscript Cancer Epidemiol Biomarkers Prev. Author manuscript; available in PMC 2011 January 1.

FAQs for UK Pathology Departments

HER2 Gene Protein Assay Is Useful to Determine HER2 Status and Evaluate HER2 Heterogeneity in HER2 Equivocal Breast Cancer

Reviewer's report. Version: 1 Date: 24 May Reviewer: Cathy Moelans. Reviewer's report:

Setting The setting was secondary care. The economic study was conducted in the USA.

Assessment Run B HER2 IHC

Genetic heterogeneity in HER2/neu testing by fluorescence in situ hybridization: a study of 2522 cases

On May 4 and 5, 2002, the College of American Pathologists

HER2/neu Amplification in Breast Cancer Stratification by Tumor Type and Grade

HER2 Testing of Multifocal Invasive Breast Carcinoma. Gillian C. Bethune, MD, J. Brendan Mullen, MD, and Martin C. Chang, MD, PhD

HER2 status in breast cancer: experience of a Spanish National Reference Centre

Data Supplement 1: 2013 Update Rationale and Background Information

Version 2 of these Guidelines were drafted in response to published updated ASCO/CAP HER2 test Guideline Recommendations-

HER2 FISH pharmdx TM Interpretation Guide - Breast Cancer

Introduction. The HER2 Testing Expert Panel has identified five Clinical Questions that form the core of this Focused Update.

CME/SAM ABSTRACT. AJCP / Original Article

HER2 CISH pharmdx TM Kit Interpretation Guide Breast Cancer

Template for Reporting Results of Biomarker Testing of Specimens From Patients With Carcinoma of the Breast

Original Article. Jennifer Jeung, MD; Roshan Patel, MD; Lizette Vila, MD; Dara Wakefield, MD; Chen Liu, MD, PhD

Importance of confirming HER2 overexpression of recurrence lesion in breast cancer patients

08 Concordance Between Local and Central Laboratory HER2 Testing

Low ER+ Breast Cancer. Is This a Distinct Group? Nika C. Gloyeske, MD, David J. Dabbs, MD, and Rohit Bhargava, MD ABSTRACT

Prediction of HER2 gene status in Her2 2 þ invasive breast cancer: a study of 108 cases comparing ASCO/CAP and FDA recommendations

Breast cancer diagnostic solutions Deliver diagnostic confidence

Systematic assessment of HER2/neu in gynecologic neoplasms, an institutional experience

System-wide Ownership Group: Allina Health Breast Program Committee. Hospital Division Quality Council: August 2018

What is HER2 positive breast cancer in 2018? Updated ASCO-CAP guidelines. Giuseppe Viale University of Milan European Institute of Oncology

College of American Pathologists. Pathology Performance Measures included in CMS 2012 PQRS

University of Groningen

CME/SAM. Ellen G. East, MD, 1 Judy C. Pang, MD, 1 Kelley M. Kidwell, PhD, 2 and Julie M. Jorns, MD 1 ABSTRACT

Supplementary Online Content

# Best Practices for IHC Detection and Interpretation of ER, PR, and HER2 Protein Overexpression in Breast Cancer

Instant Quality FISH. The name says it all.

Instant Quality FISH. The name says it all.

1.5. Research Areas Treatment Selection

CME/SAM. HER2 Heterogeneity Affects Trastuzumab Responses and Survival in Patients With HER2-Positive Metastatic Breast Cancer

Prosigna BREAST CANCER PROGNOSTIC GENE SIGNATURE ASSAY

Prosigna BREAST CANCER PROGNOSTIC GENE SIGNATURE ASSAY

erb-b2 Amplification by Fluorescence In Situ Hybridization in Breast Cancer Specimens Read as 2+ in Immunohistochemical Analysis

Taxotere * and carboplatin plus Herceptin (trastuzumab) (TCH): the first approved non-anthracycline Herceptin-containing regimen 1

Controversies in HER2 Oncogene Testing: What Constitutes a True Positive Result in Patients With Breast Cancer?

Considerable advances in the therapy of breast cancer

Assessment Run B HER-2 IHC. HER-2/chr17 ratio**

EARLY ONLINE RELEASE

Journal of Breast Cancer

Conflict of Interest. Thank you. I have no relevant conflicts of interest in regards to the content of this presentation.

HER-2/neu Analysis in Gastroesophageal and Gastric Adenocarcinoma Keith Daniel Bohman, MD

Assessment Run B HER-2

First released in 2007 and updated in 2013, the recommendations

Breast Cancer Interpretation Guide

Guideline. Associated Documents ASCO CAP 2018 GUIDELINES and SUPPLEMENTS -

Department of Pathology, Loyola University Medical Center, Maywood, IL 60153, USA 2

저작권법에따른이용자의권리는위의내용에의하여영향을받지않습니다.

Targeting the Oncogenic Pathway as Opposed to the Primary Tumor Site: HER2 as an Example

Assessment of Breast Cancer with Borderline HER2 Status Using MIP Microarray

MBP AP 3 Core Curriculum

KEY WORDS: Breast carcinoma, c-erbb2, Fluorescent. Mod Pathol 2001;14(11):

Validation of a clinical laboratory test means confirmation,

Human epidermal growth factor receptor 2 (HER2)

Expression of human epidermal growth factor receptor 2 in primary and paired parenchymal recurrent and/or metastatic sites of gastric cancer

Digital Pathology and CAP Guidelines

Quality assurance and quality control in pathology in breast disease centers

Implications of Progesterone Receptor Status for the Biology and Prognosis of Breast Cancers

Brief Formalin Fixation and Rapid Tissue Processing Do Not Affect the Sensitivity of ER Immunohistochemistry of Breast Core Biopsies

Three Hours Thirty Minutes

Evaluation of HER2/neu oncoprotein in serum and tissue samples of women with breast cancer: Correlation with clinicopathological parameters

Measure Definition Benchmark Endorsed By. Measure Definition Benchmark Endorsed By

Update on the Practical Management of HER2-Positive Breast Cancer

Clinical Policy: Her2/neu Testing Reference Number: CP.MP.155

Update on the Practical Management of HER2-Positive Breast Cancer

Droplet digital PCR using HER2/EIF2C1 ratio for detection of HER2 amplification in breast cancer tissues

The Effect of Delay in Fixation, Different Fixatives, and Duration of Fixation in Estrogen and Progesterone Receptor Results in Breast Carcinoma

Transcription:

Anatomic Pathology / Image Analysis of HER2 Immunostaining Image Analysis of HER2 Immunohistochemical Staining Reproducibility and Concordance With Fluorescence In Situ Hybridization of a Laboratory-Validated Scoring Technique Douglas M. Minot, Jesse Voss, Susan Rademacher, Toe Lwin, Jessica Orsulak, Bolette Caron, Rhett Ketterling, MD, Aziza Nassar, MD, Beiyun Chen, MD, PhD, and Amy Clayton, MD Key Words: Breast neoplasms; Immunohistochemistry; Fluorescence in situ hybridization; Trastuzumab; Herceptin; HER2; Targeted therapy CME/SAM DOI: 10.1309/AJCP9MKNLHQNK2ZX Upon completion of this activity you will be able to: discuss the importance of concordance between immunohistochemistry and fluorescence in situ hybridization results in evaluating HER2 status in breast cancer patients. describe the validated image analysis technique for HER2 evaluation. compare performance characteristics of manual HER2 immunohistochemical assessment and the image analysis method. discuss the effect on inter- and intraobserver variability measurements using the validated image analysis method. The ASCP is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The ASCP designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 Credit per article. Physicians should claim only the credit commensurate with the extent of their participation in the activity. This activity qualifies as an American Board of Pathology Maintenance of Certification Part II Self-Assessment Module. The authors of this article and the planning committee members and staff have no relevant financial relationships with commercial interests to disclose. Questions appear on p 319. Exam is located at www.ascp.org/ajcpcme. Abstract Image analysis of the HER2 immunohistochemical (IHC) stain can help determine which breast cancer patients may benefit from HER2-targeted therapy. We studied the concordance of HER2 IHC and fluorescence in situ hybridization (FISH) as well as reproducibility of surgical pathologist (SP) and cytotechnologist (CT) interpretations using manual and image analysis methodologies on 154 IHC cases. Concordances with FISH were good for IHC negative (0, 1+) cases (range, 97%-100%) and positive (3+) cases (range, 87%-100%). Image analysis had fewer equivocal (2+) results (10.4%) than CT (14.9%) and SP (16.2%) manual methods, with higher concordances to FISH (31%, 26%, and 20% for image analysis, CT manual, and SP manual, respectively). CT manual (κ = 0.747) and image analysis (κ = 0.779) methods had better interobserver reproducibility than SP manual (κ = 0.697). CT image analysis had better intraobserver reproducibility (κ = 0.882) than CT (κ = 0.828) and SP (κ = 0.766) manual methods. HER2 IHC analysis performed by image analysis can produce accurate results with improved reproducibility. The human epidermal growth factor receptor 2 (HER2) protein is a transmembrane receptor kinase, which is encoded by the HER2/neu (ERBB2) gene and is amplified in approximately 25% to 30% of all breast cancers. The HER2 signaling pathway and estrogen receptor pathway are considered 2 of the most effective drivers of cell survival and proliferation in 85% of all breast cancers. Trastuzumab (Herceptin, Genentech, San Francisco, CA) is a humanized monoclonal antibody directed at the HER2 pathway that binds the extracellular domain of HER2, thus interfering with the signal transduction cascade initiated by HER2 overexpression. 1 The requirement that HER2 protein overexpression or gene amplification is present before treatment with trastuzumab is supported by multiple clinical studies that show effectiveness in this cohort of patients. 2-5 There are currently 2 primary laboratory methods used to determine HER2 status: immunohistochemical analysis, which determines the level of protein expression, and HER2 fluorescence in situ hybridization (FISH), a cytogenetic technique developed to detect amplification of the ERBB2 gene. The US Food and Drug Administration (FDA)-approved immunohistochemical kits include HercepTest (DAKO, Carpinteria, CA) and Pathway (Ventana Medical Systems, Tucson, AZ). Currently, there are 3 FISH assays with FDA approval: PathVysion (Abbott Laboratories, Abbott Park, IL), Inform (Ventana Medical Systems), and PharmDx (DAKO, Glostrup, Denmark). Considerable debate exists as to whether immunohistochemical analysis or FISH is the best to determine a patient s HER2 status and subsequent eligibility to receive 270 Am J Clin Pathol 2012;137:270-276 270 DOI: 10.1309/AJCP9MKNLHQNK2ZX

Anatomic Pathology / Original Article targeted therapy. This debate exists, in part, because both testing modalities were used in the prospective randomized adjuvant trials of trastuzumab. Evidence of immunohistochemical overexpression (3+), FISH amplification, or a combination of the 2 tests (2+ immunohistochemical staining with FISH amplification) were used to determine enrollment eligibility. Further confounding this debate are the multiple studies that demonstrate suboptimal concordance rates between immunohistochemical assessments and FISH analyses between laboratories performing HER2 testing. 6-9 Guidelines and recommendations were published in 2007 by a joint American Society of Clinical Oncology/College of American Pathologists (ASCO/CAP) Task Force in an effort to standardize testing protocols and test interpretation. 10 In addition to providing specific guidance intended to reduce assay variation with specific scoring algorithms, the panel also recommended that laboratories show 95% concordance with another validated laboratory test. Some recent studies indicate that adherence to the guidelines can benefit laboratories by improving HER2 immunohistochemical and FISH concordance, reduce inconclusive FISH cases, 11 and decrease interobserver variability. 12 Other studies have suggested that biologic reasons may have a large role in discordant cases, 13 and further clinical studies are needed to determine whether the updated guidelines are better at predicting response to anti-her2 therapy. 14 Historically, the primary method used to determine immunohistochemical overexpression has been visual assessment by bright-field microscopy. In recent years, investigators have demonstrated that image analysis can be an effective tool for achieving accurate and reproducible interpretation of HER2 protein expression. 15-18 A study previously published from our group demonstrated that by using a laboratoryvalidated scoring technique, one can accurately identify nonamplified and amplified FISH cases by immunohistochemical analysis with fewer 2+ cases being reflexed to FISH. 19 Despite the inroads that digital imaging technology companies have made in pathology, there seems to be a dearth of published peer-reviewed articles that clearly describe image analysis techniques with accuracy and precision assessments. The goal of this study was to investigate the accuracy and precision of our validated scoring technique using this technology by multiple observers. Materials and Methods Patient Population This retrospective study was performed on 154 of the 159 slides from our original validation study as previously described. 19 In brief, 187 consecutive patients with breast cancer were selected who underwent routine HER2 testing between January 22, 2008, and February 13, 2008, at the Mayo Clinic. Of the original 187 patients, the data for 28 were excluded owing to various reasons (FISH hybridization failure, equivocal FISH results, or insufficient tissue for FISH analysis), leaving a total of 159 patients for the original validation study. The 5 specimens excluded from this study were because of significant slide damage (eg, broken, cracked) that prohibited them from being scanned by the imaging instrument for analysis. All cases had FISH analysis performed to determine ERBB2 amplification status regardless of immunohistochemical score, which is a departure from our clinical practice of performing FISH analysis on immunohistochemically 2+ cases only. The mean, median, and range of ages of the patients in this study were 63.9, 64.0, and 24 to 97 years, respectively. The study population included 12 metastatic lesions and 142 primary breast tumors. HER2 Immunohistochemical Analysis Breast cancer specimens were stained as part of clinical practice using HercepTest, a semiquantitative assay used to determine HER2 protein overexpression. Our laboratory analyzes HER2-stained slides using the Automated Cellular Imaging System (ACIS) III (DAKO, Carpinteria), which is an automated image analysis system that uses a bright-field microscope. The ACIS digitizes immunohistochemically stained tissue slides, which can then be evaluated using proprietary image analysis software. HER2 slides were subjected to manual (visual assessment using bright-field microscopy) and ACIS-assisted assessments using our validated scoring method. Our validated scoring method consists of the mean score from 6 areas similar to the area of tissue seen using a 40 objective, with 2 areas each of high-intensity cytoplasmic membrane staining, moderate-intensity cytoplasmic membrane staining, and low-intensity membrane staining. When low-intensity staining was absent, 2 tumor areas without cell membrane staining were substituted. The study participants were 3 surgical pathologists (SPs) and 3 cytotechnologists (CTs). CTs were included because it is our laboratory practice to have CTs prescreen all HER2 immunohistochemically stained breast cancer specimens before pathologist review and final sign-out. First, pathologists and CTs performed manual assessments of the 154 slides without knowledge of existing immunohistochemical scores or FISH results and recorded their findings based on the HercepTest scale (0, 1+, 2+, and 3+) using the specific immunohistochemical scoring criteria defined in the ASCO/ CAP guidelines Table 1. 10,20 A percentage estimate of cells staining at each of the 4 levels (0, 1+, 2+, and 3+) was also collected at this time to interpret the immunohistochemical slides using the HercepTest package insert method (Table 1). Second, ACIS-assisted reviews were performed by the Am J Clin Pathol 2012;137:270-276 271 271 DOI: 10.1309/AJCP9MKNLHQNK2ZX 271

Minot et al / Image Analysis of HER2 Immunostaining Table 1 HercepTest Scoring Algorithm and ASCO/CAP Scoring Algorithm Score HercepTest ASCO/CAP 0 No staining observed or membrane staining observed in No staining observed in invasive tumor cells <10%of the tumor cells 1+ Faint/barely perceptible membrane staining detected in Weak, incomplete membrane staining in any proportion of >10%of the tumor cells; cells stained in only invasive tumor cells or weak, complete membrane staining part of membrane in <10% of cells 2+ A weak to moderate complete membrane staining Complete membrane staining that is nonuniform or weak but with observed in >10% of tumor cells obvious circumferential distribution in at least 10% of cells or intense, complete membrane staining in 30% of tumor cells 3+ Strong, complete membrane staining observed in >10% Uniform, intense membrane staining of >30% of invasive tumor cells of the tumor cells Based on HercepTest package insert. 20 Based on current American Society of Clinical Oncology (ASCO)/College of American Pathologists (CAP) guidelines first published in 2007. 10 CTs after a minimum 2-week washout period. Finally, to determine intraobserver variability, participants reanalyzed 20 slides that represented a range of immunohistochemical scores, manually (SPs and CTs) and with ACIS-assistance (CTs) after an additional 2-week period. Statistical Analysis Statistical analysis comparing interobserver and intraobserver variability was performed using Graphpad Software (Graphpad Software, La Jolla, CA) using the Quantify agreement with κ function. Results Observer concordance with FISH is summarized in Table 2. All SP and CT immunohistochemical assessments (manual and ACIS-assisted) had perfect and near-perfect concordance with FISH in the negative (0 and 1+) HercepTest scoring categories (100% and 97%-99%, respectively). There were 6 false-positive cases (HER2 immunohistochemical score 3+/FISH nonamplified) identified for all assessments with 3 identified in the SP assessments, 2 in the CT ACIS-assisted assessments, and 1 in the CT manual assessments. The average positive predictive values of a 3+ HER2 immunohistochemical score for SP, CT (manual), and CT (ACIS-assisted) were 93%, 96.7%, and 94%, respectively. The overall average correlations of immunohistochemical scores between SPs was 70.3%, whereas the correlation of CT assessments was 80.5% for manual interpretation and 78.8% for ACIS-assisted interpretation. If the 0 and 1+ categories were combined, overall average correlations for SP, CT manual assessments, and CT ACIS-assisted assessments improved to 87.9%, 90.9%, and 93.1%, respectively. CTs with ACIS-assistance identified fewer (mean, 17.3) equivocal immunohistochemical 2+ cases than in their manual assessments (mean, 23.3) and SP manual assessments (mean, 25.7). Of 3 CTs, 2 called an average of 9 fewer 2+ cases with ACIS assistance than the CT manual assessments, and a higher proportion of the 2+ cases identified by the 2 CTs using the ACIS method were FISH+ than their manual readings (30% vs 24%). Overall, the percentages of equivocal (2+) immunohistochemical cases that were positive by FISH were 16.9%, 25.7%, and 28.8% for the SP, CT manual, and CT ACIS-assisted assessments, respectively. We compared the performance of HER2 immunohistochemical manual assessment using the HercepTest scoring algorithm and the ASCO/CAP-recommended scoring algorithm (Table 1) based on data collected for estimated staining percentages by the multiple observers in our study. Table 3 shows observer scores when strict adherence to the HercepTest scoring algorithm was followed as described in the package insert. 20 The majority of the SPs (2/3) would have called more 2+ cases (mean, 2 cases) using the Hercep- Test package insert instructions than when using the ASCO/ CAP guidelines, with a lower percentage of these 2+ cases Table 2 Number of Patients per HercepTest Score With a Positive FISH Result by Observer and Assessment Type (Manual or ACIS-Assisted) Score Observer 0 1+ 2+ 3+ Total Pathologist 1 (manual) 30 (0) 85 (1) 27 (19) 12 (92) 154 Pathologist 2 (manual) 60 (0) 64 (3) 15 (13) 15 (87) 154 Pathologist 3 (manual) 20 (0) 89 (1) 35 (17) 10 (100) 154 Technologist 1 (manual) 22 (0) 91 (1) 31 (23) 10 (90) 154 Technologist 1 (ACIS) 34 (0) 92 (2) 17 (29) 11 (91) 154 Technologist 2 (manual) 39 (0) 85 (2) 20 (25) 10 (100) 154 Technologist 2 (ACIS) 51 (0) 77 (3) 16 (31) 10 (100) 154 Technologist 3 (manual) 20 (0) 106 (2) 19 (32) 9 (100) 154 Technologist 3 (ACIS) 51 (0) 73 (3) 19 (26) 11 (91) 154 ACIS, Automated Cellular Imaging System. The percentage of cases in each immunohistochemical category positive by fluorescence in situ hybridization is shown in parentheses. 272 Am J Clin Pathol 2012;137:270-276 272 DOI: 10.1309/AJCP9MKNLHQNK2ZX

Anatomic Pathology / Original Article Table 3 Immunohistochemical Scores and Concordance With Fluorescence In Situ Hybridization Using the HercepTest Package Insert Criteria Score Observer 0 1+ 2+ 3+ Total Surgical pathologist 1 31 (0) 77 (1) 30 (13) 16 (75) 154 2 56 (0) 67 (4) 16 (13) 15 (80) 154 3 30 (0) 79 (1) 33 (12) 12 (100) 154 Cytotechnologist 1 34 (0) 79 (1) 28 (14) 13 (92) 154 2 48 (0) 73 (3) 21 (14) 12 (100) 154 3 40 (0) 86 (2) 17 (24) 11 (100) 154 Based on percentage estimates provided by study participants. The percentage of cases in each immunohistochemical category positive by fluorescence in situ hybridization is shown in parentheses. being FISH+ (mean, 13% vs 16%). The majority of SPs (2/3) would also have called more 3+ cases (mean, 3 cases), with a lower percentage of the cases being FISH+ than when these cases were manually assessed under the current ASCO/CAP guidelines (87.5% vs 96%). Two CTs called fewer 2+ cases using the package insert criteria (mean, 2.5 cases), but a lower percentage of these cases was FISH+ (mean, 19% vs 27.5%) compared with using the ASCO/CAP criteria. Also in contrast with the SPs, all 3 CTs identified more 3+ cases (mean, 2.3 cases), but a similar proportion of these cases was positive by FISH on average, when compared with their original manual assessments (97.3% vs 96.7%). Table 4 κ Statistic by Observer (Pathologist or Cytotechnologist) and Assessment Type (Manual or ACIS-Assisted) κ 95% CI Interobserver Pathologist 1 vs pathologist 2 0.668 0.552-0.823 Pathologist 1 vs pathologist 3 0.726 0.607-0.845 Pathologist 2 vs pathologist 3 0.677 0.544-0.809 Technologist 1 vs technologist 2 0.709 0.578-0.839 Technologist 1 vs technologist 2 0.808 0.686-0.930 Technologist 1 vs technologist 3 0.755 0.633-0.877 Technologist 1 vs technologist 3 0.839 0.730-0.948 Technologist 2 vs technologist 3 0.778 0.650-0.904 Technologist 2 vs technologist 3 0.689 0.540-0.839 Intraobserver Pathologist 1 0.774 0.539-1.01 Pathologist 2 0.759 0.508-1.01 Pathologist 3 0.764 0.517-1.01 Technologist 1 0.767 0.525-1.01 Technologist 1 0.913 0.748-1.079 Technologist 2 0.903 0.717-1.088 Technologist 2 0.82 0.583-1.057 Technologist 3 0.814 0.569-1.059 Technologist 3 0.913 0.748-1.079 ACIS, Automated Cellular Imaging System; CI, confidence interval. Manual assessment. ACIS method (2 areas of high expression, 2 areas of moderate expression, and 2 areas of low or no expression). We also examined interobserver and intraobserver agreement levels (κ statistic) Table 4. Interobserver reproducibility statistics show average κ scores of 0.690, 0.747, and 0.779 for SP, CT manual, and CT ACIS-assisted assessments, respectively. In addition, 2 of 3 CTs saw improvements in their reproducibility using the ACIS-assisted method compared with their manual assessments. Intraobserver reproducibility statistics show average κ scores of 0.766, 0.828, and 0.882 for SP, CT manual, and CT ACIS-assisted, respectively. Of 3 cytotechnologists, 2 saw an improvement of this measure using our validated image analysis technique compared with the manual method. Discussion This study demonstrates that laboratory personnel can achieve high precision and high accuracy with image analysis of HER2-stained slides using a laboratory-validated image analysis scoring technique. In fact, by some measurements, the image analysis technique performed better than manual assessments. We saw increased concordance with FISH and better interobserver and intraobserver reproducibility overall with the ACIS-assisted method over manual assessments. Concordance rates with FISH were perfect (100%) in the HercepTest 0 category, regardless of the analysis method. In the HercepTest 1+ category, we saw similar false-negative rates across all analysis methods (range, 1%-3%). These are encouraging findings because they suggest that few cases are being undercalled. Our data also show that patients who have a strongly positive (3+) immunohistochemical result are also being appropriately identified, an important finding because patients with these results are also known to derive the most therapeutic benefit from HER2 pathway inhibitory agents. Pathologists concordance with FISH in the 3+ category ranged from 87% to 100%, CT 2 had perfect (100%) concordance regardless of analysis method, and CT 1 improved slightly and CT 3 saw a slight decrease in performance when using the image analysis technique. Another significant finding in our study was the decrease in the number of cases being interpreted as equivocal (2+) using our validated ACIS-assisted technique. Of 3 CTs, 2 identified fewer 2+ cases (4 and 14 cases, respectively) when using the ACIS, while the percentage of 2+ cases that were FISH+ increased on average (30% vs 24%). This observation, coupled with the identification of more immunohistochemically negative (0, 1+) cases and a similar number of cases in the positive (3+) category for ACIS-assisted assessments, suggests that the ACIS is appropriately downgrading a proportion of these equivocal cases without missing FISH+ cases. Cantaloni et al 21 found that they were able to reduce the number of specimens submitted for FISH analysis by 18% by using Am J Clin Pathol 2012;137:270-276 273 273 DOI: 10.1309/AJCP9MKNLHQNK2ZX 273

Minot et al / Image Analysis of HER2 Immunostaining computer-assisted immunohistochemical analysis on a cohort of equivocal 2+ cases while maintaining a very low (1%) false-negative rate. These data suggest that a validated image analysis technique can reduce the number of equivocal (2+) cases that would be reflexed to FISH while maintaining a very low false-negative rate. HER2 immunohistochemical analysis is typically performed using 1 of 2 FDA-approved kits, HercepTest and Pathway. An important and somewhat controversial issue is that the recommended ASCO/CAP guidelines are significantly different from the HercepTest scoring algorithm. This panel now recommends that more than 30% of tumor cells must show circumferential membrane staining to consider a tumor as strongly positive (3+). This would result in all cases that are greater than 10% but less than or equal to 30%, which would be called strongly positive (3+) according to the HercepTest package insert, now being called equivocal (2+) under the new guidelines. 10 Theoretically, adoption of these criteria could lead to more equivocal immunohistochemical cases, which thus would be subjected to additional FISH testing. We were able to compare the performance of manual assessment of HER2 immunohistochemical analysis using the HercepTest scoring algorithm and the ASCO/CAP-recommended scoring algorithm (Table 1) based on the estimated staining percentages recorded by multiple observers in our study. If interpretations were made based on the percentage categorization (0, 1+, 2+, and 3+) of the tumor cells by SPs and CTs, more cases would have been called equivocal (2+) by 2 of 3 SPs, thus potentially increasing the number of cases reflexed to FISH. However, CTs did not see a similar increase in the number of equivocal (2+) cases when using the package insert method. A relatively low percentage of these equivocal cases were positive by FISH on average when using the package insert method (13% for SPs and 17% for CTs). In comparison, average FISH positivity rates were considerably higher in the equivocal category for the ASCO/CAP guideline methods for SP (16.9%) and CT manual (25.7%) interpretations and the CT ACIS-assisted method (28.8%). Our data also suggest that pathologists could have overcalled (3+ immunohistochemical staining/fish ) a higher proportion of cases using the package insert method vs using the ASCO/ CAP guidelines (15% vs 7%, respectively). We found that by using image analysis, the number of equivocal HER2 immunohistochemical results can be reduced, thus reducing the number of cases reflexed to FISH analysis. However, the optimal HER2 testing algorithm is still under debate. 22 Several modeling and meta-analysis studies have been performed and seem to offer little clarity to this issue. 23-26 Elkin et al 23 concluded that it would be more costeffective to use FISH alone or as confirmation of all positive HercepTest results, rather than using FISH to confirm only weakly positive results or using HercepTest alone, whereas Lidgren et al 24 concluded in their analysis that FISH testing for all patients is a cost-effective treatment option from a societal perspective. Dendukuri et al 25 performed a meta-analysis and found that the strategy with the lowest cost-effectiveness ratio involved screening all newly diagnosed cases of breast cancer with immunohistochemical analysis and confirming scores of 2+ or 3+ with FISH. The current ASCO/CAP guidelines recommend that clinicians first perform immunohistochemical analysis, with equivocal results (2+) reflexed to FISH. The published guidelines identify a potential role for image analysis as a means to achieve consistent interpretation. Image analysis is being used by some institutions, as shown by a recent survey distributed to participants in the HER2 immunohistochemical analysis proficiency program that indicated that 33% of laboratories are currently using quantitative computer image analysis. 27 Recent image analysis studies have been published that show positive correlations with FISH, that meet or exceed the guideline goal of 95% concordance for negative and positive immunohistochemical results. 15,18 Dobson et al 15 achieved a 95% concordance rate between their image analysis technique and FISH by determining the extent of circumferential HER2 staining along with other tissue staining features. While our ACIS-assisted method increased the overall concordance of HER2 immunohistochemical analysis and FISH, our method also improved interobserver and intraobserver reproducibility. Of 3 CTs in our study, 2 noticed improvements in interobserver and intraobserver variability by using image analysis, and the CT ACIS-assisted method had better κ statistic values overall on average than CT manual and SP assessments. This finding is consistent with the findings of other investigators who have demonstrated that image analysis can decrease the variation in HER2 immunohistochemical scoring. 16,17,28 Strengths of our study include our use of clinical patient samples, a multiple observer study format with pathologist and cytotechnologist participants, a clearly defined and validated image analysis method, and a single gold standard for all study specimens. A potential limitation to this study is that we compared the HercepTest and ASCO/CAP criteria based on our presumption that an observer would make a manual immunohistochemical interpretation using the estimated percentage levels of tumor staining. It is also possible that other immeasurable variables could impact a final interpretation outside of simple percentage assessments. In addition, the specimens used for this study were obtained during a 2-month time frame. It is possible, but unlikely, that variabilities in staining from lot changes and/or shifts in staining personnel could have affected the results of our study if specimens were obtained during a longer time. Image analysis with the ACIS relies on consistent staining quality since the user is unable to modify the instruments color thresholding algorithm in the FDA-approved HER2 software application. 274 Am J Clin Pathol 2012;137:270-276 274 DOI: 10.1309/AJCP9MKNLHQNK2ZX

Anatomic Pathology / Original Article The results from this study demonstrate that a lofty goal of 95% concordance rates between immunohistochemical analysis and FISH is achievable using the ACIS image analysis instrument with our validated scoring algorithm. Interobserver and intraobserver variability can also be improved over manual assessment through the use of this ACIS-assisted scoring technique. It is clear that additional experiential studies are needed from other investigators to determine whether this technique is reproducible at other institutions. As the spotlight grows brighter on laboratory testing, it will become increasingly important for laboratories to demonstrate accuracy, precision, and cost-effectiveness of HER2 immunohistochemical testing, and we believe that image analysis can be a useful method to achieve these objectives. From the Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN. Address reprint requests to Dr Clayton: Dept of Laboratory Medicine and Pathology, Mayo Clinic, 200 First St SW, Rochester, MN 55905. References 1. Goldenberg MM. Trastuzumab, a recombinant DNA derived humanized monoclonal antibody, a novel agent for the treatment of metastatic breast cancer. Clin Ther. 1999;21:309-318. 2. Mass RD, Press MF, Anderson S, et al. Evaluation of clinical outcomes according to HER2 detection by fluorescence in situ hybridization in women with metastatic breast cancer treated with trastuzumab. Clin Breast Cancer. 2005;6:240-246. 3. Cobleigh MA, Vogel CL, Tripathy D, et al. Multinational study of the efficacy and safety of humanized anti-her2 monoclonal antibody in women who have HER2- overexpressing metastatic breast cancer that has progressed after chemotherapy for metastatic disease. J Clin Oncol. 1999;17:2639-2648. 4. Vogel CL, Cobleigh MA, Tripathy D, et al. Efficacy and safety of trastuzumab as a single agent in first-line treatment of HER2-overexpressing metastatic breast cancer. J Clin Oncol. 2002;20:719-726. 5. Slamon DJ, Leyland-Jones B, Shak S, et al. Use of chemotherapy plus a monoclonal antibody against HER2 for metastatic breast cancer that overexpresses HER2. N Engl J Med. 2001;344:783-792. 6. Roche PC, Suman VJ, Jenkins RB, et al. Concordance between local and central laboratory HER2 testing in the Breast Intergroup Trial N9831. J Natl Cancer Inst. 2002;94:855-857. 7. Perez EA, Suman VJ, Davidson NE, et al. HER2 testing by local, central, and reference laboratories in specimens from the North Central Cancer Treatment Group N9831 Intergroup Adjuvant Trial. J Clin Oncol. 2006;24:3032-3038. 8. Wludarski SC, Lopes LF, Berto E Silva TR, et al. HER2 testing in breast carcinoma: very low concordance rate between reference and local laboratories in Brazil. Appl Immunohistochem Mol Morphol. 2011;19:112-118. 9. Papadopoulos S, Kouvatseas G, Skarlos D, et al. Comparison of HER2 detection methods between central and regional laboratories in Greece. Clin Breast Cancer. 2007;7:784-790. 10. Wolff AC, Hammond ME, Schwartz JN, et al. American Society of Clinical Oncology/College of American Pathologists guideline recommendations for human epidermal growth factor receptor 2 testing in breast cancer. Arch Pathol Lab Med. 2007;131:18-43. 11. Middleton LP, Price KM, Puig P, et al. Implementation of American Society of Clinical Oncology/College of American Pathologists HER2 guideline recommendations in a tertiary care facility increases HER2 immunohistochemistry and fluorescence in situ hybridization concordance and decreases the number of inconclusive cases. Arch Pathol Lab Med. 2009;133:775-780. 12. Hameed O, Adams AL, Baker AC, et al. Using a higher cutoff for the percentage of HER2+ cells decreases interobserver variability in the interpretation of HER2 immunohistochemical analysis. Am J Clin Pathol. 2008;130:425-427. 13. Grimm EE, Schmidt RA, Swanson PE, et al. Achieving 95% cross-methodological concordance in HER2 testing: causes and implications of discordant cases. Am J Clin Pathol. 2010;134:284-292. 14. Shah SS, Ketterling RP, Goetz MP, et al. Impact of American Society of Clinical Oncology/College of American Pathologists guideline recommendations on HER2 interpretation in breast cancer. Hum Pathol. 2010;41:103-106. 15. Dobson L, Conway C, Hanley A, et al. Image analysis as an adjunct to manual HER-2 immunohistochemical review: a diagnostic tool to standardize interpretation. Histopathology. 2010;57:27-38. 16. Masmoudi H, Hewitt SM, Petrick N, et al. Automated quantitative assessment of HER-2/neu immunohistochemical expression in breast cancer. IEEE Trans Med Imaging. 2009;28:916-925. 17. Gustavson MD, Bourke-Martin B, Reilly D, et al. Standardization of HER2 immunohistochemistry in breast cancer by automated quantitative analysis. Arch Pathol Lab Med. 2009;133:1413-1419. 18. Turashvili G, Leung S, Turbin D, et al. Inter-observer reproducibility of HER2 immunohistochemical assessment and concordance with fluorescent in situ hybridization (FISH): pathologist assessment compared to quantitative image analysis. BMC Cancer. 2009;9:165. doi:10.1186/1471-2407-9-165. 19. Minot DM, Kipp BR, Root RM, et al. Automated Cellular Imaging System III for assessing HER2 status in breast cancer specimens: development of a standardized scoring method that correlates with FISH. Am J Clin Pathol. 2009;132:133-138. 20. HercepTest [package insert]. Carpinteria, CA: DAKO North America; 2010. 21. Cantaloni C, Tonini RE, Eccher C, et al. Diagnostic value of automated HER2 evaluation in breast cancer: a study on 272 equivocal (score 2+) HER2 immunoreactive cases using an FDA approved system. Appl Immunohistochem Mol Morphol. 2011;19:306-312. 22. Phillips KA, Marshall DA, Haas JS, et al. Clinical practice patterns and cost effectiveness of human epidermal growth receptor 2 testing strategies in breast cancer patients. Cancer. 2009;115:5166-5174. Am J Clin Pathol 2012;137:270-276 275 275 DOI: 10.1309/AJCP9MKNLHQNK2ZX 275

Minot et al / Image Analysis of HER2 Immunostaining 23. Elkin EB, Weinstein MC, Winer EP, et al. HER-2 testing and trastuzumab therapy for metastatic breast cancer: a costeffectiveness analysis. J Clin Oncol. 2004;22:854-863. 24. Lidgren M, Wilking N, Jonsson B, et al. Cost-effectiveness of HER2 testing and trastuzumab therapy for metastatic breast cancer. Acta Oncol. 2008;47:1018-1028. 25. Dendukuri N, Khetani K, McIsaac M, et al. Testing for HER2-positive breast cancer: a systematic review and costeffectiveness analysis. CMAJ. 2007;176:1429-1434. 26. Blank PR, Schwenkglenks M, Moch H, et al. Human epidermal growth factor receptor 2 expression in early breast cancer patients: a Swiss cost-effectiveness analysis of different predictive assay strategies. Breast Cancer Res Treat. 2010;124:497-507. 27. Nakhleh RE, Grimm EE, Idowu MO, et al. Laboratory compliance with the American Society of Clinical Oncology/ College of American Pathologists guidelines for human epidermal growth factor receptor 2 testing: a College of American Pathologists survey of 757 laboratories. Arch Pathol Lab Med. 2010;134:728-734. 28. Gavrielides MA, Gallas BD, Lenz P, et al. Observer variability in the interpretation of HER2/neu immunohistochemical expression with unaided and computer-aided digital microscopy. Arch Pathol Lab Med. 2011;135:233-242. 276 Am J Clin Pathol 2012;137:270-276 276 DOI: 10.1309/AJCP9MKNLHQNK2ZX