ARTIFICIAL INTELLIGENCE FOR DIGITAL PATHOLOGY. Kyunghyun Paeng, Co-founder and Research Scientist, Lunit Inc.

Size: px
Start display at page:

Download "ARTIFICIAL INTELLIGENCE FOR DIGITAL PATHOLOGY. Kyunghyun Paeng, Co-founder and Research Scientist, Lunit Inc."

Transcription

1 ARTIFICIAL INTELLIGENCE FOR DIGITAL PATHOLOGY Kyunghyun Paeng, Co-founder and Research Scientist, Lunit Inc.

2 1. BACKGROUND: DIGITAL PATHOLOGY 2. APPLICATIONS AGENDA BREAST CANCER PROSTATE CANCER 3. DEMONSTRATIONS 4. CONCLUSION 2

3 BACKGROUND: DIGITAL PATHOLOGY DIAGNOSTIC PROCEDURE Patient Detection (X-ray, CT, MRI,...) Diagnosis (biopsy, resection,...) Treatment Radiology Pathology Oncology 3

4 BACKGROUND: DIGITAL PATHOLOGY LIMITATIONS OF CONVENTIONAL PATHOLOGY Slide Report Diagnosis (biopsy, resection,...) Pathology (-) Archiving (-) Workflow (-) Analysis 4

5 BACKGROUND: DIGITAL PATHOLOGY RISE OF DIGITAL PATHOLOGY Diagnosis (biopsy, resection,...) Pathology (+) Archiving (+) Workflow (+) Analysis Digital pathology 5

6 BACKGROUND: DIGITAL PATHOLOGY WHY DO WE NEED AI IN DIGITAL PATHOLOGY? (+) Reproducibility (+) Accuracy (+) Workload reduction 25% disagreement among pathologists in breast biopsy report. Diagnostic Concordance Among Pathologists Interpreting Breast Biopsy Specimens., JAMA,

7 BACKGROUND: DIGITAL PATHOLOGY CHALLENGES IN AI FOR DIGITAL PATHOLOGY ~ 100,000 pixels 1. Gigapixel images Grade 1 Grade 2 Grade 3 2. Quality variation 3. Ambiguity in ground-truth definition 3! 4! 3? 4? 7

8 KEY APPLICATIONS: #1. Tumor proliferation score prediction in breast resection specimen. #2. Gleason score prediction in prostate biopsy specimen. 8

9 APPLICATION #1: BREAST CANCER WHAT IS TUMOR PROLIFERATION SCORE? Breast resection specimen Proliferation score (in 10 consecutive HPFs) Mitosis Score 1: ~6 mitosis Score 2: 6~10 mitosis Score 3: 10~ mitosis good prognosis bad 9

10 APPLICATION #1: BREAST CANCER TUMOR PROLIFERATION SCORE PREDICTION Data statistics Tumor Proliferation Assessment Challenge 2016 TUPAC16 MICCAI Grand Challenge Training dataset Test dataset, Proliferation score 500 slides, Proliferation score 321 slides, Mitosis #1 (x,y)... Mitosis #N (x,y) Auxiliary dataset 656 ROIs from 73 slides 10

11 APPLICATION #1: BREAST CANCER TUMOR PROLIFERATION SCORE PREDICTION System overview Whole slide image... Mitosis Detection Network 1. The number of mitosis 2. The number of cells Tissue region extraction Stain normalization Patch extraction at x40 ROI detection using cell density Phase 1: Handling whole slide images Auxiliary set for mitosis detection Phase 2: Mitosis detection Feature vector based on statistical information Support Vector Machine Proliferation score Phase 3: Score prediction 11

12 APPLICATION #1: BREAST CANCER TUMOR PROLIFERATION SCORE PREDICTION Phase 1: Handling whole slide images Resizing a whole slide image. Finding a threshold. Morphological operations. Whole slide image... Stain normalization Patch extraction with 10 HPFs size. Cell detection in each patch. Tissue region extraction Patch extraction at x40 ROI detection using cell density 30 ROIs selection. Stain normalization. 12

13 APPLICATION #1: BREAST CANCER TUMOR PROLIFERATION SCORE PREDICTION Phase 2: Mitosis detection Mitosis Detection Network 128 x 128 conv 1, 3x3, 16 resblock 1.1, 3x3, 32 resblock 1.3, 3x3, 32 resblock 2.1, 3x3, 64 resblock 2.3, 3x3, 64 resblock 3.1, 3x3, 128 resblock 3.3, 3x3, mitosis 8 normal Global pooling layer Auxiliary set for mitosis detection Based on Residual Network (ResNet). 9 residual blocks = 21 layers architecture. 2 step training procedure. Cropped global pooling layer. Training step:, Inference step: 13

14 APPLICATION #1: BREAST CANCER TUMOR PROLIFERATION SCORE PREDICTION Phase 3: Score prediction Converting each WSI to a 21-dim feature vector. 10-fold cross validation from 500 training samples. Feature selection based on cross validation results. 1. The number of mitosis 2. The number of cells Feature vector based on statistical information Support Vector Machine Proliferation score 14

15 APPLICATION #1: BREAST CANCER TUMOR PROLIFERATION SCORE PREDICTION Results Tumor Proliferation Assessment Challenge 2016 TUPAC16 MICCAI Grand Challenge 15

16 APPLICATION #2: PROSTATE CANCER WHAT IS GLEASON SCORE? Prostate biopsy specimen Core #1: Core #2: Core #3: Core #4: Grade 1 Grade 2 Grade 3 Grade 4 Grade 1, 2 Grade 3 Grade 4 Grade 5 Grade 5 16

17 APPLICATION #2: PROSTATE CANCER GLEASON SCORE PREDICTION Data statistics Training dataset Test dataset, { Grade, Contours } 900 slides, { Grade, Contours } 50 slides The number of patients: 385 The number of slides: 1152 The number of cores: 4907 The number of normal cores: 2872 The number of cancer cores: 2035 Dataset from medical centers 17

18 APPLICATION #2: PROSTATE CANCER GLEASON SCORE PREDICTION System overview Patch-based classification Normal Grade 3 Grade 4 Grade 5 Gleason score classification network Normal Grade 3 Grade 4 Grade 5 Memory network-based refinement (25 neighbors) Embedded memory vector... Query vector Embedding Ranking loss with thermometer code Memory network 18 Refined output

19 APPLICATION #2: PROSTATE CANCER GLEASON SCORE PREDICTION Patch-based classification Normal Grade 3 Baseline settings ResNet 101 architecture. 512x512 patch with 75% overlap. Softmax loss with 4 class classification. Key features for improving performance ~75% Grade 4 Normal patches from only fully normal slides. è +~5% gain Ranking loss with thermometer code. è +2~3% gain Grade 5 Not a classification problem! Ordering problem! Network decodes from the left-most bit to the right-most bit. 19

20 APPLICATION #2: PROSTATE CANCER Patch-level outputs (25 neighbors) GLEASON SCORE PREDICTION Memory network-based refinement + ~5% gain 1D-CNN Refined output Memory vector (25x4dim) Query vector (1x4dim) Embedding... 25x x1024 Innerproduct... Weighting Attention vector 25x1 Softmax 20

21 APPLICATION #2: PROSTATE CANCER GLEASON SCORE PREDICTION Results Patch-level performance Baseline: 75% + Data cleansing: 80% + Ranking loss: 82.8% + Memnet refinement: 87.5% Core-level performance Normal or cancer core? AUC: 97.8% Gleason score prediction? Only 1 st major: 83% Both: 76.7% 21

22 DEMO #1: BREAST CANCER 22

23 DEMO #2: PROSTATE CANCER 23

24 Lessons learned CONCLUSION Artificial intelligence for digital pathology Challenge #1. How to handle gigapixel images? (i.e., whole slide images) ü Consider how to sample patches. (patch size, sampling step,...) è with pathologists. ü Consider how to construct whole pipeline from gigapixel images to diagnosis. Challenge #2. How to handle quality variation between slides? ü Design image processing modules carefully. ü Do cross-validation to avoid overfitting. Challenge #3. How to handle ambiguous ground-truth? ü Design task-specific loss. ü Sanitize training dataset as much as possible you can. ü Don t be satisfied with patch-based results. 24

25 THANK YOU TEAM MEMBERS

arxiv: v1 [cs.cv] 30 May 2018

arxiv: v1 [cs.cv] 30 May 2018 A Robust and Effective Approach Towards Accurate Metastasis Detection and pn-stage Classification in Breast Cancer Byungjae Lee and Kyunghyun Paeng Lunit inc., Seoul, South Korea {jaylee,khpaeng}@lunit.io

More information

Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images

Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images Sachin Mehta 1, Ezgi Mercan 1, Jamen Bartlett 2, Donald Weaver 2, Joann G. Elmore 1, and Linda Shapiro 1 1 University

More information

Highly Accurate Brain Stroke Diagnostic System and Generative Lesion Model. Junghwan Cho, Ph.D. CAIDE Systems, Inc. Deep Learning R&D Team

Highly Accurate Brain Stroke Diagnostic System and Generative Lesion Model. Junghwan Cho, Ph.D. CAIDE Systems, Inc. Deep Learning R&D Team Highly Accurate Brain Stroke Diagnostic System and Generative Lesion Model Junghwan Cho, Ph.D. CAIDE Systems, Inc. Deep Learning R&D Team Established in September, 2016 at 110 Canal st. Lowell, MA 01852,

More information

Digital Pathology - moving on after implementation. Catarina Eloy, MD, PhD

Digital Pathology - moving on after implementation. Catarina Eloy, MD, PhD Digital Pathology - moving on after implementation Catarina Eloy, MD, PhD Catarina Eloy, MD, PhD No conflict of interests to declare Pathology challenges today Maintaining high quality students interested

More information

Combination of life science entrepreneurs, software development and machine vision experts & recognized scientists.

Combination of life science entrepreneurs, software development and machine vision experts & recognized scientists. Combination of life science entrepreneurs, software development and machine vision experts & recognized scientists. Kaisa Helminen CEO Previously: Sartorius Thermo Scientific Finnzymes Johan Lundin MD,

More information

Methods for Segmentation and Classification of Digital Microscopy Tissue Images

Methods for Segmentation and Classification of Digital Microscopy Tissue Images Methods for Segmentation and Classification of Digital Microscopy Tissue Images Quoc Dang Vu 1, Simon Graham 2, Minh Nguyen Nhat To 1, Muhammad Shaban 2, Talha Qaiser 2, Navid Alemi Koohbanani 2, Syed

More information

ITERATIVELY TRAINING CLASSIFIERS FOR CIRCULATING TUMOR CELL DETECTION

ITERATIVELY TRAINING CLASSIFIERS FOR CIRCULATING TUMOR CELL DETECTION ITERATIVELY TRAINING CLASSIFIERS FOR CIRCULATING TUMOR CELL DETECTION Yunxiang Mao 1, Zhaozheng Yin 1, Joseph M. Schober 2 1 Missouri University of Science and Technology 2 Southern Illinois University

More information

Session: Imaging for Clinical Decision Support

Session: Imaging for Clinical Decision Support healthitnews Session: Imaging for Clinical Decision Support Chair: Ian Poole, PhD Scientific Fellow Toshiba Medical Visualisation Systems, Edinburgh A Canon Group Company What is Clinical Decision Support?.

More information

arxiv: v1 [cs.cv] 1 Oct 2018

arxiv: v1 [cs.cv] 1 Oct 2018 Augmented Mitotic Cell Count using Field Of Interest Proposal Marc Aubreville 1, Christof A. Bertram 2, Robert Klopfleisch 2, Andreas Maier 1 arxiv:1810.00850v1 [cs.cv] 1 Oct 2018 1 Pattern Recognition

More information

Deep learning approaches to medical applications

Deep learning approaches to medical applications Deep learning approaches to medical applications Joseph Paul Cohen Postdoctoral Fellow at Montreal Institute for Learning Algorithms Friend of the Farlow Fellow at Harvard University U.S. National Science

More information

Deep learning and non-negative matrix factorization in recognition of mammograms

Deep learning and non-negative matrix factorization in recognition of mammograms Deep learning and non-negative matrix factorization in recognition of mammograms Bartosz Swiderski Faculty of Applied Informatics and Mathematics Warsaw University of Life Sciences, Warsaw, Poland bartosz_swiderski@sggw.pl

More information

Classification of breast cancer histology images using transfer learning

Classification of breast cancer histology images using transfer learning Classification of breast cancer histology images using transfer learning Sulaiman Vesal 1 ( ), Nishant Ravikumar 1, AmirAbbas Davari 1, Stephan Ellmann 2, Andreas Maier 1 1 Pattern Recognition Lab, Friedrich-Alexander-Universität

More information

Differentiating Tumor and Edema in Brain Magnetic Resonance Images Using a Convolutional Neural Network

Differentiating Tumor and Edema in Brain Magnetic Resonance Images Using a Convolutional Neural Network Original Article Differentiating Tumor and Edema in Brain Magnetic Resonance Images Using a Convolutional Neural Network Aida Allahverdi 1, Siavash Akbarzadeh 1, Alireza Khorrami Moghaddam 2, Armin Allahverdy

More information

Deep-Learning Based Semantic Labeling for 2D Mammography & Comparison of Complexity for Machine Learning Tasks

Deep-Learning Based Semantic Labeling for 2D Mammography & Comparison of Complexity for Machine Learning Tasks Deep-Learning Based Semantic Labeling for 2D Mammography & Comparison of Complexity for Machine Learning Tasks Paul H. Yi, MD, Abigail Lin, BSE, Jinchi Wei, BSE, Haris I. Sair, MD, Ferdinand K. Hui, MD,

More information

Visual interpretation in pathology

Visual interpretation in pathology 13 Visual interpretation in pathology Tissue architecture (alteration) evaluation e.g., for grading prostate cancer Immunohistochemistry (IHC) staining scoring e.g., HER2 in breast cancer (companion diagnostic

More information

Skin cancer reorganization and classification with deep neural network

Skin cancer reorganization and classification with deep neural network Skin cancer reorganization and classification with deep neural network Hao Chang 1 1. Department of Genetics, Yale University School of Medicine 2. Email: changhao86@gmail.com Abstract As one kind of skin

More information

Background Information

Background Information Background Information Erlangen, November 26, 2017 RSNA 2017 in Chicago: South Building, Hall A, Booth 1937 Artificial intelligence: Transforming data into knowledge for better care Inspired by neural

More information

3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients

3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients 3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients Dong Nie 1,2, Han Zhang 1, Ehsan Adeli 1, Luyan Liu 1, and Dinggang Shen 1(B) 1 Department of Radiology

More information

POC Brain Tumor Segmentation. vlife Use Case

POC Brain Tumor Segmentation. vlife Use Case Brain Tumor Segmentation vlife Use Case 1 Automatic Brain Tumor Segmentation using CNN Background Brain tumor segmentation seeks to separate healthy tissue from tumorous regions such as the advancing tumor,

More information

A Multi-Resolution Deep Learning Framework for Lung Adenocarcinoma Growth Pattern Classification

A Multi-Resolution Deep Learning Framework for Lung Adenocarcinoma Growth Pattern Classification MIUA2018, 053, v4 (final): Multi-Resolution CNN for Lung Growth Pattern Classification 1 A Multi-Resolution Deep Learning Framework for Lung Adenocarcinoma Growth Pattern Classification Najah Alsubaie

More information

Is digital pathology ready for use in routine histopathology? Dr David Snead University Hospitals of Coventry and Warwickshire NHS Trust Coventry UK

Is digital pathology ready for use in routine histopathology? Dr David Snead University Hospitals of Coventry and Warwickshire NHS Trust Coventry UK Is digital pathology ready for use in routine histopathology? Dr David Snead University Hospitals of Coventry and Warwickshire NHS Trust Coventry UK Pathologists and microscopes. 1850 Rudolph Virchow (1821-1902),

More information

Artificial Intelligence in Breast Imaging

Artificial Intelligence in Breast Imaging Artificial Intelligence in Breast Imaging Manisha Bahl, MD, MPH Director of Breast Imaging Fellowship Program, Massachusetts General Hospital Assistant Professor of Radiology, Harvard Medical School Outline

More information

Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification

Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification Kamyar Nazeri, Azad Aminpour, and Mehran Ebrahimi Faculty of Science, University of Ontario Institute of Technology

More information

Computer based delineation and follow-up multisite abdominal tumors in longitudinal CT studies

Computer based delineation and follow-up multisite abdominal tumors in longitudinal CT studies Research plan submitted for approval as a PhD thesis Submitted by: Refael Vivanti Supervisor: Professor Leo Joskowicz School of Engineering and Computer Science, The Hebrew University of Jerusalem Computer

More information

CS231n Project: Prediction of Head and Neck Cancer Submolecular Types from Patholoy Images

CS231n Project: Prediction of Head and Neck Cancer Submolecular Types from Patholoy Images CSn Project: Prediction of Head and Neck Cancer Submolecular Types from Patholoy Images Kuy Hun Koh Yoo Energy Resources Engineering Stanford University Stanford, CA 90 kohykh@stanford.edu Markus Zechner

More information

Image Captioning using Reinforcement Learning. Presentation by: Samarth Gupta

Image Captioning using Reinforcement Learning. Presentation by: Samarth Gupta Image Captioning using Reinforcement Learning Presentation by: Samarth Gupta 1 Introduction Summary Supervised Models Image captioning as RL problem Actor Critic Architecture Policy Gradient architecture

More information

Improving Network Accuracy with Augmented Imagery Training Data

Improving Network Accuracy with Augmented Imagery Training Data Improving Network Accuracy with Augmented Imagery Training Data Ted Hromadka 1, LCDR Niels Olson 2 MD 1, 2 US Navy NMCSD Presented at GTC 2017 Goals Determine effectiveness of various affine transforms

More information

Lessons learned in the use of digital imaging at Memorial Sloan Kettering Cancer Center

Lessons learned in the use of digital imaging at Memorial Sloan Kettering Cancer Center Lessons learned in the use of digital imaging at Memorial Sloan Kettering Cancer Center Executive War College May 3, 2018 Victor E. Reuter, M.D. Vice-Chair, Department of Pathology Medical Director, Warren

More information

MRI Image Processing Operations for Brain Tumor Detection

MRI Image Processing Operations for Brain Tumor Detection MRI Image Processing Operations for Brain Tumor Detection Prof. M.M. Bulhe 1, Shubhashini Pathak 2, Karan Parekh 3, Abhishek Jha 4 1Assistant Professor, Dept. of Electronics and Telecommunications Engineering,

More information

arxiv: v1 [cs.cv] 26 Feb 2018

arxiv: v1 [cs.cv] 26 Feb 2018 Classification of breast cancer histology images using transfer learning Sulaiman Vesal 1, Nishant Ravikumar 1, AmirAbbas Davari 1, Stephan Ellmann 2, Andreas Maier 1 arxiv:1802.09424v1 [cs.cv] 26 Feb

More information

Healthcare Research You

Healthcare Research You DL for Healthcare Goals Healthcare Research You What are high impact problems in healthcare that deep learning can solve? What does research in AI applications to medical imaging look like? How can you

More information

arxiv: v1 [cs.cv] 21 Jul 2017

arxiv: v1 [cs.cv] 21 Jul 2017 A Multi-Scale CNN and Curriculum Learning Strategy for Mammogram Classification William Lotter 1,2, Greg Sorensen 2, and David Cox 1,2 1 Harvard University, Cambridge MA, USA 2 DeepHealth Inc., Cambridge

More information

Virtual Microscopy: Express Surgical Pathology Consultation. Mercè Jordà, University of Miami, Florida

Virtual Microscopy: Express Surgical Pathology Consultation. Mercè Jordà, University of Miami, Florida Virtual Microscopy: Express Surgical Pathology Consultation Mercè Jordà, University of Miami, Florida Telepathology versus Virtual microscopy (Digital Pathology) Telepathology Use of telecommunications

More information

Weak Supervision. Vincent Chen and Nish Khandwala

Weak Supervision. Vincent Chen and Nish Khandwala Weak Supervision Vincent Chen and Nish Khandwala Outline Motivation We want more labels! We want to program our data! #Software2.0 Weak Supervision Formulation Landscape of Noisy Labeling Schemes Snorkel

More information

CHAPTER 2 MAMMOGRAMS AND COMPUTER AIDED DETECTION

CHAPTER 2 MAMMOGRAMS AND COMPUTER AIDED DETECTION 9 CHAPTER 2 MAMMOGRAMS AND COMPUTER AIDED DETECTION 2.1 INTRODUCTION This chapter provides an introduction to mammogram and a description of the computer aided detection methods of mammography. This discussion

More information

Tumor Cellularity Assessment. Rene Bidart

Tumor Cellularity Assessment. Rene Bidart Tumor Cellularity Assessment Rene Bidart 1 Goals Find location and class of all cell nuclei: Lymphocyte Cells Normal Epithelial Cells Malignant Epithelial Cells Why: Test effectiveness of pre-surgery treatment

More information

A DEEP LEARNING METHOD FOR DETECTING AND CLASSIFYING BREAST CANCER METASTASES IN LYMPH NODES ON HISTOPATHOLOGICAL IMAGES

A DEEP LEARNING METHOD FOR DETECTING AND CLASSIFYING BREAST CANCER METASTASES IN LYMPH NODES ON HISTOPATHOLOGICAL IMAGES A DEEP LEARNING METHOD FOR DETECTING AND CLASSIFYING BREAST CANCER METASTASES IN LYMPH NODES ON HISTOPATHOLOGICAL IMAGES Kaiwen Xiao 1, Zichen Wang 1, Tong Xu 1, Tao Wan 1,2 1 DeepCare Inc., Beijing, China

More information

arxiv: v1 [stat.ml] 23 Jan 2017

arxiv: v1 [stat.ml] 23 Jan 2017 Learning what to look in chest X-rays with a recurrent visual attention model arxiv:1701.06452v1 [stat.ml] 23 Jan 2017 Petros-Pavlos Ypsilantis Department of Biomedical Engineering King s College London

More information

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. X, NO. Y, MONTH YEAR. 1

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. X, NO. Y, MONTH YEAR. 1 IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, VOL. X, NO. Y, MONTH YEAR. 1 Epithelium segmentation using deep learning in H&E-stained prostate specimens with immunohistochemistry as reference standard

More information

Supplemental Information

Supplemental Information Supplemental Information Prediction of Prostate Cancer Recurrence using Quantitative Phase Imaging Shamira Sridharan 1, Virgilia Macias 2, Krishnarao Tangella 3, André Kajdacsy-Balla 2 and Gabriel Popescu

More information

A REVIEW ON CLASSIFICATION OF BREAST CANCER DETECTION USING COMBINATION OF THE FEATURE EXTRACTION MODELS. Aeronautical Engineering. Hyderabad. India.

A REVIEW ON CLASSIFICATION OF BREAST CANCER DETECTION USING COMBINATION OF THE FEATURE EXTRACTION MODELS. Aeronautical Engineering. Hyderabad. India. Volume 116 No. 21 2017, 203-208 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu A REVIEW ON CLASSIFICATION OF BREAST CANCER DETECTION USING COMBINATION OF

More information

Automatic Classification of Breast Masses for Diagnosis of Breast Cancer in Digital Mammograms using Neural Network

Automatic Classification of Breast Masses for Diagnosis of Breast Cancer in Digital Mammograms using Neural Network IJSTE - International Journal of Science Technology & Engineering Volume 1 Issue 11 May 2015 ISSN (online): 2349-784X Automatic Classification of Breast Masses for Diagnosis of Breast Cancer in Digital

More information

CSE Introduction to High-Perfomance Deep Learning ImageNet & VGG. Jihyung Kil

CSE Introduction to High-Perfomance Deep Learning ImageNet & VGG. Jihyung Kil CSE 5194.01 - Introduction to High-Perfomance Deep Learning ImageNet & VGG Jihyung Kil ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton,

More information

Lung Region Segmentation using Artificial Neural Network Hopfield Model for Cancer Diagnosis in Thorax CT Images

Lung Region Segmentation using Artificial Neural Network Hopfield Model for Cancer Diagnosis in Thorax CT Images Automation, Control and Intelligent Systems 2015; 3(2): 19-25 Published online March 20, 2015 (http://www.sciencepublishinggroup.com/j/acis) doi: 10.11648/j.acis.20150302.12 ISSN: 2328-5583 (Print); ISSN:

More information

Automated Blood Vessel Extraction Based on High-Order Local Autocorrelation Features on Retinal Images

Automated Blood Vessel Extraction Based on High-Order Local Autocorrelation Features on Retinal Images Automated Blood Vessel Extraction Based on High-Order Local Autocorrelation Features on Retinal Images Yuji Hatanaka 1(&), Kazuki Samo 2, Kazunori Ogohara 1, Wataru Sunayama 1, Chisako Muramatsu 3, Susumu

More information

HHS Public Access Author manuscript Med Image Comput Comput Assist Interv. Author manuscript; available in PMC 2018 January 04.

HHS Public Access Author manuscript Med Image Comput Comput Assist Interv. Author manuscript; available in PMC 2018 January 04. Discriminative Localization in CNNs for Weakly-Supervised Segmentation of Pulmonary Nodules Xinyang Feng 1, Jie Yang 1, Andrew F. Laine 1, and Elsa D. Angelini 1,2 1 Department of Biomedical Engineering,

More information

HEALTHCARE AI DEVELOPMENT CYCLE

HEALTHCARE AI DEVELOPMENT CYCLE Dr. Keith Dreyer Chief Science Officer, ACR Data Science Institute ACR Board of Chancellors, Chairman Informatics Commission Chief Data Science Officer, MGH, BWH, Partners Healthcare Associate Professor

More information

Automatic Prostate Cancer Classification using Deep Learning. Ida Arvidsson Centre for Mathematical Sciences, Lund University, Sweden

Automatic Prostate Cancer Classification using Deep Learning. Ida Arvidsson Centre for Mathematical Sciences, Lund University, Sweden Automatic Prostate Cancer Classification using Deep Learning Ida Arvidsson Centre for Mathematical Sciences, Lund University, Sweden Outline Autoencoders, theory Motivation, background and goal for prostate

More information

CHS-NET: A Cascaded Neural Network with Semi-Focal Loss for Mitosis Detection

CHS-NET: A Cascaded Neural Network with Semi-Focal Loss for Mitosis Detection Proceedings of Machine Learning Research 95:161-175, 2018 ACML 2018 CHS-NET: A Cascaded Neural Network with Semi-Focal Loss for Mitosis Detection Yanbo Ma 1 mayanbo@pku.edu.cn Jiarui Sun 2 1701120005@pku.edu.cn

More information

Critical reading of diagnostic imaging studies. Lecture Goals. Constantine Gatsonis, PhD. Brown University

Critical reading of diagnostic imaging studies. Lecture Goals. Constantine Gatsonis, PhD. Brown University Critical reading of diagnostic imaging studies Constantine Gatsonis Center for Statistical Sciences Brown University Annual Meeting Lecture Goals 1. Review diagnostic imaging evaluation goals and endpoints.

More information

A Deep Learning Approach for Breast Cancer Mass Detection

A Deep Learning Approach for Breast Cancer Mass Detection A Deep Learning Approach for Breast Cancer Mass Detection Wael E.Fathy 1, Amr S. Ghoneim 2 Teaching Assistant 1, Assistant Professor 2 Department of Computer Science, Faculty of Computers and Information

More information

Roadmap for Developing and Validating Therapeutically Relevant Genomic Classifiers. Richard Simon, J Clin Oncol 23:

Roadmap for Developing and Validating Therapeutically Relevant Genomic Classifiers. Richard Simon, J Clin Oncol 23: Roadmap for Developing and Validating Therapeutically Relevant Genomic Classifiers. Richard Simon, J Clin Oncol 23:7332-7341 Presented by Deming Mi 7/25/2006 Major reasons for few prognostic factors to

More information

Machine Learning in Precision Medicine Coronary Health Prediction - Cardiac Events (Atherosclerosis) - Heart Transplant (Vasculopathy)

Machine Learning in Precision Medicine Coronary Health Prediction - Cardiac Events (Atherosclerosis) - Heart Transplant (Vasculopathy) Machine Learning in Precision Medicine Coronary Health Prediction - Cardiac Events (Atherosclerosis) - Heart Transplant (Vasculopathy) M. Sonka + IIBI, Charles University, IKEM, CKTCH The University of

More information

Final Report: Automated Semantic Segmentation of Volumetric Cardiovascular Features and Disease Assessment

Final Report: Automated Semantic Segmentation of Volumetric Cardiovascular Features and Disease Assessment Final Report: Automated Semantic Segmentation of Volumetric Cardiovascular Features and Disease Assessment Tony Lindsey 1,3, Xiao Lu 1 and Mojtaba Tefagh 2 1 Department of Biomedical Informatics, Stanford

More information

Final Project Report Sean Fischer CS229 Introduction

Final Project Report Sean Fischer CS229 Introduction Introduction The field of pathology is concerned with identifying and understanding the biological causes and effects of disease through the study of morphological, cellular, and molecular features in

More information

Automatic Extraction of Synoptic Data. George Cernile Artificial Intelligence in Medicine AIM

Automatic Extraction of Synoptic Data. George Cernile Artificial Intelligence in Medicine AIM Automatic Extraction of Synoptic Data George Cernile Artificial Intelligence in Medicine AIM Agenda Background Technology used Demonstration Questions How often are checklist elements included in a report,

More information

Supplementary Online Content

Supplementary Online Content Supplementary Online Content Ting DS, Cheung CY-L, Lim G, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic

More information

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns 1. Introduction Vasily Morzhakov, Alexey Redozubov morzhakovva@gmail.com, galdrd@gmail.com Abstract Cortical

More information

Abstract. Background. Objective

Abstract. Background. Objective Molecular epidemiology of clinical tissues with multi-parameter IHC Poster 237 J Ruan 1, T Hope 1, J Rheinhardt 2, D Wang 2, R Levenson 1, T Nielsen 3, H Gardner 2, C Hoyt 1 1 CRi, Woburn, Massachusetts,

More information

Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images

Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images Tae Joon Jun, Dohyeun Kim, and Daeyoung Kim School of Computing, KAIST,

More information

arxiv: v1 [cs.lg] 4 Feb 2019

arxiv: v1 [cs.lg] 4 Feb 2019 Machine Learning for Seizure Type Classification: Setting the benchmark Subhrajit Roy [000 0002 6072 5500], Umar Asif [0000 0001 5209 7084], Jianbin Tang [0000 0001 5440 0796], and Stefan Harrer [0000

More information

EARLY STAGE DIAGNOSIS OF LUNG CANCER USING CT-SCAN IMAGES BASED ON CELLULAR LEARNING AUTOMATE

EARLY STAGE DIAGNOSIS OF LUNG CANCER USING CT-SCAN IMAGES BASED ON CELLULAR LEARNING AUTOMATE EARLY STAGE DIAGNOSIS OF LUNG CANCER USING CT-SCAN IMAGES BASED ON CELLULAR LEARNING AUTOMATE SAKTHI NEELA.P.K Department of M.E (Medical electronics) Sengunthar College of engineering Namakkal, Tamilnadu,

More information

INTRODUCTION TO MACHINE LEARNING. Decision tree learning

INTRODUCTION TO MACHINE LEARNING. Decision tree learning INTRODUCTION TO MACHINE LEARNING Decision tree learning Task of classification Automatically assign class to observations with features Observation: vector of features, with a class Automatically assign

More information

Outline (1) Outline (2) Concepts in Prostate Pathology. Peculiarities of Prostate Cancer. Peculiarities of Prostate Cancer

Outline (1) Outline (2) Concepts in Prostate Pathology. Peculiarities of Prostate Cancer. Peculiarities of Prostate Cancer Concepts in Prostate Pathology Murali Varma Cardiff, UK wptmv@cf.ac.uk Sarajevo Nov 2013 Outline (1) Peculiarities of prostate cancer Peculiarities of prostate needle biopsy Needle bx vs. TURP Prostate

More information

Beyond the DVH: Voxelbased Automated Planning and Quality Assurance

Beyond the DVH: Voxelbased Automated Planning and Quality Assurance 1 Beyond the DVH: Voxelbased Automated Planning and Quality Assurance Presented by Chris McIntosh Research Associate Department of Medical Imaging & Physics Princess Margaret Cancer Centre C. McIntosh

More information

Multi-task Learning of Dish Detection and Calorie Estimation

Multi-task Learning of Dish Detection and Calorie Estimation Multi-task Learning of Dish Detection and Calorie Estimation Takumi Ege and Keiji Yanai The University of Electro-Communications, Tokyo Introduction Foodlog CaloNavi Volume selection required Crop a dish

More information

Convolutional Neural Networks (CNN)

Convolutional Neural Networks (CNN) Convolutional Neural Networks (CNN) Algorithm and Some Applications in Computer Vision Luo Hengliang Institute of Automation June 10, 2014 Luo Hengliang (Institute of Automation) Convolutional Neural Networks

More information

Comparison of Two Approaches for Direct Food Calorie Estimation

Comparison of Two Approaches for Direct Food Calorie Estimation Comparison of Two Approaches for Direct Food Calorie Estimation Takumi Ege and Keiji Yanai The University of Electro-Communications, Tokyo Direct food calorie estimation Foodlog CaloNavi Volume selection

More information

arxiv: v2 [cs.cv] 19 Dec 2017

arxiv: v2 [cs.cv] 19 Dec 2017 An Ensemble of Deep Convolutional Neural Networks for Alzheimer s Disease Detection and Classification arxiv:1712.01675v2 [cs.cv] 19 Dec 2017 Jyoti Islam Department of Computer Science Georgia State University

More information

Developing ML Models for semantic segmentation of medical images

Developing ML Models for semantic segmentation of medical images Developing ML Models for semantic segmentation of medical images Raj Jena University of Cambridge Microsoft Research Cambridge Disclosures I perform consultancy work for InnerEye team at Microsoft Research

More information

Why did the network make this prediction?

Why did the network make this prediction? Why did the network make this prediction? Ankur Taly (Google Inc.) Joint work with Mukund Sundararajan and Qiqi Yan Some Deep Learning Successes Source: https://www.cbsinsights.com Deep Neural Networks

More information

Convolutional Neural Networks for Estimating Left Ventricular Volume

Convolutional Neural Networks for Estimating Left Ventricular Volume Convolutional Neural Networks for Estimating Left Ventricular Volume Ryan Silva Stanford University rdsilva@stanford.edu Maksim Korolev Stanford University mkorolev@stanford.edu Abstract End-systolic and

More information

Automated detection of masses on whole breast volume ultrasound scanner: false positive reduction using deep convolutional neural network

Automated detection of masses on whole breast volume ultrasound scanner: false positive reduction using deep convolutional neural network Automated detection of masses on whole breast volume ultrasound scanner: false positive reduction using deep convolutional neural network Yuya Hiramatsu a, Chisako Muramatsu* a, Hironobu Kobayashi b, Takeshi

More information

Reviewer's report. Version: 1 Date: 24 May Reviewer: Cathy Moelans. Reviewer's report:

Reviewer's report. Version: 1 Date: 24 May Reviewer: Cathy Moelans. Reviewer's report: Reviewer's report Title: Validation of HER2 testing with core needle biopsy specimens from primary breast cancers in terms of interobserver reproducibility and concordance with surgically resected specimens

More information

MR-Radiomics in Neuro-Oncology

MR-Radiomics in Neuro-Oncology Klinik für Stereotaxie und funktionelle Neurochirurgie Institut für Neurowissenschaften und Medizin MR-Radiomics in Neuro-Oncology M. Kocher Klinik für funktionelle Neurochirurgie und Stereotaxie Forschungszentrum

More information

arxiv: v2 [cs.cv] 8 Mar 2018

arxiv: v2 [cs.cv] 8 Mar 2018 Automated soft tissue lesion detection and segmentation in digital mammography using a u-net deep learning network Timothy de Moor a, Alejandro Rodriguez-Ruiz a, Albert Gubern Mérida a, Ritse Mann a, and

More information

Inferring Clinical Correlations from EEG Reports with Deep Neural Learning

Inferring Clinical Correlations from EEG Reports with Deep Neural Learning Inferring Clinical Correlations from EEG Reports with Deep Neural Learning Methods for Identification, Classification, and Association using EHR Data S23 Travis R. Goodwin (Presenter) & Sanda M. Harabagiu

More information

Automated Estimation of mts Score in Hand Joint X-Ray Image Using Machine Learning

Automated Estimation of mts Score in Hand Joint X-Ray Image Using Machine Learning Automated Estimation of mts Score in Hand Joint X-Ray Image Using Machine Learning Shweta Khairnar, Sharvari Khairnar 1 Graduate student, Pace University, New York, United States 2 Student, Computer Engineering,

More information

Cancer Cells Detection using OTSU Threshold Algorithm

Cancer Cells Detection using OTSU Threshold Algorithm Cancer Cells Detection using OTSU Threshold Algorithm Nalluri Sunny 1 Velagapudi Ramakrishna Siddhartha Engineering College Mithinti Srikanth 2 Velagapudi Ramakrishna Siddhartha Engineering College Kodali

More information

NMF-Density: NMF-Based Breast Density Classifier

NMF-Density: NMF-Based Breast Density Classifier NMF-Density: NMF-Based Breast Density Classifier Lahouari Ghouti and Abdullah H. Owaidh King Fahd University of Petroleum and Minerals - Department of Information and Computer Science. KFUPM Box 1128.

More information

Flat Epithelial Atypia

Flat Epithelial Atypia Flat Epithelial Atypia Richard Owings, M.D. University of Arkansas for Medical Sciences Department of Pathology Flat epithelial atypia can be a difficult lesion May be a subtle diagnosis Lots of changes

More information

MITOS & ATYPIA Detection of Mitosis and Evaluation of Nuclear Atypia Score in Breast Cancer Histological Images

MITOS & ATYPIA Detection of Mitosis and Evaluation of Nuclear Atypia Score in Breast Cancer Histological Images MITOS & ATYPIA Detection of Mitosis and Evaluation of Nuclear Atypia Score in Breast Cancer Histological Images An ICPR 2014 Contest June 27, 2014 1 Organizers IPAL Lab (CNRS UMI 2955, Université Joseph

More information

The Human Behaviour-Change Project

The Human Behaviour-Change Project The Human Behaviour-Change Project Participating organisations A Collaborative Award funded by the www.humanbehaviourchange.org @HBCProject This evening Opening remarks from the chair Mary de Silva, The

More information

Patch-based Head and Neck Cancer Subtype Classification

Patch-based Head and Neck Cancer Subtype Classification Patch-based Head and Neck Cancer Subtype Classification Wanyi Qian, Guoli Yin, Frances Liu, Advisor: Olivier Gevaert, Mu Zhou, Kevin Brennan Stanford University wqian2@stanford.edu, guoliy@stanford.edu,

More information

ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES

ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES P.V.Rohini 1, Dr.M.Pushparani 2 1 M.Phil Scholar, Department of Computer Science, Mother Teresa women s university, (India) 2 Professor

More information

Early Detection of Lung Cancer

Early Detection of Lung Cancer Early Detection of Lung Cancer Aswathy N Iyer Dept Of Electronics And Communication Engineering Lymie Jose Dept Of Electronics And Communication Engineering Anumol Thomas Dept Of Electronics And Communication

More information

Efficient Deep Model Selection

Efficient Deep Model Selection Efficient Deep Model Selection Jose Alvarez Researcher Data61, CSIRO, Australia GTC, May 9 th 2017 www.josemalvarez.net conv1 conv2 conv3 conv4 conv5 conv6 conv7 conv8 softmax prediction???????? Num Classes

More information

FAQs for UK Pathology Departments

FAQs for UK Pathology Departments FAQs for UK Pathology Departments This is an educational piece written for Healthcare Professionals FAQs for UK Pathology Departments If you would like to discuss any of the listed FAQs further, or have

More information

Computational Pathology

Computational Pathology Computational Pathology In the Midst of a Revolution: How Computational Pathology is Transforming Clinical Practice and Biomedical Research Thomas J. Fuchs Associate Member, Memorial Sloan Kettering Cancer

More information

AN ALGORITHM FOR EARLY BREAST CANCER DETECTION IN MAMMOGRAMS

AN ALGORITHM FOR EARLY BREAST CANCER DETECTION IN MAMMOGRAMS AN ALGORITHM FOR EARLY BREAST CANCER DETECTION IN MAMMOGRAMS Isaac N. Bankman', William A. Christens-Barryl, Irving N. Weinberg2, Dong W. Kim3, Ralph D. Semmell, and William R. Brody2 The Johns Hopkins

More information

AN EFFICIENT DIGITAL SUPPORT SYSTEM FOR DIAGNOSING BRAIN TUMOR

AN EFFICIENT DIGITAL SUPPORT SYSTEM FOR DIAGNOSING BRAIN TUMOR AN EFFICIENT DIGITAL SUPPORT SYSTEM FOR DIAGNOSING BRAIN TUMOR Yatendra Kashyap Corporate institute of science & Technology, Bhopal ---------------------------------------------------------------------***---------------------------------------------------------------------

More information

Segmentation of Tumor Region from Brain Mri Images Using Fuzzy C-Means Clustering And Seeded Region Growing

Segmentation of Tumor Region from Brain Mri Images Using Fuzzy C-Means Clustering And Seeded Region Growing IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 18, Issue 5, Ver. I (Sept - Oct. 2016), PP 20-24 www.iosrjournals.org Segmentation of Tumor Region from Brain

More information

Mammography limitations. Clinical performance of digital breast tomosynthesis compared to digital mammography: blinded multi-reader study

Mammography limitations. Clinical performance of digital breast tomosynthesis compared to digital mammography: blinded multi-reader study Clinical performance of digital breast tomosynthesis compared to digital mammography: blinded multi-reader study G. Gennaro (1), A. Toledano (2), E. Baldan (1), E. Bezzon (1), C. di Maggio (1), M. La Grassa

More information

Contributions to Brain MRI Processing and Analysis

Contributions to Brain MRI Processing and Analysis Contributions to Brain MRI Processing and Analysis Dissertation presented to the Department of Computer Science and Artificial Intelligence By María Teresa García Sebastián PhD Advisor: Prof. Manuel Graña

More information

Convolutional Neural Networks for Text Classification

Convolutional Neural Networks for Text Classification Convolutional Neural Networks for Text Classification Sebastian Sierra MindLab Research Group July 1, 2016 ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, 2016 1 / 32 Outline 1 What is

More information

TMIST A Bridge to Personalized Screening. Canadian Society of Breast Imaging April 26, 2018

TMIST A Bridge to Personalized Screening. Canadian Society of Breast Imaging April 26, 2018 TMIST A Bridge to Personalized Screening Canadian Society of Breast Imaging April 26, 2018 Topics 1. Overview of TMIST Aims and Methods 2. Status of the Study (4/13/18) 3. How your site (in Canada) can

More information

Clustering of MRI Images of Brain for the Detection of Brain Tumor Using Pixel Density Self Organizing Map (SOM)

Clustering of MRI Images of Brain for the Detection of Brain Tumor Using Pixel Density Self Organizing Map (SOM) IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 19, Issue 6, Ver. I (Nov.- Dec. 2017), PP 56-61 www.iosrjournals.org Clustering of MRI Images of Brain for the

More information