Deep Learning, Lung Cancer Screening & the Data Science Bowl 2017

Transcription

1 Deep Learning, Lung Cancer Screening & the Data Science Bowl 2017 Bram van Ginneken, Arnaud Arindra Adiyoso Setio, Colin Jacobs Diagnostic Image Analysis Group, Radboud University Medical Center, Nijmegen, The Netherlands Fraunhofer MEVIS, Bremen, Germany

2 Background and disclosures : PhD Detection of tuberculosis in chest radiographs: CAD4TB now in use in >20 countries 2004: Research on automated analysis of chest CT scans for lung cancer screening, with many partners in Europe, USA, Canada, Korea 2010: Chair of Diagnostic Image Analysis Group, 40 researchers at Radboud University Medical Center, Nijmegen, The Netherlands; working for Fraunhofer MEVIS in Bremen, Germany 2010: Developed software for automated reading of chest CT screening scans, available via Mevis Medical Solutions (Veolity) and InVivo (DynaCAD Lung) 2014: Founder of Thirona 2016: Involved in Data Science Bowl

3 Contents Why should you do lung cancer screening with CT Human reading of screening CT scans Computer reading of screening CT scans 2017 Data Science Bowl results

4 Lung cancer is the biggest cancer killer Lung cancer can grow unnoticed for years, because the lungs are very big organs When the patient goes to the doctor with complaints and lung cancer is diagnosed, the median size of the cancer is 4 cm, and usually it has already metastasized

5

6 Early detection is our only hope

7

8

9 Screening with CT Hold your breath, slide through scanner in <10 seconds High resolution (<1mm) 3D image of the lungs Very low dose possible No contrast material needed, very user friendly No high-end scanner needed: cheap (~200 k$)

10 Baseline

11 After 1 year 6mm nodule

12 After 2 years 2cm nodule Squamous cell lung cancer Still early stage!

13 NLST led to screening implementation

14 Screening centers in the United States

15 Human reading of screening CT scans

16

17 Nodule malignancy calculator

18 Radiologists often don t agree on nodules Show table and images from LIDC study...

19

20

21 Some radiologists see many more nodules...

22 Radiologist often don t agree on nodule type

23 What type of nodule is it? Complete agreement non-solid nodule Complete agreement solid nodule

24 What type of nodule is it? Complete disagreement part-solid nodule Complete disagreement part-solid nodule

25 Lung-RADS 4X

26 The Lung-RADS 4X category in practice

27 The Lung-RADS 4X category in practice

28 Computer reading of screening CT scans

29 Sensitivity 2009: Finding nodules with computers All together Dayton Pisa Utrecht Torino Bremen Florianópolis Bari Hamburg Average number of false alarms per scan

30 2017: Finding nodules with deep learning

31

32 LUNA16: Nodule detection competition

33 LUNA16 leaderboard

34 Deep learning for nodule type classification Nature Scientific Reports 2017

35

36

37

38 Automatic segmentation May 2005: 640 mm 3 / 10.7mm; -490 HU, 326 mg Jan 2010: 1042 mm 3 / 12.5mm; -324 HU, 703 mg Case from the Danish Lung Cancer Screening Trial

39 Data Science Bowl 2017 Results

40 Data Science Bowl 2017 Teams were provided with a single low dose CT scan from a lung cancer screening participant Task: predict if this subject was diagnosed with lung cancer within one year of the CT scan Approach of most teams: Look for suspicious nodules Estimate probability of malignancy for the most suspicious nodule(s)

41

42 ROC analysis Data Science Bowl test set 4B 4B,4A 4B,4A,3 4B,4A,3,2 Lung-RADS category Non-cancer cases Cancer cases A B 54 67

43 ROC analysis Data Science Bowl test set 4B 4B,4A 4B,4A,3 4B,4A,3,2 Lung-RADS category Non-cancer cases Cancer cases A B 54 67

44 ROC analysis Data Science Bowl test set 4B,4A 4B,4A,3 4B,4A,3,2 4B

45 ROC analysis Data Science Bowl test set 4B,4A 4B,4A,3 4B,4A,3,2 4B

46 Conclusions and future work DSB 2017 provides very promising results In lung cancer screening the vast majority of all scans are follow-up scans: estimating probability of lung cancer given a single CT scan is therefore not the most important and most relevant problem Future competitions: Estimate probability of lung cancer given multiple CT screening rounds Extend the problem, taking into account clinical information Add liquid biopsy results (blood tests), genetic tests, etc Predict 5-year probability of lung cancer: personalized screening intervals