Learning Convolutional Neural Networks for Graphs

Size: px
Start display at page:

Download "Learning Convolutional Neural Networks for Graphs"

Transcription

1 GA Learning Convolutional Neural Networks for Graphs Mathias Niepert Mohamed Ahmed Konstantin Kutzkov NEC Laboratories Europe

2 Representation Learning for Graphs Telecom Safety Transportation Industry Smart cities Intermediate Representation: Graphs? Deep Learning System (Edge) deployment Learning Convolutional Neural Networks for Graphs

3 Problem Definition Input: Finite collection of graphs Nodes of any two graphs are not necessarily in correspondence Nodes and edges may have attributes (discrete and continuous) Problem: Learn a representation for classification/regression Example: Graph classification problem class[ ] =? Learning Convolutional Neural Networks for Graphs

4 State of the Art: Graph Kernels Define kernel based on substructures Shortest paths Random walks Subtrees... Kernel is similarity function on pairs of graphs Count the number of common substructures Use graph kernels with SVMs 4 Learning Convolutional Neural Networks for Graphs

5 Patchy: Learning CNNs for Graphs 5 Learning Convolutional Neural Networks for Graphs

6 Patchy: Learning CNNs for Graphs node sequence selection (w=6 nodes) 6 Learning Convolutional Neural Networks for Graphs

7 Patchy: Learning CNNs for Graphs node sequence selection (w=6 nodes) 7 Learning Convolutional Neural Networks for Graphs

8 Patchy: Learning CNNs for Graphs node sequence selection (w=6 nodes) 8 Learning Convolutional Neural Networks for Graphs

9 Patchy: Learning CNNs for Graphs node sequence selection (w=6 nodes) 9 Learning Convolutional Neural Networks for Graphs

10 Patchy: Learning CNNs for Graphs node sequence selection (w=6 nodes) 10 Learning Convolutional Neural Networks for Graphs

11 Patchy: Learning CNNs for Graphs node sequence selection (w=6 nodes) 11 Learning Convolutional Neural Networks for Graphs

12 Patchy: Learning CNNs for Graphs neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 1 Learning Convolutional Neural Networks for Graphs

13 Patchy: Learning CNNs for Graphs neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 1 Learning Convolutional Neural Networks for Graphs

14 Patchy: Learning CNNs for Graphs neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 14 Learning Convolutional Neural Networks for Graphs

15 Patchy: Learning CNNs for Graphs neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 15 Learning Convolutional Neural Networks for Graphs

16 Patchy: Learning CNNs for Graphs neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 16 Learning Convolutional Neural Networks for Graphs

17 Patchy: Learning CNNs for Graphs neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 17 Learning Convolutional Neural Networks for Graphs

18 Patchy: Learning CNNs for Graphs neighborhood normalization (exactly k=4 nodes) neighborhood assembly (at least k=4 nodes) node sequence selection (w=6 nodes) 18 Learning Convolutional Neural Networks for Graphs

19 Patchy: Learning CNNs for Graphs Convolutional architecture a m a m a m normalized neighborhoods serve as receptive fields node and edge attributes correspond to channels neighborhood normalization 19 Learning Convolutional Neural Networks for Graphs

20 Node Sequence Selection We use centrality measures to generate the node sequences Nodes with similar structural roles are aligned across graphs node sequence selection A: Betweenness centrality B: Closeness centrality C: Eigenvector centrality D: Degree centrality 0 Learning Convolutional Neural Networks for Graphs

21 Neighborhood Assembly Simple breadth-first expansion until at least k nodes added, or no additional nodes to add neighborhood assembly 1 Learning Convolutional Neural Networks for Graphs

22 Graph Normalization Problem Nodes of any two graphs should have similar position in the adjacency matrices iff their structural roles are similar adjacency matrices under labeling 4 labeling method (centrality etc.) distance measures in matrix and graph space 1 normalization Result: For several distance measure pairs it is possible to efficiently compare labeling methods without supervision Example: A A 1 and edit distance on graphs Learning Convolutional Neural Networks for Graphs

23 Graph Normalization 1 Distance to root node Learning Convolutional Neural Networks for Graphs

24 Graph Normalization Centrality measures, etc. 1 Distance to root node 4 Learning Convolutional Neural Networks for Graphs

25 Graph Normalization Canonicalization (break ties) Centrality measures, etc. 1 Distance to root node 5 Learning Convolutional Neural Networks for Graphs

26 Computational Complexity At most linear in number of input graphs At most quadratic in number of nodes for each graph (depends on maximal node degree and centrality measure) 6 Learning Convolutional Neural Networks for Graphs

27 Convolutional Architecture v 1 v M field size: 4, stride: 4, filters: M Learning Convolutional Neural Networks for Graphs

28 Convolutional Architecture v 1 v M field size: 4, stride: 4, filters: M Learning Convolutional Neural Networks for Graphs

29 Convolutional Architecture v 1 v M v 1 v M field size: 4, stride: 4, filters: M Learning Convolutional Neural Networks for Graphs

30 Convolutional Architecture v 1 v N field size:, stride: 1, N filters v 1 v M v 1 v M field size: 4, stride: 4, filters: M Learning Convolutional Neural Networks for Graphs

31 Convolutional Architecture v 1 v N field size:, stride: 1, N filters v 1 v M v 1 v M field size: 4, stride: 4, filters: M Learning Convolutional Neural Networks for Graphs

32 Convolutional Architecture v 1 v N v 1 v N field size:, stride: 1, N filters v 1 v M v 1 v M field size: 4, stride: 4, filters: M Learning Convolutional Neural Networks for Graphs

33 Experiments - Graph Classification Finite collection of graphs and their class labels class = 1 class = 0 class = 1 Nodes of any two graphs are not necessarily in correspondence Nodes and edges may have attributes (discrete and continuous) Learn a function from graphs to class labels class[ ] =? Learning Convolutional Neural Networks for Graphs

34 Experiments - Convolutional Architecture softmax flatten, dense 18 units field size: 10, stride: 1, filters: field size: k, stride: k, filters: Learning Convolutional Neural Networks for Graphs

35 Classification Datasets MUTAG: Nitro compounds where classes indicate mutagenic effect on a bacterium (Salmonella Typhimurium) PTC: Chemical compounds where classes indicate carcinogenicity for male and female rats NCI: Chemical compounds where classes indicate activity against non-small cell lung cancer and ovarian cancer cell lines D&D: Protein structures where classes indicate whether structure is an enzyme or not... 5 Learning Convolutional Neural Networks for Graphs

36 Experiments - Graph Classification Q: How efficient and effective compared to graph kernels? Apply Patchy to typical graph classification benchmark data 6 Learning Convolutional Neural Networks for Graphs

37 Experiments - Visualization Q: What do learned edge filters look like? Restricted Boltzmann machine applied to graphs Receptive field size of hidden layer: 9 graphs sampled from RBM small instances of graphs weights of hidden nodes 7 Learning Convolutional Neural Networks for Graphs

38 Discussion Pros: Graph kernel design not required Outperforms graph kernels on several datasets (speed and accuracy) Incorporates node and edge features (discrete and continuous) Supports visualizations (graph motifs, etc.) Cons: Prone to overfitting on smaller data sets (graph kernel benchmarks) Shift from designing graph kernels to tuning hyperparameters Graph normalization not part of learning code to be released: patchy.neclab.eu 8 Learning Convolutional Neural Networks for Graphs

CSE Introduction to High-Perfomance Deep Learning ImageNet & VGG. Jihyung Kil

CSE Introduction to High-Perfomance Deep Learning ImageNet & VGG. Jihyung Kil CSE 5194.01 - Introduction to High-Perfomance Deep Learning ImageNet & VGG Jihyung Kil ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton,

More information

Shu Kong. Department of Computer Science, UC Irvine

Shu Kong. Department of Computer Science, UC Irvine Ubiquitous Fine-Grained Computer Vision Shu Kong Department of Computer Science, UC Irvine Outline 1. Problem definition 2. Instantiation 3. Challenge 4. Fine-grained classification with holistic representation

More information

Shu Kong. Department of Computer Science, UC Irvine

Shu Kong. Department of Computer Science, UC Irvine Ubiquitous Fine-Grained Computer Vision Shu Kong Department of Computer Science, UC Irvine Outline 1. Problem definition 2. Instantiation 3. Challenge and philosophy 4. Fine-grained classification with

More information

COMP9444 Neural Networks and Deep Learning 5. Convolutional Networks

COMP9444 Neural Networks and Deep Learning 5. Convolutional Networks COMP9444 Neural Networks and Deep Learning 5. Convolutional Networks Textbook, Sections 6.2.2, 6.3, 7.9, 7.11-7.13, 9.1-9.5 COMP9444 17s2 Convolutional Networks 1 Outline Geometry of Hidden Unit Activations

More information

Automatic Classification of Perceived Gender from Facial Images

Automatic Classification of Perceived Gender from Facial Images Automatic Classification of Perceived Gender from Facial Images Joseph Lemley, Sami Abdul-Wahid, Dipayan Banik Advisor: Dr. Razvan Andonie SOURCE 2016 Outline 1 Introduction 2 Faces - Background 3 Faces

More information

Deep learning and non-negative matrix factorization in recognition of mammograms

Deep learning and non-negative matrix factorization in recognition of mammograms Deep learning and non-negative matrix factorization in recognition of mammograms Bartosz Swiderski Faculty of Applied Informatics and Mathematics Warsaw University of Life Sciences, Warsaw, Poland bartosz_swiderski@sggw.pl

More information

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns 1. Introduction Vasily Morzhakov, Alexey Redozubov morzhakovva@gmail.com, galdrd@gmail.com Abstract Cortical

More information

Figure 1: MRI Scanning [2]

Figure 1: MRI Scanning [2] A Deep Belief Network Based Brain Tumor Detection in MRI Images Thahseen P 1, Anish Kumar B 2 1 MEA Engineering College, State Highway 39, Nellikunnu-Vengoor, Perinthalmanna, Malappuram, Kerala 2 Assistant

More information

Convolutional Neural Networks for Text Classification

Convolutional Neural Networks for Text Classification Convolutional Neural Networks for Text Classification Sebastian Sierra MindLab Research Group July 1, 2016 ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, 2016 1 / 32 Outline 1 What is

More information

Rumor Detection on Twitter with Tree-structured Recursive Neural Networks

Rumor Detection on Twitter with Tree-structured Recursive Neural Networks 1 Rumor Detection on Twitter with Tree-structured Recursive Neural Networks Jing Ma 1, Wei Gao 2, Kam-Fai Wong 1,3 1 The Chinese University of Hong Kong 2 Victoria University of Wellington, New Zealand

More information

Flexible, High Performance Convolutional Neural Networks for Image Classification

Flexible, High Performance Convolutional Neural Networks for Image Classification Flexible, High Performance Convolutional Neural Networks for Image Classification Dan C. Cireşan, Ueli Meier, Jonathan Masci, Luca M. Gambardella, Jürgen Schmidhuber IDSIA, USI and SUPSI Manno-Lugano,

More information

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014

UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 Exam policy: This exam allows two one-page, two-sided cheat sheets (i.e. 4 sides); No other materials. Time: 2 hours. Be sure to write

More information

Object Detectors Emerge in Deep Scene CNNs

Object Detectors Emerge in Deep Scene CNNs Object Detectors Emerge in Deep Scene CNNs Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, Antonio Torralba Presented By: Collin McCarthy Goal: Understand how objects are represented in CNNs Are

More information

A Novel Capsule Neural Network Based Model For Drowsiness Detection Using Electroencephalography Signals

A Novel Capsule Neural Network Based Model For Drowsiness Detection Using Electroencephalography Signals A Novel Capsule Neural Network Based Model For Drowsiness Detection Using Electroencephalography Signals Luis Guarda Bräuning (1) Nicolas Astorga (1) Enrique López Droguett (1) Marcio Moura (2) Marcelo

More information

Convolutional and LSTM Neural Networks

Convolutional and LSTM Neural Networks Convolutional and LSTM Neural Networks Vanessa Jurtz January 11, 2017 Contents Neural networks and GPUs Lasagne Peptide binding to MHC class II molecules Convolutional Neural Networks (CNN) Recurrent and

More information

PMR5406 Redes Neurais e Lógica Fuzzy. Aula 5 Alguns Exemplos

PMR5406 Redes Neurais e Lógica Fuzzy. Aula 5 Alguns Exemplos PMR5406 Redes Neurais e Lógica Fuzzy Aula 5 Alguns Exemplos APPLICATIONS Two examples of real life applications of neural networks for pattern classification: RBF networks for face recognition FF networks

More information

Enhance micro-blogging recommendations of posts with an homophily-based graph

Enhance micro-blogging recommendations of posts with an homophily-based graph Enhance micro-blogging recommendations of posts with an homophily-based graph Quentin Grossetti 1,2 Supervised by Cédric du Mouza 2, Camelia Constantin 1 and Nicolas Travers 2 1 LIP6 - Université Pierre

More information

Data mining for Obstructive Sleep Apnea Detection. 18 October 2017 Konstantinos Nikolaidis

Data mining for Obstructive Sleep Apnea Detection. 18 October 2017 Konstantinos Nikolaidis Data mining for Obstructive Sleep Apnea Detection 18 October 2017 Konstantinos Nikolaidis Introduction: What is Obstructive Sleep Apnea? Obstructive Sleep Apnea (OSA) is a relatively common sleep disorder

More information

Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine

Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine Valfredo Pilla Jr, André Zanellato, Cristian Bortolini, Humberto R. Gamba and Gustavo Benvenutti Borba Graduate

More information

Neural Network for Detecting Head Impacts from Kinematic Data. Michael Fanton, Nicholas Gaudio, Alissa Ling CS 229 Project Report

Neural Network for Detecting Head Impacts from Kinematic Data. Michael Fanton, Nicholas Gaudio, Alissa Ling CS 229 Project Report Neural Network for Detecting Head Impacts from Kinematic Data Michael Fanton, Nicholas Gaudio, Alissa Ling CS 229 Project Report 1. Abstract Mild Traumatic Brain Injury (mtbi) is a serious health concern,

More information

A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images

A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images Ameen, SA and Vadera, S http://dx.doi.org/10.1111/exsy.12197 Title Authors Type URL A convolutional

More information

Assessing Functional Neural Connectivity as an Indicator of Cognitive Performance *

Assessing Functional Neural Connectivity as an Indicator of Cognitive Performance * Assessing Functional Neural Connectivity as an Indicator of Cognitive Performance * Brian S. Helfer 1, James R. Williamson 1, Benjamin A. Miller 1, Joseph Perricone 1, Thomas F. Quatieri 1 MIT Lincoln

More information

Factoid Question Answering

Factoid Question Answering Factoid Question Answering CS 898 Project June 12, 2017 Salman Mohammed David R. Cheriton School of Computer Science University of Waterloo Motivation Source: https://www.apple.com/newsroom/2017/01/hey-siri-whos-going-to-win-the-super-bowl/

More information

Contents. Just Classifier? Rules. Rules: example. Classification Rule Generation for Bioinformatics. Rule Extraction from a trained network

Contents. Just Classifier? Rules. Rules: example. Classification Rule Generation for Bioinformatics. Rule Extraction from a trained network Contents Classification Rule Generation for Bioinformatics Hyeoncheol Kim Rule Extraction from Neural Networks Algorithm Ex] Promoter Domain Hybrid Model of Knowledge and Learning Knowledge refinement

More information

Image Classification with TensorFlow: Radiomics 1p/19q Chromosome Status Classification Using Deep Learning

Image Classification with TensorFlow: Radiomics 1p/19q Chromosome Status Classification Using Deep Learning Image Classification with TensorFlow: Radiomics 1p/19q Chromosome Status Classification Using Deep Learning Charles Killam, LP.D. Certified Instructor, NVIDIA Deep Learning Institute NVIDIA Corporation

More information

The Impact of Visual Saliency Prediction in Image Classification

The Impact of Visual Saliency Prediction in Image Classification Dublin City University Insight Centre for Data Analytics Universitat Politecnica de Catalunya Escola Tècnica Superior d Enginyeria de Telecomunicacions de Barcelona Eric Arazo Sánchez The Impact of Visual

More information

Convolutional Neural Networks for Estimating Left Ventricular Volume

Convolutional Neural Networks for Estimating Left Ventricular Volume Convolutional Neural Networks for Estimating Left Ventricular Volume Ryan Silva Stanford University rdsilva@stanford.edu Maksim Korolev Stanford University mkorolev@stanford.edu Abstract End-systolic and

More information

B657: Final Project Report Holistically-Nested Edge Detection

B657: Final Project Report Holistically-Nested Edge Detection B657: Final roject Report Holistically-Nested Edge Detection Mingze Xu & Hanfei Mei May 4, 2016 Abstract Holistically-Nested Edge Detection (HED), which is a novel edge detection method based on fully

More information

Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning

Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning Yu-An Chung 1 Hsuan-Tien Lin 1 Shao-Wen Yang 2 1 Dept. of Computer Science and Information Engineering National Taiwan University, Taiwan

More information

Hierarchical Convolutional Features for Visual Tracking

Hierarchical Convolutional Features for Visual Tracking Hierarchical Convolutional Features for Visual Tracking Chao Ma Jia-Bin Huang Xiaokang Yang Ming-Husan Yang SJTU UIUC SJTU UC Merced ICCV 2015 Background Given the initial state (position and scale), estimate

More information

A HMM-based Pre-training Approach for Sequential Data

A HMM-based Pre-training Approach for Sequential Data A HMM-based Pre-training Approach for Sequential Data Luca Pasa 1, Alberto Testolin 2, Alessandro Sperduti 1 1- Department of Mathematics 2- Department of Developmental Psychology and Socialisation University

More information

Efficient Deep Model Selection

Efficient Deep Model Selection Efficient Deep Model Selection Jose Alvarez Researcher Data61, CSIRO, Australia GTC, May 9 th 2017 www.josemalvarez.net conv1 conv2 conv3 conv4 conv5 conv6 conv7 conv8 softmax prediction???????? Num Classes

More information

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING 1

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING 1 IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING Joint Classification and Regression via Deep Multi-Task Multi-Channel Learning for Alzheimer s Disease Diagnosis Mingxia Liu, Jun Zhang, Ehsan Adeli, Dinggang

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Behavioral training.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Behavioral training. Supplementary Figure 1 Behavioral training. a, Mazes used for behavioral training. Asterisks indicate reward location. Only some example mazes are shown (for example, right choice and not left choice maze

More information

Predicting Breast Cancer Recurrence Using Machine Learning Techniques

Predicting Breast Cancer Recurrence Using Machine Learning Techniques Predicting Breast Cancer Recurrence Using Machine Learning Techniques Umesh D R Department of Computer Science & Engineering PESCE, Mandya, Karnataka, India Dr. B Ramachandra Department of Electrical and

More information

INDUCTIVE LEARNING OF TREE-BASED REGRESSION MODELS. Luís Fernando Raínho Alves Torgo

INDUCTIVE LEARNING OF TREE-BASED REGRESSION MODELS. Luís Fernando Raínho Alves Torgo Luís Fernando Raínho Alves Torgo INDUCTIVE LEARNING OF TREE-BASED REGRESSION MODELS Tese submetida para obtenção do grau de Doutor em Ciência de Computadores Departamento de Ciência de Computadores Faculdade

More information

3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients

3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients 3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients Dong Nie 1,2, Han Zhang 1, Ehsan Adeli 1, Luyan Liu 1, and Dinggang Shen 1(B) 1 Department of Radiology

More information

DIABETIC RISK PREDICTION FOR WOMEN USING BOOTSTRAP AGGREGATION ON BACK-PROPAGATION NEURAL NETWORKS

DIABETIC RISK PREDICTION FOR WOMEN USING BOOTSTRAP AGGREGATION ON BACK-PROPAGATION NEURAL NETWORKS International Journal of Computer Engineering & Technology (IJCET) Volume 9, Issue 4, July-Aug 2018, pp. 196-201, Article IJCET_09_04_021 Available online at http://www.iaeme.com/ijcet/issues.asp?jtype=ijcet&vtype=9&itype=4

More information

To What Extent Can the Recognition of Unfamiliar Faces be Accounted for by the Direct Output of Simple Cells?

To What Extent Can the Recognition of Unfamiliar Faces be Accounted for by the Direct Output of Simple Cells? To What Extent Can the Recognition of Unfamiliar Faces be Accounted for by the Direct Output of Simple Cells? Peter Kalocsai, Irving Biederman, and Eric E. Cooper University of Southern California Hedco

More information

Final Report: Automated Semantic Segmentation of Volumetric Cardiovascular Features and Disease Assessment

Final Report: Automated Semantic Segmentation of Volumetric Cardiovascular Features and Disease Assessment Final Report: Automated Semantic Segmentation of Volumetric Cardiovascular Features and Disease Assessment Tony Lindsey 1,3, Xiao Lu 1 and Mojtaba Tefagh 2 1 Department of Biomedical Informatics, Stanford

More information

arxiv: v1 [cs.lg] 6 Oct 2016

arxiv: v1 [cs.lg] 6 Oct 2016 Combining Generative and Discriminative Neural Networks for Sleep Stages Classification Endang Purnama Giri 1,2, Mohamad Ivan Fanany 1, Aniati Murni Arymurthy 1, arxiv:1610.01741v1 [cs.lg] 6 Oct 2016 1

More information

FCNet: A Convolutional Neural Network for Calculating Functional Connectivity from functional MRI

FCNet: A Convolutional Neural Network for Calculating Functional Connectivity from functional MRI FCNet: A Convolutional Neural Network for Calculating Functional Connectivity from functional MRI Atif Riaz, Muhammad Asad, S. M. Masudur Rahman Al-Arif, Eduardo Alonso, Danai Dima, Philip Corr and Greg

More information

STDP-based spiking deep convolutional neural networks for object recognition

STDP-based spiking deep convolutional neural networks for object recognition arxiv:1611.01421v3 [cs.cv] 25 Dec 2017 This manuscript is published in Neural Networks. Please cite it as: Kheradpisheh, S.R., Ganjtabesh, M., Thorpe, S.J., Masquelier, T., STDP-based spiking deep convolutional

More information

Using Computational Models to Understand ASD Facial Expression Recognition Patterns

Using Computational Models to Understand ASD Facial Expression Recognition Patterns Using Computational Models to Understand ASD Facial Expression Recognition Patterns Irene Feng Dartmouth College Computer Science Technical Report TR2017-819 May 30, 2017 Irene Feng 2 Literature Review

More information

Representational similarity analysis

Representational similarity analysis School of Psychology Representational similarity analysis Dr Ian Charest Representational similarity analysis representational dissimilarity matrices (RDMs) stimulus (e.g. images, sounds, other experimental

More information

arxiv: v2 [stat.ml] 30 Oct 2018

arxiv: v2 [stat.ml] 30 Oct 2018 BOOTSTRAPPING GRAPH CONVOLUTIONAL NEURAL NETWORKS FOR AUTISM SPECTRUM DISORDER CLASSIFICATION Rushil Anirudh and Jayaraman J. Thiagarajan Lawrence Livermore National Laboratory Email: {anirudh1, jjayaram}@llnl.gov

More information

Patients EEG Data Analysis via Spectrogram Image with a Convolution Neural Network

Patients EEG Data Analysis via Spectrogram Image with a Convolution Neural Network Patients EEG Data Analysis via Spectrogram Image with a Convolution Neural Network Longhao Yuan and Jianting Cao ( ) Graduate School of Engineering, Saitama Institute of Technology, Fusaiji 1690, Fukaya-shi,

More information

Neuromorphic convolutional recurrent neural network for road safety or safety near the road

Neuromorphic convolutional recurrent neural network for road safety or safety near the road Neuromorphic convolutional recurrent neural network for road safety or safety near the road WOO-SUP HAN 1, IL SONG HAN 2 1 ODIGA, London, U.K. 2 Korea Advanced Institute of Science and Technology, Daejeon,

More information

Summary and discussion of: Why Does Unsupervised Pre-training Help Deep Learning?

Summary and discussion of: Why Does Unsupervised Pre-training Help Deep Learning? Summary and discussion of: Why Does Unsupervised Pre-training Help Deep Learning? Statistics Journal Club, 36-825 Avinava Dubey and Mrinmaya Sachan and Jerzy Wieczorek December 3, 2014 1 Summary 1.1 Deep

More information

Not-So-CLEVR: learning same different relations strains feedforward neural networks

Not-So-CLEVR: learning same different relations strains feedforward neural networks Not-So-CLEVR: learning same different relations strains feedforward neural networks Junkyung Kim Matthew Ricci Thomas Serre equal contributions Department of Cognitive, Linguistic & Psychological Sciences

More information

Holistically-Nested Edge Detection (HED)

Holistically-Nested Edge Detection (HED) Holistically-Nested Edge Detection (HED) Saining Xie, Zhuowen Tu Presented by Yuxin Wu February 10, 20 What is an Edge? Local intensity change? Used in traditional methods: Canny, Sobel, etc Learn it!

More information

Supplementary Online Content

Supplementary Online Content Supplementary Online Content Ting DS, Cheung CY-L, Lim G, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic

More information

Predicting Breast Cancer Survivability Rates

Predicting Breast Cancer Survivability Rates Predicting Breast Cancer Survivability Rates For data collected from Saudi Arabia Registries Ghofran Othoum 1 and Wadee Al-Halabi 2 1 Computer Science, Effat University, Jeddah, Saudi Arabia 2 Computer

More information

Classıfıcatıon of Dıabetes Dısease Usıng Backpropagatıon and Radıal Basıs Functıon Network

Classıfıcatıon of Dıabetes Dısease Usıng Backpropagatıon and Radıal Basıs Functıon Network UTM Computing Proceedings Innovations in Computing Technology and Applications Volume 2 Year: 2017 ISBN: 978-967-0194-95-0 1 Classıfıcatıon of Dıabetes Dısease Usıng Backpropagatıon and Radıal Basıs Functıon

More information

Leukemia Blood Cell Image Classification Using Convolutional Neural Network

Leukemia Blood Cell Image Classification Using Convolutional Neural Network Leukemia Blood Cell Image Classification Using Convolutional Neural Network T. T. P. Thanh, Caleb Vununu, Sukhrob Atoev, Suk-Hwan Lee, and Ki-Ryong Kwon Abstract Acute myeloid leukemia is a type of malignant

More information

On the Use of Brainprints as Passwords

On the Use of Brainprints as Passwords 9/24/2015 2015 Global Identity Summit (GIS) 1 On the Use of Brainprints as Passwords Zhanpeng Jin Department of Electrical and Computer Engineering Department of Biomedical Engineering Binghamton University,

More information

Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images

Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images Sachin Mehta 1, Ezgi Mercan 1, Jamen Bartlett 2, Donald Weaver 2, Joann G. Elmore 1, and Linda Shapiro 1 1 University

More information

On Training of Deep Neural Network. Lornechen

On Training of Deep Neural Network. Lornechen On Training of Deep Neural Network Lornechen 2016.04.20 1 Outline Introduction Layer-wise Pre-training & Fine-tuning Activation Function Initialization Method Advanced Layers and Nets 2 Neural Network

More information

CPSC81 Final Paper: Facial Expression Recognition Using CNNs

CPSC81 Final Paper: Facial Expression Recognition Using CNNs CPSC81 Final Paper: Facial Expression Recognition Using CNNs Luis Ceballos Swarthmore College, 500 College Ave., Swarthmore, PA 19081 USA Sarah Wallace Swarthmore College, 500 College Ave., Swarthmore,

More information

A Vision-based Affective Computing System. Jieyu Zhao Ningbo University, China

A Vision-based Affective Computing System. Jieyu Zhao Ningbo University, China A Vision-based Affective Computing System Jieyu Zhao Ningbo University, China Outline Affective Computing A Dynamic 3D Morphable Model Facial Expression Recognition Probabilistic Graphical Models Some

More information

arxiv: v1 [cs.cv] 30 May 2018

arxiv: v1 [cs.cv] 30 May 2018 A Robust and Effective Approach Towards Accurate Metastasis Detection and pn-stage Classification in Breast Cancer Byungjae Lee and Kyunghyun Paeng Lunit inc., Seoul, South Korea {jaylee,khpaeng}@lunit.io

More information

Quantifying Radiographic Knee Osteoarthritis Severity using Deep Convolutional Neural Networks

Quantifying Radiographic Knee Osteoarthritis Severity using Deep Convolutional Neural Networks Quantifying Radiographic Knee Osteoarthritis Severity using Deep Convolutional Neural Networks Joseph Antony, Kevin McGuinness, Noel E O Connor, Kieran Moran Insight Centre for Data Analytics, Dublin City

More information

Automatic Quality Assessment of Cardiac MRI

Automatic Quality Assessment of Cardiac MRI Automatic Quality Assessment of Cardiac MRI Ilkay Oksuz 02.05.2018 Contact: ilkay.oksuz@kcl.ac.uk http://kclmmag.org 1 Cardiac MRI Quality Issues Need for high quality images Wide range of artefacts Manual

More information

COMPARATIVE STUDY ON FEATURE EXTRACTION METHOD FOR BREAST CANCER CLASSIFICATION

COMPARATIVE STUDY ON FEATURE EXTRACTION METHOD FOR BREAST CANCER CLASSIFICATION COMPARATIVE STUDY ON FEATURE EXTRACTION METHOD FOR BREAST CANCER CLASSIFICATION 1 R.NITHYA, 2 B.SANTHI 1 Asstt Prof., School of Computing, SASTRA University, Thanjavur, Tamilnadu, India-613402 2 Prof.,

More information

Arecent paper [31] claims to (learn to) classify EEG

Arecent paper [31] claims to (learn to) classify EEG IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Training on the test set? An analysis of Spampinato et al. [31] Ren Li, Jared S. Johansen, Hamad Ahmed, Thomas V. Ilyevsky, Ronnie B Wilbur,

More information

Rich feature hierarchies for accurate object detection and semantic segmentation

Rich feature hierarchies for accurate object detection and semantic segmentation Rich feature hierarchies for accurate object detection and semantic segmentation Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik UC Berkeley Tech Report @ http://arxiv.org/abs/1311.2524! Detection

More information

Visual semantics: image elements. Symbols Objects People Poses

Visual semantics: image elements. Symbols Objects People Poses Visible Partisanship Polmeth XXXIII, Rice University, July 22, 2016 Convolutional Neural Networks for the Analysis of Political Images L. Jason Anastasopoulos ljanastas@uga.edu (University of Georgia,

More information

Convolutional and LSTM Neural Networks

Convolutional and LSTM Neural Networks Convolutional and LSTM Neural Networks Vanessa Jurtz January 12, 2016 Contents Neural networks and GPUs Lasagne Peptide binding to MHC class II molecules Convolutional Neural Networks (CNN) Recurrent and

More information

POC Brain Tumor Segmentation. vlife Use Case

POC Brain Tumor Segmentation. vlife Use Case Brain Tumor Segmentation vlife Use Case 1 Automatic Brain Tumor Segmentation using CNN Background Brain tumor segmentation seeks to separate healthy tissue from tumorous regions such as the advancing tumor,

More information

Early Diagnosis of Autism Disease by Multi-channel CNNs

Early Diagnosis of Autism Disease by Multi-channel CNNs Early Diagnosis of Autism Disease by Multi-channel CNNs Guannan Li 1,2, Mingxia Liu 2, Quansen Sun 1(&), Dinggang Shen 2(&), and Li Wang 2(&) 1 School of Computer Science and Engineering, Nanjing University

More information

Classification of benign and malignant masses in breast mammograms

Classification of benign and malignant masses in breast mammograms Classification of benign and malignant masses in breast mammograms A. Šerifović-Trbalić*, A. Trbalić**, D. Demirović*, N. Prljača* and P.C. Cattin*** * Faculty of Electrical Engineering, University of

More information

Motivation: Attention: Focusing on specific parts of the input. Inspired by neuroscience.

Motivation: Attention: Focusing on specific parts of the input. Inspired by neuroscience. Outline: Motivation. What s the attention mechanism? Soft attention vs. Hard attention. Attention in Machine translation. Attention in Image captioning. State-of-the-art. 1 Motivation: Attention: Focusing

More information

A Reliable Method for Brain Tumor Detection Using Cnn Technique

A Reliable Method for Brain Tumor Detection Using Cnn Technique IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE) e-issn: 2278-1676,p-ISSN: 2320-3331, PP 64-68 www.iosrjournals.org A Reliable Method for Brain Tumor Detection Using Cnn Technique Neethu

More information

Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech

Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech arxiv:1901.05613v1 [cs.cv] 17 Jan 2019 Shahjalal Ahmed, Md. Rafiqul Islam,

More information

Use of MALDI-TOF mass spectrometry and machine learning to detect the adulteration of extra virgin olive oils

Use of MALDI-TOF mass spectrometry and machine learning to detect the adulteration of extra virgin olive oils PO-CON1811E Use of MALDI-TOF mass spectrometry and machine learning to detect the adulteration of extra virgin olive oils ASMS 218 MP 21 Simona Salivo 1 ; Tom K. Abban 1 ; Ismael Duque 2 ; Luis Mancera

More information

A Deep Learning Approach for Subject Independent Emotion Recognition from Facial Expressions

A Deep Learning Approach for Subject Independent Emotion Recognition from Facial Expressions A Deep Learning Approach for Subject Independent Emotion Recognition from Facial Expressions VICTOR-EMIL NEAGOE *, ANDREI-PETRU BĂRAR *, NICU SEBE **, PAUL ROBITU * * Faculty of Electronics, Telecommunications

More information

Medical Knowledge Attention Enhanced Neural Model. for Named Entity Recognition in Chinese EMR

Medical Knowledge Attention Enhanced Neural Model. for Named Entity Recognition in Chinese EMR Medical Knowledge Attention Enhanced Neural Model for Named Entity Recognition in Chinese EMR Zhichang Zhang, Yu Zhang, Tong Zhou College of Computer Science and Engineering, Northwest Normal University,

More information

Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images

Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images Tae Joon Jun, Dohyeun Kim, and Daeyoung Kim School of Computing, KAIST,

More information

BLADDERSCAN PRIME PLUS TM DEEP LEARNING

BLADDERSCAN PRIME PLUS TM DEEP LEARNING BLADDERSCAN PRIME PLUS TM DEEP LEARNING BladderScan Prime Plus from Verathon Takes Accuracy and Ease of Use to a New Level Powered by ImageSense TM deep learning technology, an advanced implementation

More information

Mutation Profile to Predict Tumor Stage in Lung Adenocarcinoma

Mutation Profile to Predict Tumor Stage in Lung Adenocarcinoma Mutation Profile to Predict Tumor Stage in Lung Adenocarcinoma 1 st Calvin Kuo Mechanical Engineering Department Stanford University Stanford, USA calvink@stanford.edu Abstract Lung adenocarcinoma is among

More information

Reduction of Overfitting in Diabetes Prediction Using Deep Learning Neural Network

Reduction of Overfitting in Diabetes Prediction Using Deep Learning Neural Network Reduction of Overfitting in Diabetes Prediction Using Deep Learning Neural Network Akm Ashiquzzaman *, Abdul Kawsar Tushar *, Md. Rashedul Islam *, 1, and Jong-Myon Kim **, 2 * Department of CSE, University

More information

A Feed-Forward Neural Network Model For The Accurate Prediction Of Diabetes Mellitus

A Feed-Forward Neural Network Model For The Accurate Prediction Of Diabetes Mellitus A Feed-Forward Neural Network Model For The Accurate Prediction Of Diabetes Mellitus Yinghui Zhang, Zihan Lin, Yubeen Kang, Ruoci Ning, Yuqi Meng Abstract: Diabetes mellitus is a group of metabolic diseases

More information

A NEW HUMANLIKE FACIAL ATTRACTIVENESS PREDICTOR WITH CASCADED FINE-TUNING DEEP LEARNING MODEL

A NEW HUMANLIKE FACIAL ATTRACTIVENESS PREDICTOR WITH CASCADED FINE-TUNING DEEP LEARNING MODEL A NEW HUMANLIKE FACIAL ATTRACTIVENESS PREDICTOR WITH CASCADED FINE-TUNING DEEP LEARNING MODEL Jie Xu, Lianwen Jin*, Lingyu Liang*, Ziyong Feng, Duorui Xie South China University of Technology, Guangzhou

More information

arxiv: v1 [q-bio.nc] 12 Jun 2014

arxiv: v1 [q-bio.nc] 12 Jun 2014 1 arxiv:1406.3284v1 [q-bio.nc] 12 Jun 2014 Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Charles F. Cadieu 1,, Ha Hong 1,2, Daniel L. K. Yamins 1,

More information

Tumor Cellularity Assessment. Rene Bidart

Tumor Cellularity Assessment. Rene Bidart Tumor Cellularity Assessment Rene Bidart 1 Goals Find location and class of all cell nuclei: Lymphocyte Cells Normal Epithelial Cells Malignant Epithelial Cells Why: Test effectiveness of pre-surgery treatment

More information

arxiv: v1 [cs.cv] 17 Aug 2017

arxiv: v1 [cs.cv] 17 Aug 2017 Deep Learning for Medical Image Analysis Mina Rezaei, Haojin Yang, Christoph Meinel Hasso Plattner Institute, Prof.Dr.Helmert-Strae 2-3, 14482 Potsdam, Germany {mina.rezaei,haojin.yang,christoph.meinel}@hpi.de

More information

Classification of Mammograms using Gray-level Co-occurrence Matrix and Support Vector Machine Classifier

Classification of Mammograms using Gray-level Co-occurrence Matrix and Support Vector Machine Classifier Classification of Mammograms using Gray-level Co-occurrence Matrix and Support Vector Machine Classifier P.Samyuktha,Vasavi College of engineering,cse dept. D.Sriharsha, IDD, Comp. Sc. & Engg., IIT (BHU),

More information

Improved Intelligent Classification Technique Based On Support Vector Machines

Improved Intelligent Classification Technique Based On Support Vector Machines Improved Intelligent Classification Technique Based On Support Vector Machines V.Vani Asst.Professor,Department of Computer Science,JJ College of Arts and Science,Pudukkottai. Abstract:An abnormal growth

More information

Sleep Staging with Deep Learning: A convolutional model

Sleep Staging with Deep Learning: A convolutional model Sleep Staging with Deep Learning: A convolutional model Isaac Ferna ndez-varela1, Dimitrios Athanasakis2, Samuel Parsons3 Elena Herna ndez-pereira1, and Vicente Moret-Bonillo1 1- Universidade da Corun

More information

Session: Imaging for Clinical Decision Support

Session: Imaging for Clinical Decision Support healthitnews Session: Imaging for Clinical Decision Support Chair: Ian Poole, PhD Scientific Fellow Toshiba Medical Visualisation Systems, Edinburgh A Canon Group Company What is Clinical Decision Support?.

More information

GOLD CLASSIFICATION OF COPDGENE COHORT BASED ON DEEP LEARNING

GOLD CLASSIFICATION OF COPDGENE COHORT BASED ON DEEP LEARNING GOLD CLASSIFICATION OF COPDGENE COHORT BASED ON DEEP LEARNING Jun Ying 1,2, Joyita Dutta 1, Ning Guo 1, Lei Xia 2, Arkadiusz Sitek 1, Quanzheng Li 1 Quanzheng Li: Li.Quanzheng@mgh.harvard.edu 1 Nuclear

More information

A Hierarchical Artificial Neural Network Model for Giemsa-Stained Human Chromosome Classification

A Hierarchical Artificial Neural Network Model for Giemsa-Stained Human Chromosome Classification A Hierarchical Artificial Neural Network Model for Giemsa-Stained Human Chromosome Classification JONGMAN CHO 1 1 Department of Biomedical Engineering, Inje University, Gimhae, 621-749, KOREA minerva@ieeeorg

More information

A CONVOLUTION NEURAL NETWORK ALGORITHM FOR BRAIN TUMOR IMAGE SEGMENTATION

A CONVOLUTION NEURAL NETWORK ALGORITHM FOR BRAIN TUMOR IMAGE SEGMENTATION A CONVOLUTION NEURAL NETWORK ALGORITHM FOR BRAIN TUMOR IMAGE SEGMENTATION 1 Priya K, 2 Dr.O. Saraniya 1 PG Scholar, 2 Assistant Professor Department Of ECE Government College of Technology, Coimbatore,

More information

Attentional Masking for Pre-trained Deep Networks

Attentional Masking for Pre-trained Deep Networks Attentional Masking for Pre-trained Deep Networks IROS 2017 Marcus Wallenberg and Per-Erik Forssén Computer Vision Laboratory Department of Electrical Engineering Linköping University 2014 2017 Per-Erik

More information

A Comparison of Deep Neural Network Training Methods for Large Vocabulary Speech Recognition

A Comparison of Deep Neural Network Training Methods for Large Vocabulary Speech Recognition A Comparison of Deep Neural Network Training Methods for Large Vocabulary Speech Recognition LászlóTóth and Tamás Grósz MTA-SZTE Research Group on Artificial Intelligence Hungarian Academy of Sciences

More information

ACUTE LEUKEMIA CLASSIFICATION USING CONVOLUTION NEURAL NETWORK IN CLINICAL DECISION SUPPORT SYSTEM

ACUTE LEUKEMIA CLASSIFICATION USING CONVOLUTION NEURAL NETWORK IN CLINICAL DECISION SUPPORT SYSTEM ACUTE LEUKEMIA CLASSIFICATION USING CONVOLUTION NEURAL NETWORK IN CLINICAL DECISION SUPPORT SYSTEM Thanh.TTP 1, Giao N. Pham 1, Jin-Hyeok Park 1, Kwang-Seok Moon 2, Suk-Hwan Lee 3, and Ki-Ryong Kwon 1

More information

The Importance of Time in Visual Attention Models

The Importance of Time in Visual Attention Models The Importance of Time in Visual Attention Models Degree s Thesis Audiovisual Systems Engineering Author: Advisors: Marta Coll Pol Xavier Giró-i-Nieto and Kevin Mc Guinness Dublin City University (DCU)

More information

Satoru Hiwa, 1 Kenya Hanawa, 2 Ryota Tamura, 2 Keisuke Hachisuka, 3 and Tomoyuki Hiroyasu Introduction

Satoru Hiwa, 1 Kenya Hanawa, 2 Ryota Tamura, 2 Keisuke Hachisuka, 3 and Tomoyuki Hiroyasu Introduction Computational Intelligence and Neuroscience Volume 216, Article ID 1841945, 9 pages http://dx.doi.org/1.1155/216/1841945 Research Article Analyzing Brain Functions by Subject Classification of Functional

More information

Networks and Hierarchical Processing: Object Recognition in Human and Computer Vision

Networks and Hierarchical Processing: Object Recognition in Human and Computer Vision Networks and Hierarchical Processing: Object Recognition in Human and Computer Vision Guest&Lecture:&Marius&Cătălin&Iordan&& CS&131&8&Computer&Vision:&Foundations&and&Applications& 01&December&2014 1.

More information