Convolutional Neural Networks for Text Classification
|
|
|
- Sharon Goodwin
- 6 years ago
- Views:
Transcription
1 Convolutional Neural Networks for Text Classification Sebastian Sierra MindLab Research Group July 1, 2016 ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
2 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
3 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
4 What is a Convolution? Convolutions are great for extracting features from Images. Convolutional Neural Networks (CNN) are biologically-inspired variants of MLPs Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
5 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
6 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
7 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
8 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
9 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
10 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
11 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
12 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
13 Green: Input, Yellow: Convolutional Filter, Red: Output ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
14 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
15 Convolutional Neural Network Figure 1: Close up of Convolutional Neural Network Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
16 Convolutional Neural Network CNNs are networks composed of several layers of convolutions with nonlinear activation functions like ReLU or tanh applied to the results. Traditional Layers are fully connected, instead CNN use local connections. Each layer applies different filters (thousands) like the ones showed above, and combines their results. Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
17 Properties of Convolutional Neural Networks Local Invariance Compositionality Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
18 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
19 CNN in NLP Do they make sense in NLP? Perhaps Recurrent Neural Networks would make more sense trying to learn patterns extracted from a text sequence. They are not cognitively or linguistically plausible. Advantage There are fast GPU implementations for CNNs Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
20 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
21 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
22 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
23 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
24 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
25 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
26 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
27 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
28 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
29 An example of how CNN work Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
30 Char-CNN Let s try this model Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
31 Char-CNN Let s try this model C R d l : Matrix representation of a sequence of length l(140, 300,?). H R d w : Convolutional filter matrix where, d : Dimensionality of character embeddings (used 30) w : Width of convolution filter (3, 4, 5) ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
32 A simple architecture Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
33 Steps for applying a CNN 1 Apply a convolution between C and H to obtain a vector f R l w+1 f [i] = C[, i : i + w 1], H A, B is the Frobenius inner product. Tr(AB T ) 2 This vector f is also known as feature map. 3 Take the maximum value over time as the feature that represents filter H. (K-max pooling) f = relu(max{f [i]} + b) i 4 Then we do the same for all m filters. z = [ f i,..., f m ] Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
34 Intution behind Why ReLU and not tanh? Should I use multiple filter weights H? Should I use variable filter widths w? Can I add another channel as in Computer Vision domain? Is Max-Pooling capturing the most important activation? Would they capture morphological relations? Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
35 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
36 Regularization tricks Use dropout (Gradients are only backpropagated through certain inputs of z). Constrain L 2 norms of weight vectors of each class(rows in Softmax matrx W (S) ) to a fixed number: If W c (S) > s, the rescale it so W c (S) = s. Early Stopping Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
37 CNN in NLP - Previous Work Previous works: NLP from scratch (Collobert et al. 2011). Sentence or paragraph modelling using words as input (Kim 2014; Kalchbrenner, Grefenstette, and Blunsom 2014; Johnson and T. Zhang 2015a; Johnson and T. Zhang 2015b). Text classification using characters as input (Kim et al. 2016; X. Zhang, Zhao, and LeCun 2015) Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
38 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
39 Outline 1 What is a Convolution? 2 What are Convolutional Neural Networks? 3 CNN for NLP 4 CNN hyperparameters 5 Example: The Model 6 Bibliography Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
40 Collobert, Ronan et al. (2011). Natural language processing (almost) from scratch. In: Journal of Machine Learning Research 12.Aug, pp Johnson, Rie and Tong Zhang (2015a). Effective Use of Word Order for Text Categorization with Convolutional Neural Networks. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Denver, Colorado: Association for Computational Linguistics, pp url: (2015b). Semi-supervised convolutional neural networks for text categorization via region embedding. In: Advances in neural information processing systems, pp Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
41 Kalchbrenner, Nal, Edward Grefenstette, and Phil Blunsom (2014). A Convolutional Neural Network for Modelling Sentences. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Baltimore, Maryland: Association for Computational Linguistics, pp url: Kim, Yoon (2014). Convolutional Neural Networks for Sentence Classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha, Qatar: Association for Computational Linguistics, pp url: Kim, Yoon et al. (2016). Character-Aware Neural Language Models. In: Thirtieth AAAI Conference on Artificial Intelligence. Zhang, Xiang, Junbo Zhao, and Yann LeCun (2015). Character-level Convolutional Networks for Text Classification. In: Advanced in Neural Information Processing Systems (NIPS 2015). Vol. 28. Sebastian Sierra (MindLab Research Group) NLP Summer Class July 1, / 32
COMP9444 Neural Networks and Deep Learning 5. Convolutional Networks
COMP9444 Neural Networks and Deep Learning 5. Convolutional Networks Textbook, Sections 6.2.2, 6.3, 7.9, 7.11-7.13, 9.1-9.5 COMP9444 17s2 Convolutional Networks 1 Outline Geometry of Hidden Unit Activations
Convolutional Neural Networks (CNN)
Convolutional Neural Networks (CNN) Algorithm and Some Applications in Computer Vision Luo Hengliang Institute of Automation June 10, 2014 Luo Hengliang (Institute of Automation) Convolutional Neural Networks
CSE Introduction to High-Perfomance Deep Learning ImageNet & VGG. Jihyung Kil
CSE 5194.01 - Introduction to High-Perfomance Deep Learning ImageNet & VGG Jihyung Kil ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton,
Convolutional and LSTM Neural Networks
Convolutional and LSTM Neural Networks Vanessa Jurtz January 11, 2017 Contents Neural networks and GPUs Lasagne Peptide binding to MHC class II molecules Convolutional Neural Networks (CNN) Recurrent and
Interpreting Deep Neural Networks and their Predictions
Fraunhofer Image Processing Heinrich Hertz Institute Interpreting Deep Neural Networks and their Predictions Wojciech Samek ML Group, Fraunhofer HHI (joint work with S. Lapuschkin, A. Binder, G. Montavon,
Convolutional and LSTM Neural Networks
Convolutional and LSTM Neural Networks Vanessa Jurtz January 12, 2016 Contents Neural networks and GPUs Lasagne Peptide binding to MHC class II molecules Convolutional Neural Networks (CNN) Recurrent and
A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images
A convolutional neural network to classify American Sign Language fingerspelling from depth and colour images Ameen, SA and Vadera, S http://dx.doi.org/10.1111/exsy.12197 Title Authors Type URL A convolutional
Supplementary Online Content
Supplementary Online Content Ting DS, Cheung CY-L, Lim G, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic
Flexible, High Performance Convolutional Neural Networks for Image Classification
Flexible, High Performance Convolutional Neural Networks for Image Classification Dan C. Cireşan, Ueli Meier, Jonathan Masci, Luca M. Gambardella, Jürgen Schmidhuber IDSIA, USI and SUPSI Manno-Lugano,
An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns
An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns 1. Introduction Vasily Morzhakov, Alexey Redozubov morzhakovva@gmail.com, galdrd@gmail.com Abstract Cortical
Medical Knowledge Attention Enhanced Neural Model. for Named Entity Recognition in Chinese EMR
Medical Knowledge Attention Enhanced Neural Model for Named Entity Recognition in Chinese EMR Zhichang Zhang, Yu Zhang, Tong Zhou College of Computer Science and Engineering, Northwest Normal University,
Efficient Deep Model Selection
Efficient Deep Model Selection Jose Alvarez Researcher Data61, CSIRO, Australia GTC, May 9 th 2017 www.josemalvarez.net conv1 conv2 conv3 conv4 conv5 conv6 conv7 conv8 softmax prediction???????? Num Classes
Improving the Interpretability of DEMUD on Image Data Sets
Improving the Interpretability of DEMUD on Image Data Sets Jake Lee, Jet Propulsion Laboratory, California Institute of Technology & Columbia University, CS 19 Intern under Kiri Wagstaff Summer 2018 Government
c Copyright 2017 Cody Burkard
c Copyright 2017 Cody Burkard Can Intelligent Hyperparameter Selection Improve Resistance to Adversarial Examples? Cody Burkard A thesis submitted in partial fulfillment of the requirements for the degree
Deep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 12: Time Sequence Data, Recurrent Neural Networks (RNNs), Long Short-Term Memories (s), and Image Captioning Peter Belhumeur Computer Science Columbia University
arxiv: v1 [stat.ml] 23 Jan 2017
![arxiv: v1 [stat.ml] 23 Jan 2017](/thumbs/81/83414183.jpg "arxiv: v1 [stat.ml] 23 Jan 2017")
Learning what to look in chest X-rays with a recurrent visual attention model arxiv:1701.06452v1 [stat.ml] 23 Jan 2017 Petros-Pavlos Ypsilantis Department of Biomedical Engineering King s College London
Learning Convolutional Neural Networks for Graphs
GA-65449 Learning Convolutional Neural Networks for Graphs Mathias Niepert Mohamed Ahmed Konstantin Kutzkov NEC Laboratories Europe Representation Learning for Graphs Telecom Safety Transportation Industry
Motivation: Attention: Focusing on specific parts of the input. Inspired by neuroscience.
Outline: Motivation. What s the attention mechanism? Soft attention vs. Hard attention. Attention in Machine translation. Attention in Image captioning. State-of-the-art. 1 Motivation: Attention: Focusing
CS-E Deep Learning Session 4: Convolutional Networks
CS-E4050 - Deep Learning Session 4: Convolutional Networks Jyri Kivinen Aalto University 23 September 2015 Credits: Thanks to Tapani Raiko for slides material. CS-E4050 - Deep Learning Session 4: Convolutional
On Training of Deep Neural Network. Lornechen
On Training of Deep Neural Network Lornechen 2016.04.20 1 Outline Introduction Layer-wise Pre-training & Fine-tuning Activation Function Initialization Method Advanced Layers and Nets 2 Neural Network
Factoid Question Answering
Factoid Question Answering CS 898 Project June 12, 2017 Salman Mohammed David R. Cheriton School of Computer Science University of Waterloo Motivation Source: https://www.apple.com/newsroom/2017/01/hey-siri-whos-going-to-win-the-super-bowl/
ACUTE LEUKEMIA CLASSIFICATION USING CONVOLUTION NEURAL NETWORK IN CLINICAL DECISION SUPPORT SYSTEM
ACUTE LEUKEMIA CLASSIFICATION USING CONVOLUTION NEURAL NETWORK IN CLINICAL DECISION SUPPORT SYSTEM Thanh.TTP 1, Giao N. Pham 1, Jin-Hyeok Park 1, Kwang-Seok Moon 2, Suk-Hwan Lee 3, and Ki-Ryong Kwon 1
Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images
Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images Tae Joon Jun, Dohyeun Kim, and Daeyoung Kim School of Computing, KAIST,
Identifying Cognitive Distortion by Convolutional Neural Network based Text Classification
International Journal of Information Technology Vol. 23 No. 1 2017 Identifying Cognitive Distortion by Convolutional Neural Network based Text Classification Xuejiao Zhao 12, Chunyan Miao 12, and Zhenchang
Image Captioning using Reinforcement Learning. Presentation by: Samarth Gupta
Image Captioning using Reinforcement Learning Presentation by: Samarth Gupta 1 Introduction Summary Supervised Models Image captioning as RL problem Actor Critic Architecture Policy Gradient architecture
PMR5406 Redes Neurais e Lógica Fuzzy. Aula 5 Alguns Exemplos
PMR5406 Redes Neurais e Lógica Fuzzy Aula 5 Alguns Exemplos APPLICATIONS Two examples of real life applications of neural networks for pattern classification: RBF networks for face recognition FF networks
POC Brain Tumor Segmentation. vlife Use Case
Brain Tumor Segmentation vlife Use Case 1 Automatic Brain Tumor Segmentation using CNN Background Brain tumor segmentation seeks to separate healthy tissue from tumorous regions such as the advancing tumor,
Deep Learning based Information Extraction Framework on Chinese Electronic Health Records
Deep Learning based Information Extraction Framework on Chinese Electronic Health Records Bing Tian Yong Zhang Kaixin Liu Chunxiao Xing RIIT, Beijing National Research Center for Information Science and
Risk Prediction with Electronic Health Records: A Deep Learning Approach
Risk Prediction with Electronic Health Records: A Deep Learning Approach Abstract Yu Cheng Fei Wang Ping Zhang Jianying Hu The recent years have witnessed a surge of interests in data analytics with patient
arxiv: v2 [cs.cv] 19 Dec 2017
![arxiv: v2 [cs.cv] 19 Dec 2017](/thumbs/89/97557782.jpg "arxiv: v2 [cs.cv] 19 Dec 2017")
An Ensemble of Deep Convolutional Neural Networks for Alzheimer s Disease Detection and Classification arxiv:1712.01675v2 [cs.cv] 19 Dec 2017 Jyoti Islam Department of Computer Science Georgia State University
AN EFFICIENT DIGITAL SUPPORT SYSTEM FOR DIAGNOSING BRAIN TUMOR
AN EFFICIENT DIGITAL SUPPORT SYSTEM FOR DIAGNOSING BRAIN TUMOR Yatendra Kashyap Corporate institute of science & Technology, Bhopal ---------------------------------------------------------------------***---------------------------------------------------------------------
Automatic Classification of Perceived Gender from Facial Images
Automatic Classification of Perceived Gender from Facial Images Joseph Lemley, Sami Abdul-Wahid, Dipayan Banik Advisor: Dr. Razvan Andonie SOURCE 2016 Outline 1 Introduction 2 Faces - Background 3 Faces
Differential Attention for Visual Question Answering
Differential Attention for Visual Question Answering Badri Patro and Vinay P. Namboodiri IIT Kanpur { badri,vinaypn }@iitk.ac.in Abstract In this paper we aim to answer questions based on images when provided
A HMM-based Pre-training Approach for Sequential Data
A HMM-based Pre-training Approach for Sequential Data Luca Pasa 1, Alberto Testolin 2, Alessandro Sperduti 1 1- Department of Mathematics 2- Department of Developmental Psychology and Socialisation University
Keywords Artificial Neural Networks (ANN), Echocardiogram, BPNN, RBFNN, Classification, survival Analysis.
Design of Classifier Using Artificial Neural Network for Patients Survival Analysis J. D. Dhande 1, Dr. S.M. Gulhane 2 Assistant Professor, BDCE, Sevagram 1, Professor, J.D.I.E.T, Yavatmal 2 Abstract The
arxiv: v1 [cs.ai] 28 Nov 2017
![arxiv: v1 [cs.ai] 28 Nov 2017](/thumbs/78/77416856.jpg "arxiv: v1 [cs.ai] 28 Nov 2017")
: a better way of the parameters of a Deep Neural Network arxiv:1711.10177v1 [cs.ai] 28 Nov 2017 Guglielmo Montone Laboratoire Psychologie de la Perception Université Paris Descartes, Paris montone.guglielmo@gmail.com
Tumor Cellularity Assessment. Rene Bidart
Tumor Cellularity Assessment Rene Bidart 1 Goals Find location and class of all cell nuclei: Lymphocyte Cells Normal Epithelial Cells Malignant Epithelial Cells Why: Test effectiveness of pre-surgery treatment
arxiv: v2 [cs.lg] 1 Jun 2018
![arxiv: v2 [cs.lg] 1 Jun 2018](/thumbs/89/101161632.jpg "arxiv: v2 [cs.lg] 1 Jun 2018")
Shagun Sodhani 1 * Vardaan Pahuja 1 * arxiv:1805.11016v2 [cs.lg] 1 Jun 2018 Abstract Self-play (Sukhbaatar et al., 2017) is an unsupervised training procedure which enables the reinforcement learning agents
A Deep Siamese Neural Network Learns the Human-Perceived Similarity Structure of Facial Expressions Without Explicit Categories
A Deep Siamese Neural Network Learns the Human-Perceived Similarity Structure of Facial Expressions Without Explicit Categories Sanjeev Jagannatha Rao (sjrao@ucsd.edu) Department of Computer Science and
Shu Kong. Department of Computer Science, UC Irvine
Ubiquitous Fine-Grained Computer Vision Shu Kong Department of Computer Science, UC Irvine Outline 1. Problem definition 2. Instantiation 3. Challenge and philosophy 4. Fine-grained classification with
Understanding Convolutional Neural
Understanding Convolutional Neural Networks Understanding Convolutional Neural Networks David Stutz July 24th, 2014 David Stutz July 24th, 2014 0/53 1/53 Table of Contents - Table of Contents 1 Motivation
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering SUPPLEMENTARY MATERIALS 1. Implementation Details 1.1. Bottom-Up Attention Model Our bottom-up attention Faster R-CNN
Character-based Embedding Models and Reranking Strategies for Understanding Natural Language Meal Descriptions
INTERSPEECH 2017 August 20 24, 2017, Stockholm, Sweden Character-based Embedding Models and Reranking Strategies for Understanding Natural Language Meal Descriptions Mandy Korpusik, Zachary Collins, and
Automatic Quality Assessment of Cardiac MRI
Automatic Quality Assessment of Cardiac MRI Ilkay Oksuz 02.05.2018 Contact: ilkay.oksuz@kcl.ac.uk http://kclmmag.org 1 Cardiac MRI Quality Issues Need for high quality images Wide range of artefacts Manual
Convolutional Neural Networks for Estimating Left Ventricular Volume
Convolutional Neural Networks for Estimating Left Ventricular Volume Ryan Silva Stanford University rdsilva@stanford.edu Maksim Korolev Stanford University mkorolev@stanford.edu Abstract End-systolic and
Shu Kong. Department of Computer Science, UC Irvine
Ubiquitous Fine-Grained Computer Vision Shu Kong Department of Computer Science, UC Irvine Outline 1. Problem definition 2. Instantiation 3. Challenge 4. Fine-grained classification with holistic representation
Retinopathy Net. Alberto Benavides Robert Dadashi Neel Vadoothker
Retinopathy Net Alberto Benavides Robert Dadashi Neel Vadoothker Motivation We were interested in applying deep learning techniques to the field of medical imaging Field holds a lot of promise and can
3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients
3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients Dong Nie 1,2, Han Zhang 1, Ehsan Adeli 1, Luyan Liu 1, and Dinggang Shen 1(B) 1 Department of Radiology
Early Diagnosis of Autism Disease by Multi-channel CNNs
Early Diagnosis of Autism Disease by Multi-channel CNNs Guannan Li 1,2, Mingxia Liu 2, Quansen Sun 1(&), Dinggang Shen 2(&), and Li Wang 2(&) 1 School of Computer Science and Engineering, Nanjing University
Sleep Staging with Deep Learning: A convolutional model
Sleep Staging with Deep Learning: A convolutional model Isaac Ferna ndez-varela1, Dimitrios Athanasakis2, Samuel Parsons3 Elena Herna ndez-pereira1, and Vicente Moret-Bonillo1 1- Universidade da Corun
Deep learning and non-negative matrix factorization in recognition of mammograms
Deep learning and non-negative matrix factorization in recognition of mammograms Bartosz Swiderski Faculty of Applied Informatics and Mathematics Warsaw University of Life Sciences, Warsaw, Poland bartosz_swiderski@sggw.pl
ECG Beat Recognition using Principal Components Analysis and Artificial Neural Network
International Journal of Electronics Engineering, 3 (1), 2011, pp. 55 58 ECG Beat Recognition using Principal Components Analysis and Artificial Neural Network Amitabh Sharma 1, and Tanushree Sharma 2
CPSC81 Final Paper: Facial Expression Recognition Using CNNs
CPSC81 Final Paper: Facial Expression Recognition Using CNNs Luis Ceballos Swarthmore College, 500 College Ave., Swarthmore, PA 19081 USA Sarah Wallace Swarthmore College, 500 College Ave., Swarthmore,
Skin cancer reorganization and classification with deep neural network
Skin cancer reorganization and classification with deep neural network Hao Chang 1 1. Department of Genetics, Yale University School of Medicine 2. Email: changhao86@gmail.com Abstract As one kind of skin
Using Deep Convolutional Networks for Gesture Recognition in American Sign Language
Using Deep Convolutional Networks for Gesture Recognition in American Sign Language Abstract In the realm of multimodal communication, sign language is, and continues to be, one of the most understudied
Grounding Ontologies in the External World
Grounding Ontologies in the External World Antonio CHELLA University of Palermo and ICAR-CNR, Palermo antonio.chella@unipa.it Abstract. The paper discusses a case study of grounding an ontology in the
arxiv: v2 [cs.cv] 22 Mar 2018
![arxiv: v2 [cs.cv] 22 Mar 2018](/thumbs/94/122062874.jpg "arxiv: v2 [cs.cv] 22 Mar 2018")
Deep saliency: What is learnt by a deep network about saliency? Sen He 1 Nicolas Pugeault 1 arxiv:1801.04261v2 [cs.cv] 22 Mar 2018 Abstract Deep convolutional neural networks have achieved impressive performance
arxiv: v2 [cs.cl] 12 Jul 2018
![arxiv: v2 [cs.cl] 12 Jul 2018](/thumbs/90/101987028.jpg "arxiv: v2 [cs.cl] 12 Jul 2018")
Design Challenges and Misconceptions in Neural Sequence Labeling Jie Yang, Shuailong Liang, Yue Zhang Singapore University of Technology and Design {jie yang, shuailong liang}@mymail.sutd.edu.sg yue zhang@sutd.edu.sg
Vector Learning for Cross Domain Representations
Vector Learning for Cross Domain Representations Shagan Sah, Chi Zhang, Thang Nguyen, Dheeraj Kumar Peri, Ameya Shringi, Raymond Ptucha Rochester Institute of Technology, Rochester, NY 14623, USA arxiv:1809.10312v1
arxiv: v1 [cs.cl] 15 Aug 2017
![arxiv: v1 [cs.cl] 15 Aug 2017](/thumbs/90/101584437.jpg "arxiv: v1 [cs.cl] 15 Aug 2017")
Identifying Harm Events in Clinical Care through Medical Narratives arxiv:1708.04681v1 [cs.cl] 15 Aug 2017 Arman Cohan Information Retrieval Lab, Dept. of Computer Science Georgetown University arman@ir.cs.georgetown.edu
Discovering and Understanding Self-harm Images in Social Media. Neil O Hare, MFSec Bucharest, Romania, June 6 th, 2017
Discovering and Understanding Self-harm Images in Social Media Neil O Hare, MFSec 2017. Bucharest, Romania, June 6 th, 2017 Who am I? PhD from Dublin City University, 2007. Multimedia Search Currently
Deep Neural Networks: A New Framework for Modeling Biological Vision and Brain Information Processing
ANNUAL REVIEWS Further Click here to view this article's online features: Download figures as PPT slides Navigate linked references Download citations Explore related articles Search keywords Annu. Rev.
A CONVOLUTION NEURAL NETWORK ALGORITHM FOR BRAIN TUMOR IMAGE SEGMENTATION
A CONVOLUTION NEURAL NETWORK ALGORITHM FOR BRAIN TUMOR IMAGE SEGMENTATION 1 Priya K, 2 Dr.O. Saraniya 1 PG Scholar, 2 Assistant Professor Department Of ECE Government College of Technology, Coimbatore,
Highly Accurate Brain Stroke Diagnostic System and Generative Lesion Model. Junghwan Cho, Ph.D. CAIDE Systems, Inc. Deep Learning R&D Team
Highly Accurate Brain Stroke Diagnostic System and Generative Lesion Model Junghwan Cho, Ph.D. CAIDE Systems, Inc. Deep Learning R&D Team Established in September, 2016 at 110 Canal st. Lowell, MA 01852,
Memory-Augmented Active Deep Learning for Identifying Relations Between Distant Medical Concepts in Electroencephalography Reports
Memory-Augmented Active Deep Learning for Identifying Relations Between Distant Medical Concepts in Electroencephalography Reports Ramon Maldonado, BS, Travis Goodwin, PhD Sanda M. Harabagiu, PhD The University
Task 1: Machine Learning with Spike-Timing-Dependent Plasticity (STDP)
DARPA Report Task1 for Year 1 (Q1-Q4) Task 1: Machine Learning with Spike-Timing-Dependent Plasticity (STDP) 1. Shortcomings of the deep learning approach to artificial intelligence It has been established
Satoru Hiwa, 1 Kenya Hanawa, 2 Ryota Tamura, 2 Keisuke Hachisuka, 3 and Tomoyuki Hiroyasu Introduction
Computational Intelligence and Neuroscience Volume 216, Article ID 1841945, 9 pages http://dx.doi.org/1.1155/216/1841945 Research Article Analyzing Brain Functions by Subject Classification of Functional
ITERATIVELY TRAINING CLASSIFIERS FOR CIRCULATING TUMOR CELL DETECTION
ITERATIVELY TRAINING CLASSIFIERS FOR CIRCULATING TUMOR CELL DETECTION Yunxiang Mao 1, Zhaozheng Yin 1, Joseph M. Schober 2 1 Missouri University of Science and Technology 2 Southern Illinois University
Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine
Facial Expression Classification Using Convolutional Neural Network and Support Vector Machine Valfredo Pilla Jr, André Zanellato, Cristian Bortolini, Humberto R. Gamba and Gustavo Benvenutti Borba Graduate
How can Natural Language Processing help MedDRA coding? April Andrew Winter Ph.D., Senior Life Science Specialist, Linguamatics
How can Natural Language Processing help MedDRA coding? April 16 2018 Andrew Winter Ph.D., Senior Life Science Specialist, Linguamatics Summary About NLP and NLP in life sciences Uses of NLP with MedDRA
Chapter 1. Introduction
Chapter 1 Introduction Artificial neural networks are mathematical inventions inspired by observations made in the study of biological systems, though loosely based on the actual biology. An artificial
Understanding Biological Visual Attention Using Convolutional Neural Networks
Understanding Biological Visual Attention Using Convolutional Neural Networks Grace W. Lindsay a,b, Kenneth D. Miller a,b a Center for Theoretical Neuroscience, College of Physicians and Surgeons, Columbia
Speech Emotion Detection and Analysis
Speech Emotion Detection and Analysis Helen Chan Travis Ebesu Caleb Fujimori COEN296: Natural Language Processing Prof. Ming-Hwa Wang School of Engineering Department of Computer Engineering Santa Clara
Introduction to Machine Learning. Katherine Heller Deep Learning Summer School 2018
Introduction to Machine Learning Katherine Heller Deep Learning Summer School 2018 Outline Kinds of machine learning Linear regression Regularization Bayesian methods Logistic Regression Why we do this
MASTER S THESIS. Ali El Adi. Deep neural networks to forecast cardiac and respiratory deterioration of intensive care patients
MASTER S THESIS Ali El Adi Deep neural networks to forecast cardiac and respiratory deterioration of intensive care patients UNIVERSITY OF TAMPERE Faculty of Natural Sciences Computational Big Data Analytics
The Impact of Visual Saliency Prediction in Image Classification
Dublin City University Insight Centre for Data Analytics Universitat Politecnica de Catalunya Escola Tècnica Superior d Enginyeria de Telecomunicacions de Barcelona Eric Arazo Sánchez The Impact of Visual
EECS 433 Statistical Pattern Recognition
EECS 433 Statistical Pattern Recognition Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208 http://www.eecs.northwestern.edu/~yingwu 1 / 19 Outline What is Pattern
Artificial Neural Networks (Ref: Negnevitsky, M. Artificial Intelligence, Chapter 6)
Artificial Neural Networks (Ref: Negnevitsky, M. Artificial Intelligence, Chapter 6) BPNN in Practice Week 3 Lecture Notes page 1 of 1 The Hopfield Network In this network, it was designed on analogy of
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation Biyi Fang Michigan State University ACM SenSys 17 Nov 6 th, 2017 Biyi Fang (MSU) Jillian Co (MSU) Mi Zhang
Neuromorphic convolutional recurrent neural network for road safety or safety near the road
Neuromorphic convolutional recurrent neural network for road safety or safety near the road WOO-SUP HAN 1, IL SONG HAN 2 1 ODIGA, London, U.K. 2 Korea Advanced Institute of Science and Technology, Daejeon,
Rich feature hierarchies for accurate object detection and semantic segmentation
Rich feature hierarchies for accurate object detection and semantic segmentation Ross Girshick, Jeff Donahue, Trevor Darrell, Jitendra Malik UC Berkeley Tech Report @ http://arxiv.org/abs/1311.2524! Detection
Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images
Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images Sachin Mehta 1, Ezgi Mercan 1, Jamen Bartlett 2, Donald Weaver 2, Joann G. Elmore 1, and Linda Shapiro 1 1 University
IN this paper we examine the role of shape prototypes in
On the Role of Shape Prototypes in Hierarchical Models of Vision Michael D. Thomure, Melanie Mitchell, and Garrett T. Kenyon To appear in Proceedings of the International Joint Conference on Neural Networks
Question 1 Multiple Choice (8 marks)
Philadelphia University Student Name: Faculty of Engineering Student Number: Dept. of Computer Engineering First Exam, First Semester: 2015/2016 Course Title: Neural Networks and Fuzzy Logic Date: 19/11/2015
Hierarchical Convolutional Features for Visual Tracking
Hierarchical Convolutional Features for Visual Tracking Chao Ma Jia-Bin Huang Xiaokang Yang Ming-Husan Yang SJTU UIUC SJTU UC Merced ICCV 2015 Background Given the initial state (position and scale), estimate
UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014
UNIVERSITY of PENNSYLVANIA CIS 520: Machine Learning Final, Fall 2014 Exam policy: This exam allows two one-page, two-sided cheat sheets (i.e. 4 sides); No other materials. Time: 2 hours. Be sure to write
A Novel Capsule Neural Network Based Model For Drowsiness Detection Using Electroencephalography Signals
A Novel Capsule Neural Network Based Model For Drowsiness Detection Using Electroencephalography Signals Luis Guarda Bräuning (1) Nicolas Astorga (1) Enrique López Droguett (1) Marcio Moura (2) Marcelo
A Deep Learning Approach for Subject Independent Emotion Recognition from Facial Expressions
A Deep Learning Approach for Subject Independent Emotion Recognition from Facial Expressions VICTOR-EMIL NEAGOE *, ANDREI-PETRU BĂRAR *, NICU SEBE **, PAUL ROBITU * * Faculty of Electronics, Telecommunications
arxiv: v2 [cs.lg] 3 Apr 2019
![arxiv: v2 [cs.lg] 3 Apr 2019](/thumbs/96/126740662.jpg "arxiv: v2 [cs.lg] 3 Apr 2019")
ALLEVIATING CATASTROPHIC FORGETTING USING CONTEXT-DEPENDENT GATING AND SYNAPTIC STABILIZATION arxiv:1802.01569v2 [cs.lg] 3 Apr 2019 Nicolas Y. Masse Department of Neurobiology The University of Chicago
Interpretable & Transparent Deep Learning
Fraunhofer Image Processing Heinrich Hertz Institute Interpretable & Transparent Deep Learning Fraunhofer HHI, Machine Learning Group Wojciech Samek Northern Lights Deep Learning Workshop (NLDL 19) Tromsø,
A Vision-based Affective Computing System. Jieyu Zhao Ningbo University, China
A Vision-based Affective Computing System Jieyu Zhao Ningbo University, China Outline Affective Computing A Dynamic 3D Morphable Model Facial Expression Recognition Probabilistic Graphical Models Some
Automatic Context-Aware Image Captioning
Technical Disclosure Commons Defensive Publications Series May 23, 2017 Automatic Context-Aware Image Captioning Sandro Feuz Sebastian Millius Follow this and additional works at: http://www.tdcommons.org/dpubs_series
Do Deep Neural Networks Suffer from Crowding?
Do Deep Neural Networks Suffer from Crowding? Anna Volokitin Gemma Roig ι Tomaso Poggio voanna@vision.ee.ethz.ch gemmar@mit.edu tp@csail.mit.edu Center for Brains, Minds and Machines, Massachusetts Institute
Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech
Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech arxiv:1901.05613v1 [cs.cv] 17 Jan 2019 Shahjalal Ahmed, Md. Rafiqul Islam,
High-Resolution Breast Cancer Screening with Multi-View Deep Convolutional Neural Networks
High-Resolution Breast Cancer Screening with Multi-View Deep Convolutional Neural Networks Krzysztof J. Geras Joint work with Kyunghyun Cho, Linda Moy, Gene Kim, Stacey Wolfson and Artie Shen. GTC 2017
Rumor Detection on Twitter with Tree-structured Recursive Neural Networks
1 Rumor Detection on Twitter with Tree-structured Recursive Neural Networks Jing Ma 1, Wei Gao 2, Kam-Fai Wong 1,3 1 The Chinese University of Hong Kong 2 Victoria University of Wellington, New Zealand
Patient2Vec: A Personalized Interpretable Deep Representation of the Longitudinal Electronic Health Record
Date of publication 10, 2018, date of current version 10, 2018. Digital Object Identifier 10.1109/ACCESS.2018.2875677 arxiv:1810.04793v3 [q-bio.qm] 25 Oct 2018 Patient2Vec: A Personalized Interpretable
IDENTIFYING STRESS BASED ON COMMUNICATIONS IN SOCIAL NETWORKS
IDENTIFYING STRESS BASED ON COMMUNICATIONS IN SOCIAL NETWORKS 1 Manimegalai. C and 2 Prakash Narayanan. C manimegalaic153@gmail.com and cprakashmca@gmail.com 1PG Student and 2 Assistant Professor, Department