Shared Response Model Tutorial! What works? How can it help you? Po-Hsuan (Cameron) Chen and Hejia Hasson Lab! Feb 15, 2017!

Size: px
Start display at page:

Download "Shared Response Model Tutorial! What works? How can it help you? Po-Hsuan (Cameron) Chen and Hejia Hasson Lab! Feb 15, 2017!"

Transcription

1 Shared Response Model Tutorial! What works? How can it help you? Po-Hsuan (Cameron) Chen and Hejia Hasson Lab! Feb 15, 2017!

2 Outline! SRM Theory! SRM on fmri! Hands-on SRM with BrainIak!

3 SRM Theory!

4 Multi-view representation learning! What is multi-view learning and why is it important?! Exist an unknown underlying distribution, each view is a realization of it! Conventional ML models concatenate multiple views into one single view! Successful multi-view learning leads to better utilization of data with better performance!

5 Motivation! Modern fmri studies of human brain use data from multiple subjects! scientific reason! statistical reason! How can we aggregate fmri data from multiple subjects?! Challenge! Inter-subject variability in anatomical structure and functional topographies!

6 Given data from training subjects,!! Prediction:! can we predict the brain response of a test subject?!! Classification:! given brain response from a test subject, can we classify what s the stimulus?!

7 Shared latent temporal response +! subject specific functional topographies! Subject 1! voxels! time! subject specific functional! topographies is the key! Subject 2! voxels! time! fmri data matrix! voxel space! time trajectory! low dimensional! shared feature space!

8 Data collected while subjects receiving stimulus! Temporally synchronized naturalistic stimuli! 1. Sample a wide range of response from the subject! 2. Use time as anchor for learning shared response! sherlock! raider! forrest! audiobook! movie watching! movie and image! watching! auditory film! listening! audio book! listening!

9 Factor Model! voxels! time! voxels! features!!! features! time! fmri data!

10 fmri response as linear combination of functional topographies! voxels! time! voxels! features! time!!!! features! fmri data! functional! topographies! features!

11 Learning what is shared across subjects! subjects x voxels! time! voxels!! features!! features! time! One!s&mulus! Many!subjects! fmri data! subject specific! functional topographies! shared! features!

12 fmri data as linear combination of subject specific functional topographies! subjects x voxels! time! features! time! voxels!!! features! fmri data! subject specific! functional topographies! shared! features!

13 Shared Response Model in one figure! [J. Cohen et al., Nat. Neur., 2017]!

14 Shared Response Model (SRM) is a latent variable model! s t N (0, s ) s s t d x it s t N (W i s t + µ i, 2 i I) Wi T W i = I W i,µ i, i x it W i not square! m s t W i shared elicited response at time t! observations of subject i at time t! functional topographies for subject i! noise level for subject i s data! x it 2 i Feature identification with dimensionality reduction! Constrained EM algorithm! [P.-H. Chen et al., NIPS, 2015]!

15 Shared features, subject specific functional topographies, and subject specific response! voxel space! feature space! =! +! X 1 W 1!!!! 0 E s x [S] =! +! X m & distribution! W m fmri! data! subject! specific! response! shared! response! subject specific! functional! topographies! shared features!

16 SRM on fmri!

17 Evaluation with various datasets! Different MRI machines! Different institutes! Different subjects! Different preprocessing protocols! Different brain regions! Different data size! sherlock! raider! forrest! audiobook!

18 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

19 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

20 1 st!half! movie! movie! data! data! learn bases! image data/! movie data! project to! bases! projected! data! output! Generalization to new subject! with time segment matching! subject 1! subject 1! subject 1! Learning Subject Specific Bases!! shared response! (template)! Testing on Held-out Subject!!! train! classifier! subject m-1! subject m-1! subject m-1! subject m! W 1 W m 1 W m subject m! W 1 W m 1 W m subject m! test! Datasets! sherlock! forrest! raider!

21 1 st!half! movie! movie! data! data! learn bases! image 2 nd!half!! data/! movie!data! project to! bases! projected! data! output! Generalization to new subject! with time segment matching! subject 1! subject 1! subject 1! Learning Subject Specific Bases!! shared response! (template)! Testing on Held-out Subject!!! train! classifier! subject m-1! subject m-1! subject m-1! subject m! W 1 W m 1 W m subject m! W 1 W m 1 W m subject m! test! Datasets! sherlock! forrest! raider!

22 Generalization to new subject! with time segment matching!

23 Generalization to new subject and distinct stimulus with image classification! movie! data! subject 1! Learning Subject Specific Bases!! subject m-1! subject m! Dataset! raider! learn bases! image Image! data/! movie data! data! project to! bases! projected! data! W 1 W m 1 W m subject 1! subject 1! shared response! (template)! Testing on Held-out Subject!!! subject m-1! subject m-1! subject m! W 1 W m 1 W m subject m! output! train! classifier! test!

24 Generalization to new subject and distinct stimulus with image classification! Outperforms within-subject classification!

25 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

26 Classifying mental states! 40 subjects listening to narrated story! Separate 40 subjects into 2 groups! Two groups receive different prior contexts! Leading to different interpretations of the story! Predict prior context of a left-out subject! Dataset! audiobook!

27 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06!

28 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06! 0.54±0.06!

29 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06! 0.54±0.06! 0.70±0.04!

30 Classifying mental states! shared! by all! Group 1! Group 2! within! group! individual! shared! by all! within! group! individual! Group! prediction! accuracy! with SRM! 0.72±0.06! 0.54±0.06! 0.70±0.04! 0.82±0.04!

31 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

32 [Slide from [Work Nicolas by Ivy Schuck]! Zhu]!

33 [Slide from Nicolas Schuck]!

34 [Slide from Nicolas Schuck]!

35 SRM with non-temporally synchronized dataset! Each observation is a noisy sample of the brain state! t! Subject 1! State!1! State!2! State!1! State!3! State!1! State!4! Subject 2! t! State!3! State!4! State!1! State!2!

36 SRM with non-temporally synchronized dataset! Step 1: reordering! t! Subject 1! State!1! State!2! State!3! State!4! Subject 2! t! State!1! State!2! State!3! State!4!

37 SRM with non-temporally synchronized dataset! Step 2: down sampling! t! Subject 1! State!1! State!2! State!3! State!4! Subject 2! t! State!1! State!2! State!3! State!4! Step 3: fit SRM with preprocessed data!

38 [Work by Ivy Zhu]!

39 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

40 Mapping Visual Field Maps: Retinotopy! [Work by Michael J. Arcaro]!

41 Original Phase Maps vs. SRM! Orig! SRM! Orig! SRM! Orig! SRM! Orig! SRM! [Work by Michael J. Arcaro]!

42 Transformation between subjects! [Work by Michael J. Arcaro]!

43 [Work by Michael J. Arcaro]!

44 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

45 Quantifying dimensionality of shared response! [J. Chen et al., Nat. Neur., 2017]! [P.-H. Chen et al. NIPS, 2015]!

46 Quantifying dimensionality of shared response! [H. Zhang et al. ArXiv, 2016]!

47 SRM on fmri! Generalize to new stimulus! Generalize to new subject! Decoupling shared and individual response! SRM with non-temporally synchronized stimulus! SRM with retinotopy! Quantifying dimensionality of shared response! Searchlight SRM!

48 Why searchlights?! Structured Sparsity! Searchlight!!!!! X i W i t-th column of! t-th column of! S t-th column of! W i X i t-th column of! S

49 Searchlight SRM! localized analysis across the whole brain! X 1 For a searchlight! X 2 SRM! W i,s Analysis! statistics! e.g. accuracy! Statistics map! X 3 Brain image! Learning phase! (training data)! Testing phase! (testing data)!

50 Time segment matching with searchlight SRM! Accuracy map from time segment matching experiment (Sherlock)!

51 How can SRM help?! What can SRM do?! Multi-subject data driven de-noising! Aggregation of multi-subject data! Generalizable to new subject and new stimulus! Outperform within subject classification! Decoupling of shared and individual response! Can I use SRM on my data?! Temporally synchronized stimuli! - No problem! Non-temporally synchronized stimuli! - Can also work with preprocessing!

52 List of extensions! SRM with word embedding! Semi-supervised SRM! Distributed SRM! Convolutional Autoencoder SRM! Spatial SRM! Kernelized SRM! Gaussian Process SRM! Information theoretic SRM! Matrix Normal SRM!

53 Key Takeaways! When should you consider using SRM?! 1. I want to figure out what s shared/not shared in my multiset data (multi-subject, multi-modality, multi-region, etc)! 2. I have multi-set data, I want better prediction accuracy!!

54 Hands-on SRM with BrainIak!

55 Code ready to use on your dataset! Simple setting, one line command to fit SRM on your data! Handles different numbers of voxels across subjects/views!

56 Jupyter notebook examples! Need jupyter notebook and brainiak properly installed with python 3!!! 1. git clone 2. cd SRM_tutorial! 3. chmod +x download-data.sh 4../download-data.sh 5. jupyter notebook!

57 ! Thank you! cameronphchen.github.io!

Contributions to Brain MRI Processing and Analysis

Contributions to Brain MRI Processing and Analysis Contributions to Brain MRI Processing and Analysis Dissertation presented to the Department of Computer Science and Artificial Intelligence By María Teresa García Sebastián PhD Advisor: Prof. Manuel Graña

More information

Bayesian Models for Combining Data Across Subjects and Studies in Predictive fmri Data Analysis

Bayesian Models for Combining Data Across Subjects and Studies in Predictive fmri Data Analysis Bayesian Models for Combining Data Across Subjects and Studies in Predictive fmri Data Analysis Thesis Proposal Indrayana Rustandi April 3, 2007 Outline Motivation and Thesis Preliminary results: Hierarchical

More information

Classification and Statistical Analysis of Auditory FMRI Data Using Linear Discriminative Analysis and Quadratic Discriminative Analysis

Classification and Statistical Analysis of Auditory FMRI Data Using Linear Discriminative Analysis and Quadratic Discriminative Analysis International Journal of Innovative Research in Computer Science & Technology (IJIRCST) ISSN: 2347-5552, Volume-2, Issue-6, November-2014 Classification and Statistical Analysis of Auditory FMRI Data Using

More information

Brain mapping 2.0: Putting together fmri datasets to map cognitive ontologies to the brain. Bertrand Thirion

Brain mapping 2.0: Putting together fmri datasets to map cognitive ontologies to the brain. Bertrand Thirion Brain mapping 2.0: Putting together fmri datasets to map cognitive ontologies to the brain Bertrand Thirion bertrand.thirion@inria.fr 1 Outline Introduction: statistical inference in neuroimaging and big

More information

Analysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014

Analysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014 Analysis of in-vivo extracellular recordings Ryan Morrill Bootcamp 9/10/2014 Goals for the lecture Be able to: Conceptually understand some of the analysis and jargon encountered in a typical (sensory)

More information

Functional MRI Mapping Cognition

Functional MRI Mapping Cognition Outline Functional MRI Mapping Cognition Michael A. Yassa, B.A. Division of Psychiatric Neuro-imaging Psychiatry and Behavioral Sciences Johns Hopkins School of Medicine Why fmri? fmri - How it works Research

More information

Group-Wise FMRI Activation Detection on Corresponding Cortical Landmarks

Group-Wise FMRI Activation Detection on Corresponding Cortical Landmarks Group-Wise FMRI Activation Detection on Corresponding Cortical Landmarks Jinglei Lv 1,2, Dajiang Zhu 2, Xintao Hu 1, Xin Zhang 1,2, Tuo Zhang 1,2, Junwei Han 1, Lei Guo 1,2, and Tianming Liu 2 1 School

More information

Hierarchical Bayesian Modeling of Individual Differences in Texture Discrimination

Hierarchical Bayesian Modeling of Individual Differences in Texture Discrimination Hierarchical Bayesian Modeling of Individual Differences in Texture Discrimination Timothy N. Rubin (trubin@uci.edu) Michael D. Lee (mdlee@uci.edu) Charles F. Chubb (cchubb@uci.edu) Department of Cognitive

More information

Interpreting fmri Decoding Weights: Additional Considerations

Interpreting fmri Decoding Weights: Additional Considerations Interpreting fmri Decoding Weights: Additional Considerations P.K. Douglas Modeling and Simulation Department,UCF Department of Psychiatry and Biobehavioral Medicine, UCLA Los Angeles, CA 90024 pdouglas@ist.ucf.edu

More information

Functional Elements and Networks in fmri

Functional Elements and Networks in fmri Functional Elements and Networks in fmri Jarkko Ylipaavalniemi 1, Eerika Savia 1,2, Ricardo Vigário 1 and Samuel Kaski 1,2 1- Helsinki University of Technology - Adaptive Informatics Research Centre 2-

More information

Machine learning approaches for clinical neuroimaging data

Machine learning approaches for clinical neuroimaging data Machine learning approaches for clinical neuroimaging data Janaina Mourao-Miranda Jane Rondina Maria Joao Rosa London, UK 28th September 2012 Machine Learning & Neuroimaging Lab We are interested in developing

More information

Representational similarity analysis

Representational similarity analysis School of Psychology Representational similarity analysis Dr Ian Charest Representational similarity analysis representational dissimilarity matrices (RDMs) stimulus (e.g. images, sounds, other experimental

More information

BRAIN STATE CHANGE DETECTION VIA FIBER-CENTERED FUNCTIONAL CONNECTIVITY ANALYSIS

BRAIN STATE CHANGE DETECTION VIA FIBER-CENTERED FUNCTIONAL CONNECTIVITY ANALYSIS BRAIN STATE CHANGE DETECTION VIA FIBER-CENTERED FUNCTIONAL CONNECTIVITY ANALYSIS Chulwoo Lim 1, Xiang Li 1, Kaiming Li 1, 2, Lei Guo 2, Tianming Liu 1 1 Department of Computer Science and Bioimaging Research

More information

Discovering Event Structure in Continuous Narrative Perception and Memory

Discovering Event Structure in Continuous Narrative Perception and Memory Article Discovering Event Structure in Continuous Narrative Perception and Memory Highlights d Event boundaries during perception can be identified from cortical activity patterns d d d Event timescales

More information

Deep learning approaches to medical applications

Deep learning approaches to medical applications Deep learning approaches to medical applications Joseph Paul Cohen Postdoctoral Fellow at Montreal Institute for Learning Algorithms Friend of the Farlow Fellow at Harvard University U.S. National Science

More information

Prediction of Successful Memory Encoding from fmri Data

Prediction of Successful Memory Encoding from fmri Data Prediction of Successful Memory Encoding from fmri Data S.K. Balci 1, M.R. Sabuncu 1, J. Yoo 2, S.S. Ghosh 3, S. Whitfield-Gabrieli 2, J.D.E. Gabrieli 2 and P. Golland 1 1 CSAIL, MIT, Cambridge, MA, USA

More information

Weak Supervision. Vincent Chen and Nish Khandwala

Weak Supervision. Vincent Chen and Nish Khandwala Weak Supervision Vincent Chen and Nish Khandwala Outline Motivation We want more labels! We want to program our data! #Software2.0 Weak Supervision Formulation Landscape of Noisy Labeling Schemes Snorkel

More information

Incorporation of Imaging-Based Functional Assessment Procedures into the DICOM Standard Draft version 0.1 7/27/2011

Incorporation of Imaging-Based Functional Assessment Procedures into the DICOM Standard Draft version 0.1 7/27/2011 Incorporation of Imaging-Based Functional Assessment Procedures into the DICOM Standard Draft version 0.1 7/27/2011 I. Purpose Drawing from the profile development of the QIBA-fMRI Technical Committee,

More information

Heterogeneous Data Mining for Brain Disorder Identification. Bokai Cao 04/07/2015

Heterogeneous Data Mining for Brain Disorder Identification. Bokai Cao 04/07/2015 Heterogeneous Data Mining for Brain Disorder Identification Bokai Cao 04/07/2015 Outline Introduction Tensor Imaging Analysis Brain Network Analysis Davidson et al. Network discovery via constrained tensor

More information

Chapter 5. Summary and Conclusions! 131

Chapter 5. Summary and Conclusions! 131 ! Chapter 5 Summary and Conclusions! 131 Chapter 5!!!! Summary of the main findings The present thesis investigated the sensory representation of natural sounds in the human auditory cortex. Specifically,

More information

Identification of Neuroimaging Biomarkers

Identification of Neuroimaging Biomarkers Identification of Neuroimaging Biomarkers Dan Goodwin, Tom Bleymaier, Shipra Bhal Advisor: Dr. Amit Etkin M.D./PhD, Stanford Psychiatry Department Abstract We present a supervised learning approach to

More information

Network-based pattern recognition models for neuroimaging

Network-based pattern recognition models for neuroimaging Network-based pattern recognition models for neuroimaging Maria J. Rosa Centre for Neuroimaging Sciences, Institute of Psychiatry King s College London, UK Outline Introduction Pattern recognition Network-based

More information

arxiv: v2 [cs.cv] 19 Dec 2017

arxiv: v2 [cs.cv] 19 Dec 2017 An Ensemble of Deep Convolutional Neural Networks for Alzheimer s Disease Detection and Classification arxiv:1712.01675v2 [cs.cv] 19 Dec 2017 Jyoti Islam Department of Computer Science Georgia State University

More information

Discriminative Analysis for Image-Based Population Comparisons

Discriminative Analysis for Image-Based Population Comparisons Discriminative Analysis for Image-Based Population Comparisons Polina Golland 1,BruceFischl 2, Mona Spiridon 3, Nancy Kanwisher 3, Randy L. Buckner 4, Martha E. Shenton 5, Ron Kikinis 6, and W. Eric L.

More information

NMF-Density: NMF-Based Breast Density Classifier

NMF-Density: NMF-Based Breast Density Classifier NMF-Density: NMF-Based Breast Density Classifier Lahouari Ghouti and Abdullah H. Owaidh King Fahd University of Petroleum and Minerals - Department of Information and Computer Science. KFUPM Box 1128.

More information

WHAT DOES THE BRAIN TELL US ABOUT TRUST AND DISTRUST? EVIDENCE FROM A FUNCTIONAL NEUROIMAGING STUDY 1

WHAT DOES THE BRAIN TELL US ABOUT TRUST AND DISTRUST? EVIDENCE FROM A FUNCTIONAL NEUROIMAGING STUDY 1 SPECIAL ISSUE WHAT DOES THE BRAIN TE US ABOUT AND DIS? EVIDENCE FROM A FUNCTIONAL NEUROIMAGING STUDY 1 By: Angelika Dimoka Fox School of Business Temple University 1801 Liacouras Walk Philadelphia, PA

More information

Formulating Emotion Perception as a Probabilistic Model with Application to Categorical Emotion Classification

Formulating Emotion Perception as a Probabilistic Model with Application to Categorical Emotion Classification Formulating Emotion Perception as a Probabilistic Model with Application to Categorical Emotion Classification Reza Lotfian and Carlos Busso Multimodal Signal Processing (MSP) lab The University of Texas

More information

Ch.20 Dynamic Cue Combination in Distributional Population Code Networks. Ka Yeon Kim Biopsychology

Ch.20 Dynamic Cue Combination in Distributional Population Code Networks. Ka Yeon Kim Biopsychology Ch.20 Dynamic Cue Combination in Distributional Population Code Networks Ka Yeon Kim Biopsychology Applying the coding scheme to dynamic cue combination (Experiment, Kording&Wolpert,2004) Dynamic sensorymotor

More information

Introduction to Computational Neuroscience

Introduction to Computational Neuroscience Introduction to Computational Neuroscience Lecture 10: Brain-Computer Interfaces Ilya Kuzovkin So Far Stimulus So Far So Far Stimulus What are the neuroimaging techniques you know about? Stimulus So Far

More information

Hebbian Plasticity for Improving Perceptual Decisions

Hebbian Plasticity for Improving Perceptual Decisions Hebbian Plasticity for Improving Perceptual Decisions Tsung-Ren Huang Department of Psychology, National Taiwan University trhuang@ntu.edu.tw Abstract Shibata et al. reported that humans could learn to

More information

Combining fmri, ERP and SNP data with ICA: Introduction and examples Vince D. Calhoun, Ph.D.

Combining fmri, ERP and SNP data with ICA: Introduction and examples Vince D. Calhoun, Ph.D. Combining fmri, ERP and SNP data with ICA: Introduction and examples Vince D. Calhoun, Ph.D. Director, Image Analysis & MR Research The Mind Research Network Associate Professor, Electrical and Computer

More information

ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES

ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES ANALYSIS AND DETECTION OF BRAIN TUMOUR USING IMAGE PROCESSING TECHNIQUES P.V.Rohini 1, Dr.M.Pushparani 2 1 M.Phil Scholar, Department of Computer Science, Mother Teresa women s university, (India) 2 Professor

More information

Rajeev Raizada: Statement of research interests

Rajeev Raizada: Statement of research interests Rajeev Raizada: Statement of research interests Overall goal: explore how the structure of neural representations gives rise to behavioural abilities and disabilities There tends to be a split in the field

More information

Sparsity Constrained fmri Decoding of Visual Saliency in Naturalistic Video Streams

Sparsity Constrained fmri Decoding of Visual Saliency in Naturalistic Video Streams Sparsity Constrained fmri Decoding of Visual Saliency in Naturalistic Video Streams Xintao Hu, Cheng Lv, Gong Cheng, Jinglei Lv, Lei Guo, Junwei Han, Tianming Liu Abstract Naturalistic stimuli such as

More information

Action Recognition. Computer Vision Jia-Bin Huang, Virginia Tech. Many slides from D. Hoiem

Action Recognition. Computer Vision Jia-Bin Huang, Virginia Tech. Many slides from D. Hoiem Action Recognition Computer Vision Jia-Bin Huang, Virginia Tech Many slides from D. Hoiem This section: advanced topics Convolutional neural networks in vision Action recognition Vision and Language 3D

More information

Quantifying temporal ventriloquism in audio-visual synchrony perception

Quantifying temporal ventriloquism in audio-visual synchrony perception Quantifying temporal ventriloquism in audio-visual synchrony perception Irene A. Kuling 1, James F. Juola 2,3 & Armin Kohlrausch 2,4 1 VU University Amsterdam 2 Eindhoven University of Technology 3 University

More information

Introduction to Computational Neuroscience

Introduction to Computational Neuroscience Introduction to Computational Neuroscience Lecture 5: Data analysis II Lesson Title 1 Introduction 2 Structure and Function of the NS 3 Windows to the Brain 4 Data analysis 5 Data analysis II 6 Single

More information

Information-theoretic stimulus design for neurophysiology & psychophysics

Information-theoretic stimulus design for neurophysiology & psychophysics Information-theoretic stimulus design for neurophysiology & psychophysics Christopher DiMattina, PhD Assistant Professor of Psychology Florida Gulf Coast University 2 Optimal experimental design Part 1

More information

Algorithms in Nature. Pruning in neural networks

Algorithms in Nature. Pruning in neural networks Algorithms in Nature Pruning in neural networks Neural network development 1. Efficient signal propagation [e.g. information processing & integration] 2. Robust to noise and failures [e.g. cell or synapse

More information

EECS 433 Statistical Pattern Recognition

EECS 433 Statistical Pattern Recognition EECS 433 Statistical Pattern Recognition Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208 http://www.eecs.northwestern.edu/~yingwu 1 / 19 Outline What is Pattern

More information

AFOSR PI Meeting Dec 1-3, 2014 Program Director: Dr. Darema Dynamic Integration of Motion and Neural Data to Capture Human Behavior

AFOSR PI Meeting Dec 1-3, 2014 Program Director: Dr. Darema Dynamic Integration of Motion and Neural Data to Capture Human Behavior AFOSR PI Meeting Dec 1-3, 2014 Program Director: Dr. Darema Dynamic Integration of Motion and Neural Data to Capture Human Behavior Dimitris Metaxas(PI, Rutgers) D. Pantazis (co-pi, Head MEG Lab, MIT)

More information

NONLINEAR REGRESSION I

NONLINEAR REGRESSION I EE613 Machine Learning for Engineers NONLINEAR REGRESSION I Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Dec. 13, 2017 1 Outline Properties of multivariate Gaussian distributions

More information

Supplementary information Detailed Materials and Methods

Supplementary information Detailed Materials and Methods Supplementary information Detailed Materials and Methods Subjects The experiment included twelve subjects: ten sighted subjects and two blind. Five of the ten sighted subjects were expert users of a visual-to-auditory

More information

arxiv: v1 [cs.cv] 13 Jul 2018

arxiv: v1 [cs.cv] 13 Jul 2018 Multi-Scale Convolutional-Stack Aggregation for Robust White Matter Hyperintensities Segmentation Hongwei Li 1, Jianguo Zhang 3, Mark Muehlau 2, Jan Kirschke 2, and Bjoern Menze 1 arxiv:1807.05153v1 [cs.cv]

More information

Supplementary Information Methods Subjects The study was comprised of 84 chronic pain patients with either chronic back pain (CBP) or osteoarthritis

Supplementary Information Methods Subjects The study was comprised of 84 chronic pain patients with either chronic back pain (CBP) or osteoarthritis Supplementary Information Methods Subjects The study was comprised of 84 chronic pain patients with either chronic back pain (CBP) or osteoarthritis (OA). All subjects provided informed consent to procedures

More information

arxiv: v1 [q-bio.nc] 12 Jun 2014

arxiv: v1 [q-bio.nc] 12 Jun 2014 1 arxiv:1406.3284v1 [q-bio.nc] 12 Jun 2014 Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Charles F. Cadieu 1,, Ha Hong 1,2, Daniel L. K. Yamins 1,

More information

Studying the time course of sensory substitution mechanisms (CSAIL, 2014)

Studying the time course of sensory substitution mechanisms (CSAIL, 2014) Studying the time course of sensory substitution mechanisms (CSAIL, 2014) Christian Graulty, Orestis Papaioannou, Phoebe Bauer, Michael Pitts & Enriqueta Canseco-Gonzalez, Reed College. Funded by the Murdoch

More information

Bayesian Machine Learning for Decoding the Brain

Bayesian Machine Learning for Decoding the Brain for Decoding the Brain Radboud University Nijmegen, The Netherlands Institute for Computing and Information Sciences Radboud University Nijmegen, The Netherlands June 10, IWANN 2011, Torremolinos Faculty

More information

HUMAN SOCIAL INTERACTION RESEARCH PROPOSAL C8CSNR

HUMAN SOCIAL INTERACTION RESEARCH PROPOSAL C8CSNR HUMAN SOCIAL INTERACTION RESEARCH PROPOSAL C8CSNR Applicants Principal Investigator Student ID 4039921 Collaborators Name(s) Institution(s) Title of project: Neural basis of verbal and non-verbal false

More information

Automatic Definition of Planning Target Volume in Computer-Assisted Radiotherapy

Automatic Definition of Planning Target Volume in Computer-Assisted Radiotherapy Automatic Definition of Planning Target Volume in Computer-Assisted Radiotherapy Angelo Zizzari Department of Cybernetics, School of Systems Engineering The University of Reading, Whiteknights, PO Box

More information

MULTI-MODAL FETAL ECG EXTRACTION USING MULTI-KERNEL GAUSSIAN PROCESSES. Bharathi Surisetti and Richard M. Dansereau

MULTI-MODAL FETAL ECG EXTRACTION USING MULTI-KERNEL GAUSSIAN PROCESSES. Bharathi Surisetti and Richard M. Dansereau MULTI-MODAL FETAL ECG EXTRACTION USING MULTI-KERNEL GAUSSIAN PROCESSES Bharathi Surisetti and Richard M. Dansereau Carleton University, Department of Systems and Computer Engineering 25 Colonel By Dr.,

More information

Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition

Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition Charles F. Cadieu, Ha Hong, Daniel L. K. Yamins, Nicolas Pinto, Diego Ardila, Ethan A. Solomon, Najib

More information

Chapter 1. Introduction

Chapter 1. Introduction Chapter 1 Introduction 1.1 Motivation and Goals The increasing availability and decreasing cost of high-throughput (HT) technologies coupled with the availability of computational tools and data form a

More information

Motivation: Attention: Focusing on specific parts of the input. Inspired by neuroscience.

Motivation: Attention: Focusing on specific parts of the input. Inspired by neuroscience. Outline: Motivation. What s the attention mechanism? Soft attention vs. Hard attention. Attention in Machine translation. Attention in Image captioning. State-of-the-art. 1 Motivation: Attention: Focusing

More information

Semi-Supervised Disentangling of Causal Factors. Sargur N. Srihari

Semi-Supervised Disentangling of Causal Factors. Sargur N. Srihari Semi-Supervised Disentangling of Causal Factors Sargur N. srihari@cedar.buffalo.edu 1 Topics in Representation Learning 1. Greedy Layer-Wise Unsupervised Pretraining 2. Transfer Learning and Domain Adaptation

More information

17th Annual Meeting of the Organization for Human Brain Mapping (HBM) Effect of Family Income on Hippocampus Growth: Longitudinal Study

17th Annual Meeting of the Organization for Human Brain Mapping (HBM) Effect of Family Income on Hippocampus Growth: Longitudinal Study 17th Annual Meeting of the Organization for Human Brain Mapping (HBM) Effect of Family Income on Hippocampus Growth: Longitudinal Study Abstract No: 2697 Authors: Moo K. Chung 1,2, Jamie L. Hanson 1, Richard

More information

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns

An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns An Artificial Neural Network Architecture Based on Context Transformations in Cortical Minicolumns 1. Introduction Vasily Morzhakov, Alexey Redozubov morzhakovva@gmail.com, galdrd@gmail.com Abstract Cortical

More information

TITLE: A Data-Driven Approach to Patient Risk Stratification for Acute Respiratory Distress Syndrome (ARDS)

TITLE: A Data-Driven Approach to Patient Risk Stratification for Acute Respiratory Distress Syndrome (ARDS) TITLE: A Data-Driven Approach to Patient Risk Stratification for Acute Respiratory Distress Syndrome (ARDS) AUTHORS: Tejas Prahlad INTRODUCTION Acute Respiratory Distress Syndrome (ARDS) is a condition

More information

Shu Kong. Department of Computer Science, UC Irvine

Shu Kong. Department of Computer Science, UC Irvine Ubiquitous Fine-Grained Computer Vision Shu Kong Department of Computer Science, UC Irvine Outline 1. Problem definition 2. Instantiation 3. Challenge 4. Fine-grained classification with holistic representation

More information

Prof. Greg Francis 7/31/15

Prof. Greg Francis 7/31/15 Brain scans PSY 200 Greg Francis Lecture 04 Scanning Brain scanning techniques like provide spatial and temporal patterns of activity across the brain We want to analyze those patterns to discover how

More information

Early Diagnosis of Autism Disease by Multi-channel CNNs

Early Diagnosis of Autism Disease by Multi-channel CNNs Early Diagnosis of Autism Disease by Multi-channel CNNs Guannan Li 1,2, Mingxia Liu 2, Quansen Sun 1(&), Dinggang Shen 2(&), and Li Wang 2(&) 1 School of Computer Science and Engineering, Nanjing University

More information

arxiv: v1 [stat.ml] 21 Sep 2017

arxiv: v1 [stat.ml] 21 Sep 2017 Yet Another ADNI Machine Learning Paper? Paving The Way Towards Fully-reproducible Research on Classification of Alzheimer s Disease Jorge Samper-González 1,2, Ninon Burgos 1,2, Sabrina Fontanella 1,2,

More information

Automatic Diagnosis of Ovarian Carcinomas via Sparse Multiresolution Tissue Representation

Automatic Diagnosis of Ovarian Carcinomas via Sparse Multiresolution Tissue Representation Automatic Diagnosis of Ovarian Carcinomas via Sparse Multiresolution Tissue Representation Aïcha BenTaieb, Hector Li-Chang, David Huntsman, Ghassan Hamarneh Medical Image Analysis Lab, Simon Fraser University,

More information

Advanced Data Modelling & Inference

Advanced Data Modelling & Inference Edinburgh 2015: biennial SPM course Advanced Data Modelling & Inference Cyril Pernet Centre for Clinical Brain Sciences (CCBS) Neuroimaging Sciences Modelling? Y = XB + e here is my model B might be biased

More information

Inter-subject neural code converter representation. Author(s) Yamada, Kentaro; Miyawaki, Yoichi; Citation NeuroImage (2015), 113:

Inter-subject neural code converter representation. Author(s) Yamada, Kentaro; Miyawaki, Yoichi; Citation NeuroImage (2015), 113: Title Inter-subject neural code converter representation. Author(s) Yamada, Kentaro; Miyawaki, Yoichi; Citation NeuroImage (2015), 113: 289-297 Issue Date 2015-04-02 URL http://hdl.handle.net/2433/198901

More information

Retinotopy & Phase Mapping

Retinotopy & Phase Mapping Retinotopy & Phase Mapping Fani Deligianni B. A. Wandell, et al. Visual Field Maps in Human Cortex, Neuron, 56(2):366-383, 2007 Retinotopy Visual Cortex organised in visual field maps: Nearby neurons have

More information

Generative Embedding for Model-Based Classification of fmri Data

Generative Embedding for Model-Based Classification of fmri Data Generative Embedding for Model-Based Classification of fmri Data Kay H. Brodersen 1,2 *, Thomas M. Schofield 3, Alexander P. Leff 3, Cheng Soon Ong 1, Ekaterina I. Lomakina 1,2, Joachim M. Buhmann 1, Klaas

More information

Speech recognition in noisy environments: A survey

Speech recognition in noisy environments: A survey T-61.182 Robustness in Language and Speech Processing Speech recognition in noisy environments: A survey Yifan Gong presented by Tapani Raiko Feb 20, 2003 About the Paper Article published in Speech Communication

More information

arxiv: v1 [stat.ml] 23 Jan 2017

arxiv: v1 [stat.ml] 23 Jan 2017 Learning what to look in chest X-rays with a recurrent visual attention model arxiv:1701.06452v1 [stat.ml] 23 Jan 2017 Petros-Pavlos Ypsilantis Department of Biomedical Engineering King s College London

More information

Training fmri Classifiers to Discriminate Cognitive States across Multiple Subjects

Training fmri Classifiers to Discriminate Cognitive States across Multiple Subjects Training fmri Classifiers to Discriminate Cognitive States across Multiple Subjects Xuerui Wang, Rebecca Hutchinson, and Tom M. Mitchell Center for Automated Learning and Discovery Carnegie Mellon University

More information

NIH Public Access Author Manuscript Hum Brain Mapp. Author manuscript; available in PMC 2014 October 01.

NIH Public Access Author Manuscript Hum Brain Mapp. Author manuscript; available in PMC 2014 October 01. NIH Public Access Author Manuscript Published in final edited form as: Hum Brain Mapp. 2014 October ; 35(10): 5052 5070. doi:10.1002/hbm.22531. Multi-Atlas Based Representations for Alzheimer s Disease

More information

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING 1

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING 1 IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING Joint Classification and Regression via Deep Multi-Task Multi-Channel Learning for Alzheimer s Disease Diagnosis Mingxia Liu, Jun Zhang, Ehsan Adeli, Dinggang

More information

Hierarchical anatomical brain networks for MCI prediction: Revisiting volumetric measures

Hierarchical anatomical brain networks for MCI prediction: Revisiting volumetric measures University of Wollongong Research Online Faculty of Engineering and Information Sciences - Papers: Part A Faculty of Engineering and Information Sciences 2011 Hierarchical anatomical brain networks for

More information

One Class SVM and Canonical Correlation Analysis increase performance in a c-vep based Brain-Computer Interface (BCI)

One Class SVM and Canonical Correlation Analysis increase performance in a c-vep based Brain-Computer Interface (BCI) One Class SVM and Canonical Correlation Analysis increase performance in a c-vep based Brain-Computer Interface (BCI) Martin Spüler 1, Wolfgang Rosenstiel 1 and Martin Bogdan 2,1 1-Wilhelm-Schickard-Institute

More information

Shu Kong. Department of Computer Science, UC Irvine

Shu Kong. Department of Computer Science, UC Irvine Ubiquitous Fine-Grained Computer Vision Shu Kong Department of Computer Science, UC Irvine Outline 1. Problem definition 2. Instantiation 3. Challenge and philosophy 4. Fine-grained classification with

More information

Deep Learning of Brain Lesion Patterns for Predicting Future Disease Activity in Patients with Early Symptoms of Multiple Sclerosis

Deep Learning of Brain Lesion Patterns for Predicting Future Disease Activity in Patients with Early Symptoms of Multiple Sclerosis Deep Learning of Brain Lesion Patterns for Predicting Future Disease Activity in Patients with Early Symptoms of Multiple Sclerosis Youngjin Yoo 1,2,5(B),LisaW.Tang 2,3,5, Tom Brosch 1,2,5,DavidK.B.Li

More information

Machine learning for neural decoding

Machine learning for neural decoding Machine learning for neural decoding Joshua I. Glaser 1,2,6,7*, Raeed H. Chowdhury 3,4, Matthew G. Perich 3,4, Lee E. Miller 2-4, and Konrad P. Kording 2-7 1. Interdepartmental Neuroscience Program, Northwestern

More information

Spatiotemporal clustering of synchronized bursting events in neuronal networks

Spatiotemporal clustering of synchronized bursting events in neuronal networks Spatiotemporal clustering of synchronized bursting events in neuronal networks Uri Barkan a David Horn a,1 a School of Physics and Astronomy, Tel Aviv University, Tel Aviv 69978, Israel Abstract in vitro

More information

lateral organization: maps

lateral organization: maps lateral organization Lateral organization & computation cont d Why the organization? The level of abstraction? Keep similar features together for feedforward integration. Lateral computations to group

More information

Convolutional Neural Networks for Text Classification

Convolutional Neural Networks for Text Classification Convolutional Neural Networks for Text Classification Sebastian Sierra MindLab Research Group July 1, 2016 ebastian Sierra (MindLab Research Group) NLP Summer Class July 1, 2016 1 / 32 Outline 1 What is

More information

Outlier Analysis. Lijun Zhang

Outlier Analysis. Lijun Zhang Outlier Analysis Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Outline Introduction Extreme Value Analysis Probabilistic Models Clustering for Outlier Detection Distance-Based Outlier Detection Density-Based

More information

Supplemental Material

Supplemental Material 1 Supplemental Material Golomb, J.D, and Kanwisher, N. (2012). Higher-level visual cortex represents retinotopic, not spatiotopic, object location. Cerebral Cortex. Contents: - Supplemental Figures S1-S3

More information

Enhanced Detection of Lung Cancer using Hybrid Method of Image Segmentation

Enhanced Detection of Lung Cancer using Hybrid Method of Image Segmentation Enhanced Detection of Lung Cancer using Hybrid Method of Image Segmentation L Uma Maheshwari Department of ECE, Stanley College of Engineering and Technology for Women, Hyderabad - 500001, India. Udayini

More information

ELL 788 Computational Perception & Cognition July November 2015

ELL 788 Computational Perception & Cognition July November 2015 ELL 788 Computational Perception & Cognition July November 2015 Module 8 Audio and Multimodal Attention Audio Scene Analysis Two-stage process Segmentation: decomposition to time-frequency segments Grouping

More information

CLASSIFICATION OF BREAST CANCER INTO BENIGN AND MALIGNANT USING SUPPORT VECTOR MACHINES

CLASSIFICATION OF BREAST CANCER INTO BENIGN AND MALIGNANT USING SUPPORT VECTOR MACHINES CLASSIFICATION OF BREAST CANCER INTO BENIGN AND MALIGNANT USING SUPPORT VECTOR MACHINES K.S.NS. Gopala Krishna 1, B.L.S. Suraj 2, M. Trupthi 3 1,2 Student, 3 Assistant Professor, Department of Information

More information

Information Processing During Transient Responses in the Crayfish Visual System

Information Processing During Transient Responses in the Crayfish Visual System Information Processing During Transient Responses in the Crayfish Visual System Christopher J. Rozell, Don. H. Johnson and Raymon M. Glantz Department of Electrical & Computer Engineering Department of

More information

Inverse problems in functional brain imaging Identification of the hemodynamic response in fmri

Inverse problems in functional brain imaging Identification of the hemodynamic response in fmri Inverse problems in functional brain imaging Identification of the hemodynamic response in fmri Ph. Ciuciu1,2 philippe.ciuciu@cea.fr 1: CEA/NeuroSpin/LNAO May 7, 2010 www.lnao.fr 2: IFR49 GDR -ISIS Spring

More information

Introduction to NLP. Dr Alan Jones PhD. Inspire NLP 2016

Introduction to NLP. Dr Alan Jones PhD. Inspire NLP 2016 Introduction to NLP Dr Alan Jones PhD Inspire NLP 2016 alanjonesnlp@gmail.com The four minute rule You never get a second chance to make a first impression Making your mind-up FIRST IMPRESSIONS less than

More information

Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Berkes, Orban, Lengyel, Fiser.

Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment. Berkes, Orban, Lengyel, Fiser. Statistically optimal perception and learning: from behavior to neural representations. Fiser, Berkes, Orban & Lengyel Trends in Cognitive Sciences (2010) Spontaneous Cortical Activity Reveals Hallmarks

More information

Computational and Predictive Models for Medical Image Analysis Yi Hong, Computer Science, University of Georgia

Computational and Predictive Models for Medical Image Analysis Yi Hong, Computer Science, University of Georgia Neural White Matter Distinctions in Biologically Classified Psychosis Courtney Burton, B.S. Jackson, D.A. Parker, E.S. Gershon, M.S. Keshavan, G.D. Pearlson, C.A. Tamminga, B.A. Clementz, and J.E. McDowell,

More information

Personalized Disease Prediction Using a CNN-Based Similarity Learning Method

Personalized Disease Prediction Using a CNN-Based Similarity Learning Method 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) Personalized Disease Prediction Using a CNN-Based Similarity Learning Method Qiuling Suo, Fenglong Ma, Ye Yuan, Mengdi Huai,

More information

Data-driven Structured Noise Removal (FIX)

Data-driven Structured Noise Removal (FIX) Hamburg, June 8, 2014 Educational Course The Art and Pitfalls of fmri Preprocessing Data-driven Structured Noise Removal (FIX) Ludovica Griffanti! FMRIB Centre, University of Oxford, Oxford, United Kingdom

More information

Modeling Type One Diabetes with a Linear Response Function Based Model

Modeling Type One Diabetes with a Linear Response Function Based Model Modeling Type One Diabetes with a Linear Response Function Based Model Physics Honors Thesis Matthew Bauerle Advisor: Prof. Roman Vershynin Physics Honors Thesis July 29, 2016 Abstract Type one diabetes

More information

Temporal preprocessing of fmri data

Temporal preprocessing of fmri data Temporal preprocessing of fmri data Blaise Frederick, Ph.D., Yunjie Tong, Ph.D. McLean Hospital Brain Imaging Center Scope This talk will summarize the sources and characteristics of unwanted temporal

More information

Detection of Glaucoma and Diabetic Retinopathy from Fundus Images by Bloodvessel Segmentation

Detection of Glaucoma and Diabetic Retinopathy from Fundus Images by Bloodvessel Segmentation International Journal of Engineering and Advanced Technology (IJEAT) ISSN: 2249 8958, Volume-5, Issue-5, June 2016 Detection of Glaucoma and Diabetic Retinopathy from Fundus Images by Bloodvessel Segmentation

More information

Overview. Connectivity detection

Overview. Connectivity detection Overview Introduction Functional connectivity explorations Dynamic change Effect of motor fatigue Neurological change Effect of Asperger s Disorder, Depression Consciousness change Effect of anesthesia

More information

HST 583 fmri DATA ANALYSIS AND ACQUISITION

HST 583 fmri DATA ANALYSIS AND ACQUISITION HST 583 fmri DATA ANALYSIS AND ACQUISITION Neural Signal Processing for Functional Neuroimaging Neuroscience Statistics Research Laboratory Massachusetts General Hospital Harvard Medical School/MIT Division

More information

The Effects of Autocorrelated Noise and Biased HRF in fmri Analysis Error Rates

The Effects of Autocorrelated Noise and Biased HRF in fmri Analysis Error Rates The Effects of Autocorrelated Noise and Biased HRF in fmri Analysis Error Rates Ariana Anderson University of California, Los Angeles Departments of Psychiatry and Behavioral Sciences David Geffen School

More information

Classification of Alzheimer s disease subjects from MRI using the principle of consensus segmentation

Classification of Alzheimer s disease subjects from MRI using the principle of consensus segmentation Classification of Alzheimer s disease subjects from MRI using the principle of consensus segmentation Aymen Khlif and Max Mignotte 1 st September, Maynooth University, Ireland Plan Introduction Contributions

More information