Combining fmri, ERP and SNP data with ICA: Introduction and examples Vince D. Calhoun, Ph.D.

Similar documents
Overview. Multimodal Data Collection. A Role For Data Fusion?: Brain Function (spatiotemporal, task-related) EEG. fmri. Brain Structure (spatial)

Overview. Multimodal Data Collection. A Role For Data Fusion?: Possible approaches for joint analyses. Why Joint/Multimodal?

2014 M.S. Cohen all rights reserved

}Correlate/Cluster Subject N

V.D. Calhoun, 1 3 * T. Adali, 4 N.R. Giuliani, 1 J.J. Pekar, 5,6 K.A. Kiehl 1,2 and G.D. Pearlson, 1 3. Baltimore, Maryland

NIH Public Access Author Manuscript Neuroimage. Author manuscript; available in PMC 2010 March 1.

Functional connectivity in fmri

NeuroImage 45 (2009) S163 S172. Contents lists available at ScienceDirect. NeuroImage. journal homepage:

A Method for Multitask fmri Data Fusion Applied to Schizophrenia

Bayesian Inference. Thomas Nichols. With thanks Lee Harrison

Introduction to Computational Neuroscience

Fusing Simultaneous EEG-fMRI by Linking Multivariate Classifiers

HST 583 fmri DATA ANALYSIS AND ACQUISITION

Functional Elements and Networks in fmri

DATA MANAGEMENT & TYPES OF ANALYSES OFTEN USED. Dennis L. Molfese University of Nebraska - Lincoln

General Linear Model. Modeling the Brain? ICA vs PCA

Semi-blind ICA of fmri: a method for utilizing hypothesis-derived time courses in a spatial ICA analysis

Shared Response Model Tutorial! What works? How can it help you? Po-Hsuan (Cameron) Chen and Hejia Hasson Lab! Feb 15, 2017!

ABSTRACT 1. INTRODUCTION 2. ARTIFACT REJECTION ON RAW DATA

Statistical Analysis Methods for the fmri Data

Experimental design of fmri studies

NIH Public Access Author Manuscript Clin Neurophysiol. Author manuscript; available in PMC 2011 August 1.

Neuroimaging. BIE601 Advanced Biological Engineering Dr. Boonserm Kaewkamnerdpong Biological Engineering Program, KMUTT. Human Brain Mapping

Heterogeneous Data Mining for Brain Disorder Identification. Bokai Cao 04/07/2015

Neuronal chronometry of target detection: Fusion of hemodynamic and event-related potential data i

Beyond Blind Averaging: Analyzing Event-Related Brain Dynamics. Scott Makeig. sccn.ucsd.edu

NeuroImage 52 (2010) Contents lists available at ScienceDirect. NeuroImage. journal homepage:

INDEPENDENT COMPONENT ANALYSIS AND BEYOND IN BRAIN IMAGING: EEG, MEG, FMRI, AND PET

Contributions to Brain MRI Processing and Analysis

GIFT Course Lecture 6: Multi-group ICA. Vince D. Calhoun, Ph.D.

Introduction to Computational Neuroscience

Classification and Statistical Analysis of Auditory FMRI Data Using Linear Discriminative Analysis and Quadratic Discriminative Analysis

An Introduction to Translational Neuroscience Approaches to Investigating Autism

A Novel Synergistic Model Fusing Electroencephalography and Functional Magnetic Resonance Imaging for Modeling Brain Activities

Biomedical Imaging: Course syllabus

MULTIMODAL IMAGING IN TEMPORAL LOBE EPILEPSY JONATHAN WIRSICH

Functional Connectivity Measures in Memory Networks Using Independent Component Analysis

Inverse problems in functional brain imaging Identification of the hemodynamic response in fmri

Edinburgh Imaging Academy online distance learning courses. Functional Imaging

Nikos Laskaris ENTEP

Spatial and Temporal Independent Component Analysis of Functional MRI Data Containing a Pair of Task-Related Waveforms

The power of Tensor algebra in medical diagnosis

Activated Fibers: Fiber-centered Activation Detection in Task-based FMRI

Causality from fmri?

MULTI-MODAL FETAL ECG EXTRACTION USING MULTI-KERNEL GAUSSIAN PROCESSES. Bharathi Surisetti and Richard M. Dansereau

Neural Correlates of Human Cognitive Function:

Bayesian Bi-Cluster Change-Point Model for Exploring Functional Brain Dynamics

Modeling of Circuits within Networks by fmri

THE data used in this project is provided. SEIZURE forecasting systems hold promise. Seizure Prediction from Intracranial EEG Recordings

TENSOR Based Tumor Tissue Differentiation Using Magnetic Resonance Spectroscopic Imaging

Data-driven Structured Noise Removal (FIX)

The Central Nervous System

Bayesian Models for Combining Data Across Subjects and Studies in Predictive fmri Data Analysis

2014 M.S. Cohen all rights reserved

PARAFAC: a powerful tool in EEG monitoring

Population Inference post Model Selection in Neuroscience

Current issues in data-intensive brain-related research a scan of the research landscape For Spring 2016, the focus areas for funding are:

Introduction to Brain Imaging

Introduction to simultaneous EEG-fMRI

Network-based pattern recognition models for neuroimaging

From Single-trial EEG to Brain Area Dynamics

Investigations in Resting State Connectivity. Overview

Functional MRI of the dynamic brain: quasiperiodic patterns, brain states, and trajectories. Shella Keilholz BME, Emory/Georgia Tech 20 March 2018

Studying the time course of sensory substitution mechanisms (CSAIL, 2014)

Multi-Subject fmri Generalization with Independent Component Representation

Resting-State functional Connectivity MRI (fcmri) NeuroImaging

Analysis of in-vivo extracellular recordings. Ryan Morrill Bootcamp 9/10/2014

FREQUENCY DOMAIN HYBRID INDEPENDENT COMPONENT ANALYSIS OF FUNCTIONAL MAGNETIC RESONANCE IMAGING DATA

Temporal preprocessing of fmri data

Use of Functional Brain Circuitry for Diagnostic and Treatment Decisions

Computational and Predictive Models for Medical Image Analysis Yi Hong, Computer Science, University of Georgia

Biomarkers in Schizophrenia

Measurement Denoising Using Kernel Adaptive Filters in the Smart Grid

MSc Neuroimaging for Clinical & Cognitive Neuroscience

Experimental design. Alexa Morcom Edinburgh SPM course Thanks to Rik Henson, Thomas Wolbers, Jody Culham, and the SPM authors for slides

Cognitive, affective, & social neuroscience

Magnetic resonance imaging (MRI) data is a

Experimental design. Experimental design. Experimental design. Guido van Wingen Department of Psychiatry Academic Medical Center

Is imaging genetics plausible? Imaging Genetics and Multimodal Approaches to Brain Imaging. Which genetic model should be used?

Statistical Analysis of Sensor Data

The Effects of Autocorrelated Noise and Biased HRF in fmri Analysis Error Rates

The role of amplitude, phase, and rhythmicity of neural oscillations in top-down control of cognition

Competing Streams at the Cocktail Party

EEG/ERP Control Process Separation

Mining Electroencephalographic Data Using Independent Component Analysis

International Journal of Innovative Research in Advanced Engineering (IJIRAE) Volume 1 Issue 10 (November 2014)

Representational similarity analysis

Overview. Connectivity detection

Brain Computer Interface. Mina Mikhail

Temporal preprocessing of fmri data

Bayesians methods in system identification: equivalences, differences, and misunderstandings

Supplementary Information Methods Subjects The study was comprised of 84 chronic pain patients with either chronic back pain (CBP) or osteoarthritis

Group-Wise FMRI Activation Detection on Corresponding Cortical Landmarks

Early Learning vs Early Variability 1.5 r = p = Early Learning r = p = e 005. Early Learning 0.

Sensory Cue Integration

Interpreting fmri Decoding Weights: Additional Considerations

A Robust Classifier to Distinguish Noise from f MRI Independent Components

Classification of schizophrenic patients and healthy controls using multiple spatially independent components of structural MRI data

Spatiotemporal clustering of synchronized bursting events in neuronal networks

Transcription:

Combining fmri, ERP and SNP data with ICA: Introduction and examples Vince D. Calhoun, Ph.D. Director, Image Analysis & MR Research The Mind Research Network Associate Professor, Electrical and Computer Engineering The University of New Mexico 1

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions EEG EEGEEG Task 1-N Task 1-N T1/T2 SNP Other * fmri fmri fmri DTI Gene Expression 2

Multimodal Data Collection Brain Function (spatiotemporal, task-related) EEG EEGEEG Task 1-N Task 1-N fmri fmri fmri Brain Structure (spatial) Genetic Data (spatial/chromosomal) Covariates (Age, etc.) T1/T2 SNP Other * DTI Gene Expression 3

A Role For Data Fusion?: lower Temporal Resolution higher lower EEG fmri Spatial Resolution higher 4

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions 5

EEG/ERP 6

Event-related Potentials (ERPs) _ Voltage + Time EEG 7

Genetic Variation ACTTGCATCCG ACTTGTATCCG ACTTGCATCCG ACTTG--TCCG Single Nucleotide Polymorphism (SNP) Insertion/Deletion (Indel) ACTTGGCGCGCTCCG ACTTGGCGC--TCCG ACTTGGC----TCCG Short Tandem Repeat (STR) SNPS SUBJECTS SNP data matrix 8

The Link between brain function and genetic coding 9

The First Challenge 10

A conceptual slide to drive home the point Gene mrna Neuroimaging Protein Cell Cell Interaction Brain Function Behavioral Component Behavioral Disorder 11

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions 12

Separate vs. Joint Estimation Linear mixtures with shared mixing parameter In a non-joint analysis, we maximize the likelihood functions for each modality separately Resulting in two unmixing parameters, that then have to somehow be fused together In contrast: for a joint analysis we maximize the joint likelihood function, resulting in a single fused unmixing parameter C C ( E) ( E) ( F) ( F) iv, = ic cv, and iv, = ic cv, c= 1 c= 1 ( E) p ( x ; w) ( F ) p x ; w x as x as 1 ( ) ( ) ( E ) w = arg max log p x ; w * 1 w 1 2 ( ) ( F ) w = arg max log p x ; w * 2 w 2 ( ) ( ) ( E F ) * w = arg max log p x, x ; w w w= 1/ a 13

What is a feature? Feature Data Lower dimensional data containing information of interest Examples: An image of activation amplitudes, A gray matter segmentation image, fractional anisotropy image Advantages Less-computationally complex/easier to model Takes advantages of existing analytic approaches Can be used to examine inter-relationships relationships between multiple data types at the subject level fmri smri 14

What are the features? Examples: An image of activation amplitudes, A gray matter segmentation image, fractional anisotropy image Advantages Less-computationally complex/easier to model Takes advantages of existing analytic approaches Examines inter-subject covariation of multiple data types Feature Data Modality fmri SB task fmri AOD task smri EEG AOD task Modality fmri DTI smri EEG Core-Feature Recognition related activity Encode-related activity Target-related activity Novel-related activity GM concentration WM concentration CSF concentration Target-related ERP Novel-related ERP Raw data size 260 MB 200 MB 46 MB 25MB Feature size 1.3 MB 10 MB 28 MB.45MB Compression ratio 1:200 1:20 1:1.6 1:56 15

Possible approaches for joint analyses Voxel-based Correlation [Worsely 1998] Straightforward, but difficult to visualize Region-based Interregional correlation [Horwitz,, et al, 1984] Structural equation modeling [McIntosh and Gonzalez [McIntosh and Gonzalez-Lima 1994; Friston et al., 2003, McIntosh & Gonzalez-Lima, 1991, Buchel & Friston, 1997] Multiple regression and extensions [e.g., Kalman filters, Buchel & Friston, 1998] Bayes networks, Dynamic Causal Modeling [Dynamic Causal Modeling, Friston, Penny, et al, 2003] Useful for model testing, does not take into account all brain regionsr Transformation-based A natural set of tools for this problem include those that transform data matrices into a smaller set of modes or components Singular value decomposition [Friston et al., 1993; Friston et al., 1996] Partial Least Squares [McIntosh, Bookstein,, et al, 1996] Canonical Variates Analysis [Strother et al, 1995] Independent Component Analysis [McKeown al., 2002] McKeown et al, 1998, Calhoun et al, 2001, Beckmann, et 16

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions [ xmod1 xmod 2 ] = A [ smod1 smod 2 ] 17

Blind Source Separation (ICA) ICA finds directions which maximize independence (using higher order statistics) 18

Stationarity 19

a Joint ICA Shared Feature Profile b Parallel ICA Distinct but linked Feature Profile participants Coupled feature matrix Feature 1 Feature 2 = Weights * Source matrix Map 1 Map 2 Data1 Initialization (λ 1,λ c1 ) Data2 initialization (λ 2,λ c2 ) Update W 1 based on H 1 Update W 2 based on H 2 voxels/time courses Shared Contribution Matrix Y Stop? N Update W 1 based on Correlation Select the related components Stop? Update W 2 based on Correlation Y STOP 20

Joint ICA [ x x ] = A [ s s ] mod1 mod 2 mod1 mod 2 Generative Model: F E F E xi x i = A sc s c Update Equation: { 2 ( ) T T 2 ( ) } F F E E Δ W = η I y u y u W smri/fmri: fmri/fmri: EEG/fMRI: Calhoun VD, Adali T, Giuliani N, Pekar JJ, Pearlson GD, Kiehl KA. (2006): A Method for Multimodal Analysis of Independent Source Differences in Schizophrenia: Combining Gray Matter Structural and Auditory Oddball Functional Data. Hum.Brain Map. 27(1):47-62. Calhoun VD, Adali T, Kiehl KA, Astur RS, Pekar JJ, Pearlson GD. (2006): A Method for Multi-task fmri Data Fusion Applied to Schizophrenia. Hum.Brain Map. 27(7):598-610. Calhoun VD, Pearlson GD, Kiehl KA. (2006): Neuronal Chronometry of Target Detection: Fusion of Hemodynamic and Eventrelated Potential Data. NeuroImage 30(2):544-553. 21

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions 22

fmri EEG Peak of Target -locked fmri signal Preprocess Feature Extraction Preprocess Feature Extraction Position Cz of Target -locked EEG signal Normalize Normalize Subject 1 Subject 2 Subject N jica Subject 1 Subject 2 Subject N Noise Removal Visualization 23

Joint ERP/fMRI Components Calhoun, V.D., Pearlson, G.D., and Kiehl, K.A. (2006). Neuronal Chronometry of Target Detection: Fusion of Hemodynamic and Event-related Potential Data. NeuroImage 30, 544-553. 24

FMRI Snapshots (movie) ERP (temporal) Components: FMRI (spatial) Components: FMRI Image Snapshot: [ ] T= t t 1 [ ] S= s s 1 ( ) = T ( ) M t T S t F Calhoun, V.D., Pearlson, G.D., and Kiehl, K.A. (2006). Neuronal Chronometry of Target Detection: Fusion of Hemodynamic and Event-related Potential Data. NeuroImage 30, 544-553. N N 25

ERP Snapshots = [ 1 N ] [ ] ERP (temporal) Components: T t t FMRI (spatial) Components: S= s s ERP Timecourse Snapshot: 1 N ( ) = T ( ) M v T S v E Calhoun, V.D., Pearlson, G.D., and Kiehl, K.A. (2006). Neuronal Chronometry of Target Detection: Fusion of Hemodynamic and Event-related Potential Data. NeuroImage 30, 544-553. 26

27

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions 28

fmri/snp connection fmri component: specific brain regions with common independent brain functionality. SNP component: a linearly weighted group of SNPs functioning together. Relationship assumption If an association of SNPs partially define a certain brain function in specific brain regions, Then, the linked fmri and SNP components should share a similar pattern of existence across subjects. fmri components SNP components Expression pattern Subject 1.... Subject 25 Expression pattern 29

Parallel ICA structure Data1: (fmri) Data2: (SNP) X1 X2 A1 W1 S1 S2 W2 A2 MAX : {H(Y1 Y1) ) + H(Y2 Y2) ) }, <Infomax< Infomax> Subject to: arg max g{w1,w2 ŝ1, 1,ŝ22 }, Cov(a,a ) 2 2 1i 2j g( )=Correlation(A 1,A 2) = Var(a 1i ) Var(a 2j ) 30

Dynamic parallel ICA optimization Dynamically constrained components: X1 ŝ1 Adaptive constraint strength: Effects on Entropy H(.) X2 ŝ2 31

DATA1 A1 Simulation data DATA2 A2 True component: 8/8; True correlation:0.8 Data1 Data2 Parallel ICA Regular ICA connection connection 8 4 0.4149 0.4148 8 0.8275 0.6635 16 0.8240 0.6639 4 8 0.1739 0.1738 8 0.8492 0.6636 16 0.8953 0.6636 True Correlation 1.00 0.80 0.60 0.45 Parallel ICA correlation 0.9278 0.7911 0.5850 0.4603 Regular ICA correlation 0.8606 0.7348 0.5205 0.4138 32

Parallel ICA 1.independent components/factors of each modality 2.Inter Inter-relationship relationship between modalities The algorithm is based on classic ICA,, aiming to extract independent sources and enhance the connections between modalities. 33

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions 34

Example 1: SNP/fMRI Fusion Data Description: 20 Sz & 43 Healthy controls (Caucasian) fmri: one image per subject (Target activation in Auditory Oddball task SNP: one array per subject (384 SNP genotypes - -> > 367 SNPs) Control vs Patient p<0.001 SNP Z score Gene Rs1466163-4.08 AADC: aromatic L-amino L acid decarboxylase Rs2429511 3.97 ADRA2A: alpha-2a adrenergic receptor gene Rs3087454-3.09 CHRNA7: alpha 7 nicotinic cholinergic receptor Rs821616 2.96 DISC1: disrupted in schizophrenia 1 Rs885834-2.78 CHAT: choline acetyltransferase Rs1355920-2.77 CHRNA7: cholinergic receptor, nicotinic, alpha 7 R4765623 2.73 SCARB1: scavenger receptor class B, member 1 Rs4784642-2.71 GNAO1: guanine nucleotide binding protein (G protein), alpha activating activity polypeptide O Rs2071521 2.58 APOC3: apolipoprotein C-III Rs7520974 2.55 CHRM3: muscarinic-3 3 cholinergic receptor J. Liu, G. D. Pearlson, A. Windemuth, G. Ruano, N. I. Perrone-Bizzozero, and V. D. Calhoun, "Combining Fmri and Snp Data to Investigate Connections between Brain Function and Genetics Using Parallel Ica," Hum.Brain Map., In Press. 35

Subject loading associated with linked SNP and fmri components SNP 20 SZ 43 HC fmri 36

Sample size vs Number of SNPs Data collected at UCI 37

Motivation Data Description fmri ERP Genetic Features & Joint Estimation Joint ICA Outline Example 1: ERP/fMRI Example 2: Multielectrode ERP/fMRI Parallel ICA SNP/FMRI SNP/ERP Conclusions 38

Example 2: Genetics and P3 ERP generation Subjects: 41 healthy subjects(24 female, 17 male) EEG collected during AOD task, target/novel ERPs extracted Blood sample collected, genotyped 384 SNPs from 222 genes 6 physiological systems. 39

40 ADRA2A ADRA2A APOE APOE ABCB1 ABCB1 TH TH ABCB1 ABCB1 MDH1 MDH1 GNAO1 GNAO1 ADRA2A ADRA2A rs1800545 rs1800545 rs7412 rs7412 rs1128503 rs1128503 rs6578993 rs6578993 rs1045642 rs1045642 rs2278718 rs2278718 rs4784642 rs4784642 rs521674 rs521674 Genes Genes SNPs SNPs 0.55 Target Stimuli Novel Stimuli ADRA2A ADRA2A APOE APOE TH TH MDH1 MDH1 ABCB1 ABCB1 APOE APOE PIK3C3 PIK3C3 PIK3C3 PIK3C3 ADRA2A ADRA2A rs1800545 rs1800545 rs7412 rs7412 rs6578993 rs6578993 rs2278718 rs2278718 rs1128503 rs1128503 rs429358 rs429358 rs3813065 rs3813065 rs4121817 rs4121817 rs521674 rs521674 Genes Genes SNPs SNPs 0.47

Pathway Analysis 41

Fusion ICA Toolbox (FIT) 250+ unique downloads http://icatb.sourceforge.net Funded by NIH 1 R01 EB 005846 42

Thank You! 43

44