Attention March 4, 29 John Maunsell Mitchell, JF, Sundberg, KA, Reynolds, JH (27) Differential attention-dependent response modulation across cell classes in macaque visual area V4. Neuron, 55:131 141.
Moore et al.
Spatial attention task receptive field 1. fixation point fraction of probes detected. attended location unattended location attend to other stimulus attend to receptive field stimulus 75 75 neuronal response (spikes/s) time (ms) 1 time (ms) 1
!""#$%&'"&(#)*+,'-*.&/%*%#&,&1-#*&2* 3'4%$*/%.#5&16#-/#&7&3'%%#-&89:8 ;4/)#..5&<'.6(#-=&7&>'(,/'&89:8
Task difficulty modulates neuronal responses in Area V4 Spitzer, Moran & Desimone 1988
Detecting orientation change Boudreau et al. (26) fixation point receptive field easy mode (9 ) difficult mode (~1 )
Task difficulty is determined by the size of orientation change Boudreau et al. (26) easy difficult 9 ~1
Task difficulty is determined by the size of orientation change Boudreau et al. (26) easy difficult 9 ~1 probe ~2 probe ~2
Behavioral performance Boudreau et al. (26) 1. (n=872) performance on probes (proportion correct).8.6 easy mode.4 difficult mode.2. attended unattended
Example V4 neuron response to preferred orientation Boudreau et al. (26) 3 response (spikes/s) 3 difficult mode attended unattended 25 time within stimulus cycle (ms) 3 easy mode 25 time within stimulus cycle (ms) neuronal response (spikes/s) 2 easy mode 1 difficult mode attended unattended
Distribution of attentional modulation in V4 Boudreau et al. (26) easy mode difficult mode 4 median = 7% 4 median = 24% number of neurons.25.5 1. 2. 4. attentional modulation (attended / unattended).25.5 1. 2. 4. attentional modulation (attended / unattended)
!"##$%&'())*+ 86 32#%:;#3"2 #"&<3=#.##$2#3"2,-$%./$ %$1"2$ '134$5+ 6 9*66 6 *66 766 >3?$&'?+
Average attention modulation of single unit responses at different cortical levels Cook & Maunsell (22) 1% average response enhancement by attention 5% % V1 V4 MT VIP MST 7a cortical hierarchy levels
!"#$%&'%(&)*+,-"&.%/,-",+%,--$.-"&.%&'%'123%/"4.,+%".%)"''$5$.-%6"/*,+%,5$,/% 789&..&5:%;*<*":%="./<:%>%?,/-.$5%@ABBAC%,--$.-"&.% (&)*+,-"&.% ".)$F% BGH% BGB% DE% DA% DL% DLM% DK% 1I% IJ7%
!"#$%&'%(&)*+,-"&.%/,-",+%,--$.-"&.%&'%'123%/"4.,+%".%)"''$5$.-%6"/*,+%,5$,/% 789&..&5:%;*<*":%="./<:%>%?,/-.$5%@ABBAC% BGH%,--$.-"&.% (&)*+,-"&.% ".)$F% 2.x 1.5x BGB% DE% DA% DL% DLM% DK% 1I% IJ7%
Modulation of V1 fmri BOLD signal by attention Somers et al. 1999 A 1 cm p 1-15 1-5 V1+ V1-
Recording from human visual cortex Yoshor et al. 27 3 2 1 voltage (mv)!1!2 5 1 15 2 time (ms)
Responsive and unresponsive locations Yoshor et al. 27 8 8 4 4 elevation -4-4 -4-8 -4 azimuth 4-8 -4 azimuth -8-4 azimuth 4 4 4 voltage (µv) voltage (µv) 2 time (ms) 2 time (ms)
Spatial attention task Yoshor et al. 27 8 4 fixation elevation -4 stimuli response period -8-4 azimuth 4 time
Effect of attention on human LFP Yoshor et al. 27 1 3 percent correct valid cue invalid cue voltage (µv) 15 1 2 4 8 16 orientation change -15 5 time (ms)
stronger response response stronger response & increased selectivity orientation
Change in average V4 orientation tuning by attention 1. attend in attend out n = 262 V4 sample response.5 amplitude:.45.6 width: 37 37. -9-6 -3 3 6 orientation relative to preferred 9
Attention does not sharpen direction tuning in MT Treue & Martinez-Trujillo 1999 pattern A pattern B 8 attend to pattern B response (spikes/s) attend to pattern A -9 9 18 stimulus direction pattern B
Average MT contrast response functions (n = 56) 6 average rate of firing (spikes/s) 1.6 6.2 25 1 contrast (%)
Attention does not sharpen direction tuning in MT Treue & Martinez-Trujillo 1999 pattern A pattern B 8 attend to pattern B response (spikes/s) attend to pattern A -9 9 18 stimulus direction pattern B
Attention can sharpen the tuning of a population response Martinez-Trujillo & Treue 24
Orientation tuning measured with different contrasts Cat V1 Sclar & Freeman 1982 8 8% contrast response (spikes/s) 4% 2% 1% -25 25 orientation
Change in average V4 orientation tuning by attention McAdams & Maunsell (1999) 1. attend in attend out n = 262 V4 sample response.5 amplitude:.45.6 width: 37 37. -9-6 -3 3 6 orientation relative to preferred 9
%!"#$%&'% %!"#$%&3%!"#$%)%!"#$%)% 2.,"$/#/,2$% 2.,"$/#/,2$% (% &(% '(% (% &(% '(% *+,-"*%+".%*/,!1*% *+,-"*%+".%*/,!1*%
%!"#$%&'% %!"#$%&'%!"#$%)%!"#$%)% 5,"$1#1,6$% 5,"$1#1,6$% (% &(% '(% (% &(% '(% *+,-".%/"%*1,2343.% *+,-".%/"%*1,2343.%
Variance of cat V1 neuron response Dean 1981 1 1 vary: spatial frequency contrast response variance (spikes 2 ) 1.1.1.1.1 1 1 response mean (spikes)
1%&#!'2"%*+,$-&34#5(#$*"%6,$*-(+$&% McAdams & Maunsell (1999).(-/%#--"$-(+$%.(-/+,-%#--"$-(+$% 4#5(#$*"%:%79;%<%*+,$-&% 797% 4#5(#$*"%:%79=%<%*+,$-&% 797% 788% 788% &'()"% 4#5(#$*"% 7% 7% 8987% 8987% 8987% 7% 788% 8987% 7% 788%!"#$%&'()"%*+,$-%!"#$%&'()"%*+,$-%
#'-/)%-'( 2(.( )#$'%,",$)%( 2(.( )#$'%,",$)%( 43( 23(!"#$"%&'( )*(&)+%,-!".!.( 2(.( 2( 4( 56 ()*(&)+%,-!"# 2( 2( 4( 23( 43( -/$'(&)+%,(1'"%( -/$'-(/'#(-,$1+7+-(
%&&'()*+&*,))'-).+-*+-*+/.'-),).+-*.1(/.2.-,3.4.)5 $#".1(/.2.-,3.4.)5,))'-.-6*)+*),/6')!#" McAdams & Maunsell (1999)!"! "!#" $#".1(/.2.-,3.4.)5.6-+/.-6*),/6')
!""#$"%&$'())#*"+',($&')(*"&-'%$'!-#('./ %"*1#22'#"'(23'4556
!""#$"%&$'"&'("%)*+%',%"-%$'.'/'1#2#3"%4#'5%#+6 7&8.$'.$6'9#:%)&$#';<=> 5%?."%&$'@&%$" ;D 1#2#3"%4#'5%#+6 ABB#2"%4# ("%)*+*: C$#BB#2"%4# ("%)*+*:
MT responses with attention to one of two receptive field stimuli Treue & Maunsell, 1996 fixation point stim. 1 attend to stimulus 1 attend to stimulus 2 stim. 2 12 1 2 1 2 1 2 1 2 1 2 1 2 response (spikes/s) 365 time (ms) 365 time (ms)
!""#$"%&$'"&'()&*+#,'-"%.*/% &""#)'1223 :%;<"%&$ -"%.*/% 4 4 =*# >#.&9#,?#@%7%&$ 4 4 566'.78,%9
Shifting attention between two stimuli inside the receptive field of a neuron in MT location fixation point location 1 location 2 stimulus receptive field location 2 blank blank null intermediate preferred attend location attend location 1 attend location 2 null location 1 stimulus intermediate preferred
Responses of an MT neuron to different stimulus pairings and attentional states location 2 stimulus blank null intermediate preferred blank null location 1 stimulus intermediate preferred attend away attend location 1 attend location 2 response 19 2 time (ms)
MT population average responses to different stimulus pairings and attentional states location 2 stimulus blank null intermediate preferred blank null location 1 stimulus intermediate preferred attend away attend location 1 attend location 2 response 115 2 time (ms)
MT neuron 126 sp/s 1 s 5
Normalization of neuronal responses preferred stimulus rate of firing (spikes/s) 1 25 time (ms) 1 rate of firing (spikes/s)
Normalization of neuronal responses non-preferred stimulus rate of firing (spikes/s) 1 25 time (ms) 1 rate of firing (spikes/s)
Normalization of neuronal responses preferred stimulus non-preferred stimulus rate of firing (spikes/s) 1 25 time (ms) 1 rate of firing (spikes/s)
Normalization of neuronal responses Heeger et al. 1996 nearby cells preferred stimulus rate of firing linear operator normalization output nonlinearity
Normalization of neuronal responses Heeger et al. 1996 nearby cells preferred stimulus non-preferred stimulus linear operator output nonlinearity rate of firing nearby cells
Attention Normalization Model Lee & Maunsell (29) divisive normalization + excitatory + inputs MT neuron firing rate R 1,2 "!!"#!! #! #! " # # attended: $ " " # # # #! " # # $! $ attended! I 1 I 2 #! % " $! %% $! & '("! % Normalization pool N 1 N 2 ignored: #! % " $! %% $! & '(" % preferred null
MT population average responses to different stimulus pairings and attentional states location 2 stimulus blank null intermediate preferred blank null location 1 stimulus intermediate preferred attend away attend location 1 attend location 2 response 115 2 time (ms)
Responses of an MT neuron and fit of normalization model location 2 stimulus blank null intermediate preferred blank null location 1 stimulus intermediate 93 preferred out loc 1 loc 2 attention to out loc 1 loc 2 attention to out loc 1 loc 2 attention to response out loc 1 loc 2 attention to
Two stimuli in the receptive field with different contrasts cued location cued location non-preferred 5% non-preferred 1% preferred 1% preferred 5%
Effect of contrast offset on the response functions of an MT neuron attention fixed relative contrast varied null 5% preferred 1% 135 firing rate (spikes/s).8 1.6 3.1 6.2 12.5 25 5 1 preferred stimulus contrast (%)
Effect of contrast offset on the response functions of an MT neuron attention fixed relative contrast varied null 5% preferred 1% 135 preferred 1% null 5% firing rate (spikes/s).8 1.6 3.1 6.2 12.5 25 5 1 preferred stimulus contrast (%)
Effect of contrast offset on the response functions of an MT neuron attention fixed relative contrast varied null 5% preferred 1% 135 preferred 1% null 5% firing rate (spikes/s) preferred 5% null 1%.8 1.6 3.1 6.2 12.5 25 5 1 preferred stimulus contrast (%)
Contrast response functions of an MT neuron with strong modulation attention fixed relative contrast varied attention varied relative contrast fixed null 5% null preferred 1% preferred 135 firing rate (spikes/s).8 1.6 3.1 6.2 12.5 25 5 1 preferred stimulus contrast (%) 1.6 3.1 6.2 12.5 25 5 1 contrast (%)
Contrast response functions of an MT neuron with weak modulation attention fixed relative contrast varied attention varied relative contrast fixed null 5% null preferred 1% preferred 55 firing rate (spikes/s).8 1.6 3.1 6.2 12.5 25 5 1 preferred stimulus contrast (%) 1.6 3.1 6.2 12.5 25 5 1 contrast (%)
Modulation by attention is correlated to modulation by stimulus interactions 1 r =.76 p <.1 95% CIs modulation by stimulus interactions (attention fixed relative contrast varied) -1-1 1 modulation by attention (attention varied relative contrast fixed)
@<7-:&()*+,,-(,&<(+:*(<'8+:&A+,&<(!!"#! "! #! #! " # # $ " " # # # #! " # # $! $ $$ +,,-(,&<(*%&?-7 '-:+,&>-*;<(,'+/,*>+'&-7 +,,-(,&<(*>+'&-7 '-:+,&>-*;<(,'+/,*%&?-7 #! % " $! %% $! & '(!" %! "#$ %&'&()*'+,-*./&1-/2/3 %&'&()*'+,-*./&1-/2/3!! "45 546 6$ "!! '-%-''-7*/,&89:9/*;<(,'+/,*.=3! "45 546 6$ "!! ;<(,'+/,*.=3
B16#=$(+=")*%CDC%()(-#$'-,)%+#'!1),#'"/%)"-,))E%'!$"F(+%*(#(-#'"/%"&%,%)1!'/,/-(%-=,/>(% G""$(%H%C,)),=%9::8I%9::@% &'.,#'"/% +"#% &'.,#'"/% +"#% @A%!"#"$%&'()*%!"#"$%&'()*% *'+#$,-#"$% 8?:% +,--,*(%#=$(+=")*% <:;% -"/#$")% $""$#'"/% "&% +,--,*(+% )1!'/,/-(% -=,/>(% +#'!1),#'"/% :?:% :% -1$$(/#% 2345% @:% 9:;% :% 6)"-7% 89%
!"#$"%"&'(')*"+$",($-+(&-+(''"&').&+'(%/%+ 1+!",($-+%)2"+ &"3$.&(4+$"%#.&%"+ 5)"4-+ 5)6(').&+ '($7"'+ %')81+9+ %')81+:+ %')81+9+$",($-+ 9+ ;+ %')81+:+$",($-+ 9+ ;+ &"3$.&(4+ (<')*)'=+ 4.,+ >)7>+?1@+?1@+?1@+?1@+ %)2"+ %)2"+ #$.A1+ #$.A1+ B1+!",($-+#$.A(A)4)'=+ %')81+9+ %')81+:+ %')81+9+$",($-+ @+ @+ %')81+:+$",($-+ @+ @+ &"3$.&(4+ (<')*)'=+ 4.,+ >)7>+?19+?1;+?19+?1;+ %)2"+ %)2"+ #$.A1+ #$.A1+ C1+D#(')(4+(''"&').&+ %')81+9+ %')81+:+ %')81+9+$",($-+?+ @+ %')81+:+$",($-+?+ @+ &"3$.&(4+ (<')*)'=+ 4.,+ >)7>+?1?+ :1?+?1?+ :1?+ %)2"+ %)2"+ #$.A1+ #$.A1+