Supplementary Information

Similar documents
Supplemental Information. Triangulating the Neural, Psychological, and Economic Bases of Guilt Aversion

Resistance to forgetting associated with hippocampus-mediated. reactivation during new learning

Distinct Value Signals in Anterior and Posterior Ventromedial Prefrontal Cortex

There are, in total, four free parameters. The learning rate a controls how sharply the model

Neural activity to positive expressions predicts daily experience of schizophrenia-spectrum symptoms in adults with high social anhedonia

Supplementary Online Material Supplementary Table S1 to S5 Supplementary Figure S1 to S4

Title of file for HTML: Supplementary Information Description: Supplementary Figures, Supplementary Tables and Supplementary References

Nature Neuroscience: doi: /nn Supplementary Figure 1. Task timeline for Solo and Info trials.

Distinct valuation subsystems in the human brain for effort and delay

Supplementary Material. Functional connectivity in multiple cortical networks is associated with performance. across cognitive domains in older adults

Supplementary Materials for

Theory of mind skills are related to gray matter volume in the ventromedial prefrontal cortex in schizophrenia

Nature Neuroscience: doi: /nn Supplementary Figure 1. Blame judgment task.

Role of the ventral striatum in developing anorexia nervosa

SUPPLEMENTARY MATERIALS: Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision-making

Supporting online material for: Predicting Persuasion-Induced Behavior Change from the Brain

Supporting online material. Materials and Methods. We scanned participants in two groups of 12 each. Group 1 was composed largely of

Supplementary Information Methods Subjects The study was comprised of 84 chronic pain patients with either chronic back pain (CBP) or osteoarthritis

correlates with social context behavioral adaptation.

Supplemental Data. Inclusion/exclusion criteria for major depressive disorder group and healthy control group

Supplementary Material S3 Further Seed Regions

QUANTIFYING CEREBRAL CONTRIBUTIONS TO PAIN 1

Supporting Online Material for

Methods to examine brain activity associated with emotional states and traits

Investigating directed influences between activated brain areas in a motor-response task using fmri

Supporting Information. Demonstration of effort-discounting in dlpfc

Paul-Chen Hsieh, Ming-Tsung Tseng, Chi-Chao Chao, Yea-Huey Lin Wen-Yih I. Tseng, Kuan-Hong Liu, Ming-Chang Chiang, Sung-Tsang Hsieh

Text to brain: predicting the spatial distribution of neuroimaging observations from text reports (submitted to MICCAI 2018)

Supporting Information

Supplementary Results: Age Differences in Participants Matched on Performance

The Neural Signature of Social Norm Compliance Manfred Spitzer, Urs Fischbacher, Bärbel Herrnberger, Georg Grön, Ernst Fehr

CEREBRUM & CEREBRAL CORTEX

Supplementary Methods and Results

Title: Falsifying the Reward Prediction Error Hypothesis with an Axiomatic Model. Abbreviated title: Testing the Reward Prediction Error Model Class

2017, Joule Inc. or its licensors Online appendices are unedited and posted as supplied by the authors.

Hippocampal brain-network coordination during volitionally controlled exploratory behavior enhances learning

Reporting Checklist for Nature Neuroscience

Focusing Attention on the Health Aspects of Foods Changes Value Signals in vmpfc and Improves Dietary Choice

SUPPLEMENT: DYNAMIC FUNCTIONAL CONNECTIVITY IN DEPRESSION. Supplemental Information. Dynamic Resting-State Functional Connectivity in Major Depression

The Neural Basis of Following Advice

Nature Neuroscience doi: /nn Supplementary Figure 1. Characterization of viral injections.

A possible mechanism for impaired joint attention in autism

Episodic Future Thinking Reduces Reward Delay Discounting through an Enhancement of Prefrontal-Mediotemporal Interactions

Neurobiological Foundations of Reward and Risk

Supplemental Information. Differential Representations. of Prior and Likelihood Uncertainty. in the Human Brain. Current Biology, Volume 22

Double dissociation of value computations in orbitofrontal and anterior cingulate neurons

SPECIAL ISSUE: ORIGINAL ARTICLE BINDING OF WHAT AND WHERE DURING WORKING MEMORY MAINTENANCE

The Function and Organization of Lateral Prefrontal Cortex: A Test of Competing Hypotheses

Involvement of both prefrontal and inferior parietal cortex. in dual-task performance

Supplementary Digital Content

NIH Public Access Author Manuscript Proc SPIE. Author manuscript; available in PMC 2014 February 07.

Functional topography of a distributed neural system for spatial and nonspatial information maintenance in working memory

Regional and Lobe Parcellation Rhesus Monkey Brain Atlas. Manual Tracing for Parcellation Template

Testing the Reward Prediction Error Hypothesis with an Axiomatic Model

For better or for worse: neural systems supporting the cognitive down- and up-regulation of negative emotion

Reasoning and working memory: common and distinct neuronal processes

Supplementary Online Content

Hallucinations and conscious access to visual inputs in Parkinson s disease

Supplementary materials for: Executive control processes underlying multi- item working memory

Attention Response Functions: Characterizing Brain Areas Using fmri Activation during Parametric Variations of Attentional Load

SUPPLEMENTARY INFORMATION

Prefrontal connections express individual differences in intrinsic resistance to trading off honesty values against economic benefits

Reporting Checklist for Nature Neuroscience

PROPERTY OF ELSEVIER SAMPLE CONTENT - NOT FINAL. Gross Anatomy and General Organization of the Central Nervous System

Dissociation of reward anticipation and outcome with event-related fmri

Reinforcement learning and the brain: the problems we face all day. Reinforcement Learning in the brain

Supplementary information Detailed Materials and Methods

How Self-Determined Choice Facilitates Performance: A Key Role of the Ventromedial Prefrontal Cortex

Biology of Mood & Anxiety Disorders 2012, 2:11

Title of file for HTML: Peer Review File Description:

NeuroImage 76 (2013) Contents lists available at SciVerse ScienceDirect. NeuroImage. journal homepage:

Supplementary Online Content

Brain Imaging studies in substance abuse. Jody Tanabe, MD University of Colorado Denver

Constrained Principal Component Analysis Reveals Functionally Connected Load-Dependent Networks Involved in Multiple Stages of Working Memory

"False tagging mechanism False Tagging Theory All idea initially believed Doubt occur when prefrontal cortex tags it as false Provides doubt and

This article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and

Identification of Neuroimaging Biomarkers

Model-Based fmri Analysis. Will Alexander Dept. of Experimental Psychology Ghent University

Supplemental Digital Content 4: Effect sizes

Distinguishing informational from value-related encoding of rewarding and punishing outcomes in the human brain

Chapter 3. Structure and Function of the Nervous System. Copyright (c) Allyn and Bacon 2004

Separate Valuation Subsystems for Delay and Effort Decision Costs

SUPPLEMENTARY MATERIAL. Table. Neuroimaging studies on the premonitory urge and sensory function in patients with Tourette syndrome.

Brain Network Activity During Face Perception: The Impact of Perceptual Familiarity and Individual Differences in Childhood Experience

A Dorsolateral Prefrontal Cortex Semi-Automatic Segmenter

Brain anatomy and artificial intelligence. L. Andrew Coward Australian National University, Canberra, ACT 0200, Australia

Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses

NeuroImage 45 (2009) Contents lists available at ScienceDirect. NeuroImage. journal homepage:

The Cognitive Control of Memory: Age Differences in the Neural Correlates of Successful Remembering and Intentional Forgetting

Proactive and reactive control during emotional interference and its relationship to trait anxiety

Supporting Information

Causes of social reward differences encoded in human brain

Supplementary Information. Gauge size. midline. arcuate 10 < n < 15 5 < n < 10 1 < n < < n < 15 5 < n < 10 1 < n < 5. principal principal

HHS Public Access Author manuscript Eur J Neurosci. Author manuscript; available in PMC 2017 August 10.

CEREBRUM. Dr. Jamila EL Medany

Announcement. Danny to schedule a time if you are interested.

The association of children s mathematic abilities with both adults cognitive abilities

BIOL Dissection of the Sheep and Human Brain

DISSECTION OF THE SHEEP'S BRAIN

Supplementary Online Content

Transcription:

Supplementary Information The neural correlates of subjective value during intertemporal choice Joseph W. Kable and Paul W. Glimcher

a 10 0 b 10 0 10 1 10 1 Discount rate k 10 2 Discount rate k 10 2 10 3 10 3 10 4 1 2 3 4 Session 10 4 0 50 100 150 Time (d) CH DC RA AT JH MC AK HM KH YH Supplementary Figure 1. Stability of discount rates across sessions. (a) The discount rate estimated for each session is plotted for each of ten subjects. Error bars represent 95% confidence intervals estimated using the residual error of the nonlinear regression. Only paid sessions are shown. Sessions 1 and 2 were behavioral sessions, and sessions 3 and 4 (where applicable) were scanning sessions. These subjects were selected for scanning because they exhibited stable discount rates across two preliminary behavioral sessions (two additional subjects were excluded). (b) Same data as in (a), plotted against the time from the first paid session in days, to show that any instability in the discount rates is not associated with longer delays between sessions.

2 Hyperbolic adjusted-r a b c 1.0 0.9 0.8 0.7 0.6 0.5 0.5 0.6 0.7 0.8 0.9 1.0 2 Exponential adjusted-r 2 Sum-of-exponentials adjusted-r 1.0 0.9 0.8 0.7 0.6 0.5 0.5 0.6 0.7 0.8 0.9 1.0 Exponential adjusted-r 2 Hyperbolic adjusted-r 1.0 0.9 0.8 0.7 0.6 0.5 0.5 0.6 0.7 0.8 0.9 1.0 Sum-of-exponentials adjusted-r 2 2 Wilcoxon sign rank test, P = 0.0004 Wilcoxon sign rank test, P = 0.03 Wilcoxon sign rank test, P = 0.27 Supplementary Figure 2. Comparison of behavioral fits. (a) Plotted is the adjusted-r-squared for the one-parameter hyperbolic discount function versus the adjusted-r-squared for the one-parameter exponential discount function. Each point represents the fit from a single subject s data from a single paid session. (b) Plotted is the adjusted-r-squared for the two-parameter sum-of-exponentials discount function versus the adjusted-r-squared for the one-parameter exponential discount function. (c) Plotted is the adjusted-r-squared for the one-parameter hyperbolic discount function versus the adjusted-r-squared for the two-parameter sum-of-exponentials discount function.

AMOUNT DELAY CHOICE Ventral striatum Medial prefrontal a b c MR signal (z-normalized) MR signal (z-normalized) 1.0 0.5 0-0.5-0.5 0 8 16 24 0 8 16 24 Time (s) Time (s) Largest 1.0 0.5 0 Max s.e. d e f MR signal (z-normalized) MR signal (z-normalized) 1.0 0.5 0 1.0 0.5 0 Posterior cingulate -0.5 0 8 16 24 Time (s) Smallest -0.5-0.5-0.5 0 8 16 24 0 8 16 24 0 8 16 24 Time (s) Time (s) Time (s) 1 d 10 d 21 d 50 d 90 d 180 d g h i MR signal (z-normalized) 1.0 0.5 0-0.5 0 8 16 24 Time (s) MR signal (z-normalized) 1.0 0.5 0-0.5-0.5 0 8 16 24 0 8 16 24 Time (s) Time (s) Chose Immediate Chose Delayed Supplementary Figure 3. Group average timecourses for each region. Plotted are the trial averages, averaged across all ten subjects, for ventral striatum (a,d,g), medial prefrontal (b,e,h) and posterior cingulate (c,f,i) cortex. Panels (a c) show trial averages separately for each amount associated with the delayed reward, (d f) show trial averages separately for each delay associated with the delayed reward, and (g i) show trial averages separately depending on the subject s choice. Since amounts differed across subjects, data were averaged across subjects using a categorical rank (i.e., largest, smallest). These averages were calculated from the subjective value ROIs used in Figures 5, 6a c and 8a,c,e. The 6 10 s window where we observe significant effects of subjective value is shown in gray. The largest standard error is shown on the right. MR signal (z-normalized) MR signal (z-normalized) MR signal (z-normalized) 1.0 0.5 0 1.0 0.5 0 1.0 0.5 0

MR signal (z-normalized) 7.99 1.76 4.47 10.7 YH KH HM AK 1.55 16.9 4.93 2.27 2.72 0 60 120 180 0 60 120 180 0 60 120 180 0 60 120 180 Delay (d) 3.89 0.07 2.35 1.18 1.69 0.81 0.12 3.31 0.73 1.42 2.48 3.05 MC JH RA AT 3.58 2.15 0.77 1.68 2.23 1.24 0.03 0.31 0.88 0.33 0.71 1.06 0.47 0.58 1.45 2.43 1.82 0 60 120 180 0 60 120 180 1.49 2.19 0 60 120 180 0 60 120 180 1.9 DC 2.84 CH 0.9 1.88 0.1 0.92 1.1 0.04 2.1 1.00 0 60 120 180 0 60 120 180 Supplementary Figure 4. Neural discount functions for all individual subjects. For each of our ten subjects, neural activity, averaged across all three regions within the 6 10 s window, is plotted against the imposed delay to the delayed reward. These plots correspond to the ones shown in Figure 5d f for three subjects. The black line represents average predicted activity at each delay, from the fit of the subjective value regression using a subject-specific discount rate. Predicted activity in this regression model is simply a scaled and shifted version of each subject s behavioral discount function. This regression is also used to scale the y-axis across subjects (see Methods).

Subjective value a β (more impulsive) b δ (more patient) c x = 3 P < 0.005 y=5 z = 34 P < 0.00005 Supplementary Figure 5. Group analysis showing areas correlated with subjective value, a more impulsive (β) estimate of value, and a more patient (δ) estimate of value. Results from a random-effects group analysis are shown, illustrating areas where neural activity during the 6 10 s window was correlated with subjective value (a), a more impulsive (β) estimate of value (b), and a more patient (δ) estimate of value (c). For comparison purposes, we present the same slices shown in Figure 3. This analysis excludes two subjects where the β δ fit collapsed to a single exponential. Data are shown in radiological convention, with the right hemisphere shown on the left.

Supplementary Table 1. Location of effects of the subjective value of the variable delayed reward in a group random-effects analysis using a FIR-type model. Anatomical Description Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/10/9) Posterior Cingulate* (BA 31/23) Superior Temporal Sulcus/ TPO Junction (BA 39/19) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 1, 37, 19 2900 3, 38, 13 3.90 5, 38, 37 1450 3, 43, 37 3.92 54, 61, 16 1543 48, 67, 13 3.52 Ventral Striatum* 11, 5, 1 243 12, 5, 1 3.40 Posterior Dorsal Insula, extending into Pulvinar Posterior Middle Temporal Gyrus (BA 21/22) Anterior Temporal (BA 21) Anterior Dorsal Insula (BA 13) 27, 21, 17 211 21, 25, 13 3.43 63, 41, 2 209 69, 40,1 3.06 45, 3, 23 134 45, 5, 23 3.14 34, 11, 20 120 39, 11, 19 3.41 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. The significance test was a t-test on the subjective value regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 2. Location of effects of the subjective value of the variable delayed reward in a group random-effects analysis using a model that assumes a hemodynamic response function. Anatomical Description Superior Temporal Sulcus/TPO Junction* (BA 39/19) Posterior Cingulate* (BA 31/23) Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/9) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 55, 58, 22 3387 48, 67, 13 3.97 1, 37, 34 2809 6, 37, 37 4.13 4, 36, 29 1575 6, 32, 37 4.03 Ventral Striatum* 12, 2, 2 891 12, 1, 2 3.74 Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/10) Anterior Parietal* (BA 40) Posterior Dorsal Insula,* extending into Pulvinar 5, 40, 7 642 0, 38, 7 3.40 43, 37, 48 571 45, 31, 46 3.56 30, 19, 20 534 33, 16, 22 3.97 Amygdala 18, 10, 11 314 15, 4, 11 3.63 Posterior Middle Frontal Gyrus (BA 6) Posterior Middle Temporal Gyrus (BA 21) 50, 1, 42 240 51, 2, 43 3.13 65, 39, 4 212 66, 40, 2 3.41 Ventral Putamen* 21, 16, 3 153 21, 17, 4 3.83 Anterior Temporal (BA 21) Dorsal Insula (BA 13) Anterior Temporal (BA 38) 45, 3, 23 148 45, 2, 23 3.47 40, 3, 15 147 42, 4, 16 3.10 44, 21, 12 107 42, 20, 11 3.52

To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. The significance test was a t-test on the subjective value regressor associated with the presentation of the variable delayed option.

Supplementary Table 3. Location of effects of the objective amount of the variable delayed reward in a group random-effects analysis. Anatomical Description Medial Prefrontal/Rostral Anterior Cingulate (BA 32/24) Posterior Cingulate (BA 31/23) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 2, 35, 22 548 3, 38, 22 3.37 3, 29, 40 157 3, 28, 40 3.09 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. A cluster < 100 mm 3 was also present in the ventral striatum at this threshold. The significance test was a t- test on the objective amount regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 4. Location of effects of the inverse delay of the variable delayed reward in a group random-effects analysis. Anatomical Description Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/9) Inferior Prefrontal* (BA 46) Medial Prefrontal/Rostral Anterior Cingulate (BA 32/24) Anterior Temporal (BA 38) Visual Cortex* (BA 17/18/19) Visual Cortex* (BA 17/18/19) Visual Cortex (BA 17/18/19) Orbitofrontal (BA 10/11) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 8, 41, 27 1677 12, 38, 22 3.73 49, 33, 9 608 48, 35, 10 3.67 4, 34, 9 251 6, 32, 7 3.03 44, 18, 24 219 45, 17, 26 3.23 12, 84, 4 7086 12, 91, 10 3.92 14, 87, 1 4306 9, 91, 1 5.00 10, 53, 1 259 9, 52, 2 3.02 28, 45, 3 164 27, 44, 2 3.70 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. For regions in italics, the correlation was negative. The significance test was a t- test on the inverse delay regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 5. Location of effects of the subject s choice (chose delayed > chose immediate) in a group random-effects analysis. Anatomical Description Medial Prefrontal (BA 32/10) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 6, 50, 11 215 6, 50, 10 3.41 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. The significance test was a t-test on the choice regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 6. Location of effects, in a group random-effects analysis, of the value of the variable delayed reward calculated using a fixed discount rate (k = 0.01) across all subjects. Anatomical Description Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/10/9) Posterior Middle Temporal Gyrus* (BA 21/22) Superior Temporal Sulcus/ TPO Junction (BA 39) Anterior Temporal (BA 38/21) Superior Frontal (BA 8) Dorsolateral Prefrontal (BA 9) Posterior Cingulate (BA 31/23) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 5, 38, 19 5507 9, 35, 28 4.31 64, 42, 1 616 67, 46, 4 3.86 55, 55, 19 598 57, 52, 22 3.29 43, 5, 23 285 45, 5, 26 3.10 15, 23, 45 226 15, 23, 43 2.99 27, 10, 34 215 27, 8, 34 3.89 8, 44, 39 200 6, 46, 40 3.07 Amygdala 18, 2, 22 178 18, 1, 23 3.29 Medial Prefrontal/Rostral Anterior Cingulate (BA 32/24/10) Posterior Cingulate (BA 31/23) Dorsolateral Prefrontal (BA 9) Posterior Orbitofrontal (BA 13) 11, 42, 11 171 9, 44, 10 3.08 11, 34, 33 162 12, 34, 34 3.41 36, 14, 33 161 33, 14, 31 2.90 18, 12, 11 106 18, 11, 11 3.52 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. The significance test was a t-test on the fixed discount rate value regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 7. Location of effects of choice difficulty in a group random-effects analysis. Anatomical Description Superior Temporal Sulcus/TPO Junction* (BA 40/39) Superior Temporal Gyrus (BA 22) Inferior Parietal (BA 40) Posterior Parietal (BA 7) Posterior Parietal (BA 7) Posterior Middle Temporal Gyrus (BA 21) Dorsolateral Prefrontal (BA 9) Inferior Precentral Gyrus (BA 6) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 56, 41, 27 1802 54, 43, 25 3.80 51, 25, 3 505 51, 28, 7 3.59 49, 37, 31 399 51, 40, 31 3.17 15, 61, 51 201 18, 61, 52 2.92 28, 54, 50 200 27, 55, 49 2.95 59, 52, 0 131 60, 52, 2 3.26 37, 28, 37 124 36, 26, 34 3.25 50, 1, 12 104 51, 1, 13 2.96 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. For regions in italics, the correlation was negative. The significance test was a t- test on the choice difficulty regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 8. Location of effects of reaction time in a group random-effects analysis. Anatomical Description Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score None To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. The significance test was a t-test on the reaction time regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 9. Location of effects, in a group random-effects analysis, of the subjective value of the variable delayed reward calculated using a subject-specific exponential discount function. Anatomical Description Superior Temporal Sulcus/TPO Junction* (BA 39/19) Medial Prefrontal/Rostral Anterior Cingulate (BA 32/24/10/9) Medial Prefrontal/Rostral Anterior Cingulate (BA 32/24/9) Posterior Cingulate* (BA 31/23) Posterior Cingulate* (BA 31/23) Superior Frontal Gyrus (BA 6) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 54, 60, 19 2942 48, 67, 16 4.02 3, 46, 15 974 6, 44, 19 4.05 2, 33, 29 712 9, 32, 28 4.03 6, 38, 35 667 9, 37, 34 3.93 9, 41, 29 359 12, 43, 28 3.48 2, 0, 64 100 0, 1, 64 3.80 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. A cluster < 100 mm 3 was also present in the ventral striatum at this threshold. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. The significance test was a t-test on the subjective value regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 10. Location of effects, in a group random-effects analysis, of the value of the variable delayed reward calculated using a subject-specific β (steep exponential) value function. Anatomical Description Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/10/9) Superior Temporal Sulcus/TPO Junction* (BA 39) Inferior Prefrontal* (BA 44/45) Posterior Middle Temporal Gyrus (BA 21) Medial Prefrontal/Rostral Anterior Cingulate (BA 32/24/9) Posterior Dorsal Insula (BA 13) Anterior Temporal (BA 38) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 9, 44, 20 2857 9, 47, 10 4.04 52, 55, 20 1555 51, 52, 22 3.74 53, 13, 19 738 51, 14, 19 3.63 59, 36, 1 569 63, 46, 4 3.65 18, 46, 18 181 18, 50, 16 3.26 37, 11, 18 178 39, 13, 16 3.14 44, 12, 26 132 45, 11, 26 3.45 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. The significance test was a t-test on the β value regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

Supplementary Table 11. Location of effects, in a group random-effects analysis, of the value of the variable delayed reward calculated using a subject-specific δ (shallow exponential) value function. Anatomical Description Medial Prefrontal/ Rostral Anterior Cingulate* (BA 32/24/9) Posterior Cingulate* (BA 31/23) Inferior Parietal/TPO Junction (BA 39/40) Dorsolateral Prefrontal (BA 46/45) Center-of-Gravity (Talairach) Size (mm 3 ) Peak Location (Talairach) Peak z-score 2, 38, 25 988 3, 41, 22 3.80 2, 35, 35 857 6, 34, 37 3.26 56, 56, 31 798 51, 61, 34 3.29 46, 45, 4 152 48, 47, 7 2.81 To correspond with the figures, all clusters > 100 mm 3 at a voxel-wise threshold of P < 0.005 are reported. A cluster < 100 mm 3 was also present in the ventral striatum at this threshold. Significant activations (voxel-wise threshold of P < 0.001 with an extent > 100 mm 3 ) are in bold and marked with an asterisk. The significance test was a t-test on the δ value regressors for timepoints 4 6 in a trial (a window 6 10 s after the start of the trial).

SUPPLEMENTARY METHODS Payment Mechanism. As mentioned in the main text, because people s decisions involving real gains may differ from those involving hypothetical gains, subjects choices in the experiment had actual monetary consequences. At the end of each session (except for the first behavioral session, which involved only hypothetical choices), subjects rolled dice to randomly select four trials, and they were paid according to their choices on those trials. Subjects also received a flat show-up fee for each session. Paying a subset of choices, rather than every choice, is a validated method within experimental economics to ensure that decisions have actual monetary consequences. However, paying multiple choices, rather than just a single choice in a single session, could induce subjects to adopt a complex strategy that attempts to spread the payments they receive out in time. While we cannot definitively rule out this possibility, we did not observe any evidence for such behavior (see the smoothness of the discount functions in Figs. 2 and 4 and the stability of discount rates across sessions in Supplementary Fig. 2). Furthermore, we felt the risk of encountering such a strategy was worth the increased motivation (because more money was at stake) and increased confidence in the payment mechanism (because of previous experience receiving payments) engendered by paying multiple choices. All payments were made using commercially available pre-paid debit cards. This mechanism helped reduce any concerns subjects may have had about the uncertainties or difficulties associated with future payments. These debit cards could be used to make purchases or withdraw money in the same way as any national credit card. Subjects

received their card after the first session, and payments were loaded onto the card at the time specified by the subjects choices. Subjects were notified by email when payments were loaded. Using this method, future payments were immediately available at the time of delivery, and subjects required little effort to receive them. Participating in multiple sessions helped subjects become familiar with, and confident in, this payment mechanism. By the first scanning session, all subjects had received at least one delayed payment from a previous session. After this session, all subjects expressed high confidence (8 or 9 on a nine-point rating scale) in receiving future payments. Statistical Analyses of fmri Data. As mentioned in the main text, our basic regression model was a variant of a finite-impulse response (FIR) or deconvolution model, which estimated the mean activity and the correlation with the subjective value of the delayed reward separately for each of the first twelve timepoints in a trial. Thus the fmri signal in trial i at timepoint j was modeled as: ## A BOLD i, j = " i & & 1, j %% ( ) SV mean ( + " 2, j + " 3 + * [4]; $ $ 1+ kd i ' ' where A is the objective amount of and D the imposed delay to the delayed reward, k is the subject-specific discount rate estimated behaviorally, and SV mean is the mean subjective value (( A i /(1+kD i ))/number of trials). While our scanner subjects exhibited relatively stable discount rates across sessions (Supplementary Fig. 1), this analysis used the discount rate estimated using only the behavioral data from the scanning session(s) to be conservative. In this regression, β 2 estimates a voxel s average activity above baseline for all trials, while β 1 estimates a voxel s correlation with subjective value

across trials. This regression, when collapsed across amounts, can also be interpreted as scaling and shifting the subject s discount function to fit the neural data, with β 1 scaling and β 2 and β 3 combining to shift the discount function. Figure 4f j plots t-values for the contrast testing for significant effects of subjective value at timepoints 4 6 (β 1,4 + β 1,5 + β 1,6 ), and Figure 3a and Supplementary Table 1 report the results of a group randomeffects analysis for this contrast. Equation [4] was used to produce the fits in Figure 5d f, Figure 7b d and Supplementary Figure 4. These fits were also used to scale the y- axis across subjects in Figure 5d f and Supplementary Figure 4, and across regions-ofinterest (ROIs) in Figure 7b d, by calculating the predicted fmri signal for discount fractions of zero (using the fitted parameters in [4] with A = 0) and one (using the fitted parameters in [4] with D = 0 and averaging over A i ). The y-axis in each graph was then scaled from the neural activity equivalent to a discount fraction of 0.5 to that equivalent to a discount fraction of 1.5. Three models in Figure 3 (also Supplementary Tables 3, 4 and 6) replace the subjective value term in [4] with the objective amount of the larger delayed reward, the inverse of the imposed delay to the larger delayed reward, or the value of the larger delayed reward calculated with a single fixed discount rate (k = 0.01) for all subjects. Two models testing for difficulty effects (Supplementary Tables 7 and 8) replace the subjective value term with the subject s reaction time (only for those trials involving a response) or the distance from the indifference point (1 0.5 cp, where cp is the probability the subject chose the delayed reward for that amount-delay pair). Three additional models (Supplementary Fig. 5, Supplementary Tables 9, 10 and 11) replace the subjective value term with the

value of the larger delayed reward calculated using a subject-specific exponential discount rate (c from equation [2] in the main text), the value of the larger delayed reward calculated using a subject-specific β exponential term (β from equation [3] in the main text), or the value of the larger delayed reward calculated using a subject-specific δ exponential term (δ from equation [3] in the main text). In all cases, these variables were mean-centered. For testing choice effects (Fig. 3d, Supplementary Table 5), calculating trial averages (Fig. 5a c, Supplementary Fig. 3) and constructing unbiased value ROIs, we fit three additional FIR models. These models estimated the average response across trials separately for choices of the immediate and the delayed reward, for each of the six different amounts associated with the variable delayed reward, or for each of the six different delays associated with the variable delayed reward. Finally, we confirmed the results of our subjective value analysis using a model that assumed a hemodynamic response function (Supplementary Table 2). This model included three covariates modeling the presentation of the delayed option, the middle of the delay period, and the cue for the subject to choose, as well as three regressors modeling any parametric modulation of activity for these events by subjective value. Anatomical ROIs were defined in individual subjects in medial prefrontal cortex, posterior cingulate cortex and ventral striatum. The medial prefrontal ROI included all cortex along the midline anterior to the genu of the corpus callosum, the posterior cingulate ROI included the posterior third of the cingulate gyrus, and the ventral striatal ROI included the ventral portions of the caudate and putamen. Voxels were selected within each ROI according to their functional responsiveness in single-subject analyses.

For the subjective value ROIs, voxels were selected based on the subjective value regression, using a cutoff of P < 0.05 (uncorrected) for the contrast testing for an effect of subjective value at timepoints 4 6 ([β 1,4 + β 1,5 + β 1,6 ] from [4] above). Two ROIs were omitted from one subject because no voxels met this criterion. For the unbiased value ROIs, all voxels were selected which exhibited greater activity (P < 0.05, uncorrected, for timepoints 4 6 in the FIR models fitting each amount or delay separately) for either (1) the largest amount compared to the smallest amount of the delayed reward across all delays or (2) the shortest delay compared to the longest delay to the delayed reward across all amounts. One ROI in one subject was omitted because no voxels met this criterion. Activity was averaged across all selected voxels within an ROI, and summed over timepoints 4 6 for each trial. The resulting data, consisting of a single measure of neural activity on each trial, were then regressed against the objective amount of the larger delayed reward: BOLD i = " amount A i + " int + # [5]; as well as the imposed delay to the larger delayed reward: BOLD i = " delay D i + " int + # [6]. Figure 6a,d plots β delay /β amount against the subject s behavioral discount rate (k from equation [1] in the main text). Figure 6d omits two ROIs where β amount was negative, since this inverts the sign of the ratio.

These same data were also fit with a reduced, nonlinear form of equation [4], using an iterative algorithm that minimized least-squared error: ## A BOLD i = " i & & 1 %% ( ) SV mean ( + " 2 + * [7]. $ $ 1+ " k D i ' ' Equation [7] was used to produce the neurometric fits in Figure 7b d, and Figure 6b c,e f compares β k to the behavioral discount rate for each subject (k from equation [1] in the main text). Figure 6e f omits five ROIs where β 1 in equation [7] was not significantly different from zero, since that meant that no discount rate accounted for a significant amount of the variance in neural activity. For the comparison with the β-δ model, the same ROI data were also fit with an exponential version of equation [7]: BOLD i = " 1 A i e #" cd ( i # SV mean ) + " 2 + $ [8]. Figure 8 compares β c to the single exponential discount rate estimated behaviorally for each subject (c in equation [2] in the main text), or to β or δ from the behaviorallyestimated sum of exponentials discount function (equation [3] in the main text). Figure 8b,d,f omits two ROIs where β 1 in equation [8] was not significantly different from zero, since that meant that no discount rate accounted for a significant amount of the variance in neural activity.