Skip to main content
Top
Published in: Brain Structure and Function 1/2022

01-01-2022 | Original Article

To learn or to gain: neural signatures of exploration in human decision-making

Authors: Shanshan Zhen, Zachary A. Yaple, Simon B. Eickhoff, Rongjun Yu

Published in: Brain Structure and Function | Issue 1/2022

Login to get access

Abstract

Individuals not only take actions to obtain immediate rewards but also to gain more information to guide future choices. An ideal exploration–exploitation balance is crucial for maximizing reward over the long run. However, the neural signatures of exploration in humans remain unclear. Using quantitative meta-analyses of functional magnetic resonance imaging experiments on exploratory behaviors, we sought to identify the concordant activity pertaining to exploration over a range of experiments. The results revealed that exploration activates concordant brain activity associated with risk (e.g., dorsal medial prefrontal cortex and anterior insula), cognitive control (e.g., dorsolateral prefrontal cortex and inferior frontal gyrus), and motor processing (e.g., premotor cortex). These stereotaxic maps of exploration may indicate that exploration is highly linked to risk processing, but is also specifically associated with regions involved in executive control processes. Although this explanation should be treated as exploratory, these findings support theories positing an important role for the prefrontal–insular–motor cortical network in exploration.
Appendix
Available only for authorised users
Literature
go back to reference Addicott MA, Pearson JM, Sweitzer MM, Barack DL, Platt ML (2017) A primer on foraging and the explore/exploit trade-off for psychiatry research. Neuropsychopharmacology 42(10):1931PubMedPubMedCentral Addicott MA, Pearson JM, Sweitzer MM, Barack DL, Platt ML (2017) A primer on foraging and the explore/exploit trade-off for psychiatry research. Neuropsychopharmacology 42(10):1931PubMedPubMedCentral
go back to reference Amiez C, Sallet J, Procyk E, Petrides M (2012) Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration. Neuroimage 63(3):1078–1090PubMed Amiez C, Sallet J, Procyk E, Petrides M (2012) Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration. Neuroimage 63(3):1078–1090PubMed
go back to reference Augustsson H, Meyerson BJ (2004) Exploration and risk assessment: a comparative study of male house mice (Mus musculus musculus) and two laboratory strains. Physiol Behav 81(4):685–698PubMed Augustsson H, Meyerson BJ (2004) Exploration and risk assessment: a comparative study of male house mice (Mus musculus musculus) and two laboratory strains. Physiol Behav 81(4):685–698PubMed
go back to reference Badre D, Doll BB, Long NM, Frank MJ (2012) Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron 73(3):595–607PubMedPubMedCentral Badre D, Doll BB, Long NM, Frank MJ (2012) Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron 73(3):595–607PubMedPubMedCentral
go back to reference Beharelle AR, Polanía R, Hare TA, Ruff CC (2015) Transcranial stimulation over frontopolar cortex elucidates the choice attributes and neural mechanisms used to resolve exploration–exploitation trade-offs. J Neurosci 35(43):14544–14556 Beharelle AR, Polanía R, Hare TA, Ruff CC (2015) Transcranial stimulation over frontopolar cortex elucidates the choice attributes and neural mechanisms used to resolve exploration–exploitation trade-offs. J Neurosci 35(43):14544–14556
go back to reference Berlyne DE (1966) Curiosity and exploration. Science 153(3731):25–33PubMed Berlyne DE (1966) Curiosity and exploration. Science 153(3731):25–33PubMed
go back to reference Blanchard TC, Gershman SJ (2018) Pure correlates of exploration and exploitation in the human brain. Cogn Affect Behav Neurosci 18(1):117–126PubMedPubMedCentral Blanchard TC, Gershman SJ (2018) Pure correlates of exploration and exploitation in the human brain. Cogn Affect Behav Neurosci 18(1):117–126PubMedPubMedCentral
go back to reference Blanco NJ, Otto AR, Maddox WT, Beevers CG, Love BC (2013) The influence of depression symptoms on exploratory decision-making. Cognition 129(3):563–568PubMed Blanco NJ, Otto AR, Maddox WT, Beevers CG, Love BC (2013) The influence of depression symptoms on exploratory decision-making. Cognition 129(3):563–568PubMed
go back to reference Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62(5):733–743PubMed Boorman ED, Behrens TE, Woolrich MW, Rushworth MF (2009) How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 62(5):733–743PubMed
go back to reference Bridge DJ, Voss JL (2014a) Active retrieval facilitates across-episode binding by modulating the content of memory. Neuropsychologia 63:154–164PubMedPubMedCentral Bridge DJ, Voss JL (2014a) Active retrieval facilitates across-episode binding by modulating the content of memory. Neuropsychologia 63:154–164PubMedPubMedCentral
go back to reference Bridge DJ, Voss JL (2014b) Hippocampal binding of novel information with dominant memory traces can support both memory stability and change. J Neurosci 34(6):2203–2213PubMedPubMedCentral Bridge DJ, Voss JL (2014b) Hippocampal binding of novel information with dominant memory traces can support both memory stability and change. J Neurosci 34(6):2203–2213PubMedPubMedCentral
go back to reference Bridge DJ, Cohen NJ, Voss JL (2017) Distinct hippocampal versus frontoparietal network contributions to retrieval and memory-guided exploration. J Cogn Neurosci 29(8):1324–1338PubMedPubMedCentral Bridge DJ, Cohen NJ, Voss JL (2017) Distinct hippocampal versus frontoparietal network contributions to retrieval and memory-guided exploration. J Cogn Neurosci 29(8):1324–1338PubMedPubMedCentral
go back to reference Cohen JD, McClure SM, Yu AJ (2007) Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos Trans R Soc B Biol Sci 362(1481):933–942 Cohen JD, McClure SM, Yu AJ (2007) Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philos Trans R Soc B Biol Sci 362(1481):933–942
go back to reference Daw ND, O’doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441(7095):876PubMedPubMedCentral Daw ND, O’doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441(7095):876PubMedPubMedCentral
go back to reference Domenech P, Koechlin E (2015) Executive control and decision-making in the prefrontal cortex. Curr Opin Behav Sci 1:101–106 Domenech P, Koechlin E (2015) Executive control and decision-making in the prefrontal cortex. Curr Opin Behav Sci 1:101–106
go back to reference Donoso M, Collins AG, Koechlin E (2014) Foundations of human reasoning in the prefrontal cortex. Science 344(6191):1481–1486PubMed Donoso M, Collins AG, Koechlin E (2014) Foundations of human reasoning in the prefrontal cortex. Science 344(6191):1481–1486PubMed
go back to reference Eickhoff SB, Laird AR, Grefkes C, Wang LE, Zilles K, Fox PT (2009) Coordinate-based activation likelihood estimation meta-analysis of neuroimaging data: a random-effects approach based on empirical estimates of spatial uncertainty. Hum Brain Mapp 30(9):2907–2926PubMedPubMedCentral Eickhoff SB, Laird AR, Grefkes C, Wang LE, Zilles K, Fox PT (2009) Coordinate-based activation likelihood estimation meta-analysis of neuroimaging data: a random-effects approach based on empirical estimates of spatial uncertainty. Hum Brain Mapp 30(9):2907–2926PubMedPubMedCentral
go back to reference Eickhoff SB, Bzdok D, Laird AR, Roski C, Caspers S, Zilles K, Fox PT (2011) Co-activation patterns distinguish cortical modules, their connectivity and functional differentiation. Neuroimage 57(3):938–949PubMed Eickhoff SB, Bzdok D, Laird AR, Roski C, Caspers S, Zilles K, Fox PT (2011) Co-activation patterns distinguish cortical modules, their connectivity and functional differentiation. Neuroimage 57(3):938–949PubMed
go back to reference Eickhoff SB, Bzdok D, Laird AR, Kurth F, Fox PT (2012) Activation likelihood estimation meta-analysis revisited. Neuroimage 59(3):2349–2361PubMed Eickhoff SB, Bzdok D, Laird AR, Kurth F, Fox PT (2012) Activation likelihood estimation meta-analysis revisited. Neuroimage 59(3):2349–2361PubMed
go back to reference Eickhoff SB, Laird AR, Fox PM, Lancaster JL, Fox PT (2017) Implementation errors in the GingerALE Software: description and recommendations. Hum Brain Mapp 38(1):7–11PubMed Eickhoff SB, Laird AR, Fox PM, Lancaster JL, Fox PT (2017) Implementation errors in the GingerALE Software: description and recommendations. Hum Brain Mapp 38(1):7–11PubMed
go back to reference Elliott R (2003) Executive functions and their disorders: Imaging in clinical neuroscience. Br Med Bull 65(1):49–59PubMed Elliott R (2003) Executive functions and their disorders: Imaging in clinical neuroscience. Br Med Bull 65(1):49–59PubMed
go back to reference Frank MJ, Scheres A, Sherman SJ (2007) Understanding decision-making deficits in neurological conditions: insights from models of natural action selection. Philos Trans R Soc B Biol Sci 362(1485):1641–1654 Frank MJ, Scheres A, Sherman SJ (2007) Understanding decision-making deficits in neurological conditions: insights from models of natural action selection. Philos Trans R Soc B Biol Sci 362(1485):1641–1654
go back to reference Frank MJ, Doll BB, Oas-Terpstra J, Moreno F (2009) Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12(8):1062PubMedPubMedCentral Frank MJ, Doll BB, Oas-Terpstra J, Moreno F (2009) Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nat Neurosci 12(8):1062PubMedPubMedCentral
go back to reference Gorgolewski KJ, Varoquaux G, Rivera G, Schwarz Y, Ghosh SS, Maumet C et al (2015) NeuroVault. org: a web-based repository for collecting and sharing unthresholded statistical maps of the human brain. Front Neuroinform 9:8PubMedPubMedCentral Gorgolewski KJ, Varoquaux G, Rivera G, Schwarz Y, Ghosh SS, Maumet C et al (2015) NeuroVault. org: a web-based repository for collecting and sharing unthresholded statistical maps of the human brain. Front Neuroinform 9:8PubMedPubMedCentral
go back to reference Hassall C, Holland K, Krigolson O (2013) What do I do now? An electroencephalographic investigation of the explore/exploit dilemma. Neuroscience 228:361–370PubMed Hassall C, Holland K, Krigolson O (2013) What do I do now? An electroencephalographic investigation of the explore/exploit dilemma. Neuroscience 228:361–370PubMed
go back to reference Howard-Jones PA, Bogacz R, Yoo JH, Leonards U, Demetriou S (2010) The neural mechanisms of learning from competitors. Neuroimage 53(2):790–799PubMed Howard-Jones PA, Bogacz R, Yoo JH, Leonards U, Demetriou S (2010) The neural mechanisms of learning from competitors. Neuroimage 53(2):790–799PubMed
go back to reference Iordanova MD, Good M, Honey RC (2011) Retrieval-mediated learning involving episodes requires synaptic plasticity in the hippocampus. J Neurosci 31(19):7156–7162PubMedPubMedCentral Iordanova MD, Good M, Honey RC (2011) Retrieval-mediated learning involving episodes requires synaptic plasticity in the hippocampus. J Neurosci 31(19):7156–7162PubMedPubMedCentral
go back to reference Ishii H, Ohara S, Tobler PN, Tsutsui K-I, Iijima T (2015) Dopaminergic and serotonergic modulation of anterior insular and orbitofrontal cortex function in risky decision making. Neurosci Res 92:53–61PubMed Ishii H, Ohara S, Tobler PN, Tsutsui K-I, Iijima T (2015) Dopaminergic and serotonergic modulation of anterior insular and orbitofrontal cortex function in risky decision making. Neurosci Res 92:53–61PubMed
go back to reference Johnson A, Varberg Z, Benhardus J, Maahs A, Schrater P (2012) The hippocampus and exploration: dynamically evolving behavior and neural representations. Front Hum Neurosci 6:216PubMedPubMedCentral Johnson A, Varberg Z, Benhardus J, Maahs A, Schrater P (2012) The hippocampus and exploration: dynamically evolving behavior and neural representations. Front Hum Neurosci 6:216PubMedPubMedCentral
go back to reference Kayser AS, Op de Macks Z, Dahl RE, Frank MJ (2016) A neural correlate of strategic exploration at the onset of adolescence. J Cogn Neurosci 28(2):199–209PubMed Kayser AS, Op de Macks Z, Dahl RE, Frank MJ (2016) A neural correlate of strategic exploration at the onset of adolescence. J Cogn Neurosci 28(2):199–209PubMed
go back to reference Koot S, Zoratto F, Cassano T, Colangeli R, Laviola G, Van Den Bos R, Adriani W (2012) Compromised decision-making and increased gambling proneness following dietary serotonin depletion in rats. Neuropharmacology 62(4):1640–1650PubMed Koot S, Zoratto F, Cassano T, Colangeli R, Laviola G, Van Den Bos R, Adriani W (2012) Compromised decision-making and increased gambling proneness following dietary serotonin depletion in rats. Neuropharmacology 62(4):1640–1650PubMed
go back to reference Krain AL, Wilson AM, Arbuckle R, Castellanos FX, Milham MP (2006) Distinct neural mechanisms of risk and ambiguity: a meta-analysis of decision-making. Neuroimage 32(1):477–484PubMed Krain AL, Wilson AM, Arbuckle R, Castellanos FX, Milham MP (2006) Distinct neural mechanisms of risk and ambiguity: a meta-analysis of decision-making. Neuroimage 32(1):477–484PubMed
go back to reference Laureiro-Martínez D, Canessa N, Brusoni S, Zollo M, Hare T, Alemanno F, Cappa SF (2014) Frontopolar cortex and decision-making efficiency: comparing brain activity of experts with different professional background during an exploration-exploitation task. Front Hum Neurosci 7:927PubMedPubMedCentral Laureiro-Martínez D, Canessa N, Brusoni S, Zollo M, Hare T, Alemanno F, Cappa SF (2014) Frontopolar cortex and decision-making efficiency: comparing brain activity of experts with different professional background during an exploration-exploitation task. Front Hum Neurosci 7:927PubMedPubMedCentral
go back to reference Laureiro-Martínez D, Brusoni S, Canessa N, Zollo M (2015) Understanding the exploration–exploitation dilemma: an fMRI study of attention control and decision-making performance. Strateg Manag J 36(3):319–338 Laureiro-Martínez D, Brusoni S, Canessa N, Zollo M (2015) Understanding the exploration–exploitation dilemma: an fMRI study of attention control and decision-making performance. Strateg Manag J 36(3):319–338
go back to reference Liu X, Hairston J, Schrier M, Fan J (2011) Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci Biobehav Rev 35(5):1219–1236PubMed Liu X, Hairston J, Schrier M, Fan J (2011) Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci Biobehav Rev 35(5):1219–1236PubMed
go back to reference Long AB, Kuhn CM, Platt ML (2009) Serotonin shapes risky decision making in monkeys. Soc Cogn Affect Neurosci 4(4):346–356PubMedPubMedCentral Long AB, Kuhn CM, Platt ML (2009) Serotonin shapes risky decision making in monkeys. Soc Cogn Affect Neurosci 4(4):346–356PubMedPubMedCentral
go back to reference Lottem E, Banerjee D, Vertechi P, Sarra D, oude Lohuis M, Mainen ZF (2018) Activation of serotonin neurons promotes active persistence in a probabilistic foraging task. Nat Commun 9(1):1–12 Lottem E, Banerjee D, Vertechi P, Sarra D, oude Lohuis M, Mainen ZF (2018) Activation of serotonin neurons promotes active persistence in a probabilistic foraging task. Nat Commun 9(1):1–12
go back to reference Macrı̀ S, Adriani W, Chiarotti F, Laviola G (2002) Risk taking during exploration of a plus-maze is greater in adolescent than in juvenile or adult mice. Anim Behav 64(4):541–546 Macrı̀ S, Adriani W, Chiarotti F, Laviola G (2002) Risk taking during exploration of a plus-maze is greater in adolescent than in juvenile or adult mice. Anim Behav 64(4):541–546
go back to reference Mansouri FA, Buckley MJ, Mahboubi M, Tanaka K (2015) Behavioral consequences of selective damage to frontal pole and posterior cingulate cortices. Proc Natl Acad Sci 112(29):E3940–E3949PubMedPubMedCentral Mansouri FA, Buckley MJ, Mahboubi M, Tanaka K (2015) Behavioral consequences of selective damage to frontal pole and posterior cingulate cortices. Proc Natl Acad Sci 112(29):E3940–E3949PubMedPubMedCentral
go back to reference Mansouri FA, Koechlin E, Rosa MG, Buckley MJ (2017) Managing competing goals—a key role for the frontopolar cortex. Nat Rev Neurosci 18(11):645PubMed Mansouri FA, Koechlin E, Rosa MG, Buckley MJ (2017) Managing competing goals—a key role for the frontopolar cortex. Nat Rev Neurosci 18(11):645PubMed
go back to reference Mills-Finnerty C, Hanson C, Hanson SJ (2014) Brain network response underlying decisions about abstract reinforcers. Neuroimage 103:48–54PubMed Mills-Finnerty C, Hanson C, Hanson SJ (2014) Brain network response underlying decisions about abstract reinforcers. Neuroimage 103:48–54PubMed
go back to reference Mobbs D, Hassabis D, Yu R, Chu C, Rushworth M, Boorman E, Dalgleish T (2013) Foraging under competition: the neural basis of input-matching in humans. J Neurosci 33(23):9866–9872PubMedPubMedCentral Mobbs D, Hassabis D, Yu R, Chu C, Rushworth M, Boorman E, Dalgleish T (2013) Foraging under competition: the neural basis of input-matching in humans. J Neurosci 33(23):9866–9872PubMedPubMedCentral
go back to reference Morris LS, Baek K, Kundu P, Harrison NA, Frank MJ, Voon V (2016) Biases in the explore–exploit tradeoff in addictions: the role of avoidance of uncertainty. Neuropsychopharmacology 41(4):940PubMed Morris LS, Baek K, Kundu P, Harrison NA, Frank MJ, Voon V (2016) Biases in the explore–exploit tradeoff in addictions: the role of avoidance of uncertainty. Neuropsychopharmacology 41(4):940PubMed
go back to reference Murphy SE, Longhitano C, Ayres RE, Cowen PJ, Harmer CJ, Rogers RD (2009) The role of serotonin in nonnormative risky choice: the effects of tryptophan supplements on the “reflection effect” in healthy adult volunteers. J Cogn Neurosci 21(9):1709–1719PubMed Murphy SE, Longhitano C, Ayres RE, Cowen PJ, Harmer CJ, Rogers RD (2009) The role of serotonin in nonnormative risky choice: the effects of tryptophan supplements on the “reflection effect” in healthy adult volunteers. J Cogn Neurosci 21(9):1709–1719PubMed
go back to reference Ohira H, Matsunaga M, Murakami H, Osumi T, Fukuyama S, Shinoda J, Yamada J (2013) Neural mechanisms mediating association of sympathetic activity and exploration in decision-making. Neuroscience 246:362–374PubMed Ohira H, Matsunaga M, Murakami H, Osumi T, Fukuyama S, Shinoda J, Yamada J (2013) Neural mechanisms mediating association of sympathetic activity and exploration in decision-making. Neuroscience 246:362–374PubMed
go back to reference Pollmann S (2016) Frontopolar resource allocation in human and nonhuman primates. Trends Cogn Sci 20(2):84–86PubMed Pollmann S (2016) Frontopolar resource allocation in human and nonhuman primates. Trends Cogn Sci 20(2):84–86PubMed
go back to reference Reed M, Vanicek T, Seiger R, Klöbl M, Spurny B, Handschuh P et al (2021) Neuroplastic effects of a selective serotonin reuptake inhibitor in relearning and retrieval. Neuroimage 236:118039PubMed Reed M, Vanicek T, Seiger R, Klöbl M, Spurny B, Handschuh P et al (2021) Neuroplastic effects of a selective serotonin reuptake inhibitor in relearning and retrieval. Neuroimage 236:118039PubMed
go back to reference Reiter AM, Heinze H-J, Schlagenhauf F, Deserno L (2017) Impaired flexible reward-based decision-making in binge eating disorder: evidence from computational modeling and functional neuroimaging. Neuropsychopharmacology 42(3):628–637PubMed Reiter AM, Heinze H-J, Schlagenhauf F, Deserno L (2017) Impaired flexible reward-based decision-making in binge eating disorder: evidence from computational modeling and functional neuroimaging. Neuropsychopharmacology 42(3):628–637PubMed
go back to reference Rogers RD (2011) The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans. Neuropsychopharmacology 36(1):114–132PubMed Rogers RD (2011) The roles of dopamine and serotonin in decision making: evidence from pharmacological experiments in humans. Neuropsychopharmacology 36(1):114–132PubMed
go back to reference Rolls ET, McCabe C, Redoute J (2007) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex 18(3):652–663PubMed Rolls ET, McCabe C, Redoute J (2007) Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb Cortex 18(3):652–663PubMed
go back to reference Rudorf S, Preuschoff K, Weber B (2012) Neural correlates of anticipation risk reflect risk preferences. J Neurosci 32(47):16683–16692PubMedPubMedCentral Rudorf S, Preuschoff K, Weber B (2012) Neural correlates of anticipation risk reflect risk preferences. J Neurosci 32(47):16683–16692PubMedPubMedCentral
go back to reference Seymour B, Daw ND, Roiser JP, Dayan P, Dolan R (2012) Serotonin selectively modulates reward value in human decision-making. J Neurosci 32(17):5833–5842PubMedPubMedCentral Seymour B, Daw ND, Roiser JP, Dayan P, Dolan R (2012) Serotonin selectively modulates reward value in human decision-making. J Neurosci 32(17):5833–5842PubMedPubMedCentral
go back to reference Symmonds M, Wright ND, Bach DR, Dolan RJ (2011) Deconstructing risk: separable encoding of variance and skewness in the brain. Neuroimage 58(4):1139–1149PubMed Symmonds M, Wright ND, Bach DR, Dolan RJ (2011) Deconstructing risk: separable encoding of variance and skewness in the brain. Neuroimage 58(4):1139–1149PubMed
go back to reference Tamm L, Menon V, Ringel J, Reiss AL (2004) Event-related FMRI evidence of frontotemporal involvement in aberrant response inhibition and task switching in attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry 43(11):1430–1440PubMed Tamm L, Menon V, Ringel J, Reiss AL (2004) Event-related FMRI evidence of frontotemporal involvement in aberrant response inhibition and task switching in attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry 43(11):1430–1440PubMed
go back to reference Thorndike EL (1927) The law of effect. Am J Psychol 39(1/4):212–222 Thorndike EL (1927) The law of effect. Am J Psychol 39(1/4):212–222
go back to reference Thorndike EL (1933) A proof of the law of effect. Science 77(1989):173–175PubMed Thorndike EL (1933) A proof of the law of effect. Science 77(1989):173–175PubMed
go back to reference Tomov M, Truong V, Hundia R, Gershman S (2018). Dissociable neural correlates of uncertainty underlie different exploration strategies. bioRxiv 478131 Tomov M, Truong V, Hundia R, Gershman S (2018). Dissociable neural correlates of uncertainty underlie different exploration strategies. bioRxiv 478131
go back to reference Tomov MS, Truong VQ, Hundia RA, Gershman SJ (2020) Dissociable neural correlates of uncertainty underlie different exploration strategies. Nat Commun 11(1):1–12 Tomov MS, Truong VQ, Hundia RA, Gershman SJ (2020) Dissociable neural correlates of uncertainty underlie different exploration strategies. Nat Commun 11(1):1–12
go back to reference Turkeltaub PE, Eden GF, Jones KM, Zeffiro TA (2002) Meta-analysis of the functional neuroanatomy of single-word reading: method and validation. Neuroimage 16(3):765–780PubMed Turkeltaub PE, Eden GF, Jones KM, Zeffiro TA (2002) Meta-analysis of the functional neuroanatomy of single-word reading: method and validation. Neuroimage 16(3):765–780PubMed
go back to reference Turkeltaub PE, Eickhoff SB, Laird AR, Fox M, Wiener M, Fox P (2012) Minimizing within-experiment and within-group effects in activation likelihood estimation meta-analyses. Hum Brain Mapp 33(1):1–13PubMed Turkeltaub PE, Eickhoff SB, Laird AR, Fox M, Wiener M, Fox P (2012) Minimizing within-experiment and within-group effects in activation likelihood estimation meta-analyses. Hum Brain Mapp 33(1):1–13PubMed
go back to reference Wallsten TS, Pleskac TJ, Lejuez CW (2005) Modeling behavior in a clinically diagnostic sequential risk-taking task. Psychol Rev 112(4):862PubMed Wallsten TS, Pleskac TJ, Lejuez CW (2005) Modeling behavior in a clinically diagnostic sequential risk-taking task. Psychol Rev 112(4):862PubMed
go back to reference Wang JX, Voss JL (2014) Brain networks for exploration decisions utilizing distinct modeled information types during contextual learning. Neuron 82(5):1171–1182PubMedPubMedCentral Wang JX, Voss JL (2014) Brain networks for exploration decisions utilizing distinct modeled information types during contextual learning. Neuron 82(5):1171–1182PubMedPubMedCentral
go back to reference Wang JX, Cohen NJ, Voss JL (2015) Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal–prefrontal interactions for adaptive behavior. Neurobiol Learn Mem 117:22–33PubMed Wang JX, Cohen NJ, Voss JL (2015) Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal–prefrontal interactions for adaptive behavior. Neurobiol Learn Mem 117:22–33PubMed
go back to reference Wittmann BC, Daw ND, Seymour B, Dolan RJ (2008) Striatal activity underlies novelty-based choice in humans. Neuron 58(6):967–973PubMedPubMedCentral Wittmann BC, Daw ND, Seymour B, Dolan RJ (2008) Striatal activity underlies novelty-based choice in humans. Neuron 58(6):967–973PubMedPubMedCentral
go back to reference Wu S, Sun S, Camilleri JA, Eickhoff SB, Yu R (2021) Better the devil you know than the devil you don’t: neural processing of risk and ambiguity. Neuroimage 236:118109PubMed Wu S, Sun S, Camilleri JA, Eickhoff SB, Yu R (2021) Better the devil you know than the devil you don’t: neural processing of risk and ambiguity. Neuroimage 236:118109PubMed
go back to reference Yarkoni T, Poldrack RA, Nichols TE, Van Essen DC, Wager TD (2011) Large-scale automated synthesis of human functional neuroimaging data. Nat Methods 8(8):665PubMedPubMedCentral Yarkoni T, Poldrack RA, Nichols TE, Van Essen DC, Wager TD (2011) Large-scale automated synthesis of human functional neuroimaging data. Nat Methods 8(8):665PubMedPubMedCentral
Metadata
Title
To learn or to gain: neural signatures of exploration in human decision-making
Authors
Shanshan Zhen
Zachary A. Yaple
Simon B. Eickhoff
Rongjun Yu
Publication date
01-01-2022
Publisher
Springer Berlin Heidelberg
Published in
Brain Structure and Function / Issue 1/2022
Print ISSN: 1863-2653
Electronic ISSN: 1863-2661
DOI
https://doi.org/10.1007/s00429-021-02389-3

Other articles of this Issue 1/2022

Brain Structure and Function 1/2022 Go to the issue