Skip to main content
SpringerLink
Log in

Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice

  • Original Investigation
  • Published:
Psychopharmacology Aims and scope Submit manuscript

Abstract

Rationale

There is evidence that the core of the nucleus accumbens (AcbC) is involved in inter-temporal choice behaviour.

Objective

A new behavioural protocol was used to examine the effect of destruction of the AcbC on delay discounting in inter-temporal choice schedules in rats.

Method

Rats with excitotoxic lesions of the AcbC or sham lesions made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately and a larger reinforcer (B) that was delivered after a delay which increased or decreased depending on the subject’s choices. In two phases of the experiment, reinforcer sizes were selected which enabled theoretical parameters expressing delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays (i.e. the quasi-stable values of the adjusting delay seen after extended training) obtained in the two phases.

Results

In both groups, indifference delays were shorter when the sizes of A and B were 14 and 25 μl than when they were 25 and 100 μl of a 0.6 M sucrose solution. Indifference delays were shorter in AcbC-lesioned than in sham-lesioned rats. Estimates of delay discounting rate based on the ratio of the indifference delays were lower in the AcbC-lesioned than in the sham-lesioned rats. The size sensitivity parameter did not differ between the groups. Adjusting delays in successive blocks of trials were analysed using Fourier transform. The period corresponding to the dominant frequency of the power spectrum and power within the dominant frequency band did not differ between the groups.

Conclusions

Destruction of the AcbC increased the rate of delay discounting.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. ‘Immediate’ (or ‘non-delayed’) reinforcement generally signifies that reinforcer delivery is initiated immediately after the index response has been detected by the programming apparatus. Inevitably, a brief delay occurs before the subject starts to consume the reinforcer (approximately 0.5–1 s in the case of rats performing in the apparatus used in this experiment). This brief delay has been ignored in the derivation of Eqs. 3 and 4 (see Valencia-Torres et al. 2011 for discussion).

References

  • Acheson A, Farrar AM, Patak M, Hausknecht KA, Kieres AK, Choi S, de Wit H, Richards JB (2006) Nucleus accumbens lesions decrease sensitivity to rapid changes in the delay to reinforcement. Behav Brain Res 173:217–228

    Article  PubMed  Google Scholar 

  • Ainslie GW (1974) Impulse control in pigeons. J Exp Anal Behav 21:485–489

    Article  PubMed  CAS  Google Scholar 

  • Ainslie GW (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463–492

    Article  PubMed  CAS  Google Scholar 

  • Ballard K, Knutson B (2009) Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45:143–150

    Article  PubMed  Google Scholar 

  • Basar K, Sesia T, Groenenwegen H, Steinbusch HWM, Visser-Vanderwalle V, Temel Y (2010) Nucleus accumbens and impulsivity. Prog Neurobiol 92:533–557

    Article  PubMed  Google Scholar 

  • Bezzina G, Cheung THC, Asgari K, Hampson CL, Body S, Bradshaw CM, Szabadi E, Anderson IM, Deakin JFW (2007) Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis. Psychopharmacology 195:71–84

    Article  PubMed  CAS  Google Scholar 

  • Bezzina G, Body S, Cheung THC, Hampson CL, Bradshaw CM, Szabadi E, Anderson IM, Deakin JFW (2008) Effect of disconnecting the orbital prefrontal cortex from the nucleus accumbens core on inter-temporal choice behaviour: a quantitative analysis. Behav Brain Res 191:272–279

    Article  PubMed  CAS  Google Scholar 

  • Bezzina G, Cheung THC, Body S, Deakin JFW, Anderson IM, Bradshaw CM, Szabadi E (2009) Quantitative analysis of the effect of lesions of the subthalamic nucleus on inter-temporal choice: further evidence for enhancement of the incentive value of food reinforcers. Behav Pharmac 20:437–446

    Article  CAS  Google Scholar 

  • Bowman EM, Brown VJ (1998) Effects of excitotoxic lesions of the rat ventral striatum on the perception of reward cost. Exp Brain Res 123:439–448

    Article  PubMed  CAS  Google Scholar 

  • Cardinal RN (2006) Neural systems implicated in delayed and probabilistic reinforcement. Neural Netw 19:1277–1301

    Article  PubMed  Google Scholar 

  • Cardinal RN, Cheung THC (2005) Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat. BMC Neurosci 6:9

    Article  PubMed  Google Scholar 

  • Cardinal RN, Howes NJ (2005) Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats. BMC Neurosci 6:37

    Article  PubMed  Google Scholar 

  • Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ (2001) Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292:2499–2501

    Article  PubMed  CAS  Google Scholar 

  • Cardinal RN, Robbins TW, Everitt BJ (2003) Choosing delayed rewards: perspectives from learning theory, neurochemistry, and neuroanatomy. In: Heather N, Vuchinich RE (eds) Choice, behavioral economics and addiction. Elsevier, Oxford, pp 183–213, 217–218

    Chapter  Google Scholar 

  • da Costa Araújo S, Body S, Hampson CL, Langley RW, Deakin JFW, Anderson IM, Bradshaw CM, Szabadi E (2009) Effects of lesions of the nucleus accumbens core on inter-temporal choice: further observations with an adjusting delay procedure. Behav Brain Res 202:272–277

  • da Costa Araújo S, Body S, Valencia-Torres L, Olarte-Sánchez CM, Bak VK, Deakin JFW, Anderson IM, Bradshaw CM, Szabadi E (2010) Choice between reinforcer delays versus between reinforcer magnitudes: Fos expression in the orbital prefrontal cortex and nucleus accumbens core. Behav Brain Res 213:269–277

  • Dalley JW, Mar AC, Economidou D, Robbins TW (2008) Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol Biochem Behav 90:250–260

    Article  PubMed  CAS  Google Scholar 

  • Diergaarde L, Pattij T, Poortvliet I, Hogenboom F, de Vries W, Schoffelmeer ANM, De Vries TJ (2008) Impulsive choice and impulsive action predict vulnerability to distinct stages of nicotine seeking in rats. Biol Psychiat 63:301–308

    Article  PubMed  CAS  Google Scholar 

  • Evenden JL (1999) Varieties of impulsivity. Psychopharmacology 146:348–361

    Article  PubMed  CAS  Google Scholar 

  • Evenden JL, Ryan CN (1996) The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology 128:161–170

    Article  PubMed  CAS  Google Scholar 

  • Floresco SB, St Onge JR, Ghods-Sharifi S, Winstanley CA (2008) Cortico-limbic-striatal circuits subserving different forms of cost–benefit decision making. Cog Affect Behav Neurosci 8:375–389

    Article  Google Scholar 

  • Gregorios-Pippas L, Tobler PN, Schultz W (2009) Short-term temporal discounting of reward value in human ventral striatum. J Neurophysiol 101:1507–1523

    Article  PubMed  Google Scholar 

  • Hariri AR, Brown SM, Williamson DE, Flory JD, de Wit H, Manuck SB (2006) Preference for immediate over delayed rewards is associated with magnitude of ventral striatal activity. J Neurosci 26:13213–13217

    Article  PubMed  CAS  Google Scholar 

  • Ho M-Y, Mobini S, Chiang T-J, Bradshaw CM, Szabadi E (1999) Theory and method in the quantitative analysis of “impulsive choice” behaviour: implications for psychopharmacology. Psychopharmacology 146:362–372

    Article  PubMed  CAS  Google Scholar 

  • Jongen-Relo AL, Feldon J (2002) Specific neuronal protein: a new tool for histological evaluation of excitotoxic lesions. Physiol Behav 76:449–456

    Article  PubMed  CAS  Google Scholar 

  • Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nature Neurosci 10:1625–1633

    Article  PubMed  CAS  Google Scholar 

  • Kable JW, Glimcher PW (2009) The neurobiology of decision: consensus and controversy. Neuron 63:733–745

    Article  PubMed  CAS  Google Scholar 

  • Kheramin S, Body S, Mobini S, Ho M-Y, Velazquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2002) Effects of quinolinic acid-induced lesions of the orbital prefrontal cortex on inter-temporal choice: a quantitative analysis. Psychopharmacology 165:9–17

    Article  PubMed  CAS  Google Scholar 

  • Kheramin S, Body S, Mobini S, Ho M-Y, Velazquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2003) Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis. Behav Proc, 64: 239–250

    Article  Google Scholar 

  • Kheramin S, Body S, Ho M-Y, Velazquez-Martinez DN, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2004) Effects of orbital prefrontal cortex dopamine depletion on inter-temporal choice: a quantitative analysis. Psychopharmacology 175:206–214

    Article  PubMed  CAS  Google Scholar 

  • Kheramin S, Body S, Miranda Herrera F, Bradshaw CM, Szabadi E, Deakin JFW, Anderson IM (2005) The effect of orbital prefrontal cortex lesions on performance on a progressive ratio schedule: implications for models of inter-temporal choice. Behav Brain Res 156:145–152

    Article  PubMed  CAS  Google Scholar 

  • Killeen PR (2009) An additive utility model of delay discounting. Psychol Rev 116:602–619

    Article  PubMed  Google Scholar 

  • Killeen PR (2011) Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid. Behav Proc 87:57–63

    Article  Google Scholar 

  • Laibson DI (1996) An economic perspective on addiction and matching. Behav Brain Sci 19:583–584

    Article  Google Scholar 

  • Madden GJ, Johnson PS (2010) A delay-discounting primer. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 11–37

    Chapter  Google Scholar 

  • Mazur JE (1984) Tests of an equivalence rule for fixed and variable reinforcer delays. J Exp Psychol: Anim Behav Proc 10:426–436

    Article  Google Scholar 

  • Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin HC (eds) Quantitative analyses of behavior: vol. 5. The effect of delay and intervening events on reinforcement value. Erlbaum, Hillsdale, pp 55–73

    Google Scholar 

  • Mazur JE (1988) Estimation of indifference points with an adjusting-delay procedure. J Exp Anal Behav 49:37–47

    Article  PubMed  CAS  Google Scholar 

  • Mazur JE (1997) Choice, delay, probability, and conditioned reinforcement. Anim Learn Behav 25:131–147

    Article  Google Scholar 

  • Mazur JE (2001) Hyperbolic value addition and general models of animal choice. Psychol Rev 108:96–112

    Article  PubMed  CAS  Google Scholar 

  • Mazur JE (2006) Mathematical models and the experimental analysis of behavior. J Exp Anal Behav 85:285–291

    Article  Google Scholar 

  • Mazur JE, Biondi DR (2009) Delay-amount tradeoffs in choices by pigeons and rats: hyperbolic versus exponential discounting. J Exp Anal Behav 91:197–211

    Article  PubMed  Google Scholar 

  • McClure SM, Laibson DI, Loewenstein G, Cohen JD (2004) Separate neural systems value immediate and delayed monetary rewards. Science 306:503–507

    Article  PubMed  CAS  Google Scholar 

  • Odum AL, Baumann AL (2010) Delay discounting: state and trait variable. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 39–65

    Chapter  Google Scholar 

  • Paxinos G, Watson C (1998) The rat brain in stereotaxic coordinates. Academic, New York

    Google Scholar 

  • Pine A, Seymour B, Roiser JP, Bossaerts P, Friston KJ, Curran HV, Dolan RJ (2009) Encoding of marginal utility across time in the human brain. J Neurosci 29:9575–9581

    Article  PubMed  CAS  Google Scholar 

  • Pothuizen HHJ, Jongen-Relo AL, Feldon J, Yee BK (2005) Double dissociation of the effects of selective nucleus accumbens core and shell lesions on impulsive-choice behaviour and salience learning in rats. Eur J Neurosci 22:2605–2616

    Article  PubMed  Google Scholar 

  • Rachlin HC (2006) Notes on discounting. J Exp Anal Behav 85:425–435

    Article  PubMed  Google Scholar 

  • Redish AD, Kurth-Nelson Z (2010) Neural models of delay discounting. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 123–158

    Chapter  Google Scholar 

  • Rickard JF, Zhang Z-Q, Body S, Bradshaw CM, Szabadi E (2009) Effect of reinforcer magnitude on performance maintained by progressive-ratio schedules. J Exp Anal Behav 91:75–87

    Article  PubMed  CAS  Google Scholar 

  • Valencia-Torres L, da Costa Araújo S, Olarte-Sánchez CM, Body S, Bradshaw CM, Szabadi E (2011) Transitional and steady-state choice behavior under an adjusting-delay schedule. J Exp Anal Behav 95:57–74

    Article  Google Scholar 

  • Wallis JD (2007) Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior. Ann NY Acad Sci 1121:447–460

    Article  PubMed  Google Scholar 

  • Weber BJ, Huettel SA (2008) The neural substrates of probabilistic and intertemporal decision making. Brain Res 1234:104–115

    Article  PubMed  CAS  Google Scholar 

  • Williams J (2010) Attention-deficit/hyperactivity disorder and discounting: multiple minor traits and states. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 323–357

    Chapter  Google Scholar 

  • Winstanley CA (2010) The neural and neurochemical basis of discounting. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 95–121

    Chapter  Google Scholar 

  • Wittmann M, Paulus MP (2008) Decision making, impulsivity and time perception. Trends Cog Sci 12:7–12

    Article  Google Scholar 

  • Wittmann M, Leland DS, Paulus MP (2007) Time and decision making: differential contribution of the posterior insular cortex and the striatum during a delay discounting task. Exp Brain Res 179:643–653

    Article  PubMed  Google Scholar 

  • Yi R, Mitchell SH, Bickel WK (2010) Delay discounting and substance abuse-dependence. In: Madden GJ, Bickel WK (eds) Impulsivity: the behavioral and neurological science of discounting. American Psychological Association, Washington, pp 191–211

    Chapter  Google Scholar 

Download references

Acknowledgements

LVT was supported by a scholarship from the National Science Council of Mexico (CONACYT) and CMOS by a UK Medical Research Council (MRC/DTA) scholarship. We are grateful to Ms. V.K. Bak and Mr. R.W. Langley for skilled technical help.

Author information

Authors and Affiliations

  1. Psychopharmacology Section, Division of Psychiatry, University of Nottingham, Room B109, Medical School, Queen’s Medical Centre, Nottingham, NG7 2UH, UK

    L. Valencia-Torres, C. M. Olarte-Sánchez, S. da Costa Araújo, S. Body, C. M. Bradshaw & E. Szabadi

Authors
  1. L. Valencia-Torres
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. M. Olarte-Sánchez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. S. da Costa Araújo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Body
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. C. M. Bradshaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. E. Szabadi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to C. M. Bradshaw.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Valencia-Torres, L., Olarte-Sánchez, C.M., da Costa Araújo, S. et al. Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice. Psychopharmacology 219, 271–283 (2012). https://doi.org/10.1007/s00213-011-2459-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00213-011-2459-1

Keywords

Search

Navigation