Andrade C (2017) Ketamine for depression, 1: clinical summary of issues related to efficacy, adverse effects, and mechanism of action. J Clin Psychiatry 78(04):e415–e419. https://doi.org/10.4088/jcp.17f11567

Article  PubMed  Google Scholar 

Armbruster DJN, Ueltzhoffer K, Basten U, Fiebach CJ (2012) Prefrontal cortical mechanisms underlying individual differences in cognitive flexibility and stability. J Cogn Neurosci 24(12):2385–2399. https://doi.org/10.1162/jocn_a_00286

Article  PubMed  Google Scholar 

Bari A, Theobald DE, Caprioli D, Mar AC, Aidoo-Micah A, Dalley JW, Robbins TW (2010) Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats. Neuropsychopharmacology 35:1290–1301. https://doi.org/10.1038/npp.2009.233

Article  CAS  PubMed  PubMed Central  Google Scholar 

Bartsch CJ, Aaflaq S, Jacobs JT, Smith M, Summa F, Skinner S … Nordman JC (2023) A single dose of ketamine enhances early life stress-induced aggression with no effect on fear memory, anxiety-like behavior, or depression-like behavior in mice. Behav Neurosci. Advance online publication. https://doi.org/10.1037/bne0000560

Berman RM, Cappiello A, Amand A, Oren DA, Heninger GR, Charney DS, Krystal JH (2000) Antidepressant effects of ketamine in depressed patients. Biol Psychiat 47(4):351–354. https://doi.org/10.1016/s0006-3223(99)00230-9

Article  CAS  PubMed  Google Scholar 

Brendle M, Ragnhildstveit A, Slayton M (2023) Registered clinical trials investigating ketamine and esketamine for treatment-resistant depression: a systematic review. J Psychedelic Stud 6(3):176–187. https://doi.org/10.1556/2054.2022.00234

Article  Google Scholar 

Brolsma SCA, Vrijsen JN, Vassena E, Kandroodi RM, Bergman MA, van Eijndhoven PF … Cools R (2022) Challenging the negative learning bias hypothesis of depression: reversal learning in a naturalistic psychiatric sample. Psychol Med 52(2):303–313. https://doi.org/10.1017/s0033291720001956

Cools R, Barker RA, Sahakian BJ, Robbins TW (2001) Enhanced or impaired cognitive function in Parkinson’s disease as a function of dopaminergic medication and task demands. Cereb Cortex 11(12):1136–1143. https://doi.org/10.1093/cercor/11.12.1136

Article  CAS  PubMed  Google Scholar 

Craske MG, Meuret AE, Ritz T, Treanor M, Dour HJ (2016) Treatment for anhedonia: a neuroscience driven approach. Depress Anxiety 33:927–938. https://doi.org/10.1002/da.22490

Article  PubMed  Google Scholar 

Dajani DR, Uddin LQ (2015) Demystifying cognitive flexibility: implications for clinical and developmental neuroscience. Trends Neurosci 38(9):571–578. https://doi.org/10.1016/j.tins.2015.07.003

Article  CAS  PubMed  PubMed Central  Google Scholar 

Dix S, Gilmour G, Potts S, Smith JW, Tricklebank M (2010) A within-subject cognitive battery in the rat: differential effects of NMDA receptor antagonists. Psychopharmacology 212:227–242. https://doi.org/10.1007/s00213-010-1945-1

Article  CAS  PubMed  Google Scholar 

Drozd R, Rychlik M, Fijalkowska A, Rygula R (2019) Effects of cognitive judgement bias and acute antidepressant treatment on sensitivity to feedback and cognitive flexibility in the rat version of the probabilistic reversal-learning test. Behav Brain Res 359:619–629. https://doi.org/10.1016/j.bbr.2018.10.003

Article  CAS  PubMed  Google Scholar 

Eshel N, Roiser JP (2010) Reward and punishment processing in depression. Biol Psychiat 68:118–124. https://doi.org/10.1016/j.biopsych.2010.01.027

Article  PubMed  Google Scholar 

Everleigh R, Speckens A, van Weel C, Oude Voshaar R, Lucassen P (2019) Patients’ attitudes to discontinuing not-indicated long-term antidepressant use: barriers and facilitators. Ther Adv Psychopharmacol 9:1–9. https://doi.org/10.1177/2045125319872344

Article  Google Scholar 

Fleshler M, Hoffman HS (1962) A progression for generating variable-interval schedules. J Exp Anal Behav 5(4):529–530. https://doi.org/10.1901/jeab.1962.5-529

Article  CAS  PubMed  PubMed Central  Google Scholar 

Fontes RM, Shahan TA (2021) Punishment and its putative fallout: a reappraisal. J Exp Anal Behav 115(1):185–203. https://doi.org/10.1002/jeab.653

Article  PubMed  Google Scholar 

Gastambide F, Mitchell SN, Robbins TW, Tricklebank MD, Gilmour G (2013) Temporally distinct cognitive effects following acute administration of ketamine and phencyclidine in the rat. Eur Neuropsychopharmacol 23:1414–1422. https://doi.org/10.1016/j.euroneuro.2013.03.002

Article  CAS  PubMed  Google Scholar 

Hackenberg TD, DeFulio A (2007) Timeout from reinforcement: restoring a balance between analysis and application. Mexican J Behav Anal 33:37–44

Google Scholar 

Hamilton DA, Brigman JL (2015) Behavioral flexibility in rats and mice: contributions of distinct frontocortical regions. Genes Brain Behav 14:4–21. https://doi.org/10.1111/gbb.12191

Article  CAS  PubMed  Google Scholar 

Hawley CJ, Pattinson HA, Quick SJ, Echlin D, Smith V, McPhee S, Sivakumaran T (1998) A protocol for the pharmacologic treatment of major depression: a field test of a potential prototype. J Affect Disord 47:87–96. https://doi.org/10.1016/s0165-0327(97)00124-9

Article  CAS  PubMed  Google Scholar 

Huys QJM, Pizzagalli DA, Bogdan R, Dayan P (2013) Mapping anhedonia onto reinforcement learning: a behavioral meta-analysis. Biol Mood Anxiety Disord 3:12. https://doi.org/10.1186/2045-5380-3-12

Article  PubMed  PubMed Central  Google Scholar 

Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, Sanislow C, Wang P (2010) Research Domain Criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry 167(7):748–751. https://doi.org/10.1176/appi.ajp.2010.09091379

Article  PubMed  Google Scholar 

Jelen LA, Stone JM (2021) Ketamine for depression. Int Rev Psychiatry 33(3):207–228. https://doi.org/10.1080/09540261.2020.1854194

Article  PubMed  Google Scholar 

Kandroodi MR, Cook JL, Swart JC, Frobose MI, Geurts DEM, Vahabie AH … den Ouden HEM (2021) Effects of methylphenidate on reinforcement learning depend on working memory capacity. Psychopharmacology 238(12):3569–3584. https://doi.org/10.1007/s00213-021-05974-w

Kanen JW, Ersche KD, Fineberg NA, Robbins TW, Cardinal RN (2019) Computational modeling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2/3 receptor agents. Psychopharmacology 236:2337–2358. https://doi.org/10.1007/s00213-019-05325-w

Article  CAS  PubMed  PubMed Central  Google Scholar 

Kanen JW, Luo Q, Kandroodi MR, Cardinal RN, Robbins TW, Nutt D … den Ouden HEM (2022) Effect of lysergic acid diethylamide (LSD) on reinforcement learning in humans. Psychol Med 1–12. https://doi.org/10.1017/S0033291722002963

Kangas BD (2022) Examining the effects of psychoactive drugs on complex behavioral processes in laboratory animals. Adv Pharmacol 93:243–274. https://doi.org/10.1016/bs.apha.2021.09.001

Article  CAS  PubMed  Google Scholar 

Kangas BD, Der-Avakian A, Pizzagalli DA (2022) Probabilistic reinforcement learning and anhedonia. In: Pizzagalli DA (eds) Anhedonia: preclinical, translational, and clinical integration. Curr Top Behav Neurosci 58. Springer, Cham. https://doi.org/10.1007/7854_2022_349

Kehagia AA, Murray GK, Robbins TW (2010) Learning and cognitive flexibility: frontostriatal function and monoaminergic modulation. Curr Opin Neurobiol 20:199–204. https://doi.org/10.1016/j.conb.2010.01.007

Article  CAS  PubMed  Google Scholar 

Kieslich K, Valton V, Roiser JP (2022) Pleasure, reward value, prediction error and anhedonia. In: Pizzagalli DA (eds) Anhedonia: preclinical, translational, and clinical integration. Curr Top Behav Neurosci 58. Springer, Cham. https://doi.org/10.1007/7854_2021_295

Kishimoto T, Chawla JM, Hagi K, Zarate CA, Kane JM, Bauer M, Correll CU (2016) Single-dose infusion ketamine and non-ketamine N-methyl-d aspartate receptor antagonists for unipolar and bipolar depression: a meta-analysis of efficacy, safety and time trajectories. Psychol Med 46(7):1459–1472. https://doi.org/10.1017/s0033291716000064

Article  CAS  PubMed  PubMed Central  Google Scholar 

Lawrence AD, Sahakian BJ, Rogers RD, Hodges JR, Robbins TW (1999) Discrimination, reversal, and shift learning in Huntington’s disease: mechanisms of impaired response selection. Neuropsychologia 37:1359–1374. https://doi.org/10.1016/s0028-3932(99)00035-4

Article  CAS  PubMed  Google Scholar 

Leitenberg H (1965) Is time-out from positive reinforcement an aversive event? A review of the experimental evidence. Psychol Bull 64(6):428–441. https://doi.org/10.1037/h0022657

Article  CAS  PubMed  Google Scholar 

Machado-Viera R, Salvadore G, Luckenbaugh DA, Manji HK, Zarate CA (2008) Rapid onset of antidepressant action: a new paradigm in the research and treatment of major depression. J Clin Psychiatry 69(6):946–958. https://doi.org/10.4088/jcp.v69n0610