Aben B, Stapert S, Blokland A (2012) About the distinction between working memory and short-term memory. Front Psychol 3:301. https://doi.org/10.3389/fpsyg.2012.00301

Article  PubMed  PubMed Central  Google Scholar 

Barak O, Tsodyks M, Romo R (2010) Neuronal population coding of parametric working memory. J Neurosci 30(28):9424–9430. https://doi.org/10.1523/JNEUROSCI.1875-10.2010

Article  CAS  PubMed  PubMed Central  Google Scholar 

Barto AG, Sutton RS, Anderson CW (1983) Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans Syst Man Cybern 13:834–846. https://doi.org/10.1109/TSMC.1983.6313077

Article  Google Scholar 

Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166. https://doi.org/10.1109/72.279181

Article  CAS  PubMed  Google Scholar 

Brody CD, Hernández A, Zainos A, Romo R (2003) Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. Cereb Cortex 13(11):1196–1207. https://doi.org/10.1093/cercor/bhg100

Article  PubMed  Google Scholar 

Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. Eprint Arxiv.(Published online.) https://doi.org/10.48550/arXiv.1412.3555

Cichy RM, Kaiser D (2019) Deep neural networks as scientific models. Trends Cogn Sci 23(4):305–317. https://doi.org/10.1016/j.tics.2019.01.009

Article  PubMed  Google Scholar 

Compte A, Brunel N, Goldman-Rakic PS, Wang XJ (2000) Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cereb Cortex. https://doi.org/10.1093/cercor/10.9.910

Article  PubMed  Google Scholar 

Constantinidis C, Wang XJ (2004) A neural circuit basis for spatial working memory. Neuroscientist 10(6):553–565. https://doi.org/10.1177/1073858404268742

Article  PubMed  Google Scholar 

Constantinidis C, Franowicz MN, Goldman-Rakic PS (2001) Coding specificity in cortical microcircuits: a multiple-electrode analysis of primate prefrontal cortex. J Neurosci 21(10):3646–3655. https://doi.org/10.1523/JNEUROSCI.21-10-03646.2001

Article  CAS  PubMed  PubMed Central  Google Scholar 

Engel TA, Wang XJ (2011) Same or different? A neural circuit mechanism of similarity-based pattern match decision making. J Neurosci 31(19):6982–6996. https://doi.org/10.1523/JNEUROSCI.6150-10.2011

Article  CAS  PubMed  PubMed Central  Google Scholar 

Funahashi S (2017) Working memory in the prefrontal cortex. Brain Sci 7(5):49. https://doi.org/10.3390/brainsci7050049

Article  PubMed  PubMed Central  Google Scholar 

Funahashi S, Takeda K (2002) Population-vector analysis by primate prefrontal neuron activities. J Biol Phys 28(3):527–537. https://doi.org/10.1023/A:1020309916014

Article  CAS  PubMed  PubMed Central  Google Scholar 

Funahashi S, Bruce CJ, Goldman-Rakic PS (1989) Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J Neurophysiol 61(2):331–349. https://doi.org/10.1152/jn.1989.61.2.331

Article  CAS  PubMed  Google Scholar 

Georgopoulos AP, Caminiti R, Kalaska JF, Massey JT (1983) Spatial coding of movement: a hypothesis concerning the coding of movement direction by motor cortical populations. Exp Brain Res 49:327–336. https://doi.org/10.1007/978-3-642-68915-4_34

Article  CAS  PubMed  Google Scholar 

Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233:1416–1419. https://doi.org/10.1126/SCIENCE.3749885

Article  CAS  PubMed  Google Scholar 

Goldman MS (2009) Memory without feedback in a neural network. Neuron 61(4):621–634. https://doi.org/10.1016/j.neuron.2008.12.012

Article  CAS  PubMed  PubMed Central  Google Scholar 

Goldman-Rakic PS (1987) Circuitry of primate prefrontal cortex and regulation of behavior by representational memory. In: Higher functions of the brain, part i, handbook of physiology. Section I: the nervous system, vol V, pp 374–417

Grondman I, Busoniu L, Lopes GAD, Babuska R (2012) A survey of actor-critic reinforcement learning: standard and natural policy gradients. IEEE Trans Syst Man Cybern Part C 42:1291–1307. https://doi.org/10.1109/TSMCC.2012.2218595

Article  Google Scholar 

Ichihara-Takeda S, Funahashi S (2007) Activity of primate orbitofrontal and dorsolateral prefrontal neurons: task-related activity during an oculomotor delayed-response task. Exp Brain Res 181(3):409–425. https://doi.org/10.1007/s00221-007-0941-0

Article  PubMed  Google Scholar 

Jaffe RJ, Constantinidis C (2021) Working memory: from neural activity to the sentient mind. Compr Physiol 11(4):2547–2587. https://doi.org/10.1002/cphy.c210005

Article  PubMed  PubMed Central  Google Scholar 

Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. Comput Sci. https://doi.org/10.48550/arXiv.1412.6980

Article  Google Scholar 

Lara AH, Wallis JD (2015) The role of prefrontal cortex in working memory: a mini review. Front Syst Neurosci 9:173. https://doi.org/10.3389/fnsys.2015.00173

Article  PubMed  PubMed Central  Google Scholar 

Leavitt ML, Pieper F, Sachs AJ, Martinez-Trujillo JC (2018) A quadrantic bias in prefrontal representation of visual-mnemonic space. Cereb Cortex 28(7):2405–2421. https://doi.org/10.1093/cercor/bhx142

Article  PubMed  Google Scholar 

Lee D, Seo H, Jung MW (2012) Neural basis of reinforcement learning and decision making. Annu Rev Neurosci 35:287–308. https://doi.org/10.1146/annurev-neuro-062111-150512

Article  CAS  PubMed  PubMed Central  Google Scholar 

Li L, Li D, Song T, Xu X (2021) Actor-critic learning control with regularization and feature selection in policy gradient estimation. IEEE Trans Neural Netw Learn Syst 32(3):1217–1227. https://doi.org/10.1109/TNNLS.2020.2981377

Article  PubMed  Google Scholar 

Liu YH, Zhu J, Constantinidis C, Zhou X (2021) Emergence of prefrontal neuron maturation properties by training recurrent neural networks in cognitive tasks. iScience. 24(10):103178. https://doi.org/10.1016/j.isci.2021.103178

Article  PubMed  PubMed Central  Google Scholar 

Mante V, Sussillo D, Shenoy KV, Newsome WT (2013) Context dependent computation by recurrent dynamics in prefrontal cortex. Nature 503:78–84. https://doi.org/10.1038/nature12742

Article  CAS  PubMed  PubMed Central  Google Scholar 

Meyers EM, Freedman DJ, Kreiman G, Miller EK, Poggio T (2008) Dynamic population coding of category information in inferior temporal and prefrontal cortex. J Neurophysiol 100(3):1407–1419. https://doi.org/10.1152/jn.90248.2008

Article  PubMed  PubMed Central  Google Scholar 

Murray JD, Bernacchia A, Roy NA, Constantinidis C, Romo R, Wang XJ (2017) Stable population coding for working memory coexists with heterogeneous neural dynamics in prefrontal cortex. Proc Natl Acad Sci USA 114(2):394–399. https://doi.org/10.1073/pnas.1619449114

Article  CAS  PubMed  Google Scholar 

Oja E (1992) Principal components, minor components, and linear neural networks. Neural Netw 5(6):927–935. https://doi.org/10.1016/S0893-6080(05)80089-9

Article