Regulation of reinforcement learning parameters captures long-term changes in rat behaviour

Cinotti, F. ORCID: https://orcid.org/0000-0003-2921-0901, Coutureau, E., Khamassi, M., Marchand, A. R. and Girard, B. (2024) Regulation of reinforcement learning parameters captures long-term changes in rat behaviour. European Journal of Neuroscience. ISSN 1460-9568 doi: 10.1111/ejn.16449

Abstract/Summary

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade-off has been extensively studied in pretrained animals facing non-stationary decision-making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long-term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three-armed bandit task across 24 days of pretraining. We found that the day-by-day evolution of rat performance and win-shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta-learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/117387
Item Type	Article
Refereed	Yes
Divisions	Life Sciences > School of Psychology and Clinical Language Sciences > Department of Psychology
Publisher	Wiley
Download/View statistics	View download statistics for this item