2025
Behavior engineering using quantitative reinforcement learning models
Dan O, Plonsky O, Loewenstein Y. Behavior engineering using quantitative reinforcement learning models. Nature Communications 2025, 16: 4109. PMID: 40316521, PMCID: PMC12048583, DOI: 10.1038/s41467-025-58888-y.Peer-Reviewed Original ResearchConceptsTwo-alternative taskReinforcement learning modelModel of choiceReward schedulePsychological principlesMethods of model comparisonEffects of engineeringCognitive scienceExperimental participantsShape behaviorQuantitative modelTheoretical importanceAnimal behaviorLearning modelsEngine behaviorBehavioral engineeringEngineeringEngineering approachModel comparisonTaskAcademic competitionQualitative principlesCurrent interpretations of the I-PACE model of behavioral addictions
Brand M, Müller A, Wegmann E, Antons S, Brandtner A, Müller S, Stark R, Steins-Loeber S, Potenza M. Current interpretations of the I-PACE model of behavioral addictions. Journal Of Behavioral Addictions 2025, 14: 1-17. PMID: 40063161, PMCID: PMC11974429, DOI: 10.1556/2006.2025.00020.Peer-Reviewed Original ResearchMeSH KeywordsBehavior, AddictiveCognitionCompulsive BehaviorExecutive FunctionHumansImpulsive BehaviorModels, PsychologicalReinforcement, PsychologySelf-ControlConceptsI-PACE modelI-PACEBehavioral addictionsInteraction of Person-Affect-Cognition-ExecutionBehavioral addiction researchCue-reactivityDesire thinkingCompulsive behaviorsExecutive functionAddictive behaviorsNegative reinforcementAddiction researchPermissive beliefsAddiction theoryAddiction fieldSelf-controlAddictionCravingEmpirical findingsTheory buildingClinical careStimulate researchGratificationBehaviorContext of changesA generalized reward processing deficit pathway to negative symptoms across diagnostic boundaries
Spilka M, Millman Z, Waltz J, Walker E, Levin J, Powers A, Corlett P, Schiffman J, Gold J, Silverstein S, Ellman L, Mittal V, Woods S, Zinbarg R, Strauss G. A generalized reward processing deficit pathway to negative symptoms across diagnostic boundaries. Psychological Medicine 2025, 55: e6. PMID: 39901872, PMCID: PMC11968125, DOI: 10.1017/s003329172400326x.Peer-Reviewed Original ResearchMeSH KeywordsAdolescentAdultCluster AnalysisFemaleHumansMalePsychotic DisordersReinforcement, PsychologyRewardYoung AdultConceptsNegative symptomsDiagnostic boundariesPsychiatric diagnosisTransdiagnostic sample of youthProcessing profilesEffort-cost computationsPositive valence systemsElevated negative symptomsHelp-seeking participantsClinical high riskClinical group membershipSample of youthHedonic reactivityTransdiagnostic sampleCHR criteriaNeurobiological mechanismsPsychosis riskSubgroup of participantsBehavioral tasksClinical interviewPsychiatric disordersClinical participantsValence systemsGroup membershipDiagnostic classification
2024
The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking
Le T, Oba T, Couch L, McInerney L, Li C. The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking. ENeuro 2024, 11: eneuro.0437-23.2024. PMID: 38365840, PMCID: PMC10901196, DOI: 10.1523/eneuro.0437-23.2024.Peer-Reviewed Original ResearchMeSH KeywordsAvoidance LearningHumansIndividualityLearningMagnetic Resonance ImagingPainReinforcement, PsychologyRewardConceptsSuperior frontal gyrusReward-seekingCingulate cortexNeural correlatesPain avoidanceAction biasDorsal anterior cingulate cortexLeft posterior cingulate cortexAction-outcome associationsGo/No-Go taskAnterior cingulate cortexPosterior cingulate cortexImpact of outcomesHigher learning rateReward trialsFrontal gyrusAvoidance learningMidcingulate cortexNeural substratesAssociative learningAction tendenciesPre-SMAAssociated with activationPrecentral gyrusPostcentral gyrus
2023
Competitive and cooperative games for probing the neural basis of social decision-making in animals
Wang H, Kwan A. Competitive and cooperative games for probing the neural basis of social decision-making in animals. Neuroscience & Biobehavioral Reviews 2023, 149: 105158. PMID: 37019249, PMCID: PMC10175234, DOI: 10.1016/j.neubiorev.2023.105158.Peer-Reviewed Original Research
2022
Problematic social media use is statistically predicted by using social media for coping motives and by positive reinforcement processes in individuals with high COVID-19-related stress levels
Moretta T, Buodo G, Santucci V, Chen S, Potenza M. Problematic social media use is statistically predicted by using social media for coping motives and by positive reinforcement processes in individuals with high COVID-19-related stress levels. Journal Of Psychiatric Research 2022, 158: 104-113. PMID: 36580866, DOI: 10.1016/j.jpsychires.2022.12.036.Peer-Reviewed Original ResearchMeSH KeywordsAdaptation, PsychologicalBayes TheoremCommunicable Disease ControlCOVID-19HumansMotivationReinforcement, PsychologySocial MediaSymptom Flare UpReward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related
Afshar N, Cinotti F, Martin D, Khamassi M, Calu DJ, Taylor JR, Groman SM. Reward-Mediated, Model-Free Reinforcement-Learning Mechanisms in Pavlovian and Instrumental Tasks Are Related. Journal Of Neuroscience 2022, 43: 458-471. PMID: 36216504, PMCID: PMC9864557, DOI: 10.1523/jneurosci.1113-22.2022.Peer-Reviewed Original ResearchMeSH KeywordsAnimalsConditioning, OperantCuesLearningMaleMotivationRatsReinforcement, PsychologyRewardConceptsGoal-tracking behaviorReinforcement learning mechanismInstrumental learning processesSign-tracking behaviorModel-free reinforcementApproach taskInstrumental taskInstrumental behaviorBehavioral proceduresSubjects designLearning mechanismDecision Making TaskModel-based computationLearning processModel-free reinforcement learningPredictive cuesIncentive salienceAssociative learningIndividual differencesComputational mechanismsDecision-making processPavlovianModel-based algorithmValue representationAction valuesLearned helplessness: expanding on a goal-directed perspective
Duda J, Joormann J. Learned helplessness: expanding on a goal-directed perspective. Cognition & Emotion 2022, 36: 1037-1041. PMID: 36054602, DOI: 10.1080/02699931.2022.2118238.Peer-Reviewed Original ResearchAdolescent reinforcement-learning trajectories predict cocaine-taking behaviors in adult male and female rats
Villiamma P, Casby J, Groman SM. Adolescent reinforcement-learning trajectories predict cocaine-taking behaviors in adult male and female rats. Psychopharmacology 2022, 239: 2885-2901. PMID: 35705734, PMCID: PMC10332493, DOI: 10.1007/s00213-022-06174-w.Peer-Reviewed Original ResearchMeSH KeywordsAnimalsBehavior, AddictiveCocaineDecision MakingFemaleMaleRatsRats, Long-EvansReinforcement, PsychologyReversal LearningRewardConceptsCocaine-taking behaviorReversal-learning performanceDecision-making functionsReversal-learning taskReinforcement learning modelIndividual differencesAdolescent developmentFemale Long-Evans ratsRewarded outcomesDevelopmental trajectoriesNeurobiological mechanismsAdolescent trajectoriesAge-related changesGreater cocaineBiobehavioral mechanismsNeural adaptationLong-Evans ratsPredictive relationshipAddiction susceptibilityAdolescenceChoice behaviorAdulthoodDecision-making trajectoriesMental illnessChoice dataPupil Correlates of Decision Variables in Mice Playing a Competitive Mixed-Strategy Game
Wang H, Ortega HK, Atilgan H, Murphy CE, Kwan AC. Pupil Correlates of Decision Variables in Mice Playing a Competitive Mixed-Strategy Game. ENeuro 2022, 9: eneuro.0457-21.2022. PMID: 35168951, PMCID: PMC8925722, DOI: 10.1523/eneuro.0457-21.2022.Peer-Reviewed Original Research
2021
Reinforcement learning detuned in addiction: integrative and translational approaches
Groman SM, Thompson SL, Lee D, Taylor JR. Reinforcement learning detuned in addiction: integrative and translational approaches. Trends In Neurosciences 2021, 45: 96-105. PMID: 34920884, PMCID: PMC8770604, DOI: 10.1016/j.tins.2021.11.007.Peer-Reviewed Reviews, Practice Guidelines, Standards, and Consensus StatementsMeSH KeywordsAnimalsBehavior, AddictiveDecision MakingHumansReinforcement, PsychologySubstance-Related DisordersConceptsDecision-making deficitsPathophysiology of addictionDecision-making strategiesBiobehavioral mechanismsAddictionReinforcement learningDecision-making processDrug useTranslational approachComputational componentsDeficitsLearningDifferent componentsBiological mechanismsOutcomesFindingsRecent studiesBehaviorStudyAssigning the right credit to the wrong action: compulsivity in the general population is associated with augmented outcome-irrelevant value-based learning
Bullmore E, Dolan R, Goodyer I, Fonagy P, Jones P, Moutoussis M, Hauser T, Neufeld S, Romero-Garcia R, Clair M, Vértes P, Whitaker K, Inkster B, Prabhu G, Ooi C, Toseeb U, Widmer B, Bhatti J, Villis L, Alrumaithi A, Birt S, Bowler A, Cleridou K, Dadabhoy H, Davies E, Firkins A, Granville S, Harding E, Hopkins A, Isaacs D, King J, Kokorikou D, Maurice C, McIntosh C, Memarzia J, Mills H, O’Donnell C, Pantaleone S, Scott J, Kiddle B, Polek E, Fearon P, Suckling J, van Harmelen A, Kievit R, Chamberlain S. Assigning the right credit to the wrong action: compulsivity in the general population is associated with augmented outcome-irrelevant value-based learning. Translational Psychiatry 2021, 11: 564. PMID: 34741013, PMCID: PMC8571313, DOI: 10.1038/s41398-021-01642-x.Peer-Reviewed Original ResearchMeSH KeywordsAnimalsAnxiety DisordersCompulsive BehaviorHumansMotivationObsessive-Compulsive DisorderReinforcement, PsychologyConceptsCompulsive behaviorsCompulsive tendenciesValue-based learningSelf-reported compulsivityReinforcement learning tasksSchizotypal tendenciesStimulus locationCompulsivityFuture eventsWrong actionsLearning processFuture researchPositive relationshipSpecific actsCurrent studyTaskLearningIndividualsGeneral populationCausal relationshipHealthy individualsAnxietyTendencyBehaviorBeliefsPost-error Slowing During Instrumental Learning is Shaped by Working Memory-based Choice Strategies
McDougle SD. Post-error Slowing During Instrumental Learning is Shaped by Working Memory-based Choice Strategies. Neuroscience 2021, 486: 37-45. PMID: 34695537, DOI: 10.1016/j.neuroscience.2021.10.016.Peer-Reviewed Original ResearchMeSH KeywordsConditioning, OperantHumansLearningMemory, Short-TermReaction TimeReinforcement, PsychologyConceptsPost-error slowingPost-error processingDistinct neural correlatesMemory-based strategyMedial prefrontal cortexProgress of learningMultiple distinct processesExecutive resourcesWorking memoryNeural signaturesNeural correlatesCognitive loadVisuomotor skillsReinforcement learning systemTask performanceInstrumental learningPrefrontal cortexHigh load conditionsSensorimotor regionsMemoryChoice strategiesDistinct processesComputational modelLearningLearning systemA Neuroeconomics Approach to Obesity
Dan O, Wertheimer EK, Levy I. A Neuroeconomics Approach to Obesity. Biological Psychiatry 2021, 91: 860-868. PMID: 34861975, PMCID: PMC8960474, DOI: 10.1016/j.biopsych.2021.09.019.Peer-Reviewed Original ResearchConceptsValue-based decision makingUnique behavioral profileNeuroeconomic approachMotivational processesMaintenance of obesityNeural mechanismsNeurobiology of obesityBehavioral findingsBehavioral economicsBehavioral profileDecision characteristicsEffective interventionsFuture outcomesIndividual levelDecision makingReinforcement learningUseful frameworkNeuroeconomicsMultiple processesRewardNeurobiologyFuture studiesFindingsLearningAttitudesExecutive Function Assigns Value to Novel Goal-Congruent Outcomes
McDougle SD, Ballard IC, Baribault B, Bishop SJ, Collins AGE. Executive Function Assigns Value to Novel Goal-Congruent Outcomes. Cerebral Cortex 2021, 32: 231-247. PMID: 34231854, PMCID: PMC8634563, DOI: 10.1093/cercor/bhab205.Peer-Reviewed Original ResearchMeSH KeywordsExecutive FunctionGoalsHumansMotivationPrefrontal CortexReinforcement, PsychologyRewardConceptsReward circuitExecutive controlHuman reinforcementPrefrontal correlatesInstrumental learningFunctional neuroimagingNovel outcomesHigh-level representationSecondary reinforcerPrefrontal cortexMaterial rewardsSame circuitryDopaminergic circuitsNovel imageAssigns valueReward functionRewardNeuroimagingLow-level responsesComputational modelingFlexible responseReinforcersLearningCorrelatesCortexUnlocking the Reinforcement-Learning Circuits of the Orbitofrontal Cortex
Groman SM, Lee D, Taylor JR. Unlocking the Reinforcement-Learning Circuits of the Orbitofrontal Cortex. Behavioral Neuroscience 2021, 135: 120-128. PMID: 34060870, PMCID: PMC8201418, DOI: 10.1037/bne0000414.Peer-Reviewed Original ResearchMeSH KeywordsAlgorithmsAnimalsBehavior, AddictiveNeurosciencesPrefrontal CortexReinforcement, PsychologyConceptsOrbitofrontal cortexReinforcement-learning mechanismsDecision-making impairmentsDiverse clinical populationsDecision-making differsNeurocomputational approachOFC dysfunctionNeuroscience techniquesBiobehavioral disordersBehavioral paradigmsClinical populationsBiobehavioral mechanismsAddiction pathologyComputational differencesReinforcement-learning algorithmsThreshold dose for intravenous nicotine self-administration in young adult non-dependent smokers
MacLean RR, DeVito EE, Eid T, Parida S, Gueorguieva R, Sofuoglu M. Threshold dose for intravenous nicotine self-administration in young adult non-dependent smokers. Psychopharmacology 2021, 238: 2083-2090. PMID: 33796907, PMCID: PMC8715498, DOI: 10.1007/s00213-021-05833-8.Peer-Reviewed Original ResearchConceptsDose of nicotineNicotine reinforcementHigh doseSubjective effectsHuman laboratory studiesYoung adult smokersNicotine self-administration modelNon-dependent smokersOvernight nicotine abstinenceEffects modelSelf-administration modelSelf-administration procedureNicotine doseAdult smokersMethodsYoung adultsObjectivesThe current studyNicotine abstinenceNicotine addictionHigh dosesLow dosesPlaceboThreshold doseReinforcement thresholdTobacco productsDose
2020
Analysis of Opioid-Seeking Behavior Through the Intravenous Self-Administration Reinstatement Model in Rats
Fattore L, Fadda P, Zanda M, Fratta W. Analysis of Opioid-Seeking Behavior Through the Intravenous Self-Administration Reinstatement Model in Rats. Methods In Molecular Biology 2020, 2201: 231-245. PMID: 32975804, DOI: 10.1007/978-1-0716-0884-5_21.Peer-Reviewed Original ResearchMeSH KeywordsAdministration, IntravenousAnalgesics, OpioidAnimalsBehavior ControlBehavior, AddictiveConditioning, OperantCuesDisease Models, AnimalDrug-Seeking BehaviorHeroinInfusions, IntravenousMaleOpioid-Related DisordersRatsRats, Sprague-DawleyRats, WistarReinforcement, PsychologyRewardSelf AdministrationSubstance-Related DisordersConceptsNeurobiological mechanismsAnimal model of relapseExtinction-reinstatement modelHeroin-seeking behaviorReinstatement animal modelRelapse-like behaviorModel of relapseRelapse to heroinVulnerability to relapseNose poke responsesPanel press responseNonhuman primatesReinstatement modelDrug seekingLever pressOperant respondingDrug abstinenceAddiction researchVulnerability factorsPress responseSubstance useOperant responseAnimal modelsIndividual slipsSelf-administeredModeling the influence of working memory, reinforcement, and action uncertainty on reaction time and choice during instrumental learning
McDougle SD, Collins AGE. Modeling the influence of working memory, reinforcement, and action uncertainty on reaction time and choice during instrumental learning. Psychonomic Bulletin & Review 2020, 28: 20-39. PMID: 32710256, PMCID: PMC7854965, DOI: 10.3758/s13423-020-01774-z.Peer-Reviewed Original ResearchMeSH KeywordsChoice BehaviorHumansMemory, Short-TermModels, PsychologicalReaction TimeReinforcement, PsychologyUncertaintyConceptsInstrumental learningInstrumental learning processesReaction time effectsStages of learningDegree of deliberationReward contingenciesPerceptual evidenceParsimonious accountTask complexityInternal representationAction uncertaintyUnique predictionDecision dynamicsAction valuesPast experienceLearning processReaction timeMemoryLearningProcess modelTime effectsTaskDecision-making frameworkContingenciesPrior uncertaintyGaming and Gaming Disorder: A Mediation Model Gender, Salience, Age of Gaming Onset, and Time Spent Gaming
Buono FD, Paul E, Sprong ME, Smith EC, Garakani A, Griffiths MD. Gaming and Gaming Disorder: A Mediation Model Gender, Salience, Age of Gaming Onset, and Time Spent Gaming. Cyberpsychology Behavior And Social Networking 2020, 23: 647-651. PMID: 32654509, DOI: 10.1089/cyber.2019.0445.Peer-Reviewed Original Research
This site is protected by hCaptcha and its Privacy Policy and Terms of Service apply