Mojtaba Rostami Kandroodi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Mojtaba Rostami Kandroodi has a total of 44 co-authors. Here are the top co-authors by number of shared publications:
- Hanneke Eveline Maria Den Ouden
Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University
4 shared publications Majid Nili Ahmadabadi
School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
3 shared publications- Faezeh Farivar
Department of Computer and Mechatronics Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
2 shared publications - Mahdi Aliyari Shoorehdeli
K. N. Toosi University of Technology
2 shared publications Roshan Cools
Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
2 shared publications- Trevor William Robbins
University of Cambridge
2 shared publications
Latest Publications
- Open Access
- 13 June 2026
- Published by Elsevier in Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
Adaptive suppression of motivational biases increases with mood/anxiety traits
- 13 June 2026
- Published by Elsevier in Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
Open AccessAdaptive suppression of motivational biases increases with mood/anxiety traits
- Open Access
- 22 November 2022
- Published by Cambridge University Press (CUP) in Psychological Medicine
- Vol. 53 (14) , 6434-6445
Effect of lysergic acid diethylamide (LSD) on reinforcement learning in humans
Background: The non-selective serotonin 2A (5-HT2A) receptor agonist lysergic acid diethylamide (LSD) holds promise as a treatment for some psychiatric disorders. Psychedelic drugs such as LSD have been suggested to have therapeutic actions through their effects on learning. The behavioural effects of LSD in humans, however, remain incompletely understood. Here we examined how LSD affects probabilistic reversal learning (PRL) in healthy humans.Methods: Healthy volunteers received intravenous LSD (75μg in 10 mL saline) or placebo (10 mL saline) in a within-subjects design and completed a PRL task. Participants had to learn through trial and error which of three stimuli was rewarded most of the time, and these contingencies switched in a reversal phase. Computational models of reinforcement learning (RL) were fitted to the behavioural data to assess how LSD affected the updating (‘learning rates’) and deployment of value representations (‘reinforcement sensitivity’) during choice, as well as ‘stimulus stickiness’ (choice repetition irrespective of reinforcement history).Results: Raw data measures assessing sensitivity to immediate feedback (‘win-stay’ and ‘lose-shift’ probabilities) were unaffected, whereas LSD increased the impact of the strength of initial learning on perseveration. Computational modelling revealed that the most pronounced effect of LSD was the enhancement of the reward learning rate. The punishment learning rate was also elevated. Stimulus stickiness was decreased by LSD, reflecting heightened exploration. Reinforcement sensitivity differed by phase.Conclusions: Increased RL rates suggest LSD induced a state of heightened plasticity. These results indicate a potential mechanism through which revision of maladaptive associations could occur in the clinical application of LSD.
- 22 November 2022
- Published by Cambridge University Press (CUP) in Psychological Medicine
- Vol. 53 (14) , 6434-6445
Open AccessEffect of lysergic acid diethylamide (LSD) on reinforcement learning in humans
Background: The non-selective serotonin 2A (5-HT2A) receptor agonist lysergic acid diethylamide (LSD) holds promise as a treatment for some psychiatric disorders. Psychedelic drugs such as LSD have been suggested to have therapeutic actions through their effects on learning. The behavioural effects of LSD in humans, however, remain incompletely understood. Here we examined how LSD affects probabilistic reversal learning (PRL) in healthy humans.Methods: Healthy volunteers received intravenous LSD (75μg in 10 mL saline) or placebo (10 mL saline) in a within-subjects design and completed a PRL task. Participants had to learn through trial and error which of three stimuli was rewarded most of the time, and these contingencies switched in a reversal phase. Computational models of reinforcement learning (RL) were fitted to the behavioural data to assess how LSD affected the updating (‘learning rates’) and deployment of value representations (‘reinforcement sensitivity’) during choice, as well as ‘stimulus stickiness’ (choice repetition irrespective of reinforcement history).Results: Raw data measures assessing sensitivity to immediate feedback (‘win-stay’ and ‘lose-shift’ probabilities) were unaffected, whereas LSD increased the impact of the strength of initial learning on perseveration. Computational modelling revealed that the most pronounced effect of LSD was the enhancement of the reward learning rate. The punishment learning rate was also elevated. Stimulus stickiness was decreased by LSD, reflecting heightened exploration. Reinforcement sensitivity differed by phase.Conclusions: Increased RL rates suggest LSD induced a state of heightened plasticity. These results indicate a potential mechanism through which revision of maladaptive associations could occur in the clinical application of LSD.
- Open Access
- 21 October 2021
- Published by Springer Nature in Psychopharmacology
- Vol. 238 (12) , 3569-3584
Effects of methylphenidate on reinforcement learning depend on working memory capacity
Rationale: Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. Objectives and methods: Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate’s effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample (n = 102) of healthy volunteers. Results: Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. Conclusions: This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function.
- 21 October 2021
- Published by Springer Nature in Psychopharmacology
- Vol. 238 (12) , 3569-3584
Open AccessEffects of methylphenidate on reinforcement learning depend on working memory capacity
Rationale: Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. Objectives and methods: Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate’s effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample (n = 102) of healthy volunteers. Results: Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. Conclusions: This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function.
- Open Access
Cortical dopamine reduces the impact of motivational biases governing automated behaviour
Motivations shape our behaviour: the promise of reward invigorates, while in the face of punishment, we hold back. Abnormalities of motivational processing are implicated in clinical disorders characterised by excessive habits and loss of top-down control, notably substance and behavioural addictions. Striatal and frontal dopamine have been hypothesised to play complementary roles in the respective generation and control of these motivational biases. However, while dopaminergic interventions have indeed been found to modulate motivational biases, these previous pharmacological studies used regionally non-selective pharmacological agents. Here, we tested the hypothesis that frontal dopamine controls the balance between Pavlovian, bias-driven automated responding and instrumentally learned action values. Specifically, we examined whether selective enhancement of cortical dopamine either (i) enables adaptive suppression of Pavlovian control when biases are maladaptive; or (ii) non-specifically modulates the degree of bias-driven automated responding. Healthy individuals (n=35) received the catechol-o-methyltransferase (COMT) inhibitor tolcapone in a randomized, double-blind, placebo-controlled cross-over design, and completed a motivational Go NoGo task known to elicit motivational biases. In support of hypothesis (ii), tolcapone globally decreased motivational bias. Specifically, tolcapone improved performance on trials where the bias was unhelpful, but impaired performance in bias-congruent conditions. These results indicate a non-selective role for cortical dopamine in the regulation of motivational processes underpinning top-down control over automated behaviour. The findings have direct relevance to understanding neurobiological mechanisms underpinning addiction and obsessive-compulsive disorders, as well as highlighting a potential trans-diagnostic novel mechanism to address such symptoms.
Open AccessCortical dopamine reduces the impact of motivational biases governing automated behaviour
Motivations shape our behaviour: the promise of reward invigorates, while in the face of punishment, we hold back. Abnormalities of motivational processing are implicated in clinical disorders characterised by excessive habits and loss of top-down control, notably substance and behavioural addictions. Striatal and frontal dopamine have been hypothesised to play complementary roles in the respective generation and control of these motivational biases. However, while dopaminergic interventions have indeed been found to modulate motivational biases, these previous pharmacological studies used regionally non-selective pharmacological agents. Here, we tested the hypothesis that frontal dopamine controls the balance between Pavlovian, bias-driven automated responding and instrumentally learned action values. Specifically, we examined whether selective enhancement of cortical dopamine either (i) enables adaptive suppression of Pavlovian control when biases are maladaptive; or (ii) non-specifically modulates the degree of bias-driven automated responding. Healthy individuals (n=35) received the catechol-o-methyltransferase (COMT) inhibitor tolcapone in a randomized, double-blind, placebo-controlled cross-over design, and completed a motivational Go NoGo task known to elicit motivational biases. In support of hypothesis (ii), tolcapone globally decreased motivational bias. Specifically, tolcapone improved performance on trials where the bias was unhelpful, but impaired performance in bias-congruent conditions. These results indicate a non-selective role for cortical dopamine in the regulation of motivational processes underpinning top-down control over automated behaviour. The findings have direct relevance to understanding neurobiological mechanisms underpinning addiction and obsessive-compulsive disorders, as well as highlighting a potential trans-diagnostic novel mechanism to address such symptoms.
- Open Access
Optimal Reinforcement Learning with Asymmetric Updating in Volatile Environments: a Simulation Study
A bstract: The ability to predict the future is essential for decision-making and interaction with the environment to avoid punishment and gain reward. Reinforcement learning algorithms provide a normative way for interactive learning, especially in volatile environments. The optimal strategy for the classic reinforcement learning model is to increase the learning rate as volatility increases. Inspired by optimistic bias in humans, an alternative reinforcement learning model has been developed by adding a punishment learning rate to the classic reinforcement learning model. In this study, we aim to 1) compare the performance of these two models in interaction with different environments, and 2) find optimal parameters for the models. Our simulations indicate that having two different learning rates for rewards and punishments increases performance in a volatile environment. Investigation of the optimal parameters shows that in almost all environments, having a higher reward learning rate compared to the punishment learning rate is beneficial for achieving higher performance which in this case is the accumulation of more rewards. Our results suggest that to achieve high performance, we need a shorter memory window for recent rewards and a longer memory window for punishments. This is consistent with optimistic bias in human behavior.
Open AccessOptimal Reinforcement Learning with Asymmetric Updating in Volatile Environments: a Simulation Study
A bstract: The ability to predict the future is essential for decision-making and interaction with the environment to avoid punishment and gain reward. Reinforcement learning algorithms provide a normative way for interactive learning, especially in volatile environments. The optimal strategy for the classic reinforcement learning model is to increase the learning rate as volatility increases. Inspired by optimistic bias in humans, an alternative reinforcement learning model has been developed by adding a punishment learning rate to the classic reinforcement learning model. In this study, we aim to 1) compare the performance of these two models in interaction with different environments, and 2) find optimal parameters for the models. Our simulations indicate that having two different learning rates for rewards and punishments increases performance in a volatile environment. Investigation of the optimal parameters shows that in almost all environments, having a higher reward learning rate compared to the punishment learning rate is beneficial for achieving higher performance which in this case is the accumulation of more rewards. Our results suggest that to achieve high performance, we need a shorter memory window for recent rewards and a longer memory window for punishments. This is consistent with optimistic bias in human behavior.
- Open Access
- 15 June 2020
- Published by Cambridge University Press (CUP) in Psychological Medicine
- Vol. 52 (2) , 303-313
Challenging the negative learning bias hypothesis of depression: reversal learning in a naturalistic psychiatric sample
Background: Classic theories posit that depression is driven by a negative learning bias. Most studies supporting this proposition used small and selected samples, excluding patients with comorbidities. However, comorbidity between psychiatric disorders occurs in up to 70% of the population. Therefore, the generalizability of the negative bias hypothesis to a naturalistic psychiatric sample as well as the specificity of the bias to depression, remain unclear. In the present study, we tested the negative learning bias hypothesis in a large naturalistic sample of psychiatric patients, including depression, anxiety, addiction, attention-deficit/hyperactivity disorder, and/or autism. First, we assessed whether the negative bias hypothesis of depression generalized to a heterogeneous (and hence more naturalistic) depression sample compared with controls. Second, we assessed whether negative bias extends to other psychiatric disorders. Third, we adopted a dimensional approach, by using symptom severity as a way to assess associations across the sample.Methods: We administered a probabilistic reversal learning task to 217 patients and 81 healthy controls. According to the negative bias hypothesis, participants with depression should exhibit enhanced learning and flexibility based on punishment v. reward. We combined analyses of traditional measures with more sensitive computational modeling.Results: In contrast to previous findings, this sample of depressed patients with psychiatric comorbidities did not show a negative learning bias.Conclusions: These results speak against the generalizability of the negative learning bias hypothesis to depressed patients with comorbidities. This study highlights the importance of investigating unselected samples of psychiatric patients, which represent the vast majority of the psychiatric population.
- 15 June 2020
- Published by Cambridge University Press (CUP) in Psychological Medicine
- Vol. 52 (2) , 303-313
Open AccessChallenging the negative learning bias hypothesis of depression: reversal learning in a naturalistic psychiatric sample
Background: Classic theories posit that depression is driven by a negative learning bias. Most studies supporting this proposition used small and selected samples, excluding patients with comorbidities. However, comorbidity between psychiatric disorders occurs in up to 70% of the population. Therefore, the generalizability of the negative bias hypothesis to a naturalistic psychiatric sample as well as the specificity of the bias to depression, remain unclear. In the present study, we tested the negative learning bias hypothesis in a large naturalistic sample of psychiatric patients, including depression, anxiety, addiction, attention-deficit/hyperactivity disorder, and/or autism. First, we assessed whether the negative bias hypothesis of depression generalized to a heterogeneous (and hence more naturalistic) depression sample compared with controls. Second, we assessed whether negative bias extends to other psychiatric disorders. Third, we adopted a dimensional approach, by using symptom severity as a way to assess associations across the sample.Methods: We administered a probabilistic reversal learning task to 217 patients and 81 healthy controls. According to the negative bias hypothesis, participants with depression should exhibit enhanced learning and flexibility based on punishment v. reward. We combined analyses of traditional measures with more sensitive computational modeling.Results: In contrast to previous findings, this sample of depressed patients with psychiatric comorbidities did not show a negative learning bias.Conclusions: These results speak against the generalizability of the negative learning bias hypothesis to depressed patients with comorbidities. This study highlights the importance of investigating unselected samples of psychiatric patients, which represent the vast majority of the psychiatric population.
- 22 November 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Magnetics
- Vol. 53 (00189464) , 1
Estimation of Depth and Length of Defects from Magnetic Flux Leakage Measurements: Verification with Simulations, Experiments, and Pigging data
Magnetic flux leakage (MFL) method is the most widely used non-destructive testing techniques for detection and characterization of defects in product transmission pipelines. The maximum safe operating pressure is a crucial parameter in practice, which is predicted with respect to the length, width, and depth of defects. In a previous work, an algorithm is devised to detect and estimate the width of the defect based on MFL signals. In this paper, an efficient method based on axial MFL level contours is devised to estimate the length of the defect. This method uses the patterns of signal level contours in the region corresponding to the defect's area. In addition, a Gaussian radial basis function neural network (NN) is trained to approximate the depth of the defect. The NN is fed with the estimated length, width, and signal peak-to-peak values, and the output of the network is the estimated depth. The proposed detection and estimation method is applied to MFL measurements to detect and determine the sizing of metal loss defects. The efficacy and accuracy of the proposed methods are examined through a rich set of sample defects that contains simulated defects, designed defects that are carved on a real pipe by milling, and actual pigging data validated by several dig up verifications. Obtained results confirm the effectiveness and accuracy of the proposed depth and length estimation method along with the previously devised detection and width estimation methods, in characterization of metal loss defects.
- 22 November 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Magnetics
- Vol. 53 (00189464) , 1
Estimation of Depth and Length of Defects from Magnetic Flux Leakage Measurements: Verification with Simulations, Experiments, and Pigging data
Magnetic flux leakage (MFL) method is the most widely used non-destructive testing techniques for detection and characterization of defects in product transmission pipelines. The maximum safe operating pressure is a crucial parameter in practice, which is predicted with respect to the length, width, and depth of defects. In a previous work, an algorithm is devised to detect and estimate the width of the defect based on MFL signals. In this paper, an efficient method based on axial MFL level contours is devised to estimate the length of the defect. This method uses the patterns of signal level contours in the region corresponding to the defect's area. In addition, a Gaussian radial basis function neural network (NN) is trained to approximate the depth of the defect. The NN is fed with the estimated length, width, and signal peak-to-peak values, and the output of the network is the estimated depth. The proposed detection and estimation method is applied to MFL measurements to detect and determine the sizing of metal loss defects. The efficacy and accuracy of the proposed methods are examined through a rich set of sample defects that contains simulated defects, designed defects that are carved on a real pipe by milling, and actual pigging data validated by several dig up verifications. Obtained results confirm the effectiveness and accuracy of the proposed depth and length estimation method along with the previously devised detection and width estimation methods, in characterization of metal loss defects.
- Open Access
- 3 January 2012
- Published by Wiley in ISRN Artificial Intelligence
- Vol. 2012, 1-8
Control of Flexible Joint Manipulator via Reduced Rule-Based Fuzzy Control with Experimental Validation
A novel structure of fuzzy logic controller is presented for trajectory tracking and vibration control of a flexible joint manipulator. The rule base of fuzzy controller is divided into two sections. Each section includes two variables. The variables of first section are the error of tip angular position and the error of deflection angle, while the variables of second section are derivatives of mentioned errors. Using these structures, it would be possible to reduce the number of rules. Advantages of proposed fuzzy logic are low computational complexity, high interpretability of rules, and convenience in fuzzy controller. Implementing of the fuzzy logic controller on Quanser flexible joint reveals efficiency of proposed controller. To show the efficiency of this method, the results are compared with LQR method. In this paper, experimental validation of proposed method is presented.
- 3 January 2012
- Published by Wiley in ISRN Artificial Intelligence
- Vol. 2012, 1-8
Open AccessControl of Flexible Joint Manipulator via Reduced Rule-Based Fuzzy Control with Experimental Validation
A novel structure of fuzzy logic controller is presented for trajectory tracking and vibration control of a flexible joint manipulator. The rule base of fuzzy controller is divided into two sections. Each section includes two variables. The variables of first section are the error of tip angular position and the error of deflection angle, while the variables of second section are derivatives of mentioned errors. Using these structures, it would be possible to reduce the number of rules. Advantages of proposed fuzzy logic are low computational complexity, high interpretability of rules, and convenience in fuzzy controller. Implementing of the fuzzy logic controller on Quanser flexible joint reveals efficiency of proposed controller. To show the efficiency of this method, the results are compared with LQR method. In this paper, experimental validation of proposed method is presented.
- 1 December 2011
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1080-1085
Intelligent Control of human prosthetic eye movements system for the emotional support by a huggable pet-type robot via Gaussian RBF neural network based on sliding mode control
In this study, intelligent control of human eye movements system for the emotional support by a huggable pet type robot via Gaussian RBF neural network based on sliding mode control is presented. Despite active research and significant progress in the last three decades on control of human eye movements, it remains challenging issue due to its applications in prosthetic eyes and robotics. The geometry and model of human eye movements system are investigated and this system is considered as a nonlinear control system. The specified model may only be an academic exercise. It can have scientific importance in understanding of the human movement system in general. Also, it can be useful for robotics. By using Gaussian RBF Neural Networks Based on Sliding Mode Control, the control goal can be achieved. The adaptation laws of designed controllers are obtained based on sliding mode control methodology without calculating the Jacobian of the system. The proposed method is capable to control of human eye movements system. Intelligent methods such as artificial neural networks are proposed to control the human eye movements and numerical simulations are presented. It is concluded that the intelligent controls applied to control of human eye movements system are emulated from the neural controls in biological system.
- 1 December 2011
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1080-1085
Intelligent Control of human prosthetic eye movements system for the emotional support by a huggable pet-type robot via Gaussian RBF neural network based on sliding mode control
In this study, intelligent control of human eye movements system for the emotional support by a huggable pet type robot via Gaussian RBF neural network based on sliding mode control is presented. Despite active research and significant progress in the last three decades on control of human eye movements, it remains challenging issue due to its applications in prosthetic eyes and robotics. The geometry and model of human eye movements system are investigated and this system is considered as a nonlinear control system. The specified model may only be an academic exercise. It can have scientific importance in understanding of the human movement system in general. Also, it can be useful for robotics. By using Gaussian RBF Neural Networks Based on Sliding Mode Control, the control goal can be achieved. The adaptation laws of designed controllers are obtained based on sliding mode control methodology without calculating the Jacobian of the system. The proposed method is capable to control of human eye movements system. Intelligent methods such as artificial neural networks are proposed to control the human eye movements and numerical simulations are presented. It is concluded that the intelligent controls applied to control of human eye movements system are emulated from the neural controls in biological system.
- 1 December 2011
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 338-343
Identification and model predictive control of continuous stirred tank reactor based on artificial neural networks
In this paper, system identification and neural network predictive control (NNPC) of a continuous stirred tank reactor (CSTR) is presented. The control problem with the objective of set point tracking between several modes is investigated. The real measurements of this process are used in system identification. Artificial networks such as MultiLayer Perceptron (MLP), Radial Basis Function (RBF), and Adaptive Neuro-Fuzzy Inference Systems (ANFIS) are applied as the intelligent identifiers to system identification. Neural network predictive control is utilized to control of continuous stirred tank reactor output. The predictive control strategy is used to calculate optimal control inputs. Two viewpoints are considered in neural network predictive control. One of them is based on neural network model of continuous stirred tank reactor and another one is based on dynamical model of continuous stirred tank reactor. Simulation results show the validity and feasibility of the proposed methods to neural network predictive control of continuous stirred tank reactor process.
- 1 December 2011
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 338-343
Identification and model predictive control of continuous stirred tank reactor based on artificial neural networks
In this paper, system identification and neural network predictive control (NNPC) of a continuous stirred tank reactor (CSTR) is presented. The control problem with the objective of set point tracking between several modes is investigated. The real measurements of this process are used in system identification. Artificial networks such as MultiLayer Perceptron (MLP), Radial Basis Function (RBF), and Adaptive Neuro-Fuzzy Inference Systems (ANFIS) are applied as the intelligent identifiers to system identification. Neural network predictive control is utilized to control of continuous stirred tank reactor output. The predictive control strategy is used to calculate optimal control inputs. Two viewpoints are considered in neural network predictive control. One of them is based on neural network model of continuous stirred tank reactor and another one is based on dynamical model of continuous stirred tank reactor. Simulation results show the validity and feasibility of the proposed methods to neural network predictive control of continuous stirred tank reactor process.