Reilly James Innes
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Reilly James Innes has a total of 59 co-authors. Here are the top co-authors by number of shared publications:
- Niek Stevenson
Department of Psychology, University of Amsterdam, Amsterdam, Netherlands
7 shared publications - Scott D. Brown
School of Psychological Science, College of Engineering, Science and Environment, University of Newcastle, Callaghan 2308, Australia
6 shared publications - Zachary L. Howard
A Population Health, Hunter New England Local Health District, Newcastle, NSW, Australia
5 shared publications - Ami Eidels
School of Psychology, University of Newcastle, Callaghan, NSW, Australia
4 shared publications Andrew Heathcote
Department of Psychology, University of Amsterdam
4 shared publicationsNathan J. Evans
4 shared publications
Latest Publications
- Open Access
- 1 December 2025
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 30 (6) , 1218-1241
Using group level factor models to resolve high dimensionality in model-based sampling.
Joint modeling of decisions and neural activation poses the potential to provide significant advances in linking brain and behavior. However, methods of joint modeling have been limited by difficulties in estimation, often due to high dimensionality and simultaneous estimation challenges. In the current article, we propose a method of model estimation that draws on state-of-the-art Bayesian hierarchical modeling techniques and uses factor analysis as a means of dimensionality reduction and inference at the group level. This hierarchical factor approach can adopt any model for the individual and distill the relationships of its parameters across individuals through a factor structure. We demonstrate the significant dimensionality reduction gained by factor analysis and good parameter recovery, and illustrate a variety of factor loading constraints that can be used for different purposes and research questions, as well as three applications of the method to previously analyzed data. We conclude that this method provides a flexible and usable approach with interpretable outcomes that are primarily data-driven, in contrast to the largely hypothesis-driven methods often used in joint modeling. Although we focus on joint modeling methods, this model-based estimation approach could be used for any high dimensional modeling problem. We provide open-source code and accompanying tutorial documentation to make the method accessible to any researchers. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
- 1 December 2025
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 30 (6) , 1218-1241
Open AccessUsing group level factor models to resolve high dimensionality in model-based sampling.
Joint modeling of decisions and neural activation poses the potential to provide significant advances in linking brain and behavior. However, methods of joint modeling have been limited by difficulties in estimation, often due to high dimensionality and simultaneous estimation challenges. In the current article, we propose a method of model estimation that draws on state-of-the-art Bayesian hierarchical modeling techniques and uses factor analysis as a means of dimensionality reduction and inference at the group level. This hierarchical factor approach can adopt any model for the individual and distill the relationships of its parameters across individuals through a factor structure. We demonstrate the significant dimensionality reduction gained by factor analysis and good parameter recovery, and illustrate a variety of factor loading constraints that can be used for different purposes and research questions, as well as three applications of the method to previously analyzed data. We conclude that this method provides a flexible and usable approach with interpretable outcomes that are primarily data-driven, in contrast to the largely hypothesis-driven methods often used in joint modeling. Although we focus on joint modeling methods, this model-based estimation approach could be used for any high dimensional modeling problem. We provide open-source code and accompanying tutorial documentation to make the method accessible to any researchers. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
- Open Access
- 8 July 2025
- Published by Center for Open Science in PsyArXiv
EMC2: An R Package for cognitive models of choice
We introduce EMC2, an R package for Bayesian hierarchical analysis of cognitive models of choice. EMC2 bridges the gap between standard regression analyses and cognitive modeling through linear-model specifications for each type of cognitive model parameter. The flexible implementation of the linear modeling language allows users to map model parameters directly to complicated designs and hypotheses. EMC2 implements recent developments in Bayesian parameter estimation and hypothesis testing, including powerful and efficient sampling and marginal likelihood estimation algorithms, making it computationally feasible to estimate many different cognitive models and perform inference among them. Using two leading evidence-accumulation models, we illustrate how EMC2 provides a workflow that makes it easy to specify diverse parameterizations and informative priors, and to evaluate, refine, compare, and interpret models.
- 8 July 2025
- Published by Center for Open Science in PsyArXiv
Open AccessEMC2: An R Package for cognitive models of choice
We introduce EMC2, an R package for Bayesian hierarchical analysis of cognitive models of choice. EMC2 bridges the gap between standard regression analyses and cognitive modeling through linear-model specifications for each type of cognitive model parameter. The flexible implementation of the linear modeling language allows users to map model parameters directly to complicated designs and hypotheses. EMC2 implements recent developments in Bayesian parameter estimation and hypothesis testing, including powerful and efficient sampling and marginal likelihood estimation algorithms, making it computationally feasible to estimate many different cognitive models and perform inference among them. Using two leading evidence-accumulation models, we illustrate how EMC2 provides a workflow that makes it easy to specify diverse parameterizations and informative priors, and to evaluate, refine, compare, and interpret models.
- Open Access
- 2 July 2024
- Published by Center for Open Science in PsyArXiv
An expert guide to planning experimental tasks for evidence accumulation modelling
Evidence accumulation models (EAMs) are powerful tools for making sense of human and animal decision-making behaviour. EAMs have generated significant theoretical advances in psychology, behavioural economics, and cognitive neuroscience, and are increasingly used as a measurement tool in clinical research and other applied settings. Obtaining valid and reliable inferences from EAMs depends on knowing how to establish a close match between model assumptions and features of the task/data to which the model is applied. However, this knowledge is rarely articulated in the EAM literature, leaving beginners to rely on the private advice of mentors and colleagues, and on inefficient trial-and-error learning. In this article, we provide practical guidance for designing tasks appropriate for EAMs, for relating experimental manipulations to EAM parameters, for planning appropriate sample sizes, and for preparing data and conducting an EAM analysis. Our advice is based on prior methodological studies and the authors’ substantial collective experience with EAMs. By encouraging good task design practices, and warning of potential pitfalls, we hope to improve the quality and trustworthiness of future EAM research and applications.
- 2 July 2024
- Published by Center for Open Science in PsyArXiv
Open AccessAn expert guide to planning experimental tasks for evidence accumulation modelling
Evidence accumulation models (EAMs) are powerful tools for making sense of human and animal decision-making behaviour. EAMs have generated significant theoretical advances in psychology, behavioural economics, and cognitive neuroscience, and are increasingly used as a measurement tool in clinical research and other applied settings. Obtaining valid and reliable inferences from EAMs depends on knowing how to establish a close match between model assumptions and features of the task/data to which the model is applied. However, this knowledge is rarely articulated in the EAM literature, leaving beginners to rely on the private advice of mentors and colleagues, and on inefficient trial-and-error learning. In this article, we provide practical guidance for designing tasks appropriate for EAMs, for relating experimental manipulations to EAM parameters, for planning appropriate sample sizes, and for preparing data and conducting an EAM analysis. Our advice is based on prior methodological studies and the authors’ substantial collective experience with EAMs. By encouraging good task design practices, and warning of potential pitfalls, we hope to improve the quality and trustworthiness of future EAM research and applications.
- Open Access
- 9 February 2024
- Published by Center for Open Science in PsyArXiv
Hierarchical Bayesian Estimation for Cognitive Models using Particle Metropolis within Gibbs (PMwG): A tutorial
Estimating quantitative cognitive models from data is a staple of modern psychological science, but can be difficult and inefficient. Particle Metropolis within Gibbs (PMwG) is a robust and efficient sampling algorithm which supports model estimation in a hierarchical Bayesian framework. This tutorial shows how cognitive modelling can proceed efficiently using pmwg, a new open-source package for the R language. We step through implementing the pmwg package with simple signal detection theory models, to more complex cognitive models in which two tasks are jointly modelled together. Through this process, we also address questions of model-adequacy and model selection, which are must be solved in order to answer meaningful psychological questions. PMwG, and the pmwg package, has the potential to move the field of psychology ahead in new and interesting directions, and to resolve questions that were once too hard to answer with previously available sampling methods.
- 9 February 2024
- Published by Center for Open Science in PsyArXiv
Open AccessHierarchical Bayesian Estimation for Cognitive Models using Particle Metropolis within Gibbs (PMwG): A tutorial
Estimating quantitative cognitive models from data is a staple of modern psychological science, but can be difficult and inefficient. Particle Metropolis within Gibbs (PMwG) is a robust and efficient sampling algorithm which supports model estimation in a hierarchical Bayesian framework. This tutorial shows how cognitive modelling can proceed efficiently using pmwg, a new open-source package for the R language. We step through implementing the pmwg package with simple signal detection theory models, to more complex cognitive models in which two tasks are jointly modelled together. Through this process, we also address questions of model-adequacy and model selection, which are must be solved in order to answer meaningful psychological questions. PMwG, and the pmwg package, has the potential to move the field of psychology ahead in new and interesting directions, and to resolve questions that were once too hard to answer with previously available sampling methods.
- Open Access
- 21 December 2022
- Published by Center for Open Science in PsyArXiv
Joint modelling of latent cognitive mechanisms shared across decision-making domains
Decision-making behavior is often understood using the framework of evidence accumulation models (EAMs). Nowadays, EAMs are applied to various domains of decision-making with the underlying assumption that the latent cognitive constructs proposed by EAMs are consistent across these domains. In this study we investigate both the extent to which the parameters of EAMs are related between four different decision-making domains and across different time points. To that end, we make use of the novel joint modelling approach, that explicitly includes relationships between parameters, such as covariances or underlying factors, in one combined joint model. Consequently, this joint model also accounts for measurement error and uncertainty within the estimation of these relations. We found that EAM parameters were consistent between time points on three of the four decision-making tasks. For our between-task analysis we constructed a joint model with a factor analysis on the parameters of the different tasks. Our two factor joint model indicated that information processing ability was related between the different decision-making domains. However, other cognitive constructs such as the degree of response caution and urgency were only comparable on some domains.
- 21 December 2022
- Published by Center for Open Science in PsyArXiv
Open AccessJoint modelling of latent cognitive mechanisms shared across decision-making domains
Decision-making behavior is often understood using the framework of evidence accumulation models (EAMs). Nowadays, EAMs are applied to various domains of decision-making with the underlying assumption that the latent cognitive constructs proposed by EAMs are consistent across these domains. In this study we investigate both the extent to which the parameters of EAMs are related between four different decision-making domains and across different time points. To that end, we make use of the novel joint modelling approach, that explicitly includes relationships between parameters, such as covariances or underlying factors, in one combined joint model. Consequently, this joint model also accounts for measurement error and uncertainty within the estimation of these relations. We found that EAM parameters were consistent between time points on three of the four decision-making tasks. For our between-task analysis we constructed a joint model with a factor analysis on the parameters of the different tasks. Our two factor joint model indicated that information processing ability was related between the different decision-making domains. However, other cognitive constructs such as the degree of response caution and urgency were only comparable on some domains.
- Open Access
- 26 July 2022
- Published by Center for Open Science in PsyArXiv
Using group level factor models to resolve high dimensionality in model-based sampling
Joint modelling of decisions and neural activation poses the potential toprovide significant advances in linking brain and behaviour. However, methodsof joint modelling have been limited by difficulties in estimation, oftendue to high dimensionality and simultaneous estimation challenges. In thecurrent article, we propose a method of model estimation which draws onstate-of-the-art Bayesian hierarchical modelling techniques and uses factoranalysis as a means of dimensionality reduction and inference at the grouplevel. This hierarchical factor approach can adopt any model for the individualand distil the relationships of its parameters across individuals througha factor structure. We demonstrate the significant dimensionality reductiongained by factor analysis, good parameter recovery, and illustrate a varietyof factor loading constraints which can be used for different purposes andresearch questions, as well as three applications of the method to previouslyanalysed data. We conclude that this method provides a flexible and usableapproach with interpretable outcomes that are primarily data driven, in contrastto the largely hypothesis driven methods often used in joint modelling.Although we focus on joint modelling methods, this model based estimationapproach could be used for any high dimensional modelling problem. Weprovide open source code and accompanying tutorial documentation to makethe method accessible to any researchers.
- 26 July 2022
- Published by Center for Open Science in PsyArXiv
Open AccessUsing group level factor models to resolve high dimensionality in model-based sampling
Joint modelling of decisions and neural activation poses the potential toprovide significant advances in linking brain and behaviour. However, methodsof joint modelling have been limited by difficulties in estimation, oftendue to high dimensionality and simultaneous estimation challenges. In thecurrent article, we propose a method of model estimation which draws onstate-of-the-art Bayesian hierarchical modelling techniques and uses factoranalysis as a means of dimensionality reduction and inference at the grouplevel. This hierarchical factor approach can adopt any model for the individualand distil the relationships of its parameters across individuals througha factor structure. We demonstrate the significant dimensionality reductiongained by factor analysis, good parameter recovery, and illustrate a varietyof factor loading constraints which can be used for different purposes andresearch questions, as well as three applications of the method to previouslyanalysed data. We conclude that this method provides a flexible and usableapproach with interpretable outcomes that are primarily data driven, in contrastto the largely hypothesis driven methods often used in joint modelling.Although we focus on joint modelling methods, this model based estimationapproach could be used for any high dimensional modelling problem. Weprovide open source code and accompanying tutorial documentation to makethe method accessible to any researchers.
- Open Access
- 1 December 2021
- Published by Elsevier in Neuroscience & Biobehavioral Reviews
- Vol. 131, 1127-1135
Structure-function similarities in deep brain stimulation targets cross-species
- 1 December 2021
- Published by Elsevier in Neuroscience & Biobehavioral Reviews
- Vol. 131, 1127-1135
Open AccessStructure-function similarities in deep brain stimulation targets cross-species
- 1 September 2020
- Published by Elsevier in Journal of Mathematical Psychology
- Vol. 98, 102390
Assessing cross-modal interference in the detection response task
- 1 September 2020
- Published by Elsevier in Journal of Mathematical Psychology
- Vol. 98, 102390
Assessing cross-modal interference in the detection response task
- 12 August 2020
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 63 (5) , 788-803
The Effects of Increased Visual Information on Cognitive Workload in a Helicopter Simulator
Objective: To test the effects of enhanced display information (“symbology”) on cognitive workload in a simulated helicopter environment, using the detection response task (DRT). Background: Workload in highly demanding environments can be influenced by the amount of information given to the operator and consequently it is important to limit potential overload. Methods: Participants (highly trained military pilots) completed simulated helicopter flights, which varied in visual conditions and the amount of information given. During these flights, participants also completed a DRT as a measure of cognitive workload. Results: With more visual information available, pilots’ landing accuracy was improved across environmental conditions. The DRT is sensitive to changes in cognitive workload, with workload differences shown between environmental conditions. Increasing symbology appeared to have a minor effect on workload, with an interaction effect of symbology and environmental condition showing that symbology appeared to moderate workload. Conclusion: The DRT is a useful workload measure in simulated helicopter settings. The level of symbology-moderated pilot workload. The increased level of symbology appeared to assist pilots’ flight behavior and landing ability. Results indicate that increased symbology has benefits in more difficult scenarios. Applications: The DRT is an easily implemented and effective measure of cognitive workload in a variety of settings. In the current experiment, the DRT captures the increased workload induced by varying the environmental conditions, and provides evidence for the use of increased symbology to assist pilots.
- 12 August 2020
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 63 (5) , 788-803
The Effects of Increased Visual Information on Cognitive Workload in a Helicopter Simulator
Objective: To test the effects of enhanced display information (“symbology”) on cognitive workload in a simulated helicopter environment, using the detection response task (DRT). Background: Workload in highly demanding environments can be influenced by the amount of information given to the operator and consequently it is important to limit potential overload. Methods: Participants (highly trained military pilots) completed simulated helicopter flights, which varied in visual conditions and the amount of information given. During these flights, participants also completed a DRT as a measure of cognitive workload. Results: With more visual information available, pilots’ landing accuracy was improved across environmental conditions. The DRT is sensitive to changes in cognitive workload, with workload differences shown between environmental conditions. Increasing symbology appeared to have a minor effect on workload, with an interaction effect of symbology and environmental condition showing that symbology appeared to moderate workload. Conclusion: The DRT is a useful workload measure in simulated helicopter settings. The level of symbology-moderated pilot workload. The increased level of symbology appeared to assist pilots’ flight behavior and landing ability. Results indicate that increased symbology has benefits in more difficult scenarios. Applications: The DRT is an easily implemented and effective measure of cognitive workload in a variety of settings. In the current experiment, the DRT captures the increased workload induced by varying the environmental conditions, and provides evidence for the use of increased symbology to assist pilots.
- Open Access
- 4 August 2020
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 63 (5) , 896-909
A Broader Application of the Detection Response Task to Cognitive Tasks and Online Environments
Objective: The present research applied a well-established measure of cognitive workload in driving literature to an in-lab paradigm. We then extended this by comparing the in-lab version of the task to an online version. Background: The accurate and objective measurement of cognitive workload is important in many aspects of psychological research. The detection response task (DRT) is a well-validated method for measuring cognitive workload that has been used extensively in applied tasks, for example, to investigate the effects of phone usage or passenger conversation on driving, but has been used sparingly outside of this field. Method: The study investigated whether the DRT could be used to measure cognitive workload in tasks more commonly used in experimental cognitive psychology and whether this application could be extended to online environments. We had participants perform a multiple object tracking (MOT) task while simultaneously performing a DRT. We manipulated the cognitive load of the MOT task by changing the number of dots to be tracked. Results: Measurements from the DRT were sensitive to changes in the cognitive load, establishing the efficacy of the DRT for experimental cognitive tasks in lab-based situations. This sensitivity continued when applied to an online environment (our code for the online DRT implementation is freely available at https://osf.io/dc39s/ ), though to a reduced extent compared to the in-lab situation. Conclusion: The MOT task provides an effective manipulation of cognitive workload. The DRT is sensitive to changes in workload across a range of settings and is suitable to use outside of driving scenarios, as well as via online delivery. Application: Methodology shows how the DRT could be used to measure sources of cognitive workload in a range of human factors contexts.
- 4 August 2020
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 63 (5) , 896-909
Open AccessA Broader Application of the Detection Response Task to Cognitive Tasks and Online Environments
Objective: The present research applied a well-established measure of cognitive workload in driving literature to an in-lab paradigm. We then extended this by comparing the in-lab version of the task to an online version. Background: The accurate and objective measurement of cognitive workload is important in many aspects of psychological research. The detection response task (DRT) is a well-validated method for measuring cognitive workload that has been used extensively in applied tasks, for example, to investigate the effects of phone usage or passenger conversation on driving, but has been used sparingly outside of this field. Method: The study investigated whether the DRT could be used to measure cognitive workload in tasks more commonly used in experimental cognitive psychology and whether this application could be extended to online environments. We had participants perform a multiple object tracking (MOT) task while simultaneously performing a DRT. We manipulated the cognitive load of the MOT task by changing the number of dots to be tracked. Results: Measurements from the DRT were sensitive to changes in the cognitive load, establishing the efficacy of the DRT for experimental cognitive tasks in lab-based situations. This sensitivity continued when applied to an online environment (our code for the online DRT implementation is freely available at https://osf.io/dc39s/ ), though to a reduced extent compared to the in-lab situation. Conclusion: The MOT task provides an effective manipulation of cognitive workload. The DRT is sensitive to changes in workload across a range of settings and is suitable to use outside of driving scenarios, as well as via online delivery. Application: Methodology shows how the DRT could be used to measure sources of cognitive workload in a range of human factors contexts.