RIReilly James Innes

Reilly James Innes

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Reilly James Innes has a total of 59 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Using group level factor models to resolve high dimensionality in model-based sampling.

    by Niek Stevenson, Reilly J. Innes, Quentin F. Gronau, Steven Miletić, Andrew Heathcote, Birte U. Forstmann, Scott D. Brown

    Joint modeling of decisions and neural activation poses the potential to provide significant advances in linking brain and behavior. However, methods of joint modeling have been limited by difficulties in estimation, often due to high dimensionality and simultaneous estimation challenges. In the current article, we propose a method of model estimation that draws on state-of-the-art Bayesian hierarchical modeling techniques and uses factor analysis as a means of dimensionality reduction and inference at the group level. This hierarchical factor approach can adopt any model for the individual and distill the relationships of its parameters across individuals through a factor structure. We demonstrate the significant dimensionality reduction gained by factor analysis and good parameter recovery, and illustrate a variety of factor loading constraints that can be used for different purposes and research questions, as well as three applications of the method to previously analyzed data. We conclude that this method provides a flexible and usable approach with interpretable outcomes that are primarily data-driven, in contrast to the largely hypothesis-driven methods often used in joint modeling. Although we focus on joint modeling methods, this model-based estimation approach could be used for any high dimensional modeling problem. We provide open-source code and accompanying tutorial documentation to make the method accessible to any researchers. (PsycInfo Database Record (c) 2024 APA, all rights reserved).


  • Open Access

    EMC2: An R Package for cognitive models of choice

    by Niek Stevenson, Michelle C. Donzallaz, Reilly James Innes, Birte Forstmann, Dora Matzke, Andrew Heathcote

    We introduce EMC2, an R package for Bayesian hierarchical analysis of cognitive models of choice. EMC2 bridges the gap between standard regression analyses and cognitive modeling through linear-model specifications for each type of cognitive model parameter. The flexible implementation of the linear modeling language allows users to map model parameters directly to complicated designs and hypotheses. EMC2 implements recent developments in Bayesian parameter estimation and hypothesis testing, including powerful and efficient sampling and marginal likelihood estimation algorithms, making it computationally feasible to estimate many different cognitive models and perform inference among them. Using two leading evidence-accumulation models, we illustrate how EMC2 provides a workflow that makes it easy to specify diverse parameterizations and informative priors, and to evaluate, refine, compare, and interpret models.

  • Open Access

    An expert guide to planning experimental tasks for evidence accumulation modelling

    by Russell James Boag, Reilly James Innes, Niek Stevenson, Giwon Bahg, Jerome R Busemeyer, Gregory Edward Cox, Chris Donkin, Michael Frank, Guy Hawkins, Andrew Heathcote, et al.

    Evidence accumulation models (EAMs) are powerful tools for making sense of human and animal decision-making behaviour. EAMs have generated significant theoretical advances in psychology, behavioural economics, and cognitive neuroscience, and are increasingly used as a measurement tool in clinical research and other applied settings. Obtaining valid and reliable inferences from EAMs depends on knowing how to establish a close match between model assumptions and features of the task/data to which the model is applied. However, this knowledge is rarely articulated in the EAM literature, leaving beginners to rely on the private advice of mentors and colleagues, and on inefficient trial-and-error learning. In this article, we provide practical guidance for designing tasks appropriate for EAMs, for relating experimental manipulations to EAM parameters, for planning appropriate sample sizes, and for preparing data and conducting an EAM analysis. Our advice is based on prior methodological studies and the authors’ substantial collective experience with EAMs. By encouraging good task design practices, and warning of potential pitfalls, we hope to improve the quality and trustworthiness of future EAM research and applications.


  • Open Access

    Hierarchical Bayesian Estimation for Cognitive Models using Particle Metropolis within Gibbs (PMwG): A tutorial

    by Quentin Frederik Gronau, Caroline Kuhne, Reilly James Innes, Gavin Cooper, Niek Stevenson, Jon-Paul Cavallaro, Scott Brown, Guy Hawkins

    Estimating quantitative cognitive models from data is a staple of modern psychological science, but can be difficult and inefficient. Particle Metropolis within Gibbs (PMwG) is a robust and efficient sampling algorithm which supports model estimation in a hierarchical Bayesian framework. This tutorial shows how cognitive modelling can proceed efficiently using pmwg, a new open-source package for the R language. We step through implementing the pmwg package with simple signal detection theory models, to more complex cognitive models in which two tasks are jointly modelled together. Through this process, we also address questions of model-adequacy and model selection, which are must be solved in order to answer meaningful psychological questions. PMwG, and the pmwg package, has the potential to move the field of psychology ahead in new and interesting directions, and to resolve questions that were once too hard to answer with previously available sampling methods.


  • Open Access

    Joint modelling of latent cognitive mechanisms shared across decision-making domains

    by Niek Stevenson, Reilly James Innes, Steven Miletic, Russell James Boag

    Decision-making behavior is often understood using the framework of evidence accumulation models (EAMs). Nowadays, EAMs are applied to various domains of decision-making with the underlying assumption that the latent cognitive constructs proposed by EAMs are consistent across these domains. In this study we investigate both the extent to which the parameters of EAMs are related between four different decision-making domains and across different time points. To that end, we make use of the novel joint modelling approach, that explicitly includes relationships between parameters, such as covariances or underlying factors, in one combined joint model. Consequently, this joint model also accounts for measurement error and uncertainty within the estimation of these relations. We found that EAM parameters were consistent between time points on three of the four decision-making tasks. For our between-task analysis we constructed a joint model with a factor analysis on the parameters of the different tasks. Our two factor joint model indicated that information processing ability was related between the different decision-making domains. However, other cognitive constructs such as the degree of response caution and urgency were only comparable on some domains.

  • Open Access

    Using group level factor models to resolve high dimensionality in model-based sampling

    by Niek Stevenson, Reilly James Innes, Quentin Frederik Gronau, Steven Miletic, Andrew Heathcote, Birte Forstmann, Scott Brown

    Joint modelling of decisions and neural activation poses the potential toprovide significant advances in linking brain and behaviour. However, methodsof joint modelling have been limited by difficulties in estimation, oftendue to high dimensionality and simultaneous estimation challenges. In thecurrent article, we propose a method of model estimation which draws onstate-of-the-art Bayesian hierarchical modelling techniques and uses factoranalysis as a means of dimensionality reduction and inference at the grouplevel. This hierarchical factor approach can adopt any model for the individualand distil the relationships of its parameters across individuals througha factor structure. We demonstrate the significant dimensionality reductiongained by factor analysis, good parameter recovery, and illustrate a varietyof factor loading constraints which can be used for different purposes andresearch questions, as well as three applications of the method to previouslyanalysed data. We conclude that this method provides a flexible and usableapproach with interpretable outcomes that are primarily data driven, in contrastto the largely hypothesis driven methods often used in joint modelling.Although we focus on joint modelling methods, this model based estimationapproach could be used for any high dimensional modelling problem. Weprovide open source code and accompanying tutorial documentation to makethe method accessible to any researchers.


  • Open Access

    Structure-function similarities in deep brain stimulation targets cross-species

    by Max C. Keuken, Anneke Alkemade, Niek Stevenson, Reilly J. Innes, Birte U. Forstmann


  • Assessing cross-modal interference in the detection response task

    by Alexander Thorpe, Reilly Innes, James Townsend, Rachel Heath, Keith Nesbitt, Ami Eidels


  • The Effects of Increased Visual Information on Cognitive Workload in a Helicopter Simulator

    by Reilly J. Innes, Zachary L. Howard, Alexander Thorpe, Ami Eidels, Scott D. Brown

    Objective: To test the effects of enhanced display information (“symbology”) on cognitive workload in a simulated helicopter environment, using the detection response task (DRT). Background: Workload in highly demanding environments can be influenced by the amount of information given to the operator and consequently it is important to limit potential overload. Methods: Participants (highly trained military pilots) completed simulated helicopter flights, which varied in visual conditions and the amount of information given. During these flights, participants also completed a DRT as a measure of cognitive workload. Results: With more visual information available, pilots’ landing accuracy was improved across environmental conditions. The DRT is sensitive to changes in cognitive workload, with workload differences shown between environmental conditions. Increasing symbology appeared to have a minor effect on workload, with an interaction effect of symbology and environmental condition showing that symbology appeared to moderate workload. Conclusion: The DRT is a useful workload measure in simulated helicopter settings. The level of symbology-moderated pilot workload. The increased level of symbology appeared to assist pilots’ flight behavior and landing ability. Results indicate that increased symbology has benefits in more difficult scenarios. Applications: The DRT is an easily implemented and effective measure of cognitive workload in a variety of settings. In the current experiment, the DRT captures the increased workload induced by varying the environmental conditions, and provides evidence for the use of increased symbology to assist pilots.


  • Open Access

    A Broader Application of the Detection Response Task to Cognitive Tasks and Online Environments

    by Reilly J. Innes, Nathan J. Evans, Zachary L. Howard, Ami Eidels, Scott D. Brown

    Objective: The present research applied a well-established measure of cognitive workload in driving literature to an in-lab paradigm. We then extended this by comparing the in-lab version of the task to an online version. Background: The accurate and objective measurement of cognitive workload is important in many aspects of psychological research. The detection response task (DRT) is a well-validated method for measuring cognitive workload that has been used extensively in applied tasks, for example, to investigate the effects of phone usage or passenger conversation on driving, but has been used sparingly outside of this field. Method: The study investigated whether the DRT could be used to measure cognitive workload in tasks more commonly used in experimental cognitive psychology and whether this application could be extended to online environments. We had participants perform a multiple object tracking (MOT) task while simultaneously performing a DRT. We manipulated the cognitive load of the MOT task by changing the number of dots to be tracked. Results: Measurements from the DRT were sensitive to changes in the cognitive load, establishing the efficacy of the DRT for experimental cognitive tasks in lab-based situations. This sensitivity continued when applied to an online environment (our code for the online DRT implementation is freely available at https://osf.io/dc39s/ ), though to a reduced extent compared to the in-lab situation. Conclusion: The MOT task provides an effective manipulation of cognitive workload. The DRT is sensitive to changes in workload across a range of settings and is suitable to use outside of driving scenarios, as well as via online delivery. Application: Methodology shows how the DRT could be used to measure sources of cognitive workload in a range of human factors contexts.