Continuous Closed-Loop Decoder Adaptation with a Recursive Maximum Likelihood Algorithm Allows for Rapid Performance Acquisition in Brain-Machine Interfaces
- 1 September 2014
- journal article
- research article
- Published by MIT Press in Neural Computation
- Vol. 26 (9) , 1811-1839
Abstract
Closed-loop decoder adaptation (CLDA) is an emerging paradigm for both improving and maintaining online performance in brain-machine interfaces (BMIs). The time required for initial decoder training and any subsequent decoder recalibrations could be potentially reduced by performing continuous adaptation, in which decoder parameters are updated at every time step during these procedures, rather than waiting to update the decoder at periodic intervals in a more batch-based process. Here, we present recursive maximum likelihood (RML), a CLDA algorithm that performs continuous adaptation of a Kalman filter decoder's parameters. We demonstrate that RML possesses a variety of useful properties and practical algorithmic advantages. First, we show how RML leverages the accuracy of updates based on a batch of data while still adapting parameters on every time step. Second, we illustrate how the RML algorithm is parameterized by a single, intuitive half-life parameter that can be used to adjust the rate of adaptation in real time. Third, we show how even when the number of neural features is very large, RML's memory-efficient recursive update rules can be reformulated to also be computationally fast so that continuous adaptation is still feasible. To test the algorithm in closed-loop experiments, we trained three macaque monkeys to perform a center-out reaching task by using either spiking activity or local field potentials to control a 2D computer cursor. RML achieved higher levels of performance more rapidly in comparison to a previous CLDA algorithm that adapts parameters on a more intermediate timescale. Overall, our results indicate that RML is an effective CLDA algorithm for achieving rapid performance acquisition using continuous adaptation.Keywords
This publication has 41 references indexed in Scilit:
- A high-performance neural prosthesis enabled by control algorithm designNature Neuroscience, 2012
- Reach and grasp by people with tetraplegia using a neurally controlled robotic armNature, 2012
- Restoration of grasp following paralysis through brain-controlled stimulation of musclesNature, 2012
- Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skillsNature, 2012
- Adaptive Decoding for Brain-Machine Interfaces Through Bayesian Parameter UpdatesNeural Computation, 2011
- Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortexJournal of Neural Engineering, 2011
- Reversible large-scale modification of cortical networks during neuroprosthetic controlNature Neuroscience, 2011
- Functional network reorganization during learning in a brain-computer interface paradigmProceedings of the National Academy of Sciences, 2008
- Direct control of paralysed muscles by cortical neuronsNature, 2008
- Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegiaJournal of Neural Engineering, 2008