Brain Decoding from Functional MRI Using Long Short-Term Memory Recurrent Neural Networks
Authors:
- 13 September 2018
- book chapter
- Published by Springer Nature
- Vol. 11072, 320-328
Abstract
Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain functional connectivity or brain activation signatures for a variety of brain decoding tasks. However, most of existing studies have built decoding models upon features extracted from imaging data at individual time points or temporal windows with a fixed interval, which might not be optimal across different cognitive processes due to varying temporal durations and dependency of different cognitive processes. In this study, we develop a deep learning based framework for brain decoding by leveraging recent advances in sequence modeling using long short-term memory (LSTM) recurrent neural networks (RNNs). Particularly, functional profiles extracted from task functional imaging data based on their corresponding subject-specific intrinsic functional networks are used as features to build brain decoding models, and LSTM RNNs are adopted to learn decoding mappings between functional profiles and brain states. We evaluate the proposed method using task fMRI data from the HCP dataset, and experimental results have demonstrated that the proposed method could effectively distinguish brain states under different task events and obtain higher accuracy than conventional decoding models. Keywords Brain decoding Recurrent neural networks Long short-term memoryKeywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Decoding fMRI activity in the time domain improves classification performanceNeuroImage, 2018
- Large-scale sparse functional networks from resting state fMRINeuroImage, 2017
- Task-specific feature extraction and classification of fMRI volumes using a deep neural network initialized with a deep belief network: Evaluation using sensorimotor tasksNeuroImage, 2017
- Decoding the Semantic Content of Natural Movies from Human Brain ActivityFrontiers in Systems Neuroscience, 2016
- Decoding the individual finger movements from single‐trial functional magnetic resonance imaging recordings of human brain activityEuropean Journal of Neuroscience, 2014
- The minimal preprocessing pipelines for the Human Connectome ProjectNeuroImage, 2013
- Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analysesNeuroImage, 2012
- Decoding Subject-Driven Cognitive States with Whole-Brain Connectivity PatternsCerebral Cortex, 2011
- Classifying spatial patterns of brain activity with machine learning methods: Application to lie detectionNeuroImage, 2005
- Long Short-Term MemoryNeural Computation, 1997