Francisco Pereira
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Francisco Pereira has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Evelina Fedorenko
McGovern Institute for Brain Research, Massachusetts Institute of Technology, 02139
2 shared publications Greg Detre
Princeton University, Psychology
2 shared publicationsMatthew Botvinick
Princeton University, Psychology
2 shared publications- Matthew Botvinick
Google DeepMind, London, UK
2 shared publications Bin Lou
Medical Imaging Technologies, Siemens Healthineers, Princeton, NJ 08540, USA
1 shared publication- Bin Lou
Medical Imaging Technologies, Siemens Healthcare
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 6 March 2018
- Published by Springer Nature in Nature Communications
- Vol. 9 (1) , 1-13
Toward a universal decoder of linguistic meaning from brain activation
Prior work decoding linguistic meaning from imaging data has been largely limited to concrete nouns, using similar stimuli for training and testing, from a relatively small number of semantic categories. Here we present a new approach for building a brain decoding system in which words and sentences are represented as vectors in a semantic space constructed from massive text corpora. By efficiently sampling this space to select training stimuli shown to subjects, we maximize the ability to generalize to new meanings from limited imaging data. To validate this approach, we train the system on imaging data of individual concepts, and show it can decode semantic vector representations from imaging data of sentences about a wide variety of both concrete and abstract topics from two separate datasets. These decoded representations are sufficiently detailed to distinguish even semantically similar sentences, and to capture the similarity structure of meaning relationships between sentences.
- 6 March 2018
- Published by Springer Nature in Nature Communications
- Vol. 9 (1) , 1-13
Top Cited PapersOpen AccessToward a universal decoder of linguistic meaning from brain activation
Prior work decoding linguistic meaning from imaging data has been largely limited to concrete nouns, using similar stimuli for training and testing, from a relatively small number of semantic categories. Here we present a new approach for building a brain decoding system in which words and sentences are represented as vectors in a semantic space constructed from massive text corpora. By efficiently sampling this space to select training stimuli shown to subjects, we maximize the ability to generalize to new meanings from limited imaging data. To validate this approach, we train the system on imaging data of individual concepts, and show it can decode semantic vector representations from imaging data of sentences about a wide variety of both concrete and abstract topics from two separate datasets. These decoded representations are sufficiently detailed to distinguish even semantically similar sentences, and to capture the similarity structure of meaning relationships between sentences.
- Open Access
Decoding of generic mental representations from functional MRI data using word embeddings
Several different groups have demonstrated the feasibility of building forward models of functional MRI data in response to concrete stimuli such as pictures or video, and of using these models to decode or reconstruct stimuli shown while acquiring test fMRI data. In this paper, we introduce an approach for building forward models of conceptual stimuli, concrete or abstract, and for using these models to carry out decoding of semantic information from new imaging data. We show that this approach generalizes to topics not seen in training, and provides a straightforward path to decoding from more complex stimuli such as sentences or paragraphs.
Open AccessDecoding of generic mental representations from functional MRI data using word embeddings
Several different groups have demonstrated the feasibility of building forward models of functional MRI data in response to concrete stimuli such as pictures or video, and of using these models to decode or reconstruct stimuli shown while acquiring test fMRI data. In this paper, we introduce an approach for building forward models of conceptual stimuli, concrete or abstract, and for using these models to carry out decoding of semantic information from new imaging data. We show that this approach generalizes to topics not seen in training, and provides a straightforward path to decoding from more complex stimuli such as sentences or paragraphs.
- Open Access
- 11 February 2011
- Published by Springer Nature in Nature Precedings
- p. 1
Generating descriptive text from functional brain images
Recent work has shown that it is possible to take brain images of a subject acquired while they saw a scene and reconstruct an approximation of that scene from the images. Here we show that it is also possible to generate text from brain images. We began with images collected as participants read names of objects (e.g., ``Apartment'). Without accessing information about the object viewed for an individual image, we were able to generate from it a collection of semantically pertinent words (e.g., "door," "window"). Across images, the sets of words generated overlapped consistently with those contained in articles about the relevant concepts from the online encyclopedia Wikipedia. The technique described, if developed further, could offer an important new tool in building human computer interfaces for use in clinical settings.
- 11 February 2011
- Published by Springer Nature in Nature Precedings
- p. 1
Open AccessGenerating descriptive text from functional brain images
Recent work has shown that it is possible to take brain images of a subject acquired while they saw a scene and reconstruct an approximation of that scene from the images. Here we show that it is also possible to generate text from brain images. We began with images collected as participants read names of objects (e.g., ``Apartment'). Without accessing information about the object viewed for an individual image, we were able to generate from it a collection of semantically pertinent words (e.g., "door," "window"). Across images, the sets of words generated overlapped consistently with those contained in articles about the relevant concepts from the online encyclopedia Wikipedia. The technique described, if developed further, could offer an important new tool in building human computer interfaces for use in clinical settings.
- Open Access
- 1 January 2011
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 5, 11244
Generating Text from Functional Brain Images
Recent work has shown that it is possible to take brain images acquired during viewing of a scene and reconstruct an approximation of the scene from those images. Here we show that it is also possible to generate text about the mental content reflected in brain images. We began with images collected as participants read names of concrete items (e.g., "Apartment") while also seeing line drawings of the item named. We built a model of the mental semantic representation of concrete concepts from text data and learned to map aspects of such representation to patterns of activation in the corresponding brain image. In order to validate this mapping, without accessing information about the items viewed for left-out individual brain images, we were able to generate from each one a collection of semantically pertinent words (e.g., "door," "window" for "Apartment"). Furthermore, we show that the ability to generate such words allows us to perform a classification task and thus validate our method quantitatively.
- 1 January 2011
- Published by Frontiers Media SA in Frontiers in Human Neuroscience
- Vol. 5, 11244
Open AccessGenerating Text from Functional Brain Images
Recent work has shown that it is possible to take brain images acquired during viewing of a scene and reconstruct an approximation of the scene from those images. Here we show that it is also possible to generate text about the mental content reflected in brain images. We began with images collected as participants read names of concrete items (e.g., "Apartment") while also seeing line drawings of the item named. We built a model of the mental semantic representation of concrete concepts from text data and learned to map aspects of such representation to patterns of activation in the corresponding brain image. In order to validate this mapping, without accessing information about the items viewed for left-out individual brain images, we were able to generate from each one a collection of semantically pertinent words (e.g., "door," "window" for "Apartment"). Furthermore, we show that the ability to generate such words allows us to perform a classification task and thus validate our method quantitatively.