Daryl Fougnie
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Daryl Fougnie has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
Anish Kanabar
Department of Psychiatry, Massachusetts General Hospital, Boston, USA
3 shared publicationsClayton E. Curtis
Department of Psychology, New York University, New York, New York 10003
2 shared publicationsKartik K. Sreenivasan
Program in Psychology, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi, United Arab Emirates
2 shared publications- Kartik K. Sreenivasan
Division of Science and Mathematics, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
2 shared publications Stergiani Lentzou
Program in Psychology, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi, United Arab Emirates
2 shared publicationsTimothy F. Brady
Department of Psychology, University of California, San Diego, La Jolla, USA
2 shared publications
Latest Publications
- Open Access
- 27 November 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Probabilistic and rich individual working memories revealed by a betting game
When asked to remember a color, do people remember a point estimate (e.g., a particular shade of red), a point estimate plus an uncertainty estimate, or are memory representations rich probabilistic distributions over feature space? We asked participants to report the color of a circle held in working memory. Rather than collecting a single report per trial, we had participants place multiple bets to create trialwise uncertainty distributions. Bet dispersion correlated with performance, indicating that internal uncertainty guided bet placement. While the first bet was on average the most precisely placed, the later bets systematically shifted the distribution closer to the target, resulting in asymmetrical distributions about the first bet. This resulted in memory performance improvements when averaging across bets, and overall suggests that memory representations contain more information than can be conveyed by a single response. The later bets contained target information even when the first response would generally be classified as a guess or report of an incorrect item, suggesting that such failures are not all-or-none. This paradigm provides multiple pieces of evidence that memory representations are rich and probabilistic. Crucially, standard discrete response paradigms underestimate the amount of information in memory representations.
- 27 November 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Open AccessProbabilistic and rich individual working memories revealed by a betting game
When asked to remember a color, do people remember a point estimate (e.g., a particular shade of red), a point estimate plus an uncertainty estimate, or are memory representations rich probabilistic distributions over feature space? We asked participants to report the color of a circle held in working memory. Rather than collecting a single report per trial, we had participants place multiple bets to create trialwise uncertainty distributions. Bet dispersion correlated with performance, indicating that internal uncertainty guided bet placement. While the first bet was on average the most precisely placed, the later bets systematically shifted the distribution closer to the target, resulting in asymmetrical distributions about the first bet. This resulted in memory performance improvements when averaging across bets, and overall suggests that memory representations contain more information than can be conveyed by a single response. The later bets contained target information even when the first response would generally be classified as a guess or report of an incorrect item, suggesting that such failures are not all-or-none. This paradigm provides multiple pieces of evidence that memory representations are rich and probabilistic. Crucially, standard discrete response paradigms underestimate the amount of information in memory representations.
- 4 August 2022
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 42 (37) , 7110-7120
Common Neural Mechanisms Control Attention and Working Memory
Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.
- 4 August 2022
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 42 (37) , 7110-7120
Common Neural Mechanisms Control Attention and Working Memory
Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.
- Open Access
Common neural mechanisms control attention and working memory
Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. Significance statement How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.
Open AccessCommon neural mechanisms control attention and working memory
Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. Significance statement How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.
- Open Access
Using a betting game to reveal the rich nature of visual working memories
When we ask people to hold a color in working memory, what do they store? Do they remember colors as point estimates (e.g. a particular shade of red) or are memory representations richer, such as uncertainty distributions over feature space? We developed a novel paradigm (a betting game) to measure the nature of working memory representations. Participants were shown a set of colored circles and, after a brief memory delay, asked about one of the objects. Rather than reporting a single color, participants placed multiple bets to create distributions in color space. The dispersion of bets was correlated with performance, indicating that participants’ internal uncertainty guided bet placement. Furthermore, relative to the first response, memory performance improved when averaging across multiple bets, showing that memories contain more information than can be conveyed in a single response. Finally, information about the item in memory was present in subsequent responses even when the first response would generally be classified as a guess or report of an incorrect item, suggesting that such failures are not all-or-none. Thus, memory representations are more than noisy point estimates; they are surprisingly rich and probabilistic.
Open AccessUsing a betting game to reveal the rich nature of visual working memories
When we ask people to hold a color in working memory, what do they store? Do they remember colors as point estimates (e.g. a particular shade of red) or are memory representations richer, such as uncertainty distributions over feature space? We developed a novel paradigm (a betting game) to measure the nature of working memory representations. Participants were shown a set of colored circles and, after a brief memory delay, asked about one of the objects. Rather than reporting a single color, participants placed multiple bets to create distributions in color space. The dispersion of bets was correlated with performance, indicating that participants’ internal uncertainty guided bet placement. Furthermore, relative to the first response, memory performance improved when averaging across multiple bets, showing that memories contain more information than can be conveyed in a single response. Finally, information about the item in memory was present in subsequent responses even when the first response would generally be classified as a guess or report of an incorrect item, suggesting that such failures are not all-or-none. Thus, memory representations are more than noisy point estimates; they are surprisingly rich and probabilistic.
- Open Access
- 3 August 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (8) , 3
Working memory is corrupted by strategic changes in search templates
When searching for a specific object, we often form an image of the target, which we use as a search template. This template is thought to be maintained in working memory, primarily because of evidence that the contents of working memory influences search behavior. However, it is unknown whether this interaction applies in both directions. Here, we show that changes in search templates influence working memory. Participants were asked to remember the orientation of a line that changed every trial, and on some trials (75%) search for that orientation, but on remaining trials recall the orientation. Critically, we manipulated the target template by introducing a predictable context—distractors in the visual search task were always counterclockwise (or clockwise) from the search target. The predictable context produced a large bias in search. Importantly, we also found a similar bias in orientation memory reports, demonstrating that working memory and target templates were not held as completely separate, isolated representations. However, the memory bias was considerably smaller than the search bias, suggesting that, although there is a common source, the two may not be driven by a single, shared process.
- 3 August 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (8) , 3
Open AccessWorking memory is corrupted by strategic changes in search templates
When searching for a specific object, we often form an image of the target, which we use as a search template. This template is thought to be maintained in working memory, primarily because of evidence that the contents of working memory influences search behavior. However, it is unknown whether this interaction applies in both directions. Here, we show that changes in search templates influence working memory. Participants were asked to remember the orientation of a line that changed every trial, and on some trials (75%) search for that orientation, but on remaining trials recall the orientation. Critically, we manipulated the target template by introducing a predictable context—distractors in the visual search task were always counterclockwise (or clockwise) from the search target. The predictable context produced a large bias in search. Importantly, we also found a similar bias in orientation memory reports, demonstrating that working memory and target templates were not held as completely separate, isolated representations. However, the memory bias was considerably smaller than the search bias, suggesting that, although there is a common source, the two may not be driven by a single, shared process.
- Open Access
- 30 March 2020
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 117 (15) , 8391-8397
Humans incorporate trial-to-trial working memory uncertainty into rewarded decisions
Working memory (WM) plays an important role in action planning and decision making; however, both the informational content of memory and how that information is used in decisions remain poorly understood. To investigate this, we used a color WM task in which subjects viewed colored stimuli and reported both an estimate of a stimulus color and a measure of memory uncertainty, obtained through a rewarded decision. Reported memory uncertainty is correlated with memory error, showing that people incorporate their trial-to-trial memory quality into rewarded decisions. Moreover, memory uncertainty can be combined with other sources of information; after inducing expectations (prior beliefs) about stimuli probabilities, we found that estimates became shifted toward expected colors, with the shift increasing with reported uncertainty. The data are best fit by models in which people incorporate their trial-to-trial memory uncertainty with potential rewards and prior beliefs. Our results suggest that WM represents uncertainty information, and that this can be combined with prior beliefs. This highlights the potential complexity of WM representations and shows that rewarded decision can be a powerful tool for examining WM and informing and constraining theoretical, computational, and neurobiological models of memory.
- 30 March 2020
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 117 (15) , 8391-8397
Open AccessHumans incorporate trial-to-trial working memory uncertainty into rewarded decisions
Working memory (WM) plays an important role in action planning and decision making; however, both the informational content of memory and how that information is used in decisions remain poorly understood. To investigate this, we used a color WM task in which subjects viewed colored stimuli and reported both an estimate of a stimulus color and a measure of memory uncertainty, obtained through a rewarded decision. Reported memory uncertainty is correlated with memory error, showing that people incorporate their trial-to-trial memory quality into rewarded decisions. Moreover, memory uncertainty can be combined with other sources of information; after inducing expectations (prior beliefs) about stimuli probabilities, we found that estimates became shifted toward expected colors, with the shift increasing with reported uncertainty. The data are best fit by models in which people incorporate their trial-to-trial memory uncertainty with potential rewards and prior beliefs. Our results suggest that WM represents uncertainty information, and that this can be combined with prior beliefs. This highlights the potential complexity of WM representations and shows that rewarded decision can be a powerful tool for examining WM and informing and constraining theoretical, computational, and neurobiological models of memory.
- Open Access
- 1 May 2018
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 80 (6) , 1571-1583
A common source of attention for auditory and visual tracking
Tasks that require tracking visual information reveal the severe limitations of our capacity to attend to multiple objects that vary in time and space. Although these limitations have been...
- 1 May 2018
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 80 (6) , 1571-1583
Open AccessA common source of attention for auditory and visual tracking
Tasks that require tracking visual information reveal the severe limitations of our capacity to attend to multiple objects that vary in time and space. Although these limitations have been...
- Open Access
Humans incorporate trial-to-trial working memory uncertainty into rewarded decisions
In daily life, working memory plays an important role in action planning and decision-making. However, both the informational content of memory and how that information is used in decisions is poorly understood. To investigate this, we conducted a memory experiment where people not only reported an estimate of a remembered stimulus, but also made a rewarded decision designed to reflect memory uncertainty. Reported memory uncertainty is correlated with estimation error, showing people incorporate their trial-to-trial memory quality into rewarded decisions. Moreover, memory uncertainty can be combined with other sources of information; after we induced prior beliefs about stimuli probabilities, we found that estimates shifted towards more frequent colors, with the shift increasing with reported uncertainty. The data is best predicted by models where people incorporate their trial-to-trial memory uncertainty with potential rewards and prior beliefs, highlighting the importance of studying working memory as a process integrated with decision-making.
Open AccessHumans incorporate trial-to-trial working memory uncertainty into rewarded decisions
In daily life, working memory plays an important role in action planning and decision-making. However, both the informational content of memory and how that information is used in decisions is poorly understood. To investigate this, we conducted a memory experiment where people not only reported an estimate of a remembered stimulus, but also made a rewarded decision designed to reflect memory uncertainty. Reported memory uncertainty is correlated with estimation error, showing people incorporate their trial-to-trial memory quality into rewarded decisions. Moreover, memory uncertainty can be combined with other sources of information; after we induced prior beliefs about stimuli probabilities, we found that estimates shifted towards more frequent colors, with the shift increasing with reported uncertainty. The data is best predicted by models where people incorporate their trial-to-trial memory uncertainty with potential rewards and prior beliefs, highlighting the importance of studying working memory as a process integrated with decision-making.
- Open Access
- 1 August 2016
- Published by American Psychological Association (APA) in Journal of Experimental Psychology: Human Perception and Performance
- Vol. 42 (8) , 1231-1240
Strategic trade-offs between quantity and quality in working memory.
Is working memory capacity determined by an immutable limit-for example, 4 memory storage slots? The fact that performance is typically unaffected by task instructions has been taken as support for such structural models of memory. Here, we modified a standard working memory task to incentivize participants to remember more items. Participants were asked to remember a set of colors over a short retention interval. In 1 condition, participants reported a random item's color using a color wheel. In the modified task, participants responded to all items and their response was only considered correct if all responses were on the correct half of the color wheel. We looked for a trade-off between quantity and quality-participants storing more items, but less precisely, when required to report them all. This trade-off was observed when tasks were blocked and when task-type was cued after encoding, but not when task-type was cued during the response, suggesting that task differences changed how items were actively encoded and maintained. This strategic control over the contents of working memory challenges models that assume inflexible limits on memory storage. (PsycINFO Database Record
- 1 August 2016
- Published by American Psychological Association (APA) in Journal of Experimental Psychology: Human Perception and Performance
- Vol. 42 (8) , 1231-1240
Open AccessStrategic trade-offs between quantity and quality in working memory.
Is working memory capacity determined by an immutable limit-for example, 4 memory storage slots? The fact that performance is typically unaffected by task instructions has been taken as support for such structural models of memory. Here, we modified a standard working memory task to incentivize participants to remember more items. Participants were asked to remember a set of colors over a short retention interval. In 1 condition, participants reported a random item's color using a color wheel. In the modified task, participants responded to all items and their response was only considered correct if all responses were on the correct half of the color wheel. We looked for a trade-off between quantity and quality-participants storing more items, but less precisely, when required to report them all. This trade-off was observed when tasks were blocked and when task-type was cued after encoding, but not when task-type was cued during the response, suggesting that task differences changed how items were actively encoded and maintained. This strategic control over the contents of working memory challenges models that assume inflexible limits on memory storage. (PsycINFO Database Record