K. Andrew DeSoto
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
K. Andrew DeSoto has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
Henry L. Roediger
Department of Psychological and Brain Sciences, Washington University in St. Louis
4 shared publications- Henry L. RoedigerIII
Washington University in St. Louis, United States
4 shared publications - Adam L. Putnam
Furman University
1 shared publication - Anna Elisabeth van 'T Veer
Methodology and Statistics Unit, Institute of Psychology, Leiden University, Leiden, the Netherlands
1 shared publication - Cecilia M. Votta
Washington University in St. Louis; University of Michigan
1 shared publication - Christopher N. Wahlheim
Department of Psychological and Brain Sciences
1 shared publication
Latest Publications
- 1 April 2023
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 28 (2) , 438-451
Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints.
Robust scientific knowledge is contingent upon replication of original findings. However, replicating researchers are constrained by resources, and will almost always have to choose one replication effort to focus on from a set of potential candidates. To select a candidate efficiently in these cases, we need methods for deciding which out of all candidates considered would be the most useful to replicate, given some overall goal researchers wish to achieve. In this article we assume that the overall goal researchers wish to achieve is to maximize the utility gained by conducting the replication study. We then propose a general rule for study selection in replication research based on the replication value of the set of claims considered for replication. The replication value of a claim is defined as the maximum expected utility we could gain by conducting a replication of the claim, and is a function of (a) the value of being certain about the claim, and (b) uncertainty about the claim based on current evidence. We formalize this definition in terms of a causal decision model, utilizing concepts from decision theory and causal graph modeling. We discuss the validity of using replication value as a measure of expected utility gain, and we suggest approaches for deriving quantitative estimates of replication value. Our goal in this article is not to define concrete guidelines for study selection, but to provide the necessary theoretical foundations on which such concrete guidelines could be built. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
- 1 April 2023
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 28 (2) , 438-451
Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints.
Robust scientific knowledge is contingent upon replication of original findings. However, replicating researchers are constrained by resources, and will almost always have to choose one replication effort to focus on from a set of potential candidates. To select a candidate efficiently in these cases, we need methods for deciding which out of all candidates considered would be the most useful to replicate, given some overall goal researchers wish to achieve. In this article we assume that the overall goal researchers wish to achieve is to maximize the utility gained by conducting the replication study. We then propose a general rule for study selection in replication research based on the replication value of the set of claims considered for replication. The replication value of a claim is defined as the maximum expected utility we could gain by conducting a replication of the claim, and is a function of (a) the value of being certain about the claim, and (b) uncertainty about the claim based on current evidence. We formalize this definition in terms of a causal decision model, utilizing concepts from decision theory and causal graph modeling. We discuss the validity of using replication value as a measure of expected utility gain, and we suggest approaches for deriving quantitative estimates of replication value. Our goal in this article is not to define concrete guidelines for study selection, but to provide the necessary theoretical foundations on which such concrete guidelines could be built. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
- 24 August 2022
- Published by Springer Nature
- p. 129-136
“I Advocate on Behalf of Psychological Science Before the US Congress”
- 24 August 2022
- Published by Springer Nature
- p. 129-136
“I Advocate on Behalf of Psychological Science Before the US Congress”
- 16 January 2022
- Published by Taylor & Francis in Memory
- Vol. 30 (5) , 537-553
Confidence ratings are better predictors of future performance than delayed judgments of learning
What is the best way to predict future memory performance? The intuitive answer is through judgments of learning (JOLs), in which people estimate how likely they are to remember something in the future. Recent theory, however, suggests that a retrospective confidence rating made just after a retrieval attempt might be a better predictor in some situations. In three preregistered experiments, we compared delayed JOLs to confidence ratings. People studied paired associates (E1) or psychology vocabulary terms (E2 & E3), then took a practice cued-recall test in which they made either a JOL or confidence rating after each response. They then took a final test. In Experiment 1, confidence ratings offered higher resolution (metacognitive accuracy) of memory for paired associates than did JOLs, but in Experiments 2 and 3, the advantage of confidence ratings was much smaller. A mini meta-analysis indicated that confidence ratings have a small advantage in predicting future performance over delayed JOLs. We argue that the two judgments rely on similar cues, and that even though JOLs explicitly ask people to predict future performance, doing so does not enhance prediction accuracy. Rather, the presence of a retention interval in the JOL cue adds variability to the judgment process.
- 16 January 2022
- Published by Taylor & Francis in Memory
- Vol. 30 (5) , 537-553
Confidence ratings are better predictors of future performance than delayed judgments of learning
What is the best way to predict future memory performance? The intuitive answer is through judgments of learning (JOLs), in which people estimate how likely they are to remember something in the future. Recent theory, however, suggests that a retrospective confidence rating made just after a retrieval attempt might be a better predictor in some situations. In three preregistered experiments, we compared delayed JOLs to confidence ratings. People studied paired associates (E1) or psychology vocabulary terms (E2 & E3), then took a practice cued-recall test in which they made either a JOL or confidence rating after each response. They then took a final test. In Experiment 1, confidence ratings offered higher resolution (metacognitive accuracy) of memory for paired associates than did JOLs, but in Experiments 2 and 3, the advantage of confidence ratings was much smaller. A mini meta-analysis indicated that confidence ratings have a small advantage in predicting future performance over delayed JOLs. We argue that the two judgments rely on similar cues, and that even though JOLs explicitly ask people to predict future performance, doing so does not enhance prediction accuracy. Rather, the presence of a retention interval in the JOL cue adds variability to the judgment process.
- 29 January 2019
- Published by SAGE Publications in Current Directions in Psychological Science
- Vol. 28 (2) , 138-144
Remembering the Presidents
Here we report research on how important historical figures—presidents of the United States—are remembered and forgotten. When students are given 5 min to recall presidents (in order, if possible), they remember the first few, the most recent, and Lincoln and his immediate successors better than the rest. When this study is done over time, a regular forgetting curve appears, allowing us to assess the rate of forgetting for more recent presidents. Some presidents (e.g., Kennedy) are being forgotten more slowly than others (e.g., Truman). People are more accurate in recognizing presidents than in recalling them, but they also show interesting false recognitions, identifying people such as Alexander Hamilton as a former president. Together, these studies provide a window into how groups of people remember salient figures from their group’s past: its leaders. They also show that the effects derived from studying artificial materials in the lab may generalize more widely to other material with a different type of memory test.
- 29 January 2019
- Published by SAGE Publications in Current Directions in Psychological Science
- Vol. 28 (2) , 138-144
Remembering the Presidents
Here we report research on how important historical figures—presidents of the United States—are remembered and forgotten. When students are given 5 min to recall presidents (in order, if possible), they remember the first few, the most recent, and Lincoln and his immediate successors better than the rest. When this study is done over time, a regular forgetting curve appears, allowing us to assess the rate of forgetting for more recent presidents. Some presidents (e.g., Kennedy) are being forgotten more slowly than others (e.g., Truman). People are more accurate in recognizing presidents than in recalling them, but they also show interesting false recognitions, identifying people such as Alexander Hamilton as a former president. Together, these studies provide a window into how groups of people remember salient figures from their group’s past: its leaders. They also show that the effects derived from studying artificial materials in the lab may generalize more widely to other material with a different type of memory test.
- Open Access
- 14 March 2017
- Published by Springer Nature in Scientific Data
- Vol. 4 (1) , 170028
Replication data collection highlights value in diversity of replication attempts
Researchers agree that replicability and reproducibility are key aspects of science. A collection of Data Descriptors published in Scientific Data presents data obtained in the process of attempting to replicate previously published research. These new replication data describe published and unpublished projects. The different papers in this collection highlight the many ways that scientific replications can be conducted, and they reveal the benefits and challenges of crucial replication research. The organizers of this collection encourage scientists to reuse the data contained in the collection for their own work, and also believe that these replication examples can serve as educational resources for students, early-career researchers, and experienced scientists alike who are interested in learning more about the process of replication.
- 14 March 2017
- Published by Springer Nature in Scientific Data
- Vol. 4 (1) , 170028
Open AccessReplication data collection highlights value in diversity of replication attempts
Researchers agree that replicability and reproducibility are key aspects of science. A collection of Data Descriptors published in Scientific Data presents data obtained in the process of attempting to replicate previously published research. These new replication data describe published and unpublished projects. The different papers in this collection highlight the many ways that scientific replications can be conducted, and they reveal the benefits and challenges of crucial replication research. The organizers of this collection encourage scientists to reuse the data contained in the collection for their own work, and also believe that these replication examples can serve as educational resources for students, early-career researchers, and experienced scientists alike who are interested in learning more about the process of replication.
- 4 April 2016
- Published by SAGE Publications in Psychological Science
- Vol. 27 (5) , 644-650
Recognizing the Presidents
Studies over the past 40 years have shown that Americans can recall about half the U.S. presidents. Do people know the presidents even though they are unable to access them for recall? We investigated this question using the powerful cues of a recognition test. Specifically, we tested the ability of 326 online subjects to recognize U.S. presidents when presented with their full names among various types of lures. The hit rate for presidential recognition was .88, well above the proportion produced in free recall but far from perfect. Presidents Franklin Pierce and Chester Arthur were recognized less than 60% of the time. Interestingly, four nonpresidents were falsely recognized at relatively high rates, and Alexander Hamilton was more frequently identified as president than were several actual presidents. Even on a recognition test, knowledge of American presidents is imperfect and prone to error. The false alarm data support the theory that false fame can arise from contextual familiarity.
- 4 April 2016
- Published by SAGE Publications in Psychological Science
- Vol. 27 (5) , 644-650
Recognizing the Presidents
Studies over the past 40 years have shown that Americans can recall about half the U.S. presidents. Do people know the presidents even though they are unable to access them for recall? We investigated this question using the powerful cues of a recognition test. Specifically, we tested the ability of 326 online subjects to recognize U.S. presidents when presented with their full names among various types of lures. The hit rate for presidential recognition was .88, well above the proportion produced in free recall but far from perfect. Presidents Franklin Pierce and Chester Arthur were recognized less than 60% of the time. Interestingly, four nonpresidents were falsely recognized at relatively high rates, and Alexander Hamilton was more frequently identified as president than were several actual presidents. Even on a recognition test, knowledge of American presidents is imperfect and prone to error. The false alarm data support the theory that false fame can arise from contextual familiarity.
- Open Access
- 30 March 2016
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 7, 373
Remembering the Leaders of China
In two studies, we examined Chinese students’ memory for the names of the leaders of China. In Study 1, subjects were cued with the names of periods from China’s history. Subjects listed as many leaders as possible from each period and put them in the correct ordinal position when they could (see Roediger & DeSoto, 2014). Results showed that within each period, a primacy effect and sometimes a recency effect emerged. Moreover, the average recall probability for leaders within a specific period was a function of the ordinal position of the period. In Study 2, we asked another group of subjects to identify the sources through which they were able to recall each leader. We found that most subjects remembered leaders thanks to class and coursework. We also found a relation between a leader’s recall probability and the amount of information available on that leader on the Internet. Our findings further imply that the serial position function captures the form of collective memory.
- 30 March 2016
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 7, 373
Open AccessRemembering the Leaders of China
In two studies, we examined Chinese students’ memory for the names of the leaders of China. In Study 1, subjects were cued with the names of periods from China’s history. Subjects listed as many leaders as possible from each period and put them in the correct ordinal position when they could (see Roediger & DeSoto, 2014). Results showed that within each period, a primacy effect and sometimes a recency effect emerged. Moreover, the average recall probability for leaders within a specific period was a function of the ordinal position of the period. In Study 2, we asked another group of subjects to identify the sources through which they were able to recall each leader. We found that most subjects remembered leaders thanks to class and coursework. We also found a relation between a leader’s recall probability and the amount of information available on that leader on the Internet. Our findings further imply that the serial position function captures the form of collective memory.
- 7 February 2016
- Published by Taylor & Francis in Memory
- Vol. 25 (2) , 231-243
Study preferences for exemplar variability in self-regulated category learning
Increasing exemplar variability during category learning can enhance classification of novel exemplars from studied categories. Four experiments examined whether participants preferred variability when making study choices with the goal of later classifying novel exemplars. In Experiments 1–3, participants were familiarised with exemplars of birds from multiple categories prior to making category-level assessments of learning and subsequent choices about whether to receive more variability or repetitions of exemplars during study. After study, participants classified novel exemplars from studied categories. The majority of participants showed a consistent preference for variability in their study, but choices were not related to category-level assessments of learning. Experiment 4 provided evidence that study preferences were based primarily on theoretical beliefs in that most participants indicated a preference for variability on questionnaires that did not include prior experience with exemplars. Potential directions for theoretical development and applications to education are discussed.
- 7 February 2016
- Published by Taylor & Francis in Memory
- Vol. 25 (2) , 231-243
Study preferences for exemplar variability in self-regulated category learning
Increasing exemplar variability during category learning can enhance classification of novel exemplars from studied categories. Four experiments examined whether participants preferred variability when making study choices with the goal of later classifying novel exemplars. In Experiments 1–3, participants were familiarised with exemplars of birds from multiple categories prior to making category-level assessments of learning and subsequent choices about whether to receive more variability or repetitions of exemplars during study. After study, participants classified novel exemplars from studied categories. The majority of participants showed a consistent preference for variability in their study, but choices were not related to category-level assessments of learning. Experiment 4 provided evidence that study preferences were based primarily on theoretical beliefs in that most participants indicated a preference for variability on questionnaires that did not include prior experience with exemplars. Potential directions for theoretical development and applications to education are discussed.
- Open Access
- 26 January 2016
- Published by Ubiquity Press, Ltd. in Journal of Open Psychology Data
- Vol. 4 (1)
Psychology Data on the Effects of Study Schedules on Category-Member Classification
Subjects ('N' = 100) studied a series of 6 natural exemplars (birds) from each of 12 different categories (families). Birds were presented in one of 4 ways: (1) blocked by category; (2) intermixed; (3) first blocked, then intermixed; or (4) first intermixed, then blocked. Following study, subjects judged the likelihood that they would be able to classify new birds belonging to families that had been studied earlier. Finally, subjects were asked to classify 6 new birds from each of 12 studied families. The data were collected in the laboratory and are stored using 'figshare 'in an Excel file alongside an annotation file. The data can inform future investigations of the way that individuals learn natural concepts and categories
- 26 January 2016
- Published by Ubiquity Press, Ltd. in Journal of Open Psychology Data
- Vol. 4 (1)
Open AccessPsychology Data on the Effects of Study Schedules on Category-Member Classification
Subjects ('N' = 100) studied a series of 6 natural exemplars (birds) from each of 12 different categories (families). Birds were presented in one of 4 ways: (1) blocked by category; (2) intermixed; (3) first blocked, then intermixed; or (4) first intermixed, then blocked. Following study, subjects judged the likelihood that they would be able to classify new birds belonging to families that had been studied earlier. Finally, subjects were asked to classify 6 new birds from each of 12 studied families. The data were collected in the laboratory and are stored using 'figshare 'in an Excel file alongside an annotation file. The data can inform future investigations of the way that individuals learn natural concepts and categories
- Open Access
- 14 October 2015
- Published by PeerJ in PeerJ Preprints
Computerized methods for collecting confidence ratings: Task influences on patterns of responding
Retrospective confidence ratings and other judgments frequently are collected in computer-based psychology studies, but little research has investigated whether the method with which these ratings are collected influences the resulting data. To explore whether different confidence rating entry methods elicit different responses, 96 subjects were tested in a recognition memory paradigm. To rate confidence in recognition decisions from 0 - 100, half of the subjects used the numeric keypad on the keyboard to respond whereas the other half used an on-screen slider. Notably, whereas subjects using the numeric keypad frequently chose to enter confidence ratings divisible by 5 and 10, subjects using the slider showed no such preference but instead were more likely to accept the slider default value (i.e., 50) for each trial. The method with which confidence ratings are collected may have unintended consequences on confidence rating data and their interpretation.
- 14 October 2015
- Published by PeerJ in PeerJ Preprints
Open AccessComputerized methods for collecting confidence ratings: Task influences on patterns of responding
Retrospective confidence ratings and other judgments frequently are collected in computer-based psychology studies, but little research has investigated whether the method with which these ratings are collected influences the resulting data. To explore whether different confidence rating entry methods elicit different responses, 96 subjects were tested in a recognition memory paradigm. To rate confidence in recognition decisions from 0 - 100, half of the subjects used the numeric keypad on the keyboard to respond whereas the other half used an on-screen slider. Notably, whereas subjects using the numeric keypad frequently chose to enter confidence ratings divisible by 5 and 10, subjects using the slider showed no such preference but instead were more likely to accept the slider default value (i.e., 50) for each trial. The method with which confidence ratings are collected may have unintended consequences on confidence rating data and their interpretation.