Kate Candon
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Kate Candon has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
- Marynel Vázquez
Department of Computer Science, Yale University, New Haven, USA
9 shared publications - Houston Claure
Yale University, New Haven, USA
3 shared publications - Qiping Zhang
Yale University, New Haven, CT, USA
3 shared publications - Alexander Lew
Department of Computer Science, Yale University, New Haven, CT, USA
2 shared publications - Austin Narcomey
Yale University, New Haven, CT, USA
2 shared publications - Brian Scassellati
Department of Computer Science, Yale University, New Haven, USA
2 shared publications
Latest Publications
- 14 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (6) , 6991-6998
From Tool to Teammate: Balancing Task-Oriented and Social Talk During Human–Robot Collaboration
As robots become more integrated into shared work environments, effective communication must balance clear task directives with social engagement to support both efficiency and user satisfaction. This letter examines how people perceive task-oriented versus social dialogue during human–robot collaboration and how they judge the appropriateness of switching between them. We discuss a pilot, in-person data collection and two follow-up online studies with an autonomous robot in a collaborative pizza-making task. The pilot assesses the technical feasibility of an autonomous robot generating distinct task and social dialogue styles. Next, with a larger participant sample, we evaluate the salience of the two talk types and their impact on perceptions of the robot as a collaborative partner. The second study explores judgments of talk type switching using video clips from the pilot, revealing how timing, task state, and user behavior influence perceived appropriateness. Together, these findings highlight nuanced human expectations for robot communication and inform the design of collaborative robots that can adaptively balance task-oriented and social talk in contextually sensitive ways.
- 14 April 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (6) , 6991-6998
From Tool to Teammate: Balancing Task-Oriented and Social Talk During Human–Robot Collaboration
As robots become more integrated into shared work environments, effective communication must balance clear task directives with social engagement to support both efficiency and user satisfaction. This letter examines how people perceive task-oriented versus social dialogue during human–robot collaboration and how they judge the appropriateness of switching between them. We discuss a pilot, in-person data collection and two follow-up online studies with an autonomous robot in a collaborative pizza-making task. The pilot assesses the technical feasibility of an autonomous robot generating distinct task and social dialogue styles. Next, with a larger participant sample, we evaluate the salience of the two talk types and their impact on perceptions of the robot as a collaborative partner. The second study explores judgments of talk type switching using video clips from the pilot, revealing how timing, task state, and user behavior influence perceived appropriateness. Together, these findings highlight nuanced human expectations for robot communication and inform the design of collaborative robots that can adaptively balance task-oriented and social talk in contextually sensitive ways.
- Open Access
- 16 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 98-107
The Dynamics of Human Fairness Judgments towards a Robot
Fairness is critical for collaboration between humans, and recent research has shown its importance in human–robot collaboration. However, most human-robot interaction (HRI) studies probe fairness judgments toward a robot only at the conclusion of an interaction, overlooking the fact that perceptions of fairness can evolve over time. We present two studies of dynamic fairness that both leverage a Multiplayer Space Invaders game, where a robot controls a spaceship and distributes support across players' sides of the screen. The robot's support is at times biased in favor of one player or the other. In the first study, we examine how fairness perceptions are influenced by the timing of a robot's biased support (early vs. late in the interaction) and the beneficiary of this support (the participant vs. another agent). In the second study, we investigate how expectations of a robot's support behavior (biased vs. unbiased) interact with its actual behavior (biased vs. unbiased) in a setting where two participants each worked to score an individual score threshold. We find that fairness judgments are dynamic: fairness falls after the robot's allocation of support becomes biased but is slower to recover once support becomes unbiased, and participants expecting unbiased behavior judge fairness more harshly when these expectations are violated. Our findings advance understanding of fairness in HRI by presenting it as a dynamic construct shaped not only by the actual behavior of the robot but also by the timing of robot actions and expectations of robot behavior.
- 16 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 98-107
Open AccessThe Dynamics of Human Fairness Judgments towards a Robot
Fairness is critical for collaboration between humans, and recent research has shown its importance in human–robot collaboration. However, most human-robot interaction (HRI) studies probe fairness judgments toward a robot only at the conclusion of an interaction, overlooking the fact that perceptions of fairness can evolve over time. We present two studies of dynamic fairness that both leverage a Multiplayer Space Invaders game, where a robot controls a spaceship and distributes support across players' sides of the screen. The robot's support is at times biased in favor of one player or the other. In the first study, we examine how fairness perceptions are influenced by the timing of a robot's biased support (early vs. late in the interaction) and the beneficiary of this support (the participant vs. another agent). In the second study, we investigate how expectations of a robot's support behavior (biased vs. unbiased) interact with its actual behavior (biased vs. unbiased) in a setting where two participants each worked to score an individual score threshold. We find that fairness judgments are dynamic: fairness falls after the robot's allocation of support becomes biased but is slower to recover once support becomes unbiased, and participants expecting unbiased behavior judge fairness more harshly when these expectations are violated. Our findings advance understanding of fairness in HRI by presenting it as a dynamic construct shaped not only by the actual behavior of the robot but also by the timing of robot actions and expectations of robot behavior.
- Open Access
- 16 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 1040-1049
Learning Human Preferences over a Human-Robot Collaboration Based on Explicit and Implicit Human Feedback
There is significant interest in enabling robots to learn to perform tasks directly from interactions with non-expert users. Typically, a human serves as a teacher whose only task is to provide feedback to a robot learner. However, in real-world human-robot collaborations, the human often assists with the task while also offering feedback. Our key insight is that we can extract additional, implicit feedback from the human’s actions during the collaboration to augment the robot learning process. Under the assumption of fixed-role assignments, we first propose to formalize human preferences over a human-robot collaboration as a shared set of parameters encoding alignment between two reward functions: one that drives human behavior, and another that should direct robot behavior. This allows us to extract implicit feedback from an interaction by reasoning about the human’s actions in the task as actions that reveal the human’s preferences. Then, we combine this implicit feedback with traditional explicit human feedback to facilitate estimating the human’s preferences. We evaluated our proposed approach for Preference learning from Implicit and Explicit feedback (PIE) in simulations and with real users in a cooking scenario. Our simulation results indicate that combining multiple modalities of human feedback improves a robot’s ability to estimate human preferences over the collaboration, with a similar trend observed in real-world evaluations. These findings highlight a promising direction for enabling robots to adapt to a user’s preference model more quickly, thereby reducing the amount of time a person must spend teaching a robot.
- 16 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 1040-1049
Open AccessLearning Human Preferences over a Human-Robot Collaboration Based on Explicit and Implicit Human Feedback
There is significant interest in enabling robots to learn to perform tasks directly from interactions with non-expert users. Typically, a human serves as a teacher whose only task is to provide feedback to a robot learner. However, in real-world human-robot collaborations, the human often assists with the task while also offering feedback. Our key insight is that we can extract additional, implicit feedback from the human’s actions during the collaboration to augment the robot learning process. Under the assumption of fixed-role assignments, we first propose to formalize human preferences over a human-robot collaboration as a shared set of parameters encoding alignment between two reward functions: one that drives human behavior, and another that should direct robot behavior. This allows us to extract implicit feedback from an interaction by reasoning about the human’s actions in the task as actions that reveal the human’s preferences. Then, we combine this implicit feedback with traditional explicit human feedback to facilitate estimating the human’s preferences. We evaluated our proposed approach for Preference learning from Implicit and Explicit feedback (PIE) in simulations and with real users in a cooking scenario. Our simulation results indicate that combining multiple modalities of human feedback improves a robot’s ability to estimate human preferences over the collaboration, with a similar trend observed in real-world evaluations. These findings highlight a promising direction for enabling robots to adapt to a user’s preference model more quickly, thereby reducing the amount of time a person must spend teaching a robot.
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 885-889
REACT: Two Datasets for Analyzing Both Human Reactions and Evaluative Feedback to Robots Over Time
Recent work in Human-Robot Interaction (HRI) has shown that robots can leverage implicit communicative signals from users to understand how they are being perceived during interactions. For example, these signals can be gaze patterns, facial expressions, or body motions that reflect internal human states. To facilitate future research in this direction, we contribute the \textttREACT database, a collection of two datasets of human-robot interactions that display users' natural reactions to robots during a collaborative game and a photography scenario. Further, we analyze the datasets to show that interaction history is an important factor that can influence human reactions to robots. As a result, we believe that future models for interpreting implicit feedback in HRI should explicitly account for this history. \textttREACT opens up doors to this possibility in the future.
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 885-889
Open AccessREACT: Two Datasets for Analyzing Both Human Reactions and Evaluative Feedback to Robots Over Time
Recent work in Human-Robot Interaction (HRI) has shown that robots can leverage implicit communicative signals from users to understand how they are being perceived during interactions. For example, these signals can be gaze patterns, facial expressions, or body motions that reflect internal human states. To facilitate future research in this direction, we contribute the \textttREACT database, a collection of two datasets of human-robot interactions that display users' natural reactions to robots during a collaborative game and a photography scenario. Further, we analyze the datasets to show that interaction history is an important factor that can influence human reactions to robots. As a result, we believe that future models for interpreting implicit feedback in HRI should explicitly account for this history. \textttREACT opens up doors to this possibility in the future.
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 347-350
Multiplayer Space Invaders: A Platform for Studying Evolving Fairness Perceptions in Human-Robot Interaction
Current methods of measuring fairness in human-robot interaction (HRI) research often gauge perceptions of fairness at the conclusion of a task. However, this methodology overlooks the dynamic nature of fairness perceptions, which may shift and evolve as a task progresses. To help address this gap, we introduce a platform designed to help investigate the evolution of fairness over time: the Multiplayer Space Invaders game. This three-player game is structured such that two players work to eliminate as many of their own enemies as possible while a third player makes decisions about which player to support throughout the game. In this paper, we discuss different potential experimental designs facilitated by this platform. A key aspect of these designs is the inclusion of a robot that operates the supporting ship and must make multiple decisions about which player to aid throughout a task. We discuss how capturing fairness perceptions at different points in the game could give us deeper insights into how perceptions of fairness fluctuate in response to different variables and decisions made in the game.
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 347-350
Open AccessMultiplayer Space Invaders: A Platform for Studying Evolving Fairness Perceptions in Human-Robot Interaction
Current methods of measuring fairness in human-robot interaction (HRI) research often gauge perceptions of fairness at the conclusion of a task. However, this methodology overlooks the dynamic nature of fairness perceptions, which may shift and evolve as a task progresses. To help address this gap, we introduce a platform designed to help investigate the evolution of fairness over time: the Multiplayer Space Invaders game. This three-player game is structured such that two players work to eliminate as many of their own enemies as possible while a third player makes decisions about which player to support throughout the game. In this paper, we discuss different potential experimental designs facilitated by this platform. A key aspect of these designs is the inclusion of a robot that operates the supporting ship and must make multiple decisions about which player to aid throughout a task. We discuss how capturing fairness perceptions at different points in the game could give us deeper insights into how perceptions of fairness fluctuate in response to different variables and decisions made in the game.
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 100-102
Leveraging Implicit Human Feedback to Better Learn from Explicit Human Feedback in Human-Robot Interactions
My work aims to enable robots to more effectively learn how to help people. The way in which people want to be helped by robots can vary by task, person, or time, among other factors. Thus, it is important that robots can learn to tailor their behavior based on a person's evolving preferences during an interaction. Robots typically learn from humans via explicit feedback, such as evaluative feedback, preferences, demonstrations, or corrections. However, this type of feedback can interrupt the flow of an interaction and it places an additional cognitive burden on the human. We know that humans "leak" information through their non-verbal behavior that gives clues about their internal states during interactions? can this information be used to augment how a robot learns from humans? My research aims to explore how to incorporate feedback that humans provide implicitly into robot learning paradigms.
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 100-102
Open AccessLeveraging Implicit Human Feedback to Better Learn from Explicit Human Feedback in Human-Robot Interactions
My work aims to enable robots to more effectively learn how to help people. The way in which people want to be helped by robots can vary by task, person, or time, among other factors. Thus, it is important that robots can learn to tailor their behavior based on a person's evolving preferences during an interaction. Robots typically learn from humans via explicit feedback, such as evaluative feedback, preferences, demonstrations, or corrections. However, this type of feedback can interrupt the flow of an interaction and it places an additional cognitive burden on the human. We know that humans "leak" information through their non-verbal behavior that gives clues about their internal states during interactions? can this information be used to augment how a robot learns from humans? My research aims to explore how to incorporate feedback that humans provide implicitly into robot learning paradigms.
- Open Access
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 290-300
Verbally Soliciting Human Feedback in Continuous Human-Robot Collaboration
Humans expect robots to learn from their feedback and adapt to their preferences. However, there are limitations with how humans provide feedback to robots, e.g., humans may give less feedback as interactions progress. Therefore, it would be advantageous if robots could influence humans to provide more feedback during interactions. We conducted a 2x2 between-subjects user study (N=71) to investigate whether the framing and timing of a robot's reminder to provide feedback could influence human interactants. Human-robot interactions took place in the context of Space Invaders, a fast-paced and continuous collaborative environment. Our results suggest that reminders can influence the amount of feedback humans provide to robots, how participants feel about the robot, and how they feel about providing feedback during the interaction.
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 290-300
Open AccessVerbally Soliciting Human Feedback in Continuous Human-Robot Collaboration
Humans expect robots to learn from their feedback and adapt to their preferences. However, there are limitations with how humans provide feedback to robots, e.g., humans may give less feedback as interactions progress. Therefore, it would be advantageous if robots could influence humans to provide more feedback during interactions. We conducted a 2x2 between-subjects user study (N=71) to investigate whether the framing and timing of a robot's reminder to provide feedback could influence human interactants. Human-robot interactions took place in the context of Space Invaders, a fast-paced and continuous collaborative environment. Our results suggest that reminders can influence the amount of feedback humans provide to robots, how participants feel about the robot, and how they feel about providing feedback during the interaction.
- Open Access
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 398-407
Self-Annotation Methods for Aligning Implicit and Explicit Human Feedback in Human-Robot Interaction
Recent research in robot learning suggests that implicit human feedback is a low-cost approach to improving robot behavior without the typical teaching burden on users. Because implicit feedback can be difficult to interpret, though, we study different methods to collect fine-grained labels from users about robot performance across multiple dimensions, which can then serve to map implicit human feedback to performance values. In particular, we focused on understanding the effects of annotation order and frequency on human perceptions of the self-annotation process and the usefulness of the labels for creating data-driven models to reason about implicit feedback. Our results demonstrate that different annotation methods can influence perceived memory burden, annotation difficulty, and overall annotation time. Based on our findings, we conclude with recommendations to create future implicit feedback datasets in Human-Robot Interaction.
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 398-407
Open AccessSelf-Annotation Methods for Aligning Implicit and Explicit Human Feedback in Human-Robot Interaction
Recent research in robot learning suggests that implicit human feedback is a low-cost approach to improving robot behavior without the typical teaching burden on users. Because implicit feedback can be difficult to interpret, though, we study different methods to collect fine-grained labels from users about robot performance across multiple dimensions, which can then serve to map implicit human feedback to performance values. In particular, we focused on understanding the effects of annotation order and frequency on human perceptions of the self-annotation process and the usefulness of the labels for creating data-driven models to reason about implicit feedback. Our results demonstrate that different annotation methods can influence perceived memory burden, annotation difficulty, and overall annotation time. Based on our findings, we conclude with recommendations to create future implicit feedback datasets in Human-Robot Interaction.
- Open Access
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 525-533
Interactive Policy Shaping for Human-Robot Collaboration with Transparent Matrix Overlays
One important aspect of effective human--robot collaborations is the ability for robots to adapt quickly to the needs of humans. While techniques like deep reinforcement learning have demonstrated success as sophisticated tools for learning robot policies, the fluency of human-robot collaborations is often limited by these policies' inability to integrate changes to a user's preferences for the task. To address these shortcomings, we propose a novel approach that can modify learned policies at execution time via symbolic if-this-then-that rules corresponding to a modular and superimposable set of low-level constraints on the robot's policy. These rules, which we call Transparent Matrix Overlays, function not only as succinct and explainable descriptions of the robot's current strategy but also as an interface by which a human collaborator can easily alter a robot's policy via verbal commands. We demonstrate the efficacy of this approach on a series of proof-of-concept cooking tasks performed in simulation and on a physical robot.
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 525-533
Open AccessInteractive Policy Shaping for Human-Robot Collaboration with Transparent Matrix Overlays
One important aspect of effective human--robot collaborations is the ability for robots to adapt quickly to the needs of humans. While techniques like deep reinforcement learning have demonstrated success as sophisticated tools for learning robot policies, the fluency of human-robot collaborations is often limited by these policies' inability to integrate changes to a user's preferences for the task. To address these shortcomings, we propose a novel approach that can modify learned policies at execution time via symbolic if-this-then-that rules corresponding to a modular and superimposable set of low-level constraints on the robot's policy. These rules, which we call Transparent Matrix Overlays, function not only as succinct and explainable descriptions of the robot's current strategy but also as an interface by which a human collaborator can easily alter a robot's policy via verbal commands. We demonstrate the efficacy of this approach on a series of proof-of-concept cooking tasks performed in simulation and on a physical robot.
- Open Access
- 5 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 41-50
Perceptions of the Helpfulness of Unexpected Agent Assistance
Much prior work on creating social agents that assist users relies on preconceived assumptions of what it means to be helpful. For example, it is common to assume that a helpful agent just assists with achieving a user’s objective. However, as assistive agents become more widespread, human-agent interactions may be more ad-hoc, providing opportunities for unexpected agent assistance. How would this affect human notions of an agent’s helpfulness? To investigate this question, we conducted an exploratory study (N=186) where participants interacted with agents displaying unexpected, assistive behaviors in a Space Invaders game and we studied factors that may influence perceived helpfulness in these interactions. Our results challenge the idea that human perceptions of the helpfulness of unexpected agent assistance can be derived from a universal, objective definition of help. Also, humans will reciprocate unexpected assistance, but might not always consider that they are in fact helping an agent. Based on our findings, we recommend considering personalization and adaptation when designing future assistive behaviors for prosocial agents that may try to help users in unexpected situations.
- 5 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 41-50
Open AccessPerceptions of the Helpfulness of Unexpected Agent Assistance
Much prior work on creating social agents that assist users relies on preconceived assumptions of what it means to be helpful. For example, it is common to assume that a helpful agent just assists with achieving a user’s objective. However, as assistive agents become more widespread, human-agent interactions may be more ad-hoc, providing opportunities for unexpected agent assistance. How would this affect human notions of an agent’s helpfulness? To investigate this question, we conducted an exploratory study (N=186) where participants interacted with agents displaying unexpected, assistive behaviors in a Space Invaders game and we studied factors that may influence perceived helpfulness in these interactions. Our results challenge the idea that human perceptions of the helpfulness of unexpected agent assistance can be derived from a universal, objective definition of help. Also, humans will reciprocate unexpected assistance, but might not always consider that they are in fact helping an agent. Based on our findings, we recommend considering personalization and adaptation when designing future assistive behaviors for prosocial agents that may try to help users in unexpected situations.