BNBenjamin A. Newman

Benjamin A. Newman

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Benjamin A. Newman has a total of 25 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Task Context Shapes Ocular Associations with Stress, Cognitive Workload, and Fatigue: A Wearable Eye-Tracking Study

    by Tslil Ofir, Pamela Paniccia, Alexander Mead, Omkar Solankey, Elliot Whybrow, Jack Harwood, Michael Proulx, Zhiyuan Wang, Ajoy Savio Fernandes, Benjamin Newman, et al.

    Background: Eye-tracking correlations with cognitive and emotional states vary across studies, likely because they depend on specific task demands. We investigated the consistency and specificity of such associations between wearable eye-tracking data and self-reported measures of stress, cognitive workload, and fatigue within assessment-centre-style tasks.Methods: Participants performed tasks involving social evaluation, reasoning, planning, comprehension, and presentation while wearing Meta Aria Gen 1 glasses. Data from 97 participants were analysed using linear mixed-effects models to examine associations between 104 wearable eye-tracking and head-movement metrics and each self-reported state, while accounting for task effects. Metric-by-task interactions assessed task dependence, and sensitivity analyses examined the effects of elapsed session time and shared variance among states.Results: After false-discovery-rate correction, significant metric-by-task interactions were observed in 53 stress, 61 workload, and 12 fatigue models, especially for saccade amplitude, speed, and duration. Across tasks, stress was linked to increased gaze variability, while workload and fatigue were linked to greater fixation angular distance. Fatigue associations weakened after adjusting for session time, and no fatigue metric-by-task interactions remained significant after adjustment for elapsed session time. After controlling for overlap among self-reported states, associations remained significant for stress, but not workload or fatigue.Conclusion: Ocular associations varied by task and by the shared variance across subjective states. Measures of fixation distribution appeared to capture a more general subjective-state component rather than exclusively distinguishing workload or fatigue. Several gaze and saccade associations with stress remained significant after adjustment for workload and fatigue. Predictive modelling should distinguish shared from state-specific information and be validated across diverse activities.

  • Open Access

    Bootstrapping Linear Models for Fast Online Adaptation in Human-Agent Collaboration

    by Benjamin A Newman, Chris Paxton, Kris Kitani, Henny Admoni

    Agents that assist people need to have well-initialized policies that can adapt quickly to align with their partners' reward functions. Initializing policies to maximize performance with unknown partners can be achieved by bootstrapping nonlinear models using imitation learning over large, offline datasets. Such policies can require prohibitive computation to fine-tune in-situ and therefore may miss critical run-time information about a partner's reward function as expressed through their immediate behavior. In contrast, online logistic regression using low-capacity models performs rapid inference and fine-tuning updates and thus can make effective use of immediate in-task behavior for reward function alignment. However, these low-capacity models cannot be bootstrapped as effectively by offline datasets and thus have poor initializations. We propose BLR-HAC, Bootstrapped Logistic Regression for Human Agent Collaboration, which bootstraps large nonlinear models to learn the parameters of a low-capacity model which then uses online logistic regression for updates during collaboration. We test BLR-HAC in a simulated surface rearrangement task and demonstrate that it achieves higher zero-shot accuracy than shallow methods and takes far less computation to adapt online while still achieving similar performance to fine-tuned, large nonlinear models. For code, please see our project page https://sites.google.com/view/blr-hac.

  • Open Access

    Towards Online Adaptation for Autonomous Household Assistants

    by Benjamin A. Newman, Christopher Jason Paxton, Kris Kitani, Henny Admoni

    Many assistive home robotics applications assume open-loop interactions: robots incorporate little feedback from people while autonomously completing tasks. This places undue burden on people to condition their actions and environment to maximize the likelihood of their desired outcomes. We formalize assistive household rearrangement as collaborative online inverse reinforcement learning (IRL). Since online IRL can lead to sample inefficient interactions and overfit to specific user objectives, we compare sample efficiency and generalizability of two initial choices of action representations in a simulated household rearrangement task. We show, under certain assumptions, that representing objects by their material properties can increase sample efficiency and generalizability to out of domain objects.


  • Open Access

    Helping People Through Space and Time: Assistance as a Perspective on Human-Robot Interaction

    by Benjamin A. Newman, Reuben M. Aronson, Kris Kitani, Henny Admoni

    As assistive robotics has expanded to many task domains, comparing assistive strategies among the varieties of research becomes increasingly difficult. To begin to unify the disparate domains into a more general theory of assistance, we present a definition of assistance, a survey of existing work, and three key design axes that occur in many domains and benefit from the examination of assistance as a whole. We first define an assistance perspective that focuses on understanding a robot that is in control of its actions but subordinate to a user’s goals. Next, we use this perspective to explore design axes that arise from the problem of assistance more generally and explore how these axes have comparable trade-offs across many domains. We investigate how the assistive robot handles other people in the interaction, how the robot design can operate in a variety of action spaces to enact similar goals, and how assistive robots can vary the timing of their actions relative to the user’s behavior. While these axes are by no means comprehensive, we propose them as useful tools for unifying assistance research across domains and as examples of how taking a broader perspective on assistance enables more cross-domain theorizing about assistance.


  • HARMONIC: A multimodal dataset of assistive human–robot collaboration

    by Benjamin A. Newman, Reuben M. Aronson, Siddhartha S. Srinivasa, Kris Kitani, Henny Admoni

    We present the Human And Robot Multimodal Observations of Natural Interactive Collaboration (HARMONIC) dataset. This is a large multimodal dataset of human interactions with a robotic arm in a shared autonomy setting designed to imitate assistive eating. The dataset provides human, robot, and environmental data views of 24 different people engaged in an assistive eating task with a 6-degree-of-freedom (6-DOF) robot arm. From each participant, we recorded video of both eyes, egocentric video from a head-mounted camera, joystick commands, electromyography from the forearm used to operate the joystick, third-person stereo video, and the joint positions of the 6-DOF robot arm. Also included are several features that come as a direct result of these recordings, such as eye gaze projected onto the egocentric video, body pose, hand pose, and facial keypoints. These data streams were collected specifically because they have been shown to be closely related to human mental states and intention. This dataset could be of interest to researchers studying intention prediction, human mental state modeling, and shared autonomy. Data streams are provided in a variety of formats such as video and human-readable CSV and YAML files.


  • Examining the Effects of Anticipatory Robot Assistance on Human Decision Making

    by Benjamin A. Newman, Abhijat Biswas, Sarthak Ahuja, Siddharth Girdhar, Kris K. Kitani, Henny Admoni