Judah Goldfeder
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Judah Goldfeder has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
- Hod Lipson
Columbia University, Department of Mechanical Engineering, New York, USA
3 shared publications - Philippe Martin Wyder
Department of Mechanical Engineering, Columbia University, New York, NY, USA
3 shared publications - Jiong Lin
Mechanical Engineering Department, Columbia University, New York, NY, USA
2 shared publications - John Sipple
Google, Reston, VA, USA
2 shared publications - Meiqi Zhao
Computer Science Department, Columbia University, New York, NY, USA
2 shared publications - Quinn A. Booth
Electrical Engineering Department, Columbia University, New York, NY, USA
2 shared publications
Latest Publications
- Open Access
- 13 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1376-1382
Clay for the Creative Mind: Hands-On Robot Shaping Using Truss Links
- 13 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 1376-1382
Open AccessClay for the Creative Mind: Hands-On Robot Shaping Using Truss Links
- Top Cited Papers
- 14 January 2026
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 11 (110) , eadx3017
Learning realistic lip motions for humanoid face robots
Lip motion represents outsized importance in human communication, capturing nearly half of our visual attention during conversation. Yet anthropomorphic robots often fail to achieve lip-audio synchronization, resulting in clumsy and lifeless lip behaviors. Two fundamental barriers underlay this challenge. First, robotic lips typically lack the mechanical complexity required to reproduce nuanced human mouth movements; second, existing synchronization methods depend on manually predefined movements and rules, restricting adaptability and realism. Here, we present a humanoid robot face designed to overcome these limitations, featuring soft silicone lips actuated by a 10–degree-of-freedom mechanism. To achieve lip synchronization without predefined movements, we used a self-supervised learning pipeline based on a variational autoencoder (VAE) combined with a facial action transformer, enabling the robot to autonomously infer more realistic lip trajectories directly from speech audio. Our experimental results suggest that this method outperforms simple heuristics like amplitude-based baselines in achieving more visually coherent lip-audio synchronization. Furthermore, the learned synchronization successfully generalizes across multiple linguistic contexts, enabling robot speech articulation in 10 languages unseen during training.
- 14 January 2026
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 11 (110) , eadx3017
Top Cited PapersLearning realistic lip motions for humanoid face robots
Lip motion represents outsized importance in human communication, capturing nearly half of our visual attention during conversation. Yet anthropomorphic robots often fail to achieve lip-audio synchronization, resulting in clumsy and lifeless lip behaviors. Two fundamental barriers underlay this challenge. First, robotic lips typically lack the mechanical complexity required to reproduce nuanced human mouth movements; second, existing synchronization methods depend on manually predefined movements and rules, restricting adaptability and realism. Here, we present a humanoid robot face designed to overcome these limitations, featuring soft silicone lips actuated by a 10–degree-of-freedom mechanism. To achieve lip synchronization without predefined movements, we used a self-supervised learning pipeline based on a variational autoencoder (VAE) combined with a facial action transformer, enabling the robot to autonomously infer more realistic lip trajectories directly from speech audio. Our experimental results suggest that this method outperforms simple heuristics like amplitude-based baselines in achieving more visually coherent lip-audio synchronization. Furthermore, the learned synchronization successfully generalizes across multiple linguistic contexts, enabling robot speech articulation in 10 languages unseen during training.
- Open Access
- 18 July 2025
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 11 (29) , eadu6897
Robot metabolism: Toward machines that can grow by consuming other machines
Biological lifeforms can heal, grow, adapt, and reproduce, which are abilities essential for sustained survival and development. In contrast, robots today are primarily monolithic machines with limited ability to self-repair, physically develop, or incorporate material from their environments. While robot minds rapidly evolve new behaviors through artificial intelligence, their bodies remain closed systems, unable to systematically integrate material to grow or heal. We argue that open-ended physical adaptation is only possible when robots are designed using a small repertoire of simple modules. This allows machines to mechanically adapt by consuming parts from other machines or their surroundings and shed broken components. We demonstrate this principle on a truss modular robot platform. We show how robots can grow bigger, faster, and more capable by consuming materials from their environment and other robots. We suggest that machine metabolic processes like those demonstrated here will be an essential part of any sustained future robot ecology.
- 18 July 2025
- Published by American Association for the Advancement of Science (AAAS) in Science Advances
- Vol. 11 (29) , eadu6897
Open AccessRobot metabolism: Toward machines that can grow by consuming other machines
Biological lifeforms can heal, grow, adapt, and reproduce, which are abilities essential for sustained survival and development. In contrast, robots today are primarily monolithic machines with limited ability to self-repair, physically develop, or incorporate material from their environments. While robot minds rapidly evolve new behaviors through artificial intelligence, their bodies remain closed systems, unable to systematically integrate material to grow or heal. We argue that open-ended physical adaptation is only possible when robots are designed using a small repertoire of simple modules. This allows machines to mechanically adapt by consuming parts from other machines or their surroundings and shed broken components. We demonstrate this principle on a truss modular robot platform. We show how robots can grow bigger, faster, and more capable by consuming materials from their environment and other robots. We suggest that machine metabolic processes like those demonstrated here will be an essential part of any sustained future robot ecology.
- Open Access
- 29 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 403-407
Reducing Carbon Emissions at Scale: Interpretable and Efficient to Implement Reinforcement Learning via Policy Extraction
Machine Learning is a promising avenue for combating climate change by developing control policies that can lead to greater efficiency, reducing cost and carbon footprint. However, while much literature has focused on how we might be able to learn and develop these policies, there are two key practical considerations that are often overlooked. Even if we had these algorithms that demonstrably lead to efficiency gains, how can we convince the public to adopt them, and how can complex policies be implemented in the real world, especially if they require continuous real time interaction between the algorithm and the system it is controlling? To address these two issues, we propose a single solution: policy extraction. We consider the problem of commercial building operation, one of the highest potential impact areas for Machine Learning. We generate a building HVAC control policy via Reinforcement Learning, and then extract that policy, going from a Neural Network to a human readable fixed setpoint schedule. The result is interpretable, and can be examined by a technician, making it easier to trust. It also has fewer requirements to implement, as it circumvents the need for continuous interaction and allows for the building to be controlled in a normal, albeit more efficient fashion.
- 29 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 403-407
Open AccessReducing Carbon Emissions at Scale: Interpretable and Efficient to Implement Reinforcement Learning via Policy Extraction
Machine Learning is a promising avenue for combating climate change by developing control policies that can lead to greater efficiency, reducing cost and carbon footprint. However, while much literature has focused on how we might be able to learn and develop these policies, there are two key practical considerations that are often overlooked. Even if we had these algorithms that demonstrably lead to efficiency gains, how can we convince the public to adopt them, and how can complex policies be implemented in the real world, especially if they require continuous real time interaction between the algorithm and the system it is controlling? To address these two issues, we propose a single solution: policy extraction. We consider the problem of commercial building operation, one of the highest potential impact areas for Machine Learning. We generate a building HVAC control policy via Reinforcement Learning, and then extract that policy, going from a Neural Network to a human readable fixed setpoint schedule. The result is interpretable, and can be examined by a technician, making it easier to trust. It also has fewer requirements to implement, as it circumvents the need for continuous interaction and allows for the building to be controlled in a normal, albeit more efficient fashion.
- Open Access
- 15 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 352-356
A Lightweight Calibrated Simulation Enabling Efficient Offline Learning for Optimal Control of Real Buildings
- 15 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 352-356
Open AccessA Lightweight Calibrated Simulation Enabling Efficient Offline Learning for Optimal Control of Real Buildings