Michael Zinn
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Michael Zinn has a total of 42 co-authors. Here are the top co-authors by number of shared publications:
- Frank E. Pfefferkorn
University of Wisconsin-Madison Department of Mechanical Engineering Madison, WI 53706
7 shared publications - Michael Gleicher
Department of Computer Sciences, University of Wisconsin-Madison, Madison, WI, USA
7 shared publications - Robert G. Radwin
Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, USA
6 shared publications - Bilge Mutlu
Department of Computer Sciences, University of Wisconsin-Madison, Madison, Wisconsin, USA
5 shared publications - Michael Hagenow
University of Wisconsin-Madison, Madison, USA
5 shared publications Neil A. Duffie
University of Wisconsin Madison, Madison, WI 53706, United States
5 shared publications
Latest Publications
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 231-239
A System for Human-Robot Teaming through End-User Programming and Shared Autonomy
Many industrial tasks-such as sanding, installing fasteners, and wire harnessing-are difficult to automate due to task complexity and variability. We instead investigate deploying robots in an assistive role for these tasks, where the robot assumes the physical task burden and the skilled worker provides both the high-level task planning and low-level feedback necessary to effectively complete the task. In this article, we describe the development of a system for flexible human-robot teaming that combines state-of-the-art methods in end-user programming and shared autonomy and its implementation in sanding applications. We demonstrate the use of the system in two types of sanding tasks, situated in aircraft manufacturing, that highlight two potential workflows within the human-robot teaming setup. We conclude by discussing challenges and opportunities in human-robot teaming identified during the development, application, and demonstration of our system.
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 231-239
Open AccessA System for Human-Robot Teaming through End-User Programming and Shared Autonomy
Many industrial tasks-such as sanding, installing fasteners, and wire harnessing-are difficult to automate due to task complexity and variability. We instead investigate deploying robots in an assistive role for these tasks, where the robot assumes the physical task burden and the skilled worker provides both the high-level task planning and low-level feedback necessary to effectively complete the task. In this article, we describe the development of a system for flexible human-robot teaming that combines state-of-the-art methods in end-user programming and shared autonomy and its implementation in sanding applications. We demonstrate the use of the system in two types of sanding tasks, situated in aircraft manufacturing, that highlight two potential workflows within the human-robot teaming setup. We conclude by discussing challenges and opportunities in human-robot teaming identified during the development, application, and demonstration of our system.
- 25 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (12) , 8335-8342
Coordinated Multi-Robot Shared Autonomy Based on Scheduling and Demonstrations
Shared autonomy methods, where a human operator and a robot arm work together, have enabled robots to complete a range of complex and highly variable tasks. Existing work primarily focuses on one human sharing autonomy with a single robot. By contrast, in this letter we present an approach for multi-robot shared autonomy that enables one operator to provide real-time corrections across two coordinated robots completing the same task in parallel. Sharing autonomy with multiple robots presents fundamental challenges. The human can only correct one robot at a time, and without coordination, the human may be left idle for long periods of time. Accordingly, we develop an approach that aligns the robot's learned motions to best utilize the human's expertise. Our key idea is to leverage Learning from Demonstration (LfD) and time warping to schedule the motions of the robots based on when they may require assistance. Our method uses variability in operator demonstrations to identify the types of corrections an operator might apply during shared autonomy, leverages flexibility in how quickly the task was performed in demonstrations to aid in scheduling, and iteratively estimates the likelihood of when corrections may be needed to ensure that only one robot is completing an action requiring assistance. Through a preliminary study, we show that our method can decrease the scheduled time spent sanding by iteratively estimating the times when each robot could need assistance and generating an optimized schedule that allows the operator to provide corrections to each robot during these times.
- 25 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (12) , 8335-8342
Coordinated Multi-Robot Shared Autonomy Based on Scheduling and Demonstrations
Shared autonomy methods, where a human operator and a robot arm work together, have enabled robots to complete a range of complex and highly variable tasks. Existing work primarily focuses on one human sharing autonomy with a single robot. By contrast, in this letter we present an approach for multi-robot shared autonomy that enables one operator to provide real-time corrections across two coordinated robots completing the same task in parallel. Sharing autonomy with multiple robots presents fundamental challenges. The human can only correct one robot at a time, and without coordination, the human may be left idle for long periods of time. Accordingly, we develop an approach that aligns the robot's learned motions to best utilize the human's expertise. Our key idea is to leverage Learning from Demonstration (LfD) and time warping to schedule the motions of the robots based on when they may require assistance. Our method uses variability in operator demonstrations to identify the types of corrections an operator might apply during shared autonomy, leverages flexibility in how quickly the task was performed in demonstrations to aid in scheduling, and iteratively estimates the likelihood of when corrections may be needed to ensure that only one robot is completing an action requiring assistance. Through a preliminary study, we show that our method can decrease the scheduled time spent sanding by iteratively estimating the times when each robot could need assistance and generating an optimized schedule that allows the operator to provide corrections to each robot during these times.
- Open Access
- 23 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7704-7711
A Method For Automated Drone Viewpoints to Support Remote Robot Manipulation
Drones can provide a minimally-constrained adapting camera view to support robot telemanipulation. Furthermore, the drone view can be automated to reduce the burden on the operator during teleoperation. However, existing approaches do not focus on two important aspects of using a drone as an automated view provider. The first is how the drone should select from a range of quality viewpoints within the workspace (e.g., opposite sides of an object). The second is how to compensate for unavoidable drone pose uncertainty in determining the viewpoint. In this paper, we provide a nonlinear optimization method that yields effective and adaptive drone viewpoints for telemanipulation with an articulated manipulator. Our first key idea is to use sparse human-in-the-loop input to toggle between multiple automatically-generated drone viewpoints. Our second key idea is to introduce optimization objectives that maintain a view of the manipulator while considering drone uncertainty and the impact on viewpoint occlusion and environment collisions. We provide an instantiation of our drone viewpoint method within a drone-manipulator remote teleoperation system. Finally, we provide an initial validation of our method in tasks where we complete common household and industrial manipulations.
- 23 October 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7704-7711
Open AccessA Method For Automated Drone Viewpoints to Support Remote Robot Manipulation
Drones can provide a minimally-constrained adapting camera view to support robot telemanipulation. Furthermore, the drone view can be automated to reduce the burden on the operator during teleoperation. However, existing approaches do not focus on two important aspects of using a drone as an automated view provider. The first is how the drone should select from a range of quality viewpoints within the workspace (e.g., opposite sides of an object). The second is how to compensate for unavoidable drone pose uncertainty in determining the viewpoint. In this paper, we provide a nonlinear optimization method that yields effective and adaptive drone viewpoints for telemanipulation with an articulated manipulator. Our first key idea is to use sparse human-in-the-loop input to toggle between multiple automatically-generated drone viewpoints. Our second key idea is to introduce optimization objectives that maintain a view of the manipulator while considering drone uncertainty and the impact on viewpoint occlusion and environment collisions. We provide an instantiation of our drone viewpoint method within a drone-manipulator remote teleoperation system. Finally, we provide an initial validation of our method in tasks where we complete common household and industrial manipulations.
- 27 September 2022
- Published by Elsevier in Manufacturing Letters
- Vol. 34, 62-66
Material flow visualization during friction stir welding using high-speed X-ray imaging
- 27 September 2022
- Published by Elsevier in Manufacturing Letters
- Vol. 34, 62-66
Material flow visualization during friction stir welding using high-speed X-ray imaging
- 21 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Stability and Rendering Limitations of High-Performance Admittance Based Haptic Interfaces
This work investigates the stability and rendering limitations of admittance-type haptic devices. We investigated a wider range of impedances than had previously been considered, including stiffness, damping, mass, and combinations thereof. The coupled human driving impedance, actuator position control bandwidth, and loop delay are identified as major factors affecting the range of stable impedances. Finally, the theoretical results are experimentally verified using a custom one degree of freedom admittance type haptic device.
- 21 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Stability and Rendering Limitations of High-Performance Admittance Based Haptic Interfaces
This work investigates the stability and rendering limitations of admittance-type haptic devices. We investigated a wider range of impedances than had previously been considered, including stiffness, damping, mass, and combinations thereof. The coupled human driving impedance, actuator position control bandwidth, and loop delay are identified as major factors affecting the range of stable impedances. Finally, the theoretical results are experimentally verified using a custom one degree of freedom admittance type haptic device.
- 1 November 2021
- Published by Elsevier in Applied Ergonomics
- Vol. 97, 103531
Assessing limited visibility feedback for overhead manufacturing assembly tasks
- 1 November 2021
- Published by Elsevier in Applied Ergonomics
- Vol. 97, 103531
Assessing limited visibility feedback for overhead manufacturing assembly tasks
- 2 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (4) , 6442-6449
Informing Real-Time Corrections in Corrective Shared Autonomy Through Expert Demonstrations
Corrective Shared Autonomy is a method where human corrections are layered on top of an otherwise autonomous robot behavior. Specifically, a Corrective Shared Autonomy system leverages an external controller to allow corrections across a range of task variables (e.g., spinning speed of a tool, applied force, path) to address the specific needs of a task. However, this inherent flexibility makes the choice of what corrections to allow at any given instant difficult to determine. This choice of corrections includes determining appropriate robot state variables, scaling for these variables, and a way to allow a user to specify the corrections in an intuitive manner. This letter enables efficient Corrective Shared Autonomy by providing an automated solution based on Learning from Demonstration to both extract the nominal behavior and address these core problems. Our evaluation shows that this solution enables users to successfully complete a surface cleaning task, identifies different strategies users employed in applying corrections, and points to future improvements for our solution.
- 2 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (4) , 6442-6449
Informing Real-Time Corrections in Corrective Shared Autonomy Through Expert Demonstrations
Corrective Shared Autonomy is a method where human corrections are layered on top of an otherwise autonomous robot behavior. Specifically, a Corrective Shared Autonomy system leverages an external controller to allow corrections across a range of task variables (e.g., spinning speed of a tool, applied force, path) to address the specific needs of a task. However, this inherent flexibility makes the choice of what corrections to allow at any given instant difficult to determine. This choice of corrections includes determining appropriate robot state variables, scaling for these variables, and a way to allow a user to specify the corrections in an intuitive manner. This letter enables efficient Corrective Shared Autonomy by providing an automated solution based on Learning from Demonstration to both extract the nominal behavior and address these core problems. Our evaluation shows that this solution enables users to successfully complete a surface cleaning task, identifies different strategies users employed in applying corrections, and points to future improvements for our solution.
- 8 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (3) , 5849-5856
An Investigation of a Balanced Hybrid Active-Passive Actuator for Physical Human-Robot Interaction
Cooperative robots or “cobots” promise to allow humans and robots to work together more closely while maintaining safety. However, to date the capabilities of cobots are greatly diminished compared to industrial robots in terms of the force and power they are able to safely produce. This is in part due to the actuation choices of cobots. Low impedance robotic actuators aim to solve this problem by attempting to provide an actuator with a combination of low output impedance and a large bandwidth of force control. In short the ideal actuator has a large dynamic range. Existing actuators success and performance has been limited. We propose a high force and high power balanced hybrid active-passive actuator which aims to increase the actuation capability of low impedance actuators and to safely enable high performance larger force and workspace robots. Our balanced hybrid actuator does so, by combining and controlling a series elastic actuator, a small DC motor, and a particle brake in parallel. The actuator provides low and high frequency power producing active torques, along with power absorbing passive torques. Control challenges and advantages of hybrid actuators are discussed and overcome through the use of trajectory optimization, and the safety of the new actuator is evaluated.
- 8 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (3) , 5849-5856
An Investigation of a Balanced Hybrid Active-Passive Actuator for Physical Human-Robot Interaction
Cooperative robots or “cobots” promise to allow humans and robots to work together more closely while maintaining safety. However, to date the capabilities of cobots are greatly diminished compared to industrial robots in terms of the force and power they are able to safely produce. This is in part due to the actuation choices of cobots. Low impedance robotic actuators aim to solve this problem by attempting to provide an actuator with a combination of low output impedance and a large bandwidth of force control. In short the ideal actuator has a large dynamic range. Existing actuators success and performance has been limited. We propose a high force and high power balanced hybrid active-passive actuator which aims to increase the actuation capability of low impedance actuators and to safely enable high performance larger force and workspace robots. Our balanced hybrid actuator does so, by combining and controlling a series elastic actuator, a small DC motor, and a particle brake in parallel. The actuator provides low and high frequency power producing active torques, along with power absorbing passive torques. Control challenges and advantages of hybrid actuators are discussed and overcome through the use of trajectory optimization, and the safety of the new actuator is evaluated.
- 8 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 3720-3727
Corrective Shared Autonomy for Addressing Task Variability
Many tasks, particularly those involving interaction with the environment, are characterized by high variability, making robotic autonomy difficult. One flexible solution is to introduce the input of a human with superior experience and cognitive abilities as part of a shared autonomy policy. However, current methods for shared autonomy are not designed to address the wide range of necessary corrections (e.g., positions, forces, execution rate, etc.) that the user may need to provide to address task variability. In this letter, we present corrective shared autonomy, where users provide corrections to key robot state variables on top of an otherwise autonomous task model. We provide an instantiation of this shared autonomy paradigm and demonstrate its viability and benefits such as low user effort and physical demand via a system-level user study on three tasks involving variability situated in aircraft manufacturing.
- 8 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 6 (2) , 3720-3727
Corrective Shared Autonomy for Addressing Task Variability
Many tasks, particularly those involving interaction with the environment, are characterized by high variability, making robotic autonomy difficult. One flexible solution is to introduce the input of a human with superior experience and cognitive abilities as part of a shared autonomy policy. However, current methods for shared autonomy are not designed to address the wide range of necessary corrections (e.g., positions, forces, execution rate, etc.) that the user may need to provide to address task variability. In this letter, we present corrective shared autonomy, where users provide corrections to key robot state variables on top of an otherwise autonomous task model. We provide an instantiation of this shared autonomy paradigm and demonstrate its viability and benefits such as low user effort and physical demand via a system-level user study on three tasks involving variability situated in aircraft manufacturing.
- Open Access
Inferring geometric constraints in human demonstrations
This paper presents an approach for inferring geometric constraints in human demonstrations. In our method, geometric constraint models are built to create representations of kinematic constraints such as fixed point, axial rotation, prismatic motion, planar motion and others across multiple degrees of freedom. Our method infers geometric constraints using both kinematic and force/torque information. The approach first fits all the constraint models using kinematic information and evaluates them individually using position, force and moment criteria. Our approach does not require information about the constraint type or contact geometry; it can determine both simultaneously. We present experimental evaluations using instrumented tongs that show how constraints can be robustly inferred in recordings of human demonstrations.
Open AccessInferring geometric constraints in human demonstrations
This paper presents an approach for inferring geometric constraints in human demonstrations. In our method, geometric constraint models are built to create representations of kinematic constraints such as fixed point, axial rotation, prismatic motion, planar motion and others across multiple degrees of freedom. Our method infers geometric constraints using both kinematic and force/torque information. The approach first fits all the constraint models using kinematic information and evaluates them individually using position, force and moment criteria. Our approach does not require information about the constraint type or contact geometry; it can determine both simultaneously. We present experimental evaluations using instrumented tongs that show how constraints can be robustly inferred in recordings of human demonstrations.