MZMichael Zinn

Michael Zinn

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Michael Zinn has a total of 42 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    A System for Human-Robot Teaming through End-User Programming and Shared Autonomy

    by Michael Hagenow, Emmanuel Senft, Robert Radwin, Michael Gleicher, Michael Zinn, Bilge Mutlu

    Many industrial tasks-such as sanding, installing fasteners, and wire harnessing-are difficult to automate due to task complexity and variability. We instead investigate deploying robots in an assistive role for these tasks, where the robot assumes the physical task burden and the skilled worker provides both the high-level task planning and low-level feedback necessary to effectively complete the task. In this article, we describe the development of a system for flexible human-robot teaming that combines state-of-the-art methods in end-user programming and shared autonomy and its implementation in sanding applications. We demonstrate the use of the system in two types of sanding tasks, situated in aircraft manufacturing, that highlight two potential workflows within the human-robot teaming setup. We conclude by discussing challenges and opportunities in human-robot teaming identified during the development, application, and demonstration of our system.


  • Coordinated Multi-Robot Shared Autonomy Based on Scheduling and Demonstrations

    by Michael Hagenow, Emmanuel Senft, Nitzan Orr, Robert Radwin, Michael Gleicher, Bilge Mutlu, Dylan P. Losey, Michael Zinn

    Shared autonomy methods, where a human operator and a robot arm work together, have enabled robots to complete a range of complex and highly variable tasks. Existing work primarily focuses on one human sharing autonomy with a single robot. By contrast, in this letter we present an approach for multi-robot shared autonomy that enables one operator to provide real-time corrections across two coordinated robots completing the same task in parallel. Sharing autonomy with multiple robots presents fundamental challenges. The human can only correct one robot at a time, and without coordination, the human may be left idle for long periods of time. Accordingly, we develop an approach that aligns the robot's learned motions to best utilize the human's expertise. Our key idea is to leverage Learning from Demonstration (LfD) and time warping to schedule the motions of the robots based on when they may require assistance. Our method uses variability in operator demonstrations to identify the types of corrections an operator might apply during shared autonomy, leverages flexibility in how quickly the task was performed in demonstrations to aid in scheduling, and iteratively estimates the likelihood of when corrections may be needed to ensure that only one robot is completing an action requiring assistance. Through a preliminary study, we show that our method can decrease the scheduled time spent sanding by iteratively estimating the times when each robot could need assistance and generating an optimized schedule that allows the operator to provide corrections to each robot during these times.


  • Open Access

    A Method For Automated Drone Viewpoints to Support Remote Robot Manipulation

    by Emmanuel Senft, Michael Hagenow, Pragathi Praveena, Robert Radwin, Michael Zinn, Michael Gleicher, Bilge Mutlu

    Drones can provide a minimally-constrained adapting camera view to support robot telemanipulation. Furthermore, the drone view can be automated to reduce the burden on the operator during teleoperation. However, existing approaches do not focus on two important aspects of using a drone as an automated view provider. The first is how the drone should select from a range of quality viewpoints within the workspace (e.g., opposite sides of an object). The second is how to compensate for unavoidable drone pose uncertainty in determining the viewpoint. In this paper, we provide a nonlinear optimization method that yields effective and adaptive drone viewpoints for telemanipulation with an articulated manipulator. Our first key idea is to use sparse human-in-the-loop input to toggle between multiple automatically-generated drone viewpoints. Our second key idea is to introduce optimization objectives that maintain a view of the manipulator while considering drone uncertainty and the impact on viewpoint occlusion and environment collisions. We provide an instantiation of our drone viewpoint method within a drone-manipulator remote teleoperation system. Finally, we provide an initial validation of our method in tasks where we complete common household and industrial manipulations.


  • Material flow visualization during friction stir welding using high-speed X-ray imaging

    by Hemant Agiwal, Mohammad Ali Ansari, Daniel Franke, Patrick Faue, Samuel J. Clark, Kamel Fezzaa, Shiva Rudraraju, Michael Zinn, Frank E. Pfefferkorn


  • Stability and Rendering Limitations of High-Performance Admittance Based Haptic Interfaces

    by Patrick Dills, Kaitlyn Gabardi, Michael Zinn

    This work investigates the stability and rendering limitations of admittance-type haptic devices. We investigated a wider range of impedances than had previously been considered, including stiffness, damping, mass, and combinations thereof. The coupled human driving impedance, actuator position control bandwidth, and loop delay are identified as major factors affecting the range of stable impedances. Finally, the theoretical results are experimentally verified using a custom one degree of freedom admittance type haptic device.


  • Assessing limited visibility feedback for overhead manufacturing assembly tasks

    by Prajna Bhat, Emmanuel Senft, Michael Zinn, Michael Gleicher, Bilge Mutlu, Rebecca Cook, Robert G. Radwin


  • Informing Real-Time Corrections in Corrective Shared Autonomy Through Expert Demonstrations

    by Michael Hagenow, Emmanuel Senft, Robert Radwin, Michael Gleicher, Bilge Mutlu, Michael Zinn

    Corrective Shared Autonomy is a method where human corrections are layered on top of an otherwise autonomous robot behavior. Specifically, a Corrective Shared Autonomy system leverages an external controller to allow corrections across a range of task variables (e.g., spinning speed of a tool, applied force, path) to address the specific needs of a task. However, this inherent flexibility makes the choice of what corrections to allow at any given instant difficult to determine. This choice of corrections includes determining appropriate robot state variables, scaling for these variables, and a way to allow a user to specify the corrections in an intuitive manner. This letter enables efficient Corrective Shared Autonomy by providing an automated solution based on Learning from Demonstration to both extract the nominal behavior and address these core problems. Our evaluation shows that this solution enables users to successfully complete a surface cleaning task, identifies different strategies users employed in applying corrections, and points to future improvements for our solution.


  • An Investigation of a Balanced Hybrid Active-Passive Actuator for Physical Human-Robot Interaction

    by Patrick Dills, Alexander Dawson-Elli, Kreg Gruben, Peter G. Adamczyk, Michael Zinn

    Cooperative robots or “cobots” promise to allow humans and robots to work together more closely while maintaining safety. However, to date the capabilities of cobots are greatly diminished compared to industrial robots in terms of the force and power they are able to safely produce. This is in part due to the actuation choices of cobots. Low impedance robotic actuators aim to solve this problem by attempting to provide an actuator with a combination of low output impedance and a large bandwidth of force control. In short the ideal actuator has a large dynamic range. Existing actuators success and performance has been limited. We propose a high force and high power balanced hybrid active-passive actuator which aims to increase the actuation capability of low impedance actuators and to safely enable high performance larger force and workspace robots. Our balanced hybrid actuator does so, by combining and controlling a series elastic actuator, a small DC motor, and a particle brake in parallel. The actuator provides low and high frequency power producing active torques, along with power absorbing passive torques. Control challenges and advantages of hybrid actuators are discussed and overcome through the use of trajectory optimization, and the safety of the new actuator is evaluated.


  • Corrective Shared Autonomy for Addressing Task Variability

    by Michael Hagenow, Emmanuel Senft, Robert Radwin, Michael Gleicher, Bilge Mutlu, Michael Zinn

    Many tasks, particularly those involving interaction with the environment, are characterized by high variability, making robotic autonomy difficult. One flexible solution is to introduce the input of a human with superior experience and cognitive abilities as part of a shared autonomy policy. However, current methods for shared autonomy are not designed to address the wide range of necessary corrections (e.g., positions, forces, execution rate, etc.) that the user may need to provide to address task variability. In this letter, we present corrective shared autonomy, where users provide corrections to key robot state variables on top of an otherwise autonomous task model. We provide an instantiation of this shared autonomy paradigm and demonstrate its viability and benefits such as low user effort and physical demand via a system-level user study on three tasks involving variability situated in aircraft manufacturing.


  • Open Access

    Inferring geometric constraints in human demonstrations

    by Guru Subramani, Michael Zinn, Michael Gleicher

    This paper presents an approach for inferring geometric constraints in human demonstrations. In our method, geometric constraint models are built to create representations of kinematic constraints such as fixed point, axial rotation, prismatic motion, planar motion and others across multiple degrees of freedom. Our method infers geometric constraints using both kinematic and force/torque information. The approach first fits all the constraint models using kinematic information and evaluates them individually using position, force and moment criteria. Our approach does not require information about the constraint type or contact geometry; it can determine both simultaneously. We present experimental evaluations using instrumented tongs that show how constraints can be robustly inferred in recordings of human demonstrations.