JWJulian Whitman

Julian Whitman

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Julian Whitman has a total of 44 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Learning Modular Robot Control Policies

    by Julian Whitman, Matthew Travers, Howie Choset

    Modular robots can be rearranged into a new design, perhaps each day, to handle a wide variety of tasks by forming a customized robot for each new task. However, reconfiguring just the mechanism is not sufficient: each design also requires its own unique control policy. One could craft a policy from scratch for each new design, but such an approach is not scalable, especially given the large number of designs that can be generated from even a small set of modules. Instead, we create a modular policy framework where the policy structure is conditioned on the hardware arrangement, and use just one training process to create a policy that controls a wide variety of designs. Our approach leverages the fact that the kinematics of a modular robot can be represented as a design graph , with nodes as modules and edges as connections between them. Given a robot, its design graph is used to create a policy graph with the same structure, where each node contains a deep neural network, and modules of the same type share knowledge via shared parameters (e.g., all legs on a hexapod share the same network parameters). We developed a model-based reinforcement learning algorithm, interleaving model learning and trajectory optimization to train the policy. We show the modular policy generalizes to a large number of designs that were not seen during training without any additional learning. Finally, we demonstrate the policy controlling a variety of designs to locomote with both simulated and real robots.


  • A general locomotion control framework for multi-legged locomotors

    by Baxi Chong, Yasemin O Aydin, Jennifer M Rieser, Guillaume Sartoretti, Tianyu Wang, Julian Whitman, Abdul Kaba, Enes Aydin, Ciera McFarland, Kelimar Diaz Cruz, et al.

    Serially connected robots are promising candidates for performing tasks in confined spaces such as search and rescue in large-scale disasters. Such robots are typically limbless, and we hypothesize that the addition of limbs could improve mobility. However, a challenge in designing and controlling such devices lies in the coordination of high-dimensional redundant modules in a way that improves mobility. Here we develop a general framework to discover templates to control serially connected multi-legged robots. Specifically, we combine two approaches to build a general shape control scheme which can provide baseline patterns of self-deformation (‘gaits’) for effective locomotion in diverse robot morphologies. First, we take inspiration from a dimensionality reduction and a biological gait classification scheme to generate cyclic patterns of body deformation and foot lifting/lowering, which facilitate the generation of arbitrary substrate contact patterns. Second, we extend geometric mechanics, which was originally introduced to study swimming at low Reynolds numbers, to frictional environments, allowing the identification of optimal body–leg coordination in this common terradynamic regime. Our scheme allows the development of effective gaits on flat terrain with diverse numbers of limbs (4, 6, 16, and even 0 limbs) and backbone actuation. By properly coordinating body undulation and leg placement, our framework combines the advantages of both limbless robots (modularity and narrow profile) and legged robots (mobility). Our framework can provide general control schemes for rapid deployment of general multi-legged robots, paving the way toward machines that can traverse complex environments. In addition, we show that our framework can also offer insights into body–leg coordination in living systems, such as salamanders and centipedes, from a biomechanical perspective.


  • Open Access

    A general locomotion control framework for multi-legged locomotors

    by Baxi Chong, Yasemin O. Aydin, Jennifer M. Rieser, Guillaume Sartoretti, Tianyu Wang, Julian Whitman, Abdul Kaba, Enes Aydin, Ciera McFarland, Kelimar Diaz Cruz, et al.

    Serially connected robots are promising candidates for performing tasks in confined spaces such as search-and-rescue in large-scale disasters. Such robots are typically limbless, and we hypothesize that the addition of limbs could improve mobility. However, a challenge in designing and controlling such devices lies in the coordination of high-dimensional redundant modules in a way that improves mobility. Here we develop a general framework to control serially connected multi-legged robots. Specifically, we combine two approaches to build a general shape control scheme which can provide baseline patterns of self-deformation ("gaits") for effective locomotion in diverse robot morphologies. First, we take inspiration from a dimensionality reduction and a biological gait classification scheme to generate cyclic patterns of body deformation and foot lifting/lowering, which facilitate generation of arbitrary substrate contact patterns. Second, we use geometric mechanics methods to facilitates identification of optimal phasing of these undulations to maximize speed and/or stability. Our scheme allows the development of effective gaits in multi-legged robots locomoting on flat frictional terrain with diverse number of limbs (4, 6, 16, and even 0 limbs) and body actuation capabilities (including sidewinding gaits on limbless devices). By properly coordinating the body undulation and the leg placement, our framework combines the advantages of both limbless robots (modularity) and legged robots (mobility). We expect that our framework can provide general control schemes for the rapid deployment of general multi-legged robots, paving the ways toward machines that can traverse complex environments under real-life conditions.


  • Open Access

    Learning Modular Robot Control Policies

    by Julian Whitman, Matthew Travers, Howie Choset

    Modular robots can be rearranged into a new design, perhaps each day, to handle a wide variety of tasks by forming a customized robot for each new task. However, reconfiguring just the mechanism is not sufficient: each design also requires its own unique control policy. One could craft a policy from scratch for each new design, but such an approach is not scalable, especially given the large number of designs that can be generated from even a small set of modules. Instead, we create a modular policy framework where the policy structure is conditioned on the hardware arrangement, and use just one training process to create a policy that controls a wide variety of designs. Our approach leverages the fact that the kinematics of a modular robot can be represented as a design graph, with nodes as modules and edges as connections between them. Given a robot, its design graph is used to create a policy graph with the same structure, where each node contains a deep neural network, and modules of the same type share knowledge via shared parameters (e.g., all legs on a hexapod share the same network parameters). We developed a model-based reinforcement learning algorithm, interleaving model learning and trajectory optimization to train the policy. We show the modular policy generalizes to a large number of designs that were not seen during training without any additional learning. Finally, we demonstrate the policy controlling a variety of designs to locomote with both simulated and real robots.


  • Reconstruction of Backbone Curves for Snake Robots

    by Tianyu Wang, Bo Lin, Baxi Chong, Julian Whitman, Matthew Travers, Daniel I. Goldman, Greg Blekherman, Howie Choset

    Snake robots composed of alternating single-axis pitch and yaw joints have many internal degrees of freedom, which make them capable of versatile three-dimensional locomotion. In motion planning process, snake robot motions are often designed kinematically by a chronological sequence of continuous backbone curves that capture desired macroscopic shapes of the robot. However, as the geometric arrangement of single-axis rotary joints creates constraints on the rotations in the robot, it is challenging for the robot to reconstruct an arbitrary 3D curve. When the robot configuration does not accurately achieve the desired shapes defined by these backbone curves, the robot can have unexpected contacts with the environment, such that the robot does not achieve the desired motion. In this work, we propose a method for snake robots to reconstruct desired backbone curves by posing an optimization problem that exploits the robot's geometric structure. We verified that our method enables fast and accurate curve-configuration conversions through its applications to commonly used 3D gaits. We also demonstrated via robot experiments that 1) our method results in smooth locomotion on the robot; 2) our method allows the robot to approach the numerically predicted locomotive performance of a sequence of continuous backbone curve.


  • Task-Specific Manipulator Design and Trajectory Synthesis

    by Julian Whitman, Howie Choset

    This paper addresses the challenge of determining the optimal design of a customizable robot for a given task. We present a motion planner that not only prescribes a path, but also synthesizes the robot design to follow that path. Our approach treats design variables as part of an inverse kinematics problem to jointly optimize manipulator design parameters and trajectory. We apply our method to two distinct problems where rapid prototyping and customization are desirable: an arm prototyped for a future Mars mission, and a wearable backpack-mounted arm. We then propose a novel method to minimize the number of joints in the mechanism while maintaining its ability to reach workspace task poses. We combine these methods into a framework in which we iteratively optimize and simplify task-specialized manipulator designs.


  • Geometric Motion Planning for Systems With Toroidal and Cylindrical Shape Spaces

    by Chaohui Gong, Zhongqiang Ren, Julian Whitman, Jaskaran Grover, Baxi Chong, Howie Choset

    Kinematic motion planning using geometric mechanics tends to prescribe a trajectory in a parameterization of a shape space and determine its displacement in a position space. Often this trajectory is called a gait. Previous works assumed that the shape space is Euclidean when often it is not, either because the robotic joints can spin around forever (i.e., has an 𝕊1 configuration space component, or its parameterization has an 𝕊1 dimension). Consider a shape space that is a torus; gaits that “wrap” around the full range of a shape variable and return to its starting configuration are valid gaits in the shape space yet appear as line segments in the parameterization. Since such a gait does not form a closed loop in the parameterization, existing geometric mechanics methods cannot properly consider them. By explicitly analyzing the topology of the underlying shape space, we derive geometric tools to consider systems with toroidal and cylindrical shape spaces.


  • Snake Robot Urban Search After the 2017 Mexico City Earthquake

    by Julian Whitman, Nico Zevallos, Matt Travers, Howie Choset

    The Carnegie Mellon University Biorobotics Laboratory was invited to bring snake robots to Mexico City to assist with search and rescue efforts in the wake of the September 2017 earthquake. We travelled with the Mexican Red Cross to collapsed building sites, and deployed a snake robot within one building to obtain a camera view in two voids that conventional search cameras could not access. We confirmed that the an open area within the building was unoccupied. In this paper we describe our experiences during the deployment and the limitations of snake robot platform encountered along the way.


  • Shape-based coordination in locomotion control

    by Matthew Travers, Julian Whitman, Howie Choset

    Highly articulated systems are capable of executing a variety of behaviors by coordinating their many internal degrees of freedom to help them move more effectively in complex terrains. However, this inherent variety poses significant challenges that have been the subject of a great deal of previous work: What are the most effective or most efficient methods for achieving the intrinsic coordination necessary to produce desired global objectives? This work takes these questions one step further, asking how different levels of coordination, which we quantify in terms of kinematic coupling, affect articulated locomotion in environments with different degrees of underlying structure. We introduce shape functions as the analytical basis for specifying kinematic coupling relationships that constrain the relative motion among the internal degrees of freedom for a given system during its nominal locomotion. Furthermore, we show how shape functions are used to derive shape-based controllers (SBCs) that manage the compliant interaction between articulated bodies and the environment while explicitly preserving the inter-joint coupling defined by shape functions. Initial experimental evidence provides a comparison of the benefits of different levels of coordination for two separate platforms in environments with different degrees of inherent structure. The experimental results show that decentralized implementations, where there is relatively little inter-joint coupling, perform well across a spectrum of different terrains but that there are potential benefits to higher degrees of coupling in structured terrains. We discuss how this observation has implications related to future planning and control approaches that actively “tune” their underlying structure by dynamically varying the assumed level of coupling as a function of task specification and local environmental conditions.


  • Generating gaits for simultaneous locomotion and manipulation

    by Julian Whitman, Shuang Su, Stelian Coros, Alex Ansari, Howie Choset

    Modular robots can be rapidly reconfigured into customized articulated legged morphologies capable of mobile manipulation and inspection. However, current gait generation methods do not keep pace with the speed of physical reconfiguration. This work focuses on quickly creating gaits for modular legged robots. We build on a recent method that uses trajectory optimization to design quasi-static gaits given only robot geometry and foot contact patterns. We develop methods to automatically generate contact patterns for new gaits and transitions between them. We show the utility of these methods applied to robots with many limbs, such that limbs can be fluidly reassigned to locomotion, manipulation, or inspection tasks, or to adapt gaits to hardware failures online. We demonstrate gait and transition generation with our modular hexapod and dodecapod robots. The robots switch between gaits that use all limbs for locomotion and those that leave some limbs free to pick up objects or position a camera.