TPTae Ha Park

Tae Ha Park

*This is an algorithmically generated author record based on publicly available information.

Tae Ha Park has a total of 12 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Top Cited Papers

    Bridging the Domain Gap for Flight-Ready Spaceborne Vision

    by Tae Ha Park, Simone D’aMico

    This work presents Spacecraft Pose Network v3 (SPNv3), a neural network (NN) for monocular pose estimation of a known, non-cooperative target spacecraft. SPNv3 is designed and trained to be computationally efficient while providing robustness to spaceborne images that have not been observed during offline training and validation on the ground. These characteristics are essential to deploying NNs on space-grade edge devices. They are achieved through careful NN design choices, and an extensive tradeoff analysis reveals features such as data augmentation, transfer learning, and vision transformer architecture as a few of those that contribute to simultaneously maximizing robustness and minimizing computational overhead. Experiments demonstrate that the final SPNv3 can achieve state-of-the-art pose accuracy on hardware-in-the-loop images from a robotic testbed while having trained exclusively on computer-generated synthetic images, effectively bridging the domain gap between synthetic and real imagery. At the same time, SPNv3 runs well above the update frequency of modern satellite navigation filters when tested on a representative graphical processing unit system with flight heritage. Overall, SPNv3 is an efficient, flight-ready NN model readily applicable to close-range rendezvous and proximity operations with target resident space objects.


  • Open Access

    Event-based Structure-from-Orbit

    by Ethan Elms, Yasir Latif, Tae Ha Park, Tat-Jun Chin

    Event sensors offer high temporal resolution visual sensing, which makes them ideal for perceiving fast visual phenomena without suffering from motion blur. Certain applications in robotics and vision-based navigation require 3D perception of an object undergoing circular or spinning motion in front of a static camera, such as recovering the angular velocity and shape of the object. The setting is equivalent to observing a static object with an orbiting camera. In this paper, we propose event-based structure-from-orbit (eSfO), where the aim is to simultaneously reconstruct the 3D structure of a fast spinning object observed from a static event camera, and recover the equivalent orbital motion of the camera. Our contributions are threefold: since state-of-the-art event feature trackers cannot handle periodic self-occlusion due to the spinning motion, we develop a novel event feature tracker based on spatio-temporal clustering and data association that can better track the helical trajectories of valid features in the event data. The feature tracks are then fed to our novel factor graph-based structure-from-orbit back-end that calculates the orbital motion parameters (e.g., spin rate, relative rotational axis) that minimize the reprojection error. For evaluation, we produce a new event dataset of objects under spinning motion. Comparisons against ground truth indicate the efficacy of eSfO.

  • Adaptive Neural-Network-Based Unscented Kalman Filter for Robust Pose Tracking of Noncooperative Spacecraft

    by Tae Ha Park, Simone D’amico

    This paper presents a neural-network-based unscented Kalman filter (UKF) to estimate and track the pose (i.e., position and orientation) of a known, noncooperative, tumbling target spacecraft in a close-proximity rendezvous scenario. The UKF estimates the target’s orbit and attitude relative to the servicer based on the pose information provided by a multitask convolutional neural network (CNN) from incoming monocular images of the target. To enable reliable tracking, the process noise covariance matrix of the UKF is tuned online using adaptive state noise compensation, which leverages a newly developed closed-form process noise model for relative attitude dynamics. This paper also introduces the Satellite Hardware-In-the-loop Rendezvous Trajectories (SHIRT) dataset to enable comprehensive analyses of the performance and robustness of the proposed pipeline. SHIRT comprises the labeled images of two representative rendezvous trajectories in a low Earth orbit created using both a graphics renderer and a robotic testbed. Specifically, the CNN is solely trained on synthetic data, whereas functionality and performance of the complete navigation pipeline are evaluated on real images from the robotic testbed. The proposed UKF is evaluated on SHIRT and is shown to have subdecimeter-level position and degree-level orientation errors at steady state.


  • Open Access

    Adaptive Neural Network-based Unscented Kalman Filter for Robust Pose Tracking of Noncooperative Spacecraft

    by Tae Ha Park, Simone D'Amico

    This paper presents a neural network-based Unscented Kalman Filter (UKF) to estimate and track the pose (i.e., position and orientation) of a known, noncooperative, tumbling target spacecraft in a close-proximity rendezvous scenario. The UKF estimates the target's orbit and attitude relative to the servicer based on the pose information provided by a multi-task Convolutional Neural Network (CNN) from incoming monocular images of the target. In order to enable reliable tracking, the process noise covariance matrix of the UKF is tuned online using adaptive state noise compensation which leverages a newly developed closed-form process noise model for relative attitude dynamics. This paper also introduces the Satellite Hardware-In-the-loop Rendezvous Trajectories (SHIRT) dataset to enable comprehensive analyses of the performance and robustness of the proposed pipeline. SHIRT comprises the labeled images of two representative rendezvous trajectories in low Earth orbit created using both a graphics renderer and a robotic testbed. Specifically, the CNN is solely trained on synthetic data, whereas functionality and performance of the complete navigation pipeline are evaluated on real images from the robotic testbed. The proposed UKF is evaluated on SHIRT and is shown to have sub-decimeter-level position and degree-level orientation errors at steady-state.

  • Top Cited Papers

    Satellite Pose Estimation Competition 2021: Results and Analyses

    by Tae Ha Park, Marcus Märtens, Mohsi Jawaid, Zi Wang, Bo Chen, Tat-Jun Chin, Dario Izzo, Simone D’amico


  • Top Cited Papers

    Satellite Pose Estimation Challenge: Dataset, Competition Design, and Results

    by Mate Kisantal, Sumant Sharma, Tae Ha Park, Dario Izzo, Marcus Martens, Simone D'Amico

    Reliable pose estimation of uncooperative satellites is a key technology for enabling future on-orbit servicing and debris removal missions. The Kelvins Satellite Pose Estimation Challenge aims at evaluating and comparing monocular visionbased approaches and pushing the state-of-the-art on this problem. This work is based on the Satellite Pose Estimation Dataset, the first publicly available machine learning set of synthetic and real spacecraft imageries. The choice of dataset reflects one of the unique challenges associated with spaceborne computer vision tasks, namely the lack of spaceborne images to train and validate the developed algorithms. This work briefly reviews the basic properties and the collection process of the dataset which was made publicly available. The competition design, including the definition of performance metrics and the adopted testbed, is also discussed. The main contribution of this paper is the analysis of the submissions of the 48 competitors, which compares the performance of different approaches and uncovers what factors make the satellite pose estimation problem especially challenging.