VHVan Thanh Huynh

Van Thanh Huynh

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Van Thanh Huynh has a total of 43 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Disturbed Delay-Aware Reinforcement Learning

    by Sathira Dilshan Bataduwaarachchi, Zoran Najdovski, Hieu Trinh, Van Thanh Huynh

    Reinforcement Learning (RL) is now one of the popular control methods used in the area of robotics, which extends to various robotic domains including applications with teleoperation. Considering such applications, it is inevitable that random communication delay exist in between agent-environment interactions. This delay inevitably causes latency in capturing observations and actions. Moreover, noise can occur through external disturbances in RL entities such as rewards which will result in perturbed values. Tackling complex environments in such a scenario can be challenging as the agent receives noisy measurements amid possible delays. We take measures to address this issue in delay-aware RL by proposing a novel reward correcting filter into the delay handling RL framework. The proposed algorithm will estimate the original reward using available perturbed reward values, smoothing out the noise values present in the reward, making an accurate reward estimate available to the agent. We theoretically prove how the proposed filter can estimate the reward with regards to the monotonicity and convergence of the delay-aware RL framework, which in turn will tackle complex environments like robotic tasks. The validation of the algorithm is carried out with experimentations using the DeepMind Control Suite, which highlighted significant performance by showcasing the new algorithm’s robustness with perturbed rewards under delay-aware RL frameworks.

  • Open Access

    Deterministic delay-aware reinforcement learning

    by Sathira Dilshan Bataduwaarachchi, Zoran Najdovski, Hieu Trinh, Chee Peng Lim, Van Thanh Huynh


  • Open Access

    Observer-based Differentiators for Noisy Signals

    by Van Huynh, Hieu Trinh, Riley Bain

    We present a collection of different types of observation systems that work as differentiators. These observer-based differentiators can produce estimates for derivatives of a given signal, even though the given signal is prone to noise.

  • Open Access

    Traffic State Estimation With Spatio-Temporal Autoencoding Transformer (STAT Model)

    by Ali Reza Sattarzadeh, Pubudu N. Pathirana, van Thanh Huynh

    Traffic state estimation is an essential component of Intelligent Transportation System (ITS) designed for alleviating traffic congestion. As traffic data is composed of intricate information which can also be impacted by various factors, scholars have been attempting to utilize state-of-the-art deep learning forecasting models in recent years. However, a more complex and robust model is required to extract long-range correlations with large-scale traffic data sequences. In order to overcome the weaknesses of deep learning models, the superior performance of transformers is expected to address this effectively in time-series forecasting with transport data. Employing the capabilities of transformers in extracting long-term trends and dynamic dependencies, the proposed model improves the deep learning prediction performance for real datasets. The findings indicate that the transformer-based model exhibited promising performance in forecasting long-term traffic patterns and characteristics with a large quantity of data. In this paper, a comparison across conventional hybrid deep learning models with the Spatio-Temporal Autoencoder Transformer (STAT) model was conducted using real-world datasets. The multi-head attention-based transformer model outperformed all other comparative approaches for large-scale data demonstrating its importance in measuring the error criteria. Comprehensive evaluations across various traffic prediction datasets have established the validity of the proposed approach. Also, for an efficient model selection, Akaike Information Criterion (AIC), Schwarz Bayesian Information Criterion (SBIC), Hannan-Quinn Information Criterion (HQIC), and corrected AIC (AICc) tools were used to evaluate and compare models based on their ability to balance fit and complexity. The proposed model has shown improvements in RMSE for the STREET I980 and PEMSBAY datasets of 1.03 and 0.27, respectively. In RMSE for 60 minutes, for the same datasets, the improvements were 0.84 for STREET I980 and 0.56 for PEMS-BAY. These findings underscore the potential of transformer-based models in enhancing the performance of traffic prediction systems.


  • Open Access

    Development of a robust closed loop pressure control system for droplet generation

    by Suleman A. Naz, Van Thanh Huynh, Egan H. Doeven, Scott Adams, Abbas Z. Kouzani, Rosanne M. Guijt


  • Open Access

    SustainableTransformation of Undergraduate Engineering Education in China through Sino-Australian Cooperation: A Case Study on Electro-Mechanical System

    by Yufei Guo, John M. Long, Van Thanh Huynh

    China’s undergraduate engineering education is facing two significant challenges: passive learning and limited cross-cultural communication. In response, active learning methods such as project-based learning (PBL) and Sino-foreign cooperative education emerge as promising solutions. However, despite their potential, PBL’s application remains constrained, and many Sino-foreign cooperative programs persist with traditional passive learning approaches. How to adeptly integrate the two, namely realizing active learning in Sino-foreign cooperative education, is the primary objective of this study. To this end, a sustainable strategy for cross-cultural transfer and the adaptation of active learning is proposed. Initially, a PBL-based active learning pedagogy is tailored for a course within a Sino-Australian cooperative undergraduate program. This approach integrates hands-on activities, teamwork, and the flipped classroom method. Moreover, to ensure implementation quality, an assessment method reliant on continuous student survey feedback is suggested. Subsequently, through the statistical analysis of students’ survey data as well as final grades, both quantitative and qualitative results affirm the efficacy of the proposed strategy.


  • Open Access

    Minimal operation region prediction for networked control robotic manipulators subject to time‐varying delays and disturbances

    by Van Thanh Huynh, Chee Peng Lim, Zoran Najdovski, Dinh Cong Huong, Hieu Trinh

    Due to the disturbances and varying latency, a teleoperated robotic manipulator might not comply with the master control commands. Although prior studies on minimising the impact of network latency and disturbances on teleoperated robots were conducted, there has been very little research on the prediction of minimal operation regions of robotic arms, especially in the worst‐case scenarios when the disturbances and time delays still prevail even after impact minimisation. This study investigates the problem and proposes a novel solution to predicting minimal operation regions of networked control robotic manipulators. The proposed method can be used to forecast safe operation regions in which the manipulators will certainly enter and exclude regions that the robots will never penetrate. Leveraging on a Lyanonov Krasovskii criterion, the method performs region prediction by establishing minimal reachable bounding sets of the nonlinear, perturbed robotic arm's state vectors guided via a time‐varying delay‐dominant network. Though predominantly nonlinear, the entire prediction process is formulated as a tractable Linear Matrix Inequality (LMI) optimisation problem, which can be solved efficiently and effectively. Efficacy of the proposed method is validated with simulations where a simulated robotic arm is distorted with time‐varying delays and disturbances.


  • Design of event-triggered natural second-order observers for second-order vector systems

    by Dinh Cong Huong, Van Thanh Huynh, Hieu Trinh

    The problem of designing event-triggered natural second-order state observers for second-order vector systems subject to external disturbances is considered in this paper. In this work, state observer is constructed using discrete measurements at instants when an event-triggered condition is satisfied. Due to the errors that arise by using the event-triggered mechanism and the external disturbance, the method in this paper only robustly estimates the state position and the state velocity of the second-order vector observers instead of estimating them asymptotically. Instead of using the method based on a parameter-dependent Lyapunov function in investigating the stability of the dynamic error system of natural second-order observers, a convex optimization problem is established in this paper to give an event-triggered mechanism and minimized levels in evaluating the boundedness of the dynamic error system of the event-triggered natural second-order observers. An automobile suspension and two numerical examples demonstrate the effectiveness of the proposed method.