Jie Pan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jie Pan has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Yiliang Wu
School of Ocean Information Engineering, Jimei University, Xiamen 361021, China
5 shared publications - Ming Chen
College of Ocean Information Engineering, Jimei University, Xiamen, Fujian, China
4 shared publications - Zhengxuan Huang
College of Ocean Information Engineering, Jimei University, Xiamen, Fujian, China
3 shared publications - Guiying Zeng
College of Ocean Information Engineering, Jimei University, Xiamen, Fujian, China
2 shared publications - Guoci Cai
College of Ocean Information Engineering, Jimei University, China
2 shared publications - Haiqi Yu
College of Ocean Information Engineering, Jimei University, China
2 shared publications
Latest Publications
- Open Access
- 18 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 481-486
UWB-LiDAR Tightly Coupled Indoor Positioning System for Mobile Robots
This study addresses the challenge of high-precision positioning for mobile robots in complex indoor environments by integrating the concept of Embodied Intelligence (EI). We propose a UWB base station selection strategy based on LiDAR environmental perception, combined with a dynamically adaptive Unscented Kalman Filter (UKF) algorithm. Embodied Intelligence emphasizes the ability of robots to achieve dynamic perception and adaptive decision-making through physical interaction with the environment. Within this framework, our research enhances the adaptability and accuracy of mobile robots in complex environments through multi-sensor fusion. To improve UWB positioning accuracy under Non-Line-of-Sight (NLOS) conditions, the system employs LiDAR to perceive environmental information in real-time, dynamically identify obstacles, select available UWB base stations, and adaptively adjust sensor weights during the data fusion process. Experimental results demonstrate that, compared to using LiDAR or UWB sensors individually, as well as traditional UKF algorithms, the proposed method significantly improves positioning accuracy. Compared to the traditional UKF, the maximum errors in the X and Y directions are reduced by 43.4% and 44.9%, respectively, while the root mean square error (RMS) in the X direction is reduced by 21.3% and by 47.2% in the Y direction. This method effectively addresses UWB measurement errors under NLOS conditions while compensating for the cumulative error of LiDAR, showing significant improvements in both accuracy and robustness. This innovative approach offers an effective solution for high-precision indoor positioning in complex dynamic environments.
- 18 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 481-486
Open AccessUWB-LiDAR Tightly Coupled Indoor Positioning System for Mobile Robots
This study addresses the challenge of high-precision positioning for mobile robots in complex indoor environments by integrating the concept of Embodied Intelligence (EI). We propose a UWB base station selection strategy based on LiDAR environmental perception, combined with a dynamically adaptive Unscented Kalman Filter (UKF) algorithm. Embodied Intelligence emphasizes the ability of robots to achieve dynamic perception and adaptive decision-making through physical interaction with the environment. Within this framework, our research enhances the adaptability and accuracy of mobile robots in complex environments through multi-sensor fusion. To improve UWB positioning accuracy under Non-Line-of-Sight (NLOS) conditions, the system employs LiDAR to perceive environmental information in real-time, dynamically identify obstacles, select available UWB base stations, and adaptively adjust sensor weights during the data fusion process. Experimental results demonstrate that, compared to using LiDAR or UWB sensors individually, as well as traditional UKF algorithms, the proposed method significantly improves positioning accuracy. Compared to the traditional UKF, the maximum errors in the X and Y directions are reduced by 43.4% and 44.9%, respectively, while the root mean square error (RMS) in the X direction is reduced by 21.3% and by 47.2% in the Y direction. This method effectively addresses UWB measurement errors under NLOS conditions while compensating for the cumulative error of LiDAR, showing significant improvements in both accuracy and robustness. This innovative approach offers an effective solution for high-precision indoor positioning in complex dynamic environments.
- Open Access
- 18 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1313-1317
Bionic Hand System for 3D Hand Reconstruction Using a Single View
This paper proposes a simulation system for 3D hand reconstruction using a single view, which is dedicated to play a role in efficiently reconstructing 3D hands and accurately controlling bionic robotic hands in the fields of constructing 3D hands and bionic robotic hand control. The 3D hand reconstruction method by using SimpleHand network structure and applying it to bionic hand control and simulation. Using the FreiHAND dataset, the 3D coordinates of 21 joint points of the hand are obtained by SimpleHand network inference and rendered by MANO model to evaluate the network performance, which is also combined with several evaluation metrics. Subsequently, these 3D joint point coordinates were converted into joint parameters of the E3M5 model of the Mujoco bionic hand to achieve accurate movement control of the bionic hand. In order to improve the reconstruction accuracy and training efficiency of the model, this paper uses Bayesian Optimization to tune the key hyperparameters such as learning rate, weight decay and batch size. The experimental results show that Bayesian Optimization improves the reconstruction accuracy of the model, and the F@05 metric is improved by 2.2%. This paper demonstrates the effectiveness of SimpleHand network in 3D hand reconstruction task and verifies its potential for application in the field of gesture recognition and robot control.
- 18 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1313-1317
Open AccessBionic Hand System for 3D Hand Reconstruction Using a Single View
This paper proposes a simulation system for 3D hand reconstruction using a single view, which is dedicated to play a role in efficiently reconstructing 3D hands and accurately controlling bionic robotic hands in the fields of constructing 3D hands and bionic robotic hand control. The 3D hand reconstruction method by using SimpleHand network structure and applying it to bionic hand control and simulation. Using the FreiHAND dataset, the 3D coordinates of 21 joint points of the hand are obtained by SimpleHand network inference and rendered by MANO model to evaluate the network performance, which is also combined with several evaluation metrics. Subsequently, these 3D joint point coordinates were converted into joint parameters of the E3M5 model of the Mujoco bionic hand to achieve accurate movement control of the bionic hand. In order to improve the reconstruction accuracy and training efficiency of the model, this paper uses Bayesian Optimization to tune the key hyperparameters such as learning rate, weight decay and batch size. The experimental results show that Bayesian Optimization improves the reconstruction accuracy of the model, and the F@05 metric is improved by 2.2%. This paper demonstrates the effectiveness of SimpleHand network in 3D hand reconstruction task and verifies its potential for application in the field of gesture recognition and robot control.
- Open Access
- 18 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1324-1329
Adaptive UKF multisensor fusion localization algorithm for UAV formation
Multi-sensor data fusion technology has improved the positioning accuracy and system stability of multi-UAV formations in complex environments, and has become a mainstream solution. This study integrates data from UWB and Intel RealSense T265 sensors to provide precise positioning information for multi-UAV formations. An improved Unscented Kalman Filter (UKF) algorithm is proposed, incorporating adaptive sigma point generation and a dual-layer adaptive covariance adjustment mechanism. This modified algorithm dynamically adjusts the weight of each sensor in the positioning estimation based on the noise characteristics of different sensors, thereby effectively mitigating the impact of high-noise data on positioning accuracy and significantly enhancing overall positioning performance. Experimental results indicate that the improved UKF algorithm, compared to the conventional UKF, enhances positioning accuracy in the x, y, and z directions by 6.78%, 3.29%, and 2.88% respectively in RMSE evaluation, with corresponding reductions in standard deviations by 4.84%, 1.55%, and 7.04%. Particularly in the z direction, the interquartile range (IQR) improvement is notable, with an increase of 7.60%.
- 18 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1324-1329
Open AccessAdaptive UKF multisensor fusion localization algorithm for UAV formation
Multi-sensor data fusion technology has improved the positioning accuracy and system stability of multi-UAV formations in complex environments, and has become a mainstream solution. This study integrates data from UWB and Intel RealSense T265 sensors to provide precise positioning information for multi-UAV formations. An improved Unscented Kalman Filter (UKF) algorithm is proposed, incorporating adaptive sigma point generation and a dual-layer adaptive covariance adjustment mechanism. This modified algorithm dynamically adjusts the weight of each sensor in the positioning estimation based on the noise characteristics of different sensors, thereby effectively mitigating the impact of high-noise data on positioning accuracy and significantly enhancing overall positioning performance. Experimental results indicate that the improved UKF algorithm, compared to the conventional UKF, enhances positioning accuracy in the x, y, and z directions by 6.78%, 3.29%, and 2.88% respectively in RMSE evaluation, with corresponding reductions in standard deviations by 4.84%, 1.55%, and 7.04%. Particularly in the z direction, the interquartile range (IQR) improvement is notable, with an increase of 7.60%.
- Open Access
- 20 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 419-423
Multi-view Video Splicing System
In traditional video surveillance systems, supervisors need to watch multiple surveillance images at the same time. Surveillance video resources are scattered and huge, making it difficult to browse them all and extract useful information from them in a timely manner. The video splicing system can be used to merge multiple images and splice and fuse images from different perspectives to form a whole image, which is convenient for personnel supervision. This article introduces a multi-view video splicing system: it consists of several video cameras. Through the GStreamer framework, video streaming is performed in real time and the pictures are transmitted into the video fusion system. In the system, SURF feature points are extracted from several pictures to simulate After the radial transformation, real-time splicing is performed on them. After comparing the APAP algorithm, Multi Blend algorithm, Stitching algorithm, and the best fusion line algorithm, the best fusion line algorithm is selected for video fusion. At the same time, considering that the system requires a large amount of data operations, if the CPU is simply used to process too many videos, the effect of the algorithm and the delay of the video are often unsatisfactory. The system uses CUDA to combine the SURF algorithm and image simulation. The radial transformation is performed on the GPU, which greatly improves the fusion effect and speed of the video. Through experiments, the system can complete the splicing task better. At the same time, compared with not using CUDA for acceleration, the frame rate is increased from 3 frames per second to 25 frames, and the display can basically achieve real-time effects.
- 20 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 419-423
Open AccessMulti-view Video Splicing System
In traditional video surveillance systems, supervisors need to watch multiple surveillance images at the same time. Surveillance video resources are scattered and huge, making it difficult to browse them all and extract useful information from them in a timely manner. The video splicing system can be used to merge multiple images and splice and fuse images from different perspectives to form a whole image, which is convenient for personnel supervision. This article introduces a multi-view video splicing system: it consists of several video cameras. Through the GStreamer framework, video streaming is performed in real time and the pictures are transmitted into the video fusion system. In the system, SURF feature points are extracted from several pictures to simulate After the radial transformation, real-time splicing is performed on them. After comparing the APAP algorithm, Multi Blend algorithm, Stitching algorithm, and the best fusion line algorithm, the best fusion line algorithm is selected for video fusion. At the same time, considering that the system requires a large amount of data operations, if the CPU is simply used to process too many videos, the effect of the algorithm and the delay of the video are often unsatisfactory. The system uses CUDA to combine the SURF algorithm and image simulation. The radial transformation is performed on the GPU, which greatly improves the fusion effect and speed of the video. Through experiments, the system can complete the splicing task better. At the same time, compared with not using CUDA for acceleration, the frame rate is increased from 3 frames per second to 25 frames, and the display can basically achieve real-time effects.
- Open Access
- 20 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 623-628
Depth Camera and UWB Positioning Data Fusion Algorithm for Indoor Picking Drones
Indoor growing is a trend in agriculture in the future. Using drones to replace manual monitoring and picking of fruits can save costs and free up manpower. Achieving precise picking by drones requires strong indoor positioning capabilities, but in the complex environment of indoor orchards, using a single sensor may produce data fluctuations. This project proposes a method to fuse depth camera data and UWB data to solve the problem of insufficient positioning performance of a single sensor: independently obtain the positioning data of the depth camera and UWB, use the Kalman filter to process the data noise, and calculate the data fluctuations degree, calculate the sensor data confidence, compare and obtain the sensor data with high confidence as the preliminary data for fusion, and finally perform Kalman filter processing on the preliminary fusion data again to obtain the final data. This fusion method achieves high-precision indoor positioning of UAVs. Through simulation experiments, compared with using depth cameras or UWB data independently, the data fusion solution improves the maximum error performance by approximately 18.05% and the minimum mean square error performance. Increased by approximately 4.76%.
- 20 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 623-628
Open AccessDepth Camera and UWB Positioning Data Fusion Algorithm for Indoor Picking Drones
Indoor growing is a trend in agriculture in the future. Using drones to replace manual monitoring and picking of fruits can save costs and free up manpower. Achieving precise picking by drones requires strong indoor positioning capabilities, but in the complex environment of indoor orchards, using a single sensor may produce data fluctuations. This project proposes a method to fuse depth camera data and UWB data to solve the problem of insufficient positioning performance of a single sensor: independently obtain the positioning data of the depth camera and UWB, use the Kalman filter to process the data noise, and calculate the data fluctuations degree, calculate the sensor data confidence, compare and obtain the sensor data with high confidence as the preliminary data for fusion, and finally perform Kalman filter processing on the preliminary fusion data again to obtain the final data. This fusion method achieves high-precision indoor positioning of UAVs. Through simulation experiments, compared with using depth cameras or UWB data independently, the data fusion solution improves the maximum error performance by approximately 18.05% and the minimum mean square error performance. Increased by approximately 4.76%.