Binbin Liang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Binbin Liang has a total of 29 co-authors. Here are the top co-authors by number of shared publications:
- Wei Li
School of Aeronautics and Astronautics, Sichuan University, Chengdu, China
9 shared publications Songchen Han
4 shared publications- Guoxin Huang
National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, Chengdu 610065, China
3 shared publications - Fan Yang
College of Computer Science, Sichuan University, Chengdu, China
2 shared publications - Jianwei Zhang
College of Computer Science, Sichuan University, Chengdu, China
2 shared publications - Songchen Han
School of Aeronautics and Astronautics, Sichuan University, Chengdu, China
2 shared publications
Latest Publications
- Open Access
- 18 October 2025
- Published by Elsevier in Chinese Journal of Aeronautics
- Vol. 39 (4)
Delay propagation prediction of aviation network based on spatial–temporal dynamic interaction
- 18 October 2025
- Published by Elsevier in Chinese Journal of Aeronautics
- Vol. 39 (4)
Open AccessDelay propagation prediction of aviation network based on spatial–temporal dynamic interaction
- 5 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (1) , 547-560
Multidimensional Fusion Network for Multispectral Object Detection
Multispectral object detection has attracted increasing attention recently due to its superior detection capacity under various illumination conditions. The key challenge lies in the effective aggregation of multi-spectral features to derive highly discriminative representations. To address this challenge, we propose a novel Multidimensional Fusion Network (MMFN) to explore multi-modal information from local, global, and channel perspectives. Specifically, at the local level, local features of different modalities and their inter-relationships are captured by a window-shifted fusion. As a complement to the local information, we designed a global interaction module that facilitates the fusion of holistic, high-level semantic information spanning the entire image. We distillate the channel dependencies and complementarities between different modalities through cross-channel learning and generate the final fused representation. Comprehensive experiments conducted on three publicly available datasets provide compelling evidence validating the superiority of the proposed methodology. The results exhibit notable performance gains over state-of-the-art multispectral object detectors. Our code will be released.
- 5 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (1) , 547-560
Multidimensional Fusion Network for Multispectral Object Detection
Multispectral object detection has attracted increasing attention recently due to its superior detection capacity under various illumination conditions. The key challenge lies in the effective aggregation of multi-spectral features to derive highly discriminative representations. To address this challenge, we propose a novel Multidimensional Fusion Network (MMFN) to explore multi-modal information from local, global, and channel perspectives. Specifically, at the local level, local features of different modalities and their inter-relationships are captured by a window-shifted fusion. As a complement to the local information, we designed a global interaction module that facilitates the fusion of holistic, high-level semantic information spanning the entire image. We distillate the channel dependencies and complementarities between different modalities through cross-channel learning and generate the final fused representation. Comprehensive experiments conducted on three publicly available datasets provide compelling evidence validating the superiority of the proposed methodology. The results exhibit notable performance gains over state-of-the-art multispectral object detectors. Our code will be released.
- Open Access
- 24 March 2024
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 38 (15) , 16316-16324
Multi-Modal Disordered Representation Learning Network for Description-Based Person Search
Description-based person search aims to retrieve images of the target identity via textual descriptions. One of the challenges for this task is to extract discriminative representation from images and descriptions. Most existing methods apply the part-based split method or external models to explore the fine-grained details of local features, which ignore the global relationship between partial information and cause network instability. To overcome these issues, we propose a Multi-modal Disordered Representation Learning Network (MDRL) for description-based person search to fully extract the visual and textual representations. Specifically, we design a Cross-modality Global Feature Learning Architecture to learn the global features from the two modalities and meet the demand of the task. Based on our global network, we introduce a Disorder Local Learning Module to explore local features by a disordered reorganization strategy from both visual and textual aspects and enhance the robustness of the whole network. Besides, we introduce a Cross-modality Interaction Module to guide the two streams to extract visual or textual representations considering the correlation between modalities. Extensive experiments are conducted on two public datasets, and the results show that our method outperforms the state-of-the-art methods on CUHK-PEDES and ICFG-PEDES datasets and achieves superior performance.
- 24 March 2024
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 38 (15) , 16316-16324
Open AccessMulti-Modal Disordered Representation Learning Network for Description-Based Person Search
Description-based person search aims to retrieve images of the target identity via textual descriptions. One of the challenges for this task is to extract discriminative representation from images and descriptions. Most existing methods apply the part-based split method or external models to explore the fine-grained details of local features, which ignore the global relationship between partial information and cause network instability. To overcome these issues, we propose a Multi-modal Disordered Representation Learning Network (MDRL) for description-based person search to fully extract the visual and textual representations. Specifically, we design a Cross-modality Global Feature Learning Architecture to learn the global features from the two modalities and meet the demand of the task. Based on our global network, we introduce a Disorder Local Learning Module to explore local features by a disordered reorganization strategy from both visual and textual aspects and enhance the robustness of the whole network. Besides, we introduce a Cross-modality Interaction Module to guide the two streams to extract visual or textual representations considering the correlation between modalities. Extensive experiments are conducted on two public datasets, and the results show that our method outperforms the state-of-the-art methods on CUHK-PEDES and ICFG-PEDES datasets and achieves superior performance.
- 15 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 30 (10709908) , 1417-1421
Similarity Measure of Time Series With Different Sampling Frequencies Based on Context Density Consistency and Dynamic Time Warping
Similarity measure of time series with different sampling frequencies is vitally important for many signal processing applications. Dynamic Time Warping (DTW) is one of the most popular methods for similarity measure of time series. However, conventional DTW algorithms have limitations when dealing with time series of different sampling frequencies due to context density inconsistency such as different internal change frequencies of derivatives, shapes, events and distances in local neighborhoods. In light of this, we propose a novel Context Density Consistency Dynamic Time Warping (CDC-DTW) algorithm. It firstly designs local context windows adaptive to the lengths of time series. Then it proposed a local spatial-temporal context density consistency technique by down-sampling and interpolation compensating the high-frequency time series following the context density of low-frequency time series. Besides, a normalized Hamming window weighting function is embedded into the local contexts to create robust weighted cost measure. Extensive experimental results on 128 gold-standard UCR datasets showed that CDC-DTW increased the similarity measure accuracy by 70.53% in average comparing with other 6 classic and state-of-the-art DTW baseline algorithms.
- 15 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 30 (10709908) , 1417-1421
Similarity Measure of Time Series With Different Sampling Frequencies Based on Context Density Consistency and Dynamic Time Warping
Similarity measure of time series with different sampling frequencies is vitally important for many signal processing applications. Dynamic Time Warping (DTW) is one of the most popular methods for similarity measure of time series. However, conventional DTW algorithms have limitations when dealing with time series of different sampling frequencies due to context density inconsistency such as different internal change frequencies of derivatives, shapes, events and distances in local neighborhoods. In light of this, we propose a novel Context Density Consistency Dynamic Time Warping (CDC-DTW) algorithm. It firstly designs local context windows adaptive to the lengths of time series. Then it proposed a local spatial-temporal context density consistency technique by down-sampling and interpolation compensating the high-frequency time series following the context density of low-frequency time series. Besides, a normalized Hamming window weighting function is embedded into the local contexts to create robust weighted cost measure. Extensive experimental results on 128 gold-standard UCR datasets showed that CDC-DTW increased the similarity measure accuracy by 70.53% in average comparing with other 6 classic and state-of-the-art DTW baseline algorithms.
- Open Access
- 30 January 2023
- Published by Hindawi Limited in International Journal of Aerospace Engineering
- Vol. 2023, 1-16
A LEO Satellite Handover Strategy Based on Graph and Multiobjective Multiagent Path Finding
Low earth orbit (LEO) satellite network can provide services to users anywhere on the earth. However, the high-speed mobility of satellites leads to a dynamic environment, which brings challenges for handover and network performance optimization, especially in the scenario of multiuser using the networks meanwhile. In this paper, we exploit multiple directed graphs to model the handover process for multiuser. The nodes in a graph represent the satellites that the corresponding user may choose to access. The edges represent the possible handovers between adjacent timestamps. The path from the start node to the end node in each graph is the handover strategy of the corresponding user, and the path length is the reward that the user can get. Therefore, the handover strategy problem is transformed into a path planning problem. To minimize the average handover times, maximize the average received power, and minimize the average number of conflicts, we propose a novel handover strategy based on multiobjective multiagent path finding (MOMAPF). The simulated handover experiment on Starlink successfully derives the Pareto-optimal solution set, which corroborates the effectiveness of the proposed handover strategy. The results also show that the proposed strategy has better comprehensive performance than other strategies.
- 30 January 2023
- Published by Hindawi Limited in International Journal of Aerospace Engineering
- Vol. 2023, 1-16
Open AccessA LEO Satellite Handover Strategy Based on Graph and Multiobjective Multiagent Path Finding
Low earth orbit (LEO) satellite network can provide services to users anywhere on the earth. However, the high-speed mobility of satellites leads to a dynamic environment, which brings challenges for handover and network performance optimization, especially in the scenario of multiuser using the networks meanwhile. In this paper, we exploit multiple directed graphs to model the handover process for multiuser. The nodes in a graph represent the satellites that the corresponding user may choose to access. The edges represent the possible handovers between adjacent timestamps. The path from the start node to the end node in each graph is the handover strategy of the corresponding user, and the path length is the reward that the user can get. Therefore, the handover strategy problem is transformed into a path planning problem. To minimize the average handover times, maximize the average received power, and minimize the average number of conflicts, we propose a novel handover strategy based on multiobjective multiagent path finding (MOMAPF). The simulated handover experiment on Starlink successfully derives the Pareto-optimal solution set, which corroborates the effectiveness of the proposed handover strategy. The results also show that the proposed strategy has better comprehensive performance than other strategies.
- 27 October 2022
- Published by Elsevier in Information Processing & Management
- Vol. 60 (1)
Spatial-temporal alignment of time series with different sampling rates based on cellular multi-objective whale optimization
- 27 October 2022
- Published by Elsevier in Information Processing & Management
- Vol. 60 (1)
Spatial-temporal alignment of time series with different sampling rates based on cellular multi-objective whale optimization
- Open Access
- 10 August 2022
- Published by MDPI AG in Remote Sensing
- Vol. 14 (16) , 3877
Accurate Spatial Positioning of Target Based on the Fusion of Uncalibrated Image and GNSS
The accurate spatial positioning of the target in a fixed camera image is a critical sensing technique. Conventional visual spatial positioning methods rely on tedious camera calibration and face great challenges in selecting the representative feature points to compute the position of the target, especially when existing occlusion or in remote scenes. In order to avoid these deficiencies, this paper proposes a deep learning approach for accurate visual spatial positioning of the targets with the assistance of Global Navigation Satellite System (GNSS). It contains two stages: the first stage trains a hybrid supervised and unsupervised auto-encoder regression network offline to gain capability of regressing geolocation (longitude and latitude) directly from the fusion of image and GNSS, and learns an error scale factor to evaluate the regression error. The second stage firstly predicts regressed accurate geolocation online from the observed image and GNSS measurement, and then filters the predictive geolocation and the measured GNSS to output the optimal geolocation. The experimental results showed that the proposed approach increased the average positioning accuracy by 56.83%, 37.25%, 41.62% in a simulated scenario and 31.25%, 7.43%, 38.28% in a real-world scenario, compared with GNSS, the Interacting Multiple Model−Unscented Kalman Filters (IMM-UKF) and the supervised deep learning approach, respectively. Other improvements were also achieved in positioning stability, robustness, generalization, and performance in GNSS denied environments.
- 10 August 2022
- Published by MDPI AG in Remote Sensing
- Vol. 14 (16) , 3877
Open AccessAccurate Spatial Positioning of Target Based on the Fusion of Uncalibrated Image and GNSS
The accurate spatial positioning of the target in a fixed camera image is a critical sensing technique. Conventional visual spatial positioning methods rely on tedious camera calibration and face great challenges in selecting the representative feature points to compute the position of the target, especially when existing occlusion or in remote scenes. In order to avoid these deficiencies, this paper proposes a deep learning approach for accurate visual spatial positioning of the targets with the assistance of Global Navigation Satellite System (GNSS). It contains two stages: the first stage trains a hybrid supervised and unsupervised auto-encoder regression network offline to gain capability of regressing geolocation (longitude and latitude) directly from the fusion of image and GNSS, and learns an error scale factor to evaluate the regression error. The second stage firstly predicts regressed accurate geolocation online from the observed image and GNSS measurement, and then filters the predictive geolocation and the measured GNSS to output the optimal geolocation. The experimental results showed that the proposed approach increased the average positioning accuracy by 56.83%, 37.25%, 41.62% in a simulated scenario and 31.25%, 7.43%, 38.28% in a real-world scenario, compared with GNSS, the Interacting Multiple Model−Unscented Kalman Filters (IMM-UKF) and the supervised deep learning approach, respectively. Other improvements were also achieved in positioning stability, robustness, generalization, and performance in GNSS denied environments.
- Open Access
- 2 July 2022
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 16 (11) , 1471-1488
Plithogenic multi‐criteria decision making approach on airspace planning scheme evaluation based on ATC‐flight real‐time simulation
Airspace planning scheme evaluation based on ATC‐Flight real‐time simulation which incorporates air traffic control simulator and flight simulator has become increasingly important. It has irreplaceable advantages of truly simulating and in‐depth evaluating airspace operation, especially for analyzing human factors. As a multi‐criteria decision making (MCDM) problem, it poses challenges which this study aims to overcome from three aspects. Firstly, the complexity of airspace and the characteristics of ATC‐Flight real‐time simulation are analyzed to build a multi‐criteria evaluation system. The criteria include air traffic flow, airspace operational performance, flight procedure quality, cost, controller workload and pilot workload. Secondly, a novel weighting method based on plithogenic set is presented to derive robust subjective criteria weights from a group of human decision makers. The subjective weights are then combined with objective weights using game theory to determine cumulative criteria weights. Thirdly, technique for order preference by similarity to ideal solution (TOPSIS) and grey correlation analysis are integrated to perform comprehensive evaluation and ranking. The first series of ATC‐Flight real‐time simulations in China are conducted to illustrate a case study. The results demonstrated that the proposed MCDM approach could improve the accuracy and discriminability of evaluation results, and outperformed other existing well‐known MCDM algorithms.
- 2 July 2022
- Published by Institution of Engineering and Technology (IET) in IET Intelligent Transport Systems
- Vol. 16 (11) , 1471-1488
Open AccessPlithogenic multi‐criteria decision making approach on airspace planning scheme evaluation based on ATC‐flight real‐time simulation
Airspace planning scheme evaluation based on ATC‐Flight real‐time simulation which incorporates air traffic control simulator and flight simulator has become increasingly important. It has irreplaceable advantages of truly simulating and in‐depth evaluating airspace operation, especially for analyzing human factors. As a multi‐criteria decision making (MCDM) problem, it poses challenges which this study aims to overcome from three aspects. Firstly, the complexity of airspace and the characteristics of ATC‐Flight real‐time simulation are analyzed to build a multi‐criteria evaluation system. The criteria include air traffic flow, airspace operational performance, flight procedure quality, cost, controller workload and pilot workload. Secondly, a novel weighting method based on plithogenic set is presented to derive robust subjective criteria weights from a group of human decision makers. The subjective weights are then combined with objective weights using game theory to determine cumulative criteria weights. Thirdly, technique for order preference by similarity to ideal solution (TOPSIS) and grey correlation analysis are integrated to perform comprehensive evaluation and ranking. The first series of ATC‐Flight real‐time simulations in China are conducted to illustrate a case study. The results demonstrated that the proposed MCDM approach could improve the accuracy and discriminability of evaluation results, and outperformed other existing well‐known MCDM algorithms.
- 1 April 2022
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Aerospace Information Systems
- Vol. 19 (4) , 305-316
Efficient Small-Object Detection in Airport Surface Based on Maintain Feature High Resolution
Detection of small objects is a challenge in computer vision, especially in the application of airport surface surveillance. Operation of convolution is the key to losing the semantic information o...
- 1 April 2022
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Aerospace Information Systems
- Vol. 19 (4) , 305-316
Efficient Small-Object Detection in Airport Surface Based on Maintain Feature High Resolution
Detection of small objects is a challenge in computer vision, especially in the application of airport surface surveillance. Operation of convolution is the key to losing the semantic information o...
- Open Access
- 30 March 2022
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 16 (5) , 445-455
Multi‐stage attention network for video‐based person re‐identification
Video‐based person re‐identification (Re‐ID) has received increasing attention in video surveillance analysis in recent years. To extract relevant information of the target, many existing methods utilise the attention mechanism in the residual block of the ResNet. However, these methods only focus on the residual block and ignore the output of the shortcut part, which also contains rich information about the person. To solve this problem, a different aspect of network design is investigated: the insert position of the attention module. To simultaneously explore the discriminative information in both the residual block and the shortcut, a novel multi‐stage attention method is proposed by inserting the attention mechanism between stages of ResNet. Using this method can effectively extract the rich discriminative features of the target to better distinguish different pedestrians and improve the feature extraction capabilities of the model. Extensive experiments are conducted on four popular video‐based person Re‐ID datasets to demonstrate the effectiveness of the authors’ proposed method and display its superiority with the existing video‐based person Re‐ID methods.
- 30 March 2022
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 16 (5) , 445-455
Open AccessMulti‐stage attention network for video‐based person re‐identification
Video‐based person re‐identification (Re‐ID) has received increasing attention in video surveillance analysis in recent years. To extract relevant information of the target, many existing methods utilise the attention mechanism in the residual block of the ResNet. However, these methods only focus on the residual block and ignore the output of the shortcut part, which also contains rich information about the person. To solve this problem, a different aspect of network design is investigated: the insert position of the attention module. To simultaneously explore the discriminative information in both the residual block and the shortcut, a novel multi‐stage attention method is proposed by inserting the attention mechanism between stages of ResNet. Using this method can effectively extract the rich discriminative features of the target to better distinguish different pedestrians and improve the feature extraction capabilities of the model. Extensive experiments are conducted on four popular video‐based person Re‐ID datasets to demonstrate the effectiveness of the authors’ proposed method and display its superiority with the existing video‐based person Re‐ID methods.