Xu Lin
Research Subjects
Xu Lin has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Dapeng Tao
Yunnan University
4 shared publications - Yibing Zhan
Wuhan University
4 shared publications - Jun Ni
Yunnan University
2 shared publications - Linfei Wang
School of Physics and Electronic Information, the Key Laboratory of Opto-Electronic Information Technology of Yunnan Province, and the Engineering Research Center for Optoelectronic Detection and Perception Technology of Yunnan Province, Yunnan Normal University, Kunming, China
2 shared publications - Baosheng Yu
Nanyang Technological University
1 shared publication - Carlos Lopez-Martinez
CommSensLab, Department of Signal Theory and Communications, Universitat Politcnica de Catalunya, Barcelona, Spain
1 shared publication
Latest Publications
- 27 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
HAG-Former: A Temporal-Polarimetric Relationship Inference Network From Local to Global
Multitemporal PolSAR data can provide a unique insight into the temporal scattering characteristics of targets and highlight their dynamic changes over time, therefore supporting improved classification performance. Constrained by the complexities of satellite orbit control technology and the challenges associated with time-series PolSAR data acquisition, most prevailing methodologies rely solely on single PolSAR image to tackle land coverage classification, inherently limiting their ability to generalize across diverse scenarios. To address this limitation, this work introduces a novel Hybrid Attention-GRU Transformer (HAG-Former) model, which harnesses the power of pixel-level temporal-polarimetric change analysis and captures the dynamic variations in polarization scattering properties, thereby enhancing classification robustness and versatility. In this approach, we seamlessly integrate a self-attention mechanism, Gated Recurrent Unit (GRU), and a transformer encoder to delve into pixel-level changes in polarimetric features. Initially, the self-attention mechanism pinpoints crucial classification-aiding features, bolstering their significance. The weighted features are then feed into the GRU model, enhancing local temporal-polarimetric relationship insights. These relationships, coupled with significant features from the self-attention mechanism, are subsequently processed by the transformer encoder, unraveling global information. Furthermore, we employ a label smoothing loss function during training, mitigating the impact of sample imbalance on classification accuracy. To validate the effectiveness of our proposed methodology, we evaluated it on two benchmark datasets. The results demonstrate a notable enhancement in classification performance, achieving an overall accuracy improvement of 2.21% and 1.79% over the state-of-the-art. The code is available in: https://github.com/Thomasakun/HAGFormer.
- 27 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
HAG-Former: A Temporal-Polarimetric Relationship Inference Network From Local to Global
Multitemporal PolSAR data can provide a unique insight into the temporal scattering characteristics of targets and highlight their dynamic changes over time, therefore supporting improved classification performance. Constrained by the complexities of satellite orbit control technology and the challenges associated with time-series PolSAR data acquisition, most prevailing methodologies rely solely on single PolSAR image to tackle land coverage classification, inherently limiting their ability to generalize across diverse scenarios. To address this limitation, this work introduces a novel Hybrid Attention-GRU Transformer (HAG-Former) model, which harnesses the power of pixel-level temporal-polarimetric change analysis and captures the dynamic variations in polarization scattering properties, thereby enhancing classification robustness and versatility. In this approach, we seamlessly integrate a self-attention mechanism, Gated Recurrent Unit (GRU), and a transformer encoder to delve into pixel-level changes in polarimetric features. Initially, the self-attention mechanism pinpoints crucial classification-aiding features, bolstering their significance. The weighted features are then feed into the GRU model, enhancing local temporal-polarimetric relationship insights. These relationships, coupled with significant features from the self-attention mechanism, are subsequently processed by the transformer encoder, unraveling global information. Furthermore, we employ a label smoothing loss function during training, mitigating the impact of sample imbalance on classification accuracy. To validate the effectiveness of our proposed methodology, we evaluated it on two benchmark datasets. The results demonstrate a notable enhancement in classification performance, achieving an overall accuracy improvement of 2.21% and 1.79% over the state-of-the-art. The code is available in: https://github.com/Thomasakun/HAGFormer.
- 17 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (11) , 11086-11100
DeIoU: Toward Distinguishable Box Prediction in Densely Packed Object Detection
The Intersection over Union (IoU) has been widely employed in various stages of object detection owing to its ability to quantify the similarity between boxes objectively. However, in densely packed scenes full of crowded and small-sized objects, adjacent positive boxes often exhibit high levels of overlap. This overlap interference compromises the consistency between quality evaluation and confidence, leading to ambiguous box prediction within the previous IoU-based models. To address this issue, we design a novel learning paradigm tailored for Dense scenes based on IoU, called DeIoU. This approach effectively suppresses unnecessary overlap between predicted boxes and thereby enhances representation learning for non-salient objects. Specifically, it consists of a dense box regression loss LDeIoU and a one-to-many (O2M) label matching strategy guided by DeIoU. These components focus on calibrating the position and shape prediction quality during the model training, learning distinguishable object features by penalizing overlap interference between neighboring boxes. Extensive experiments on four object detection datasets including SKU-110K, CrowdHuman, MS COCO 2017, and DIOR, demonstrate that our DeIoU-based learning strategy outperforms other state-of-the-art methods. Notably, the proposed method delivers a substantial improvement (average 1.3 AP and 1.8 M R -2 ) across popular detectors on SKU-110K and CrowdHuman while exhibiting distinct competitiveness on small objects within natural scenes.
- 17 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (11) , 11086-11100
DeIoU: Toward Distinguishable Box Prediction in Densely Packed Object Detection
The Intersection over Union (IoU) has been widely employed in various stages of object detection owing to its ability to quantify the similarity between boxes objectively. However, in densely packed scenes full of crowded and small-sized objects, adjacent positive boxes often exhibit high levels of overlap. This overlap interference compromises the consistency between quality evaluation and confidence, leading to ambiguous box prediction within the previous IoU-based models. To address this issue, we design a novel learning paradigm tailored for Dense scenes based on IoU, called DeIoU. This approach effectively suppresses unnecessary overlap between predicted boxes and thereby enhances representation learning for non-salient objects. Specifically, it consists of a dense box regression loss LDeIoU and a one-to-many (O2M) label matching strategy guided by DeIoU. These components focus on calibrating the position and shape prediction quality during the model training, learning distinguishable object features by penalizing overlap interference between neighboring boxes. Extensive experiments on four object detection datasets including SKU-110K, CrowdHuman, MS COCO 2017, and DIOR, demonstrate that our DeIoU-based learning strategy outperforms other state-of-the-art methods. Notably, the proposed method delivers a substantial improvement (average 1.3 AP and 1.8 M R -2 ) across popular detectors on SKU-110K and CrowdHuman while exhibiting distinct competitiveness on small objects within natural scenes.
- Open Access
- 24 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 188-195
Multimodal Feature Analysis for Surgery Duration Predication
- 24 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 188-195
Open AccessMultimodal Feature Analysis for Surgery Duration Predication
- 20 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 9 (1) , 509-521
Explicit and Implicit Box Equivariance Learning for Weakly-Supervised Rotated Object Detection
Rotated object detection has emerged as a preferred alternative to the conventional Horizontal Box (HBox) object detection in various tasks. However, the majority of existing detection datasets are still annotated using HBox. Re-annotating these datasets for rotated object detection is notably inefficient and labor-intensive. Recently, weakly-supervised detectors based directly on HBox have provided a solution to bridge the gap between the rotated bounding box (RBox) prediction and the weak annotations. Nonetheless, they tend to overlook the potential impact of factors such as bounding box position, aspect ratio, and scale on angle prediction. Additionally, inconsistencies arise when evaluating rotation variations, hindering the inference performance. In light of these limitations, we propose an explicit and implicit equivariance detector (EIE-Det) to predict fine-grained RBox based on HBox annotations. Along with a shared backbone and neck structure, our proposed EIE-Det comprises a weakly supervised (WS) branch for predicting coarse RBox from HBox labels, an explicit equivariance (EE) branch for learning rotation consistency, and an implicit equivariance (IE) branch for learning position, aspect ratio, and scale consistency. Furthermore, we introduce the Tanimoto Coefficient for vector-based bounding box regression, enabling a comprehensive assessment of model prediction bias, thereby eliminating interference from variations in box aspect ratio and scale. Experiments demonstrate that our method not only significantly surpasses state-of-the-art models supervised with HBox but also achieves accuracy comparable to fully-supervised detectors (75.74$\%$ and 58.50$\%$ $AP_{50}$ on DOTA and DIOR-R, respectively).
- 20 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 9 (1) , 509-521
Explicit and Implicit Box Equivariance Learning for Weakly-Supervised Rotated Object Detection
Rotated object detection has emerged as a preferred alternative to the conventional Horizontal Box (HBox) object detection in various tasks. However, the majority of existing detection datasets are still annotated using HBox. Re-annotating these datasets for rotated object detection is notably inefficient and labor-intensive. Recently, weakly-supervised detectors based directly on HBox have provided a solution to bridge the gap between the rotated bounding box (RBox) prediction and the weak annotations. Nonetheless, they tend to overlook the potential impact of factors such as bounding box position, aspect ratio, and scale on angle prediction. Additionally, inconsistencies arise when evaluating rotation variations, hindering the inference performance. In light of these limitations, we propose an explicit and implicit equivariance detector (EIE-Det) to predict fine-grained RBox based on HBox annotations. Along with a shared backbone and neck structure, our proposed EIE-Det comprises a weakly supervised (WS) branch for predicting coarse RBox from HBox labels, an explicit equivariance (EE) branch for learning rotation consistency, and an implicit equivariance (IE) branch for learning position, aspect ratio, and scale consistency. Furthermore, we introduce the Tanimoto Coefficient for vector-based bounding box regression, enabling a comprehensive assessment of model prediction bias, thereby eliminating interference from variations in box aspect ratio and scale. Experiments demonstrate that our method not only significantly surpasses state-of-the-art models supervised with HBox but also achieves accuracy comparable to fully-supervised detectors (75.74$\%$ and 58.50$\%$ $AP_{50}$ on DOTA and DIOR-R, respectively).