Yao Xu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Yao Xu has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Meiyu Huang
Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing, China
4 shared publications - Xueshuang Xiang
Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing, China
4 shared publications Hang Cui
Advanced Electronic Materials Institute, General Research Institute for Nonferrous Metals
1 shared publication- Hao Zhou
China University of Mining and Technology (Beijing)
1 shared publication Jian Dong Cui
Advanced Electronic Materials Institute, General Research Institute for Nonferrous Metals
1 shared publication- Jingjing Hu
Beijing Institute of Technology
1 shared publication
Latest Publications
- Open Access
- 27 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 15 (19391404) , 8586-8599
Detecting Fine-Grained Airplanes in SAR Images With Sparse Attention-Guided Pyramid and Class-Balanced Data Augmentation
Airplane detection in synthetic aperture radar (SAR) images has drawn much attention owing to the success of deep learning methods. However, the development of fine-grained airplane detection in SAR images is still in a dilemma due to the small interclass variance and the large intraclass variance in complex scenes with strong interference from the background. In addition, the class imbalance problem in multiclass fine-grained airplane recognition also significantly limits the direct application of general deep-learning-based airplane detectors. This article proposes two effective methods to tackle the above two problems, respectively. First, we propose a sparse attention-guided fine-grained pyramid module to simultaneously sample discriminative local features scattered in multiscale layers and adaptively aggregate them with fine-grained attention to better classify subordinate-level airplanes with multiple scales. Second, a simple class-balanced copy-paste data augmentation strategy, which randomly copies an airplane of one category and pastes it onto an image according to the classwise probability, is proposed for class balance. Finally, extensive experiments on one public dataset and three representative deep-learning-based detection benchmarks are conducted to show the effectiveness and generalization of the two proposed methods. The combination of these two methods based on the cascade R-CNN benchmark also won the fifth place in fine-grained airplane detection in SAR images in the 2021 GaoFen Challenge.
- 27 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 15 (19391404) , 8586-8599
Open AccessDetecting Fine-Grained Airplanes in SAR Images With Sparse Attention-Guided Pyramid and Class-Balanced Data Augmentation
Airplane detection in synthetic aperture radar (SAR) images has drawn much attention owing to the success of deep learning methods. However, the development of fine-grained airplane detection in SAR images is still in a dilemma due to the small interclass variance and the large intraclass variance in complex scenes with strong interference from the background. In addition, the class imbalance problem in multiclass fine-grained airplane recognition also significantly limits the direct application of general deep-learning-based airplane detectors. This article proposes two effective methods to tackle the above two problems, respectively. First, we propose a sparse attention-guided fine-grained pyramid module to simultaneously sample discriminative local features scattered in multiscale layers and adaptively aggregate them with fine-grained attention to better classify subordinate-level airplanes with multiple scales. Second, a simple class-balanced copy-paste data augmentation strategy, which randomly copies an airplane of one category and pastes it onto an image according to the classwise probability, is proposed for class balance. Finally, extensive experiments on one public dataset and three representative deep-learning-based detection benchmarks are conducted to show the effectiveness and generalization of the two proposed methods. The combination of these two methods based on the cascade R-CNN benchmark also won the fifth place in fine-grained airplane detection in SAR images in the 2021 GaoFen Challenge.
- 30 June 2022
- Published by Springer Nature in CCF Transactions on Pervasive Computing and Interaction
- Vol. 4 (3) , 219-239
AviPer: assisting visually impaired people to perceive the world with visual-tactile multimodal attention network
Unlike able-bodied persons, it is difficult for visually impaired people, especially those in the educational age, to build a full perception of the world due to the lack of normal vision. The rapid development of AI and sensing technologies has provided new solutions to visually impaired assistance. However, to our knowledge, most previous studies focused on obstacle avoidance and environmental perception but paid less attention to educational assistance for visually impaired people. In this paper, we propose AviPer, a system that aims to assist visually impaired people to perceive the world via creating a continuous, immersive, and educational assisting pattern. Equipped with a self-developed flexible tactile glove and a webcam, AviPer can simultaneously predict the grasping object and provide voice feedback using the vision-tactile fusion classification model, when a visually impaired people is perceiving the object with his gloved hand. To achieve accurate multimodal classification, we creatively embed three attention mechanisms, namely temporal, channel-wise, and spatial attention in the model. Experimental results show that AviPer can achieve an accuracy of 99.75% in classification of 10 daily objects. We evaluated the system in a variety of extreme cases, which verified its robustness and demonstrated the necessity of visual and tactile modal fusion. We also conducted tests in the actual use scene and proved the usability and user-friendliness of the system. We opensourced the code and self-collected datasets in the hope of promoting research development and bringing changes to the lives of visually impaired people.
- 30 June 2022
- Published by Springer Nature in CCF Transactions on Pervasive Computing and Interaction
- Vol. 4 (3) , 219-239
AviPer: assisting visually impaired people to perceive the world with visual-tactile multimodal attention network
Unlike able-bodied persons, it is difficult for visually impaired people, especially those in the educational age, to build a full perception of the world due to the lack of normal vision. The rapid development of AI and sensing technologies has provided new solutions to visually impaired assistance. However, to our knowledge, most previous studies focused on obstacle avoidance and environmental perception but paid less attention to educational assistance for visually impaired people. In this paper, we propose AviPer, a system that aims to assist visually impaired people to perceive the world via creating a continuous, immersive, and educational assisting pattern. Equipped with a self-developed flexible tactile glove and a webcam, AviPer can simultaneously predict the grasping object and provide voice feedback using the vision-tactile fusion classification model, when a visually impaired people is perceiving the object with his gloved hand. To achieve accurate multimodal classification, we creatively embed three attention mechanisms, namely temporal, channel-wise, and spatial attention in the model. Experimental results show that AviPer can achieve an accuracy of 99.75% in classification of 10 daily objects. We evaluated the system in a variety of extreme cases, which verified its robustness and demonstrated the necessity of visual and tactile modal fusion. We also conducted tests in the actual use scene and proved the usability and user-friendliness of the system. We opensourced the code and self-collected datasets in the hope of promoting research development and bringing changes to the lives of visually impaired people.
- Open Access
The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion
Deep learning techniques have made an increasing impact on the field of remote sensing. However, deep neural networks based fusion of multimodal data from different remote sensors with heterogenous characteristics has not been fully explored, due to the lack of availability of big amounts of perfectly aligned multi-sensor image data with diverse scenes of high resolutions, especially for synthetic aperture radar (SAR) data and optical imagery. To promote the development of deep learning based SAR-optical fusion approaches, we release the QXS-SAROPT dataset, which contains 20,000 pairs of SAR-optical image patches. We obtain the SAR patches from SAR satellite GaoFen-3 images and the optical patches from Google Earth images. These images cover three port cities: San Diego, Shanghai and Qingdao. Here, we present a detailed introduction of the construction of the dataset, and show its two representative exemplary applications, namely SAR-optical image matching and SAR ship detection boosted by cross-modal information from optical images. As a large open SAR-optical dataset with multiple scenes of a high resolution, we believe QXS-SAROPT will be of potential value for further research in SAR-optical data fusion technology based on deep learning.
Open AccessThe QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusion
Deep learning techniques have made an increasing impact on the field of remote sensing. However, deep neural networks based fusion of multimodal data from different remote sensors with heterogenous characteristics has not been fully explored, due to the lack of availability of big amounts of perfectly aligned multi-sensor image data with diverse scenes of high resolutions, especially for synthetic aperture radar (SAR) data and optical imagery. To promote the development of deep learning based SAR-optical fusion approaches, we release the QXS-SAROPT dataset, which contains 20,000 pairs of SAR-optical image patches. We obtain the SAR patches from SAR satellite GaoFen-3 images and the optical patches from Google Earth images. These images cover three port cities: San Diego, Shanghai and Qingdao. Here, we present a detailed introduction of the construction of the dataset, and show its two representative exemplary applications, namely SAR-optical image matching and SAR ship detection boosted by cross-modal information from optical images. As a large open SAR-optical dataset with multiple scenes of a high resolution, we believe QXS-SAROPT will be of potential value for further research in SAR-optical data fusion technology based on deep learning.
- Open Access
Task-Driven Common Representation Learning via Bridge Neural Network
This paper introduces a novel deep learning based method, named bridge neural network (BNN) to dig the potential relationship between two given data sources task by task. The proposed approach employs two convolutional neural networks that project the two data sources into a feature space to learn the desired common representation required by the specific task. The training objective with artificial negative samples is introduced with the ability of mini-batch training and it's asymptotically equivalent to maximizing the total correlation of the two data sources, which is verified by the theoretical analysis. The experiments on the tasks, including pair matching, canonical correlation analysis, transfer learning, and reconstruction demonstrate the state-of-the-art performance of BNN, which may provide new insights into the aspect of common representation learning.
Open AccessTask-Driven Common Representation Learning via Bridge Neural Network
This paper introduces a novel deep learning based method, named bridge neural network (BNN) to dig the potential relationship between two given data sources task by task. The proposed approach employs two convolutional neural networks that project the two data sources into a feature space to learn the desired common representation required by the specific task. The training objective with artificial negative samples is introduced with the ability of mini-batch training and it's asymptotically equivalent to maximizing the total correlation of the two data sources, which is verified by the theoretical analysis. The experiments on the tasks, including pair matching, canonical correlation analysis, transfer learning, and reconstruction demonstrate the state-of-the-art performance of BNN, which may provide new insights into the aspect of common representation learning.
- 1 March 2015
- Published by Trans Tech Publications, Ltd. in Materials Science Forum
- Vol. 815, 268-275
Effects of Electroless Nickel on Hydrogen Absorption Properties of Zr-V-Fe Powders
Nickel coated Zr-V-Fe non-evaporable getter (NEG) powders were prepared using electroless plating. The microstructure and composition of the Ni-coated Zr-V-Fe powders were analyzed by XRD, SEM and EDS. The hydrogen absorption performance of Ni-coated Zr-V-Fe powders and as-prepared powders were analyzed by dynamic method after an activation at 300°C for 2 hours. The hydrogen absorption performance of Ni-coated Zr-V-Fe powders and as-prepared powders at 100°C, 200°C, 300°C, 400°C, and 500°C were also analyzed. The results indicated that Ni existed as crystalline phase. The Ni coating played an important role as a catalyst which favored the dissociation of hydrogen on surface and Ni lowers the hydrogen diffusion energy for the Zr-V-Fe powders. The hydrogen absorption kinetics of Ni-coated Zr-V-Fe powders was improved in comparison with that of the as-prepared powders, and a relatively higher absorption rate was exhibited.
- 1 March 2015
- Published by Trans Tech Publications, Ltd. in Materials Science Forum
- Vol. 815, 268-275
Effects of Electroless Nickel on Hydrogen Absorption Properties of Zr-V-Fe Powders
Nickel coated Zr-V-Fe non-evaporable getter (NEG) powders were prepared using electroless plating. The microstructure and composition of the Ni-coated Zr-V-Fe powders were analyzed by XRD, SEM and EDS. The hydrogen absorption performance of Ni-coated Zr-V-Fe powders and as-prepared powders were analyzed by dynamic method after an activation at 300°C for 2 hours. The hydrogen absorption performance of Ni-coated Zr-V-Fe powders and as-prepared powders at 100°C, 200°C, 300°C, 400°C, and 500°C were also analyzed. The results indicated that Ni existed as crystalline phase. The Ni coating played an important role as a catalyst which favored the dissociation of hydrogen on surface and Ni lowers the hydrogen diffusion energy for the Zr-V-Fe powders. The hydrogen absorption kinetics of Ni-coated Zr-V-Fe powders was improved in comparison with that of the as-prepared powders, and a relatively higher absorption rate was exhibited.