Haitao Guo

Synthetic aperture radar images have all-weather and all-time capabilities and are widely used in the field of ship target surveillance at sea. However, its detection accuracy is often limited by factors such as complex sea conditions, diverse ship scales, and image noise. Aiming at the problems such as inconsistent scale of ship target detection in SAR images, difficulty in detecting small targets, and interference from complex backgrounds, this paper proposes a ship detection method for SAR images based on band recombination and multi-scale feature enhancement. Firstly, aiming at the problem that the single-channel replication mode adopted by the deep neural network cannot fully extract the ship target information in SAR images, a band recombination method was designed to enhance the ship information in the images. Furthermore, the coordinate channel attention and bottleneck Transformer attention mechanisms are introduced in the backbone part of the network to enhance the network’s representation ability of the target spatial distribution and maintain the global feature modeling ability. Finally, a multi-scale feature enhancement and multi-scale effective feature aggregation module was designed to improve the detection accuracy of multi-scale ships in wide-format images. The experimental results on the LS-SSDD and HRSID datasets show that the average accuracies of the method proposed in this paper reach 78.1% and 94.5% respectively, which are improved by 6.9% and 0.8% compared with the baseline model, and are superior to other advanced algorithms, verifying the effectiveness of the method proposed in this paper. Meanwhile, the algorithm proposed in this paper has also demonstrated good performance in wide-format SAR images of actual large scenes. The method proposed in this paper effectively improves the problems of missed detection and false detection of small-target ships in SAR images of large scenes. At the same time, it enhances the efficiency of rapid and accurate detection in large scenes and can provide reliable technical support for the field of maritime target surveillance.

The task of visual geo-localization based on street-view images estimates the geographical location of a query image by recognizing the nearest reference image in a geo-tagged database. This task holds considerable practical significance in domains such as autonomous driving and outdoor navigation. Current approaches typically use perspective street-view images as reference images. However, the lack of scene content resulting from the restricted field of view (FOV) in such images is the main cause of inaccuracies in matching and localizing the query and reference images with the same global positioning system (GPS) labels. To address this issue, we propose a perspective-to-panoramic image visual geo-localization framework. This framework employs 360° panoramic images as references, thereby eliminating the issue of scene content mismatch due to the restricted FOV. Moreover, we propose the structural feature enhancement (SFE) module and integrate it into LskNet to enhance the ability of the feature extraction network to capture and extract long-term stable structural features. Furthermore, we propose the adaptive scene alignment (ASA) strategy to address the issue of data capacity and information content asymmetry between perspective and panoramic images, thereby facilitating initial scene alignment. In addition, a lightweight feature aggregation module, MixVPR, which considers spatial structure relationships, is introduced to aggregate the scene-aligned region features into robust global feature descriptors for matching and localization. Experimental results demonstrate that the proposed model outperforms current state-of-the-art methods and achieves R@1 scores of 72.5% on the Pitts250k-P2E dataset and 58.4% on the YQ360 dataset, indicating the efficacy of this approach in practical visual geo-localization applications.

Accurate ship trajectory prediction is crucial for real-time vessel position tracking and maritime safety management. However, existing methods for ship trajectory prediction encounter significant challenges. They struggle to effectively extract long-term and complex spatial–temporal features hidden within the data. Moreover, they often overlook correlations among multivariate dynamic features such as longitude (LON), latitude (LAT), speed over ground (SOG), and course over ground (COG), which are essential for precise trajectory forecasting. To address these pressing issues and fulfill the need for more accurate and comprehensive ship trajectory prediction, we propose a novel and integrated approach. Firstly, a Trajectory Point Correlation Attention (TPCA) mechanism is devised to establish spatial connections between trajectory points, thereby uncovering the local trends of trajectory point changes. Subsequently, a Temporal Pattern Attention (TPA) mechanism is introduced to handle the associations between multiple variables across different time steps and capture the dynamic feature correlations among trajectory attributes. Finally, a Great Circle Route Loss Function (GCRLoss) is constructed, leveraging the perception of the Earth’s curvature to deepen the understanding of spatial relationships and geographic information. Experimental results demonstrate that our proposed method outperforms existing ship trajectory prediction techniques, showing enhanced reliability in multi-step predictions.

Semantic Change Detection (SCD) refers to the task of simultaneously extracting the changed areas and the semantic categories (before and after the changes) in Remote Sensing Images (RSIs). This is more meaningful than Binary Change Detection (BCD) since it enables detailed change analysis in the observed areas. Previous works established triple-branch Convolutional Neural Network (CNN) architectures as the paradigm for SCD. However, it remains challenging to exploit semantic information with a limited amount of change samples. In this work, we investigate to jointly consider the spatio-temporal dependencies to improve the accuracy of SCD. First, we propose a Semantic Change Transformer (SCanFormer) to explicitly model the ’from-to’ semantic transitions between the bi-temporal RSIs. Then, we introduce a semantic learning scheme to leverage the spatio-temporal constraints, which are coherent to the SCD task, to guide the learning of semantic changes. The resulting network (SCanNet) significantly outperforms the baseline method in terms of both detection of critical semantic changes and semantic consistency in the obtained bi-temporal results. It achieves the SOTA accuracy on two benchmark datasets for the SCD.

The goal of cross-view image based geo-localization is to determine the location of a given street-view image by matching it with a collection of geo-tagged aerial images, which has important applications in the fields of remote sensing information utilization and augmented reality. Most current cross-view image based geo-localization methods focus on the image content and ignore the relations between feature nodes, resulting in insufficient mining of effective information. To address this problem, this study proposes feature relation guided cross-view image based geo-localization. This method first processes aerial remote sensing images using a polar transform to achieve the geometric coarse alignment of ground-to-aerial images, and then realizes local contextual feature concern and global feature correlation modeling of the images through the feature relation guided attention generation module designed in this study. Specifically, the module includes two branches of deformable convolution based multiscale contextual feature extraction and global spatial relations mining, which effectively capture global structural information between feature nodes at different locations while correlating contextual features and guiding global feature attention generation. Finally, a novel feature aggregation module, MixVPR, is introduced to aggregate global feature descriptors to accomplish image matching and localization. After experimental validation, the cross-view image based geo-localization algorithm proposed in this study yields results of 92.08%, 97.70%, and 98.66% for the top 1, top 5, and top 10 metrics, respectively, in CVUSA, a popular public cross-view dataset, and exhibits superior performance compared to algorithms of the same type.

Object detection in remote sensing images faces the challenges of a complex background, large object size variations, and high inter-class similarity. To address these problems, we propose an adaptive adjacent layer feature fusion (AALFF) method, which is developed on the basis of RTMDet. Specifically, the AALFF method incorporates an adjacent layer feature fusion enhancement (ALFFE) module, designed to capture high-level semantic information and accurately locate object spatial positions. ALFFE also effectively preserves small objects by fusing adjacent layer features and employs involution to aggregate contextual information in a wide spatial range for object essential features extraction in complex backgrounds. Additionally, the adaptive spatial feature fusion (ASFF) module is introduced to guide the network to select and fuse the crucial features to improve the adaptability to objects with different sizes. The proposed method achieves mean average precision (mAP) values of 77.1%, 88.9%, and 95.7% on the DIOR, HRRSD, and NWPU VHR-10 datasets, respectively. Notably, our approach achieves mAP₇₅ values of 60.8% and 79.0% on the DIOR and HRRSD datasets, respectively, surpassing the state-of-the-art performance on the DIOR dataset.

The detection and recognition of oriented objects in remote sensing images is a challenging task due to their complex backgrounds, various sizes, diverse aspect ratios, and especially arbitrary orientations. Many oriented object detection algorithms need to obtain accurate angles or adopt anchors to predict the oriented bounding boxes. When directly predicting the angles of objects’ oriented bounding boxes, the loss of angle is discontinuous during training, which makes it difficult to obtain accurate boundary of oriented objects. And the anchors also aggravate the problems of class imbalance and computational cost. To address the above problems, this paper proposes an anchor-free and angle-free detector called AF ² Det. AF ² Det adopts the information of the bounding box projection instead of the angle to represent and reconstruct the object’s oriented bounding boxes, which could avoid the problem of boundary discontinuity. To predict the information of the bounding box projection, an anchor-free architecture is built to predict objects as points based on a simple but strong U-shaped architecture. And the deformable convolution and the bottom-up feature fusion method are integrated effectively to enhance AF ² Det’ s capacity for objects’ shapes, orientations, and scales. The extensive experiments are conducted on multiple datasets, i.e., HRSC2016, FGSD2021, DOTA, and RSDD-SAR to validate the effectiveness of our method. The experimental results demonstrate that the proposed AF ² Det outperforms other anchor-free algorithms and obtains competitive results on oriented object detection.