Yu Jing

Infrared and visible image fusion is critical for unmanned aerial vehicle (UAV) wilderness search and rescue. By integrating thermal radiation of the targets and texture details of the scenario, it enables accurate search for the wounded and comprehensive perception of disaster areas, thereby significantly improving emergency rescue efficiency. To alleviate data scarcity, we construct UAV-MSR, an infrared-visible dataset for casualty search, comprising 3889 paired images captured under diverse weather, illumination, and scenarios. Existing Transformer-based fusion methods mainly focus on high-intensity pixels while inadequately modeling low-intensity complementary features, resulting in blurred details and degraded target contrast in fused images. To this end, we propose a novel differential cross-attention Transformer network to address the issue of complementary information loss. Specifically, the encoder integrates convolution operations for local detail extraction and self-attention mechanisms for global context modeling. Then, we design a differential cross-attention guided feature fusion module to enhance the representation and preservation of detailed complementary features. Furthermore, a pixel loss function with a segmentation strategy is employed to improve the saliency of the target, enabling the fused image to facilitate subsequent target detection tasks. Experimental results and ablation studies demonstrate that the proposed method achieves notable performance and generalization ability. In summary, this work delivers a multimodal dataset and an efficient infrared-visible image fusion network to enable comprehensive perception for UAVs in wilderness search and rescue scenarios.

Non-contact vital signs detection of the survivors based on bio-radar to identify their life states is significant for field search and rescue. However, when transportation is interrupted, rescue workers and equipment are unable to arrive at the disaster area promptly. In this paper, we report a hovering airborne radar for non-contact vital signs detection to overcome this challenge. The airborne radar system supports a wireless data link, enabling remote control and communication over distances of up to 3 km. In addition, a novel framework based on blind source separation is proposed for vital signals extraction. First, range migration caused by the platform motion is compensated for by the envelope alignment. Then, the respiratory waveform of the human target is extracted by the joint approximative diagonalization of eigenmatrices algorithm. Finally, the heartbeat signal is recovered by respiratory harmonic suppression through a feedback notch filter. The field experiment results demonstrate that the proposed method is capable of precisely extracting vital signals with outstanding robustness and adaptation in more cluttered environments. The work provides a technical basis for remote high-resolution vital signs detection to meet the increasing demands of actual rescue applications.

As an important and basic platform for remote life sensing, unmanned aerial vehicles (UAVs) may hide the vital signals of an injured human due to their own motion. In this work, a novel method to remove the platform motion and accurately extract human respiration is proposed. We utilized a hovering UAV as the platform of ultra-wideband (UWB) radar to capture human respiration. To remove interference from the moving UAV platform, we used the delay calculated by the correlation between each frame of UWB radar data in order to compensate for the range migration. Then, the echo signals from the human target were extracted as the observed multiple range channel signals. Owing to meeting the independent component analysis (ICA), we adopted ICA to estimate the signal of respiration. The results of respiration detection experiments conducted in two different outdoor scenarios show that our proposed method could accurately separate respiration of a ground human target without any additional sensor and prior knowledge; this physiological information will be essential for search and rescue (SAR) missions.

A novel cooperative strategy for distributed unmanned aerial vehicle (UAV) swarms with different functions, namely the mission chain-driven unmanned aerial vehicle swarms cooperation method, is proposed to allow the fast search and timely rescue of injured human targets in a wide-area outdoor environment. First, a UAV-camera unit is exploited to detect the suspected human target combined with improved deep learning technology. Then, the target location information is transferred to a self-organizing network. Then, the special bio-radar-UAV unit was released to recheck the survivals through a respiratory characteristic detection algorithm. Finally, driven by the location and vital sign status of the injured, a nearby emergency-UAV unit will perform corresponding medical emergency missions, such as dropping emergency supplies. Experimental results show that this strategy can identify the human targets autonomously from the outdoor environment effectively, and the target detection, target sensing, and medical emergency mission chain is completed successfully relying on the cooperative working mode, which is meaningful for the future search-rescue mission of outdoor injured human targets.