Jing Xing

3D scene graphs organize objects and their relationships in a scene into structured representations, providing an interpretable and queryable foundation for relational reasoning and object grounding. Existing open-vocabulary 3D scene graph construction methods primarily focus on object-level feature representation and open-ended edge reasoning. However, they often lack explicit and retrievable associations between object nodes and keyframes, making it difficult to recall relevant visual evidence for target disambiguation and relationship verification in complex queries. Moreover, pre-constructed edges are inherently limited in their ability to cover the diverse linguistic expressions encountered in downstream tasks. To address these limitations, we propose KNA-SG, a framework for constructing open-vocabulary 3D scene graphs from RGB sequences with explicit keyframe–node associations. Built upon instance-grounded 3D reconstruction, KNA-SG represents each object instance as a graph node and uses a unique instance identifier to associate the node with the keyframes in which the instance is observed. The ID-annotated keyframes guide MLLM-based open-vocabulary semantic parsing, enabling semantic attributes to be assigned to these graph nodes. This design transforms keyframes into retrievable visual evidence for target disambiguation and relationship verification during query reasoning. Verified relationships are further written back into the scene graph as reusable relational memory to support subsequent queries. To ensure the effectiveness of selected keyframes, we design a two-stage keyframe selection strategy that combines visual quality assessment with semantic redundancy removal, preserving a set of clear keyframes that provide comprehensive scene coverage. Experimental results show that KNA-SG outperforms existing methods on open-vocabulary 3D semantic segmentation and 3D object grounding tasks.

Accurate and robust localization and mapping in complex and dynamic environments remain a fundamental challenge for autonomous systems. LiDAR–Inertial–Visual Odometry (LIVO) integrates the complementary strengths of LiDAR geometry, visual appearance, and inertial motion constraints. However, existing LIVO systems still suffer from limited adaptability to sensor degradation, weak loop-closure robustness, and insufficient cross-modal consistency modeling. This paper presents a robust multi-sensor SLAM framework that integrates an uncertainty-aware LIVO front-end, a geometry-driven loop-closure module, and a cross-modal consistency factor-graph back-end. We develop an uncertainty-aware iterated error-state Kalman filter (iESKF) to tightly fuse LiDAR, visual, and inertial measurements, with measurement covariances dynamically adjusted according to innovation statistics, feature-matching quality, and observability. To improve global consistency, we propose a multi-channel Binary Triangle Constraint (mBTC) descriptor for LiDAR-based loop detection, which enhances robustness under viewpoint changes and appearance degradation. In addition, we introduce a cross-modal consistency factor to explicitly constrain the relative motion agreement between visual and LiDAR odometries. Extensive experiments on multiple public benchmarks demonstrate improved accuracy, loop-closure reliability, and long-term consistency compared with state-of-the-art LIVO systems.

Single-Domain Generalized Object Detection~(S-DGOD) aims to train an object detector on a single source domain while generalizing well to diverse unseen target domains, making it suitable for multimedia applications that involve various domain shifts, such as intelligent video surveillance and VR/AR technologies. With the success of large-scale Vision-Language Models, recent S-DGOD approaches exploit pre-trained vision-language knowledge to guide invariant feature learning across visual domains. However, the utilized knowledge remains at a coarse-grained level~(e.g., the textual description of adverse weather paired with the image) and serves as an implicit regularization for guidance, struggling to learn accurate region- and object-level features in varying domains. In this work, we propose a new cross-modal feature learning method, which can capture generalized and discriminative regional features for S-DGOD tasks. The core of our method is the mechanism of Cross-modal and Region-aware Feature Interaction, which simultaneously learns both inter-modal and intra-modal regional invariance through dynamic interactions between fine-grained textual and visual features. Moreover, we design a simple but effective strategy called Cross-domain Proposal Refining and Mixing, which aligns the position of region proposals across multiple domains and diversifies them, enhancing the localization ability of detectors in unseen scenarios. Our method achieves new state-of-the-art results on S-DGOD benchmark datasets, with improvements of +8.8\%~mPC on Cityscapes-C and +7.9\%~mPC on DWD over baselines, demonstrating its efficacy.