ZMZhenjiang Miao

Zhenjiang Miao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Zhenjiang Miao has a total of 25 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Natural Cognizing Video: A Decoupling and Integration Network for General Event Boundary Captioning

    by Yutao Liu, Wanru Xu, Zhenjiang Miao, Kaijie Zhang, Wangsheng He, Ruiying Yao

    Video captioning is a prominent and challenging research area. Previous studies have focused predominantly on describing entire video segments, often overlooking the more significant status changes within these segments. We propose a novel decoupling and integration network for general event boundary captioning (DIN-GEBC), which is applied to the Kinetics-GEBC dataset, a video dataset with fine-grained status descriptions. DIN-GEBC focuses on generating three types of captions for each video segment boundary: a caption for the dominant subject (subject caption), a caption describing the event prior to the status moment (status-before), and a caption describing the event after the status moment (status-after). To address different descriptive focuses and characteristics, DIN-GEBC is proposed for decoupling and integrating both tasks and features. For task decoupling, DIN-GEBC is designed with a dual branch structure, in which the generation of the subject caption is addressed by the dominant subject branch with a Video Q-former encoder and the generation of the status-before and status-after captions is addressed by the event branch with a Reinventing RNNs for the Transformer Era (RWKV) encoder. For task integration, DIN-GEBC enables the dominant subject branch to guide the event branch in producing detailed information regarding the subject experiencing the change. Feature disentanglement, in which the common features are used by the dominant subject branch to capture the unchanging information, is also performed, and the difference features are applied to the event branch to capture the changing information. The experimental results show that our model outperforms existing models on the Kinetics-GEBC dataset even with fewer parameters. The code is available at https://github.com/Mrliu001219/DIN-GEBC.

  • Open Access

    Probabilistic Distillation Transformer: Modelling Uncertainties for Visual Abductive Reasoning

    by Wanru Xu, Zhenjiang Miao, Yi Tian, Yigang Cen, Lili Wan, Ma Xiaole

    Visual abduction reasoning aims to find the most plausible explanation for incomplete observations, and suffers from inherent uncertainties and ambiguities, which mainly stem from the latent causal relations, incomplete observations, and the reasoning itself. To address this, we propose a probabilistic model named Uncertainty-Guided Probabilistic Distillation Transformer (UPD-Trans) to model uncertainties for Visual Abductive Reasoning. In order to better discover the correct cause-effect chain, we model all the potential causal relations into a unified reasoning framework, thus both the direct relations and latent relations are considered. In order to reduce the effect of the stochasticity and uncertainty for reasoning: 1) we extend the deterministic Transformer to a probabilistic Transformer by considering those uncertain factors as Gaussian random variables and explicitly modeling their distribution; 2) we introduce a distillation mechanism between the posterior branch with complete observations and the prior branch with incomplete observations to transfer posterior knowledge. Evaluation results on the benchmark datasets, consistently demonstrate the commendable performance of our UPD-Trans, with significant improvements after latent relation modeling and uncertainty modeling.

  • Open Access

    Boosting Semi-Supervised Video Captioning via Learning Candidates Adjusters

    by Wanru Xu, Zhenjiang Miao, Jian Yu, Yigang Cen, Yi Tian, Lili Wan, Yanli Wan, Qiang Ji

    Video captioning is a multimodal task on both CV and NLP, whose goal is to automatically obtain the description of video content with natural language statements. Although there are amounts of video data, their annotations with description sentences are very limited. In this paper, we define the semi-supervised video captioning (SSVC) problem in order to improve performance with limited annotations by leveraging the semantic knowledge from both well-annotated samples and no-annotated samples. To address the problem, we introduce a LCA-boosted model (LCABM) for boosting SSVC, where it is first to explore a learnable candidates adjuster to adjust the caption candidates and then treat these adjusted captions as pesudo labels to train the SSVC model with no-annotated samples in reverse. In particular, the model learning is considered as a bi-level optimization problem and solved by an EM-like multi-stage training algorithm. The experiments show the effectiveness of our proposed LCABM, whose performance is comparable and even better than those state-of-the-art fully-supervised methods even with less annotations.

  • Open Access

    A Method of License Plate Recognition Based on BP Neural Network with Median Filtering

    by Miaomiao Li, Zhenjiang Miao, Jiaji Wang, Shengbo Wang, Yuanhao Zhang

    With the rapid increase of cars, the research of license plate recognition in intelligent traffic algorithm has attracted much attention. In this paper, pointing at the shortcomings of the existing recognition algorithm, we adopt a license plate recognition method based on BP neural network with a median filtering. The method consists of a median filtering algorithm for denoising and a BP neural network for training and testing. First the character library is processed by median filtering to remove the influence of noise. Then, utilizing the strong learning ability of BP, the character library is passed into the network for classification. Compared with the traditional algorithm, our method not only speeds up the recognition efficiency, but also obtains more robust results. Therefore, the proposed approach can provide a technical support for the practical application of license plate recognizing.


  • Multihuman Tracking Based on a Spatial–Temporal Appearance Match

    by Yuan Shen, Zhenjiang Miao

    In this paper, we focus on the improvements of appearance representation for multihuman tracking. Many previous methods extracted low-level appearance features, such as color histogram and texture, even combined with spatial information for each frame. These methods ignore the temporal distribution of features. The features of each frame may not be stable due to illumination, human pose variation, and image noise. In order to improve it, we propose a novel appearance representation called the spatial-temporal appearance model based on the statistical distribution of Gaussian mixture model (GMM). It represents the appearance of a tracklet as a whole with dynamic spatial and temporal information. The spatial information is the dynamic subregions. The temporal information is the dynamic duration time of each subregion. Each subregion is modeled as the weighted Gaussian distribution of GMM. The online expectation-maximization (online EM) algorithm is used to estimate the parameters of GMM. Then, we propose a tracklet association method using Bayesian prediction and Jensen-Shannon divergence. The Bayesian prediction is used to predict the locations of targets. The Jensen-Shannon divergence is used to compute the distance of spatial-temporal appearance distribution between two tracklets. Finally, we test our approach on four challenging datasets (TRECVID, CAVIAR, ETH, and EPFL Terrace) and achieve good results.


  • An image inpainting method based on image retrieval

    by Jing Mi, Zhenjiang Miao, Yanping Yu

  • A Pervasive Computing Security System Based on Human Activities Analysis

    by Yun Yuan, Zhenjiang Miao, Shaohai Hu

    In recent years, the research on intelligent environment based on pervasive/ubiquitous computing technology has attracted more and more attention, especially in security such as KidsRoom by MIT AI Lab. Considering practical applications of pervasive computing technology, it is necessary to present a pervasive computing system model in the view of engineering. In this paper, we illustrated an intelligent surveillant security system based on a HPC model. This system can detect moving person, recognize his behavior, and send out alerting messages such as SMS when intruder or strange behavior is detected. We design this system based on pervasive computing and propose the implementation methods step by step