MDMuqing Deng

Muqing Deng

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Muqing Deng has a total of 45 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • AMONet: Alternating Modality Optimization Network for Multimodal Rumor Detection

    by Mali Xing, Lianzheng He, Muqing Deng, Renquan Lu

    The rapid development of social media provides diversified channels for the dissemination of rumors. How to accurately identify rumor information under different modalities becomes a significant challenge in the current field of information security. Limited by the heterogeneity of multimodal data itself, existing multimodal rumor detection methods often face the issue of modality laziness, that is, the model converges prematurely during the training process, resulting in some modality encoders failing to fully learn effective representations, ultimately weakening the model’s detection performance. To alleviate the problem of modality laziness, we propose an innovative alternating modality optimization network (AMONet), whose core innovations are embodied in three aspects: (1) An alternating modality optimization (AMO) parameter updating mechanism is proposed, to balance optimization opportunities for each modality encoder by cyclically training the branch networks of each modality; (2) To tackle the knowledge forgetting problem caused by alternating optimization, a fisher information-based regularization (FIR) method is introduced, which can impose elastic constraints on specific parameters to preserve crucial knowledge; (3) An innovative quantitative evaluation metric, modality inconsistency variance (MIV), is proposed to characterize modality laziness. Extensive experiments demonstrate that AMONet outperforms previous benchmarks.

  • MCFM: Multimodal Competitive Fusion Mechanism for Sentiment Analysis

    by Mali Xing, Zilang Zhai, Muqing Deng, Qianqian Cai, Hongru Ren, Tian Wang

    With the popularity of social media, users are able to express their opinions in multiple forms, such as text, audio, and video. Traditional unimodal sentiment analysis methods can no longer meet the processing requirements of such multisource heterogeneous data, which makes multimodal sentiment analysis a research hotspot. However, most existing methods rely on simple feature splicing or weighted fusion, neglecting the differences in the reliability of different modalities and failing to fully explore the intermodality consistency and difference information. In this article, we propose a multimodal competitive fusion mechanism and construct multimodal competitive fusion model (MCFM). The model first dynamically evaluates the reliability of each modality through the competition mechanism and adaptively assigns weights accordingly. Then it decomposed the modality representations into similar and dissimilar features through modality feature decomposition, supplemented by the overlap of orthogonal traffic channel attention constraints, to achieve the collaborative learning of consistency and dissimilarity features. We evaluate the proposed model on several datasets. In our experiments, we used textual modality data from the dataset with audio modality data for the experiments. The experimental results show that MCFM has 2%–3% higher binary accuracy (ACC2) than the baseline model on the sentiment classification task (with 2% higher binary accuracy under the negative/nonnegative metrics and 3% higher binary accuracy under the positive/negative metrics), and that on the regression task, MCFM’s mean absolute error on the test dataset is 3% lower than that of the baseline model.

  • Open Access

    Human Gait Recognition Based on Frontal-View Walking Sequences Using Multi-modal Feature Representations and Learning

    by Muqing Deng, Zebang Zhong, Yi Zou, Yanjiao Wang, Kaiwei Wang, Junrong Liao

    Despite that much progress has been reported in gait recognition, most of these existing works adopt lateral-view parameters as gait features, which requires large area of data collection environment and limits the applications of gait recognition in real-world practice. In this paper, we adopt frontal-view walking sequences rather than lateral-view sequences and propose a new gait recognition method based on multi-modal feature representations and learning. Specifically, we characterize walking sequences with two different kinds of frontal-view gait features representations, including holistic silhouette and dense optical flow. Pedestrian regions extraction is achieved by an improved YOLOv7 algorithm called Gait-YOLO algorithm to eliminate the effects of background interference. Multi-modal fusion module (MFM) is proposed to explore the intrinsic connections between silhouette and dense optical flow features by using squeeze and excitation operations at the channel and spatial levels. Gait feature encoder is further used to extract global walking characteristics, enabling efficient multi-modal information fusion. To validate the efficacy of the proposed method, we conduct experiments on CASIA-B and OUMVLP gait databases and compare performance of our proposed method with other existing state-of-the-art gait recognition methods.


  • Frontal-view gait recognition using discriminative dynamics feature representations and learning

    by Muqing Deng, Yi Zou, Wuqiao Zhu, Mali Xing, Yonghui Huang, Jie Yang

    Gait recognition plays an important role in the area of biometric recognition. Despite that much progress has been made for gait recognition in recent years, most of them are based on lateral-view gait characteristics. These methods usually require a large data collection area to capture full gait sequences, which are only applicable in wide outdoor spaces. In this paper, we propose a new frontal-view method for human gait recognition based on gait dynamics and deep transfer learning. The frontal human silhouettes are characterized with four kinds of time-varying gait features, namely the lower limb length ratio, lower limb area ratio, swing area of lower limb, and swing angle of lower limb. In the training phase, gait dynamics underlying the aforementioned time-varying gait features is approximated by radial basis function neural networks through deterministic learning theory. This kind of dynamics information reflects the essential dynamical attribute of human walking and is insensitive to the deformation of gait silhouettes caused by frontal-view walking process. To further improve the recognition rates, the extracted gait dynamics and deep transfer learning technique are incorporated, and a deep transfer learning based feature fusion strategy are investigated for human identification task in the recognition phase. To further improve the robustness against different walking conditions, three kinds of gait representations are fused to provide a comprehensive characterization of human walking movement. Finally, comprehensive experiments are carried out on the well-known public gait databases to demonstrate the recognition performance of the proposed algorithm.


  • Human Gait Recognition Based on Frontal-View Sequences Using Gait Dynamics and Deep Learning

    by Muqing Deng, Zhuyao Fan, Peng Lin, Xiaoreng Feng

    To facilitate human gait recognition, this paper proposes a new frontal-view gait recognition method using gait dynamics and deep learning. Rather than adopting lateral-view parameters as gait features in the literature, we employ improved frontal-view features and classification methods to avoid the recognition rate drops due to the complicated surveillance environment. Specifically, we characterize the binary walking silhouettes with three different kinds of frontal-view gait features, including kinematic features, spatial ratio features and area features. In addition, we capture the gait dynamics underlying the time-varying gait features to reflect temporal dynamics information of human walking. Furthermore, we incorporate the deep feature learning information into the recognition procedure to take advantage of the deep learning technique. To obtain the optimal recognition accuracy and robustness performance against walking condition variations, we calculate the similarity between the appearing test gait dynamics and the trained gait dynamics, and propose an error-based feature fusion scheme for gait recognition. To validate the efficacy of the proposed method, we conduct experiments on published gait databases by comparing with other existing gait recognition methods.


  • Human gait recognition by fusing global and local image entropy features with neural networks

    by Muqing Deng, Yuanyou Sun, Zhuyao Fan, Xiaoreng Feng

    We propose a robust gait recognition method based on the combination of global and local image entropy features. An improved feature extraction scheme is developed, in which binary walking silhouettes are characterized with global and local image entropy features. Gait dynamics underlying image entropy features are derived and fused. Additionally, pretrained deep neural networks are employed as the feature extractor on the raw fused image entropy features. The extracted gait dynamics and deep transfer learning features are finally fused and fed into a seven-layer fully connected network for the identification task. The proposed method can make use of global and local gait characteristics sufficiently, which is helpful for resisting walking conditions variation. Experiments on the CASIA-B database are conducted to demonstrate the efficiency of the proposed method.


  • Top Cited Papers

    Heart sound classification based on improved MFCC features and convolutional recurrent neural networks

    by Muqing Deng, Tingting Meng, Jiuwen Cao, Shimin Wang, Jing Zhang, Huijie Fan