Muqing Deng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Muqing Deng has a total of 45 co-authors. Here are the top co-authors by number of shared publications:
- Cong Wang
School of Control Science and Engineering, Shandong University, Jinan, China
5 shared publications Jiuwen Cao
Institute of Information and Control, Hangzhou Dianzi University, Hangzhou, China
3 shared publicationsTongjia Zheng
3 shared publicationsXiaoreng Feng
Department of Orthopaedics and Traumatology, Queen Mary Hospital, The University of Hong Kong, Hong Kong
3 shared publications- Kaiwei Wang
Zhejiang University
2 shared publications - Mali Xing
School of Automation Guangdong University of Technology Guangzhou China
2 shared publications
Latest Publications
- 5 June 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 23 (15455955) , 11387-11400
AMONet: Alternating Modality Optimization Network for Multimodal Rumor Detection
The rapid development of social media provides diversified channels for the dissemination of rumors. How to accurately identify rumor information under different modalities becomes a significant challenge in the current field of information security. Limited by the heterogeneity of multimodal data itself, existing multimodal rumor detection methods often face the issue of modality laziness, that is, the model converges prematurely during the training process, resulting in some modality encoders failing to fully learn effective representations, ultimately weakening the model’s detection performance. To alleviate the problem of modality laziness, we propose an innovative alternating modality optimization network (AMONet), whose core innovations are embodied in three aspects: (1) An alternating modality optimization (AMO) parameter updating mechanism is proposed, to balance optimization opportunities for each modality encoder by cyclically training the branch networks of each modality; (2) To tackle the knowledge forgetting problem caused by alternating optimization, a fisher information-based regularization (FIR) method is introduced, which can impose elastic constraints on specific parameters to preserve crucial knowledge; (3) An innovative quantitative evaluation metric, modality inconsistency variance (MIV), is proposed to characterize modality laziness. Extensive experiments demonstrate that AMONet outperforms previous benchmarks.
- 5 June 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 23 (15455955) , 11387-11400
AMONet: Alternating Modality Optimization Network for Multimodal Rumor Detection
The rapid development of social media provides diversified channels for the dissemination of rumors. How to accurately identify rumor information under different modalities becomes a significant challenge in the current field of information security. Limited by the heterogeneity of multimodal data itself, existing multimodal rumor detection methods often face the issue of modality laziness, that is, the model converges prematurely during the training process, resulting in some modality encoders failing to fully learn effective representations, ultimately weakening the model’s detection performance. To alleviate the problem of modality laziness, we propose an innovative alternating modality optimization network (AMONet), whose core innovations are embodied in three aspects: (1) An alternating modality optimization (AMO) parameter updating mechanism is proposed, to balance optimization opportunities for each modality encoder by cyclically training the branch networks of each modality; (2) To tackle the knowledge forgetting problem caused by alternating optimization, a fisher information-based regularization (FIR) method is introduced, which can impose elastic constraints on specific parameters to preserve crucial knowledge; (3) An innovative quantitative evaluation metric, modality inconsistency variance (MIV), is proposed to characterize modality laziness. Extensive experiments demonstrate that AMONet outperforms previous benchmarks.
- Open Access
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 139085-139108
ASCRNet: An Abundance-Guided Spectral-Spatial Collaborative Reconstruction Network for Single Hyperspectral Image Super-Resolution
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 14, 139085-139108
Open AccessASCRNet: An Abundance-Guided Spectral-Spatial Collaborative Reconstruction Network for Single Hyperspectral Image Super-Resolution
- 16 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 13 (2) , 1355-1368
MCFM: Multimodal Competitive Fusion Mechanism for Sentiment Analysis
With the popularity of social media, users are able to express their opinions in multiple forms, such as text, audio, and video. Traditional unimodal sentiment analysis methods can no longer meet the processing requirements of such multisource heterogeneous data, which makes multimodal sentiment analysis a research hotspot. However, most existing methods rely on simple feature splicing or weighted fusion, neglecting the differences in the reliability of different modalities and failing to fully explore the intermodality consistency and difference information. In this article, we propose a multimodal competitive fusion mechanism and construct multimodal competitive fusion model (MCFM). The model first dynamically evaluates the reliability of each modality through the competition mechanism and adaptively assigns weights accordingly. Then it decomposed the modality representations into similar and dissimilar features through modality feature decomposition, supplemented by the overlap of orthogonal traffic channel attention constraints, to achieve the collaborative learning of consistency and dissimilarity features. We evaluate the proposed model on several datasets. In our experiments, we used textual modality data from the dataset with audio modality data for the experiments. The experimental results show that MCFM has 2%–3% higher binary accuracy (ACC2) than the baseline model on the sentiment classification task (with 2% higher binary accuracy under the negative/nonnegative metrics and 3% higher binary accuracy under the positive/negative metrics), and that on the regression task, MCFM’s mean absolute error on the test dataset is 3% lower than that of the baseline model.
- 16 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 13 (2) , 1355-1368
MCFM: Multimodal Competitive Fusion Mechanism for Sentiment Analysis
With the popularity of social media, users are able to express their opinions in multiple forms, such as text, audio, and video. Traditional unimodal sentiment analysis methods can no longer meet the processing requirements of such multisource heterogeneous data, which makes multimodal sentiment analysis a research hotspot. However, most existing methods rely on simple feature splicing or weighted fusion, neglecting the differences in the reliability of different modalities and failing to fully explore the intermodality consistency and difference information. In this article, we propose a multimodal competitive fusion mechanism and construct multimodal competitive fusion model (MCFM). The model first dynamically evaluates the reliability of each modality through the competition mechanism and adaptively assigns weights accordingly. Then it decomposed the modality representations into similar and dissimilar features through modality feature decomposition, supplemented by the overlap of orthogonal traffic channel attention constraints, to achieve the collaborative learning of consistency and dissimilarity features. We evaluate the proposed model on several datasets. In our experiments, we used textual modality data from the dataset with audio modality data for the experiments. The experimental results show that MCFM has 2%–3% higher binary accuracy (ACC2) than the baseline model on the sentiment classification task (with 2% higher binary accuracy under the negative/nonnegative metrics and 3% higher binary accuracy under the positive/negative metrics), and that on the regression task, MCFM’s mean absolute error on the test dataset is 3% lower than that of the baseline model.
- 4 November 2024
- Published by Elsevier in ISA Transactions
- Vol. 156, 142-153
Online estimation method for extreme learning machine with kernels based on the multi-innovation theory and intelligent optimization strategy
- 4 November 2024
- Published by Elsevier in ISA Transactions
- Vol. 156, 142-153
Online estimation method for extreme learning machine with kernels based on the multi-innovation theory and intelligent optimization strategy
- Open Access
- 2 April 2024
- Published by Springer Nature in Neural Processing Letters
- Vol. 56 (2) , 1-23
Human Gait Recognition Based on Frontal-View Walking Sequences Using Multi-modal Feature Representations and Learning
Despite that much progress has been reported in gait recognition, most of these existing works adopt lateral-view parameters as gait features, which requires large area of data collection environment and limits the applications of gait recognition in real-world practice. In this paper, we adopt frontal-view walking sequences rather than lateral-view sequences and propose a new gait recognition method based on multi-modal feature representations and learning. Specifically, we characterize walking sequences with two different kinds of frontal-view gait features representations, including holistic silhouette and dense optical flow. Pedestrian regions extraction is achieved by an improved YOLOv7 algorithm called Gait-YOLO algorithm to eliminate the effects of background interference. Multi-modal fusion module (MFM) is proposed to explore the intrinsic connections between silhouette and dense optical flow features by using squeeze and excitation operations at the channel and spatial levels. Gait feature encoder is further used to extract global walking characteristics, enabling efficient multi-modal information fusion. To validate the efficacy of the proposed method, we conduct experiments on CASIA-B and OUMVLP gait databases and compare performance of our proposed method with other existing state-of-the-art gait recognition methods.
- 2 April 2024
- Published by Springer Nature in Neural Processing Letters
- Vol. 56 (2) , 1-23
Open AccessHuman Gait Recognition Based on Frontal-View Walking Sequences Using Multi-modal Feature Representations and Learning
Despite that much progress has been reported in gait recognition, most of these existing works adopt lateral-view parameters as gait features, which requires large area of data collection environment and limits the applications of gait recognition in real-world practice. In this paper, we adopt frontal-view walking sequences rather than lateral-view sequences and propose a new gait recognition method based on multi-modal feature representations and learning. Specifically, we characterize walking sequences with two different kinds of frontal-view gait features representations, including holistic silhouette and dense optical flow. Pedestrian regions extraction is achieved by an improved YOLOv7 algorithm called Gait-YOLO algorithm to eliminate the effects of background interference. Multi-modal fusion module (MFM) is proposed to explore the intrinsic connections between silhouette and dense optical flow features by using squeeze and excitation operations at the channel and spatial levels. Gait feature encoder is further used to extract global walking characteristics, enabling efficient multi-modal information fusion. To validate the efficacy of the proposed method, we conduct experiments on CASIA-B and OUMVLP gait databases and compare performance of our proposed method with other existing state-of-the-art gait recognition methods.
- 1 January 2024
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 33 (01) , 013025-20
Frontal-view gait recognition using discriminative dynamics feature representations and learning
Gait recognition plays an important role in the area of biometric recognition. Despite that much progress has been made for gait recognition in recent years, most of them are based on lateral-view gait characteristics. These methods usually require a large data collection area to capture full gait sequences, which are only applicable in wide outdoor spaces. In this paper, we propose a new frontal-view method for human gait recognition based on gait dynamics and deep transfer learning. The frontal human silhouettes are characterized with four kinds of time-varying gait features, namely the lower limb length ratio, lower limb area ratio, swing area of lower limb, and swing angle of lower limb. In the training phase, gait dynamics underlying the aforementioned time-varying gait features is approximated by radial basis function neural networks through deterministic learning theory. This kind of dynamics information reflects the essential dynamical attribute of human walking and is insensitive to the deformation of gait silhouettes caused by frontal-view walking process. To further improve the recognition rates, the extracted gait dynamics and deep transfer learning technique are incorporated, and a deep transfer learning based feature fusion strategy are investigated for human identification task in the recognition phase. To further improve the robustness against different walking conditions, three kinds of gait representations are fused to provide a comprehensive characterization of human walking movement. Finally, comprehensive experiments are carried out on the well-known public gait databases to demonstrate the recognition performance of the proposed algorithm.
- 1 January 2024
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 33 (01) , 013025-20
Frontal-view gait recognition using discriminative dynamics feature representations and learning
Gait recognition plays an important role in the area of biometric recognition. Despite that much progress has been made for gait recognition in recent years, most of them are based on lateral-view gait characteristics. These methods usually require a large data collection area to capture full gait sequences, which are only applicable in wide outdoor spaces. In this paper, we propose a new frontal-view method for human gait recognition based on gait dynamics and deep transfer learning. The frontal human silhouettes are characterized with four kinds of time-varying gait features, namely the lower limb length ratio, lower limb area ratio, swing area of lower limb, and swing angle of lower limb. In the training phase, gait dynamics underlying the aforementioned time-varying gait features is approximated by radial basis function neural networks through deterministic learning theory. This kind of dynamics information reflects the essential dynamical attribute of human walking and is insensitive to the deformation of gait silhouettes caused by frontal-view walking process. To further improve the recognition rates, the extracted gait dynamics and deep transfer learning technique are incorporated, and a deep transfer learning based feature fusion strategy are investigated for human identification task in the recognition phase. To further improve the robustness against different walking conditions, three kinds of gait representations are fused to provide a comprehensive characterization of human walking movement. Finally, comprehensive experiments are carried out on the well-known public gait databases to demonstrate the recognition performance of the proposed algorithm.
- 27 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 117-126
Human Gait Recognition Based on Frontal-View Sequences Using Gait Dynamics and Deep Learning
To facilitate human gait recognition, this paper proposes a new frontal-view gait recognition method using gait dynamics and deep learning. Rather than adopting lateral-view parameters as gait features in the literature, we employ improved frontal-view features and classification methods to avoid the recognition rate drops due to the complicated surveillance environment. Specifically, we characterize the binary walking silhouettes with three different kinds of frontal-view gait features, including kinematic features, spatial ratio features and area features. In addition, we capture the gait dynamics underlying the time-varying gait features to reflect temporal dynamics information of human walking. Furthermore, we incorporate the deep feature learning information into the recognition procedure to take advantage of the deep learning technique. To obtain the optimal recognition accuracy and robustness performance against walking condition variations, we calculate the similarity between the appearing test gait dynamics and the trained gait dynamics, and propose an error-based feature fusion scheme for gait recognition. To validate the efficacy of the proposed method, we conduct experiments on published gait databases by comparing with other existing gait recognition methods.
- 27 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 26 (15209210) , 117-126
Human Gait Recognition Based on Frontal-View Sequences Using Gait Dynamics and Deep Learning
To facilitate human gait recognition, this paper proposes a new frontal-view gait recognition method using gait dynamics and deep learning. Rather than adopting lateral-view parameters as gait features in the literature, we employ improved frontal-view features and classification methods to avoid the recognition rate drops due to the complicated surveillance environment. Specifically, we characterize the binary walking silhouettes with three different kinds of frontal-view gait features, including kinematic features, spatial ratio features and area features. In addition, we capture the gait dynamics underlying the time-varying gait features to reflect temporal dynamics information of human walking. Furthermore, we incorporate the deep feature learning information into the recognition procedure to take advantage of the deep learning technique. To obtain the optimal recognition accuracy and robustness performance against walking condition variations, we calculate the similarity between the appearing test gait dynamics and the trained gait dynamics, and propose an error-based feature fusion scheme for gait recognition. To validate the efficacy of the proposed method, we conduct experiments on published gait databases by comparing with other existing gait recognition methods.
- 1 January 2022
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 31 (01) , 013034-15
Human gait recognition by fusing global and local image entropy features with neural networks
We propose a robust gait recognition method based on the combination of global and local image entropy features. An improved feature extraction scheme is developed, in which binary walking silhouettes are characterized with global and local image entropy features. Gait dynamics underlying image entropy features are derived and fused. Additionally, pretrained deep neural networks are employed as the feature extractor on the raw fused image entropy features. The extracted gait dynamics and deep transfer learning features are finally fused and fed into a seven-layer fully connected network for the identification task. The proposed method can make use of global and local gait characteristics sufficiently, which is helpful for resisting walking conditions variation. Experiments on the CASIA-B database are conducted to demonstrate the efficiency of the proposed method.
- 1 January 2022
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 31 (01) , 013034-15
Human gait recognition by fusing global and local image entropy features with neural networks
We propose a robust gait recognition method based on the combination of global and local image entropy features. An improved feature extraction scheme is developed, in which binary walking silhouettes are characterized with global and local image entropy features. Gait dynamics underlying image entropy features are derived and fused. Additionally, pretrained deep neural networks are employed as the feature extractor on the raw fused image entropy features. The extracted gait dynamics and deep transfer learning features are finally fused and fed into a seven-layer fully connected network for the identification task. The proposed method can make use of global and local gait characteristics sufficiently, which is helpful for resisting walking conditions variation. Experiments on the CASIA-B database are conducted to demonstrate the efficiency of the proposed method.
- Top Cited Papers
- 1 October 2020
- Published by Elsevier in Neural Networks
- Vol. 130, 22-32
Heart sound classification based on improved MFCC features and convolutional recurrent neural networks
- 1 October 2020
- Published by Elsevier in Neural Networks
- Vol. 130, 22-32
Top Cited PapersHeart sound classification based on improved MFCC features and convolutional recurrent neural networks
- 1 March 2020
- Published by Elsevier in Journal of the Franklin Institute
- Vol. 357 (4) , 2471-2491
Human gait recognition based on deterministic learning and knowledge fusion through multiple walking views
- 1 March 2020
- Published by Elsevier in Journal of the Franklin Institute
- Vol. 357 (4) , 2471-2491
Human gait recognition based on deterministic learning and knowledge fusion through multiple walking views