Mingjie He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Mingjie He has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Xiaojun Bi
Minzu University of China
3 shared publications - Changdong Yu
College of Artificial Intelligence, Dalian Maritime University, Dalian 116026, China
2 shared publications - Haozhe Luo
College of Computer Science, Sichuan University, Chengdu, China
2 shared publications - Yiwei Fan
College of Shipbuilding Engineering, Harbin Engineering University, Harbin, China
2 shared publications - Yiwen Sun
Institute for Artificial Intelligence, Peking University, Beijing, China
1 shared publication
Latest Publications
- 13 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (6) , 8664-8677
Mix Q-Learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning
Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages in data acquisition and interpretability. However, current models often overlook collaboration, which affects not only impacts overall traffic efficiency but also hinders the vehicle's own normal driving in the long run. To address the aforementioned issue, this paper proposes a method named Mix Q-learning for Lane Changing (MQLC) that integrates a hybrid value Q network, taking into account both collective and individual benefits for the greater good. At the collective level, our method coordinates the individual Q and global Q networks by utilizing global information. This enables agents to effectively balance their individual interests with the collective benefit. At the individual level, we integrate a deep learning-based intent recognition module into our observation and enhance the decision network. These changes provide agents with richer decision information and more precise feature extraction for improved lane-changing decisions. This strategy enables the multi-agent system to learn and formulate optimal decision-making strategies effectively. Our MQLC model, through extensive experimental results, impressively outperforms other state-of-the-art multi-agent decision-making methods, effectively improving the overall efficiency.
- 13 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 74 (6) , 8664-8677
Mix Q-Learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning
Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages in data acquisition and interpretability. However, current models often overlook collaboration, which affects not only impacts overall traffic efficiency but also hinders the vehicle's own normal driving in the long run. To address the aforementioned issue, this paper proposes a method named Mix Q-learning for Lane Changing (MQLC) that integrates a hybrid value Q network, taking into account both collective and individual benefits for the greater good. At the collective level, our method coordinates the individual Q and global Q networks by utilizing global information. This enables agents to effectively balance their individual interests with the collective benefit. At the individual level, we integrate a deep learning-based intent recognition module into our observation and enhance the decision network. These changes provide agents with richer decision information and more precise feature extraction for improved lane-changing decisions. This strategy enables the multi-agent system to learn and formulate optimal decision-making strategies effectively. Our MQLC model, through extensive experimental results, impressively outperforms other state-of-the-art multi-agent decision-making methods, effectively improving the overall efficiency.
- 16 November 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 71 (00189456) , 1-10
A Cascaded Convolutional Neural Network for Two-Phase Flow PIV of an Object Entering Water
In the two-phase flow particle image velocimetry (PIV) experiment of an object entering water, the mask of the noncomputed area and the calculation of velocity field in particle images are two key stages. Due to the complexity of the edge of the object in the particle image, the mask calibration is usually performed manually and then the PIV estimation is carried out. We propose a cascaded convolutional neural network (CNN) in this article to implement end-to-end two-phase flow fluid motion estimation. In the first stage, the image segmentation network U-Net is used to mask the noncomputational area of the image and extract the liquid phase. In the second stage, we adopt the improved deep optical flow network, which is known as recurrent allpairs field transforms (RAFT) to calculate the velocity field. What is more, the corresponding datasets are generated for training model parameters. Finally, our approach is tested on synthetic and experimental images. The experimental results indicate that our approach not only reaches accurate segmentation of the calculated liquid phase region but also achieves a high-precision velocity field calculation. Meanwhile, this cascade CNN model has high efficiency toward real-time estimation.
- 16 November 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 71 (00189456) , 1-10
A Cascaded Convolutional Neural Network for Two-Phase Flow PIV of an Object Entering Water
In the two-phase flow particle image velocimetry (PIV) experiment of an object entering water, the mask of the noncomputed area and the calculation of velocity field in particle images are two key stages. Due to the complexity of the edge of the object in the particle image, the mask calibration is usually performed manually and then the PIV estimation is carried out. We propose a cascaded convolutional neural network (CNN) in this article to implement end-to-end two-phase flow fluid motion estimation. In the first stage, the image segmentation network U-Net is used to mask the noncomputational area of the image and extract the liquid phase. In the second stage, we adopt the improved deep optical flow network, which is known as recurrent allpairs field transforms (RAFT) to calculate the velocity field. What is more, the corresponding datasets are generated for training model parameters. Finally, our approach is tested on synthetic and experimental images. The experimental results indicate that our approach not only reaches accurate segmentation of the calculated liquid phase region but also achieves a high-precision velocity field calculation. Meanwhile, this cascade CNN model has high efficiency toward real-time estimation.
- 1 October 2021
- Published by Elsevier in Ocean Engineering
- Vol. 237, 109502
An effective convolutional neural network for liquid phase extraction in two-phase flow PIV experiment of an object entering water
- 1 October 2021
- Published by Elsevier in Ocean Engineering
- Vol. 237, 109502
An effective convolutional neural network for liquid phase extraction in two-phase flow PIV experiment of an object entering water