Pan Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Pan Zhang has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Jianwei Zhang
College of Computer Science, Sichuan University, Chengdu, China
2 shared publications - Yi Lin
College of Computer Science, Sichuan University, Chengdu, China
2 shared publications Bo Yang
1 shared publication- Bo Yang
College of Computer Science, Sichuan University, Chengdu, China
1 shared publication Changyu Yin
National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, Chengdu, China
1 shared publicationDongyue Guo
1 shared publication
Latest Publications
- 24 January 2022
- Published by Elsevier in Knowledge-Based Systems
- Vol. 241
Automatic repetition instruction generation for air traffic control training using multi-task learning with an improved copy network
- 24 January 2022
- Published by Elsevier in Knowledge-Based Systems
- Vol. 241
Automatic repetition instruction generation for air traffic control training using multi-task learning with an improved copy network
- 2 September 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 51 (5) , 442-450
A Deep Learning Framework of Autonomous Pilot Agent for Air Traffic Controller Training
In this work, a deep learning-based framework is proposed to implement an autonomous pilot agent (APA), which serves as a human pseudo-pilot to assist air traffic controller (ATCO) training. A novel paradigm, including speech recognition, language understanding, pilot repetition generation (PRG), and text-to-speech (TTS), is designed to formulate the framework pipeline, which also incorporates a simulation system interface. We mainly focus on the PRG and TTS models to address the ATC specificities in this work. The neural architecture is proposed to generate the text repetition instruction by using a sequence-to-sequence text mapping. The Transformer block is improved to implement a high-efficient TTS model, in which the nonautoregressive mechanism is applied to achieve the parallel synthesis. A dedicated phoneme vocabulary is designed to cope with the multilingual issue in the ATC domain and address the out-of-vocabulary problem. With the APA framework, a virtual training mode is proposed to complete the training task without the limitation of time and location. Experimental results on a real-world dataset show that the proposed APA framework replaces the human pilot with considerable high confidence in a real-time manner during the simulation training. Most importantly, the APA framework and the virtual training system are able to cope with the dilemma of physical attendance (like COVID-19) and improve the equipment utilization capacity for the ATCO training.
- 2 September 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 51 (5) , 442-450
A Deep Learning Framework of Autonomous Pilot Agent for Air Traffic Controller Training
In this work, a deep learning-based framework is proposed to implement an autonomous pilot agent (APA), which serves as a human pseudo-pilot to assist air traffic controller (ATCO) training. A novel paradigm, including speech recognition, language understanding, pilot repetition generation (PRG), and text-to-speech (TTS), is designed to formulate the framework pipeline, which also incorporates a simulation system interface. We mainly focus on the PRG and TTS models to address the ATC specificities in this work. The neural architecture is proposed to generate the text repetition instruction by using a sequence-to-sequence text mapping. The Transformer block is improved to implement a high-efficient TTS model, in which the nonautoregressive mechanism is applied to achieve the parallel synthesis. A dedicated phoneme vocabulary is designed to cope with the multilingual issue in the ATC domain and address the out-of-vocabulary problem. With the APA framework, a virtual training mode is proposed to complete the training task without the limitation of time and location. Experimental results on a real-world dataset show that the proposed APA framework replaces the human pilot with considerable high confidence in a real-time manner during the simulation training. Most importantly, the APA framework and the virtual training system are able to cope with the dilemma of physical attendance (like COVID-19) and improve the equipment utilization capacity for the ATCO training.