Hui Zhou
Research Subjects
Hui Zhou has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Yansha Deng
King's College London
6 shared publications - Arumugam Nallanathan
Queen Mary University of London
2 shared publications - Andreas Höglund
Ericsson Research, Stockholm, Sweden
1 shared publication Asish B. Mehta
Department of Engineering, Kings College London, London, U.K
1 shared publication- Chunyang Ye
School of Computer Science and Technology, Hainan University, Haikou, China
1 shared publication Danmei Li
College of Information Sciences and Technology, Engineering Research Center of Digitized Textile & Fashion Technology, Ministry of Education, Donghua University, No. 2999 North Renmin Road, Songjiang District, Shanghai 201620, China
1 shared publication
Latest Publications
- 19 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (5) , 4127-4140
Energy-Efficient Cellular-Connected UAV Swarm Control Optimization
Cellular-connected unmanned aerial vehicle (UAV) swarm is a promising solution for diverse applications, including cargo delivery and traffic control. However, it is still challenging to communicate with and control the UAV swarm with high reliability, low latency, and high energy efficiency. In this paper, we propose a two-phase command and control (C&C) transmission scheme in a cellular-connected UAV swarm network, where the ground base station (GBS) broadcasts the common C&C message in phase I. In phase II, the UAVs that have successfully decoded the C&C message will relay the message to the rest of UAVs via device-to-device (D2D) communications in either broadcast or unicast mode, under latency and energy constraints. To maximize the number of UAVs that receive the message successfully within the latency and energy constraints, we formulate the problem as a Constrained Markov Decision Process to find the optimal policy. To address this problem, we propose a decentralized constrained graph attention multi-agent Deep-Q-network (DCGA-MADQN) algorithm based on Lagrangian primal-dual policy optimization, where a PID-controller algorithm is utilized to update the Lagrange Multiplier. Simulation results show that our algorithm could maximize the number of UAVs that successfully receive the common C&C under energy constraints.
- 19 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (5) , 4127-4140
Energy-Efficient Cellular-Connected UAV Swarm Control Optimization
Cellular-connected unmanned aerial vehicle (UAV) swarm is a promising solution for diverse applications, including cargo delivery and traffic control. However, it is still challenging to communicate with and control the UAV swarm with high reliability, low latency, and high energy efficiency. In this paper, we propose a two-phase command and control (C&C) transmission scheme in a cellular-connected UAV swarm network, where the ground base station (GBS) broadcasts the common C&C message in phase I. In phase II, the UAVs that have successfully decoded the C&C message will relay the message to the rest of UAVs via device-to-device (D2D) communications in either broadcast or unicast mode, under latency and energy constraints. To maximize the number of UAVs that receive the message successfully within the latency and energy constraints, we formulate the problem as a Constrained Markov Decision Process to find the optimal policy. To address this problem, we propose a decentralized constrained graph attention multi-agent Deep-Q-network (DCGA-MADQN) algorithm based on Lagrangian primal-dual policy optimization, where a PID-controller algorithm is utilized to update the Lagrange Multiplier. Simulation results show that our algorithm could maximize the number of UAVs that successfully receive the common C&C under energy constraints.
- 27 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Letters
- Vol. 27 (8) , 2232-2236
Task-Oriented Semantics-Aware Communication for Wireless UAV Control and Command Transmission
To guarantee the safety and smooth control of Unmanned Aerial Vehicle (UAV) operation, the new control and command (C&C) data type imposes stringent quality of service (QoS) requirements on the cellular network. However, the existing bit-oriented communication framework is already approaching the Shannon capacity limit, which can hardly guarantee the ultra-reliable low latency communications (URLLC) service for C&C transmission. To solve the problem, task-oriented semantics-aware (TOSA) communication has been proposed recently by jointly exploiting the context of data and its importance to the UAV control task. However, to the best of our knowledge, an explicit and systematic TOSA communication framework for emerging C&C data type remains unknown. Therefore, in this paper, we propose a TOSA communication framework for C&C transmission and define its value of information based on both the similarity and age of information (AoI) of C&C signals. We also propose a deep reinforcement learning (DRL) algorithm to maximize the TOSA information. Last but not least, we present the simulation results to validate the effectiveness of our proposed TOSA communication framework.
- 27 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Letters
- Vol. 27 (8) , 2232-2236
Task-Oriented Semantics-Aware Communication for Wireless UAV Control and Command Transmission
To guarantee the safety and smooth control of Unmanned Aerial Vehicle (UAV) operation, the new control and command (C&C) data type imposes stringent quality of service (QoS) requirements on the cellular network. However, the existing bit-oriented communication framework is already approaching the Shannon capacity limit, which can hardly guarantee the ultra-reliable low latency communications (URLLC) service for C&C transmission. To solve the problem, task-oriented semantics-aware (TOSA) communication has been proposed recently by jointly exploiting the context of data and its importance to the UAV control task. However, to the best of our knowledge, an explicit and systematic TOSA communication framework for emerging C&C data type remains unknown. Therefore, in this paper, we propose a TOSA communication framework for C&C transmission and define its value of information based on both the similarity and age of information (AoI) of C&C signals. We also propose a deep reinforcement learning (DRL) algorithm to maximize the TOSA information. Last but not least, we present the simulation results to validate the effectiveness of our proposed TOSA communication framework.
- 2 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (22) , 19981-19992
Novel Listen-Before-Talk Access Scheme With Adaptive Backoff Procedure for Uplink Centric Broadband Communication
To cater for the data-hungry Internet of Things (IoT) applications, uplink centric broadband communication (UCBC) has been identified as a new service class in the vision of 5.5G, where the unlicensed spectrum has been regarded as a promising solution to boost the uplink capacity. The new radio unlicensed (NR-U) network adopts category-4 (Cat4) listen before talk (LBT) access scheme to exploit the unlicensed spectrum and fairly coexist with the incumbent wireless fidelity (WiFi) network. However, the existing Cat4 LBT access scheme adopts single fixed energy detection (ED) threshold and backoff speed, which cannot adapt to the sophisticated interference and achieve the expected uplink system throughput. To tackle this issue, in this article, we develop a novel Cat4 LBT access scheme with adaptive backoff procedure for UCBC, which includes instantaneous interference level quantification, instantaneous interference level sharing, and backoff speed determination. The results have shown that our proposed adaptive Cat4 LBT scheme achieves over 70% uplink system throughput performance gain where cell throughput of NR-U network rises by over 100%, and cell throughput of WiFi network increases by 25%.
- 2 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (22) , 19981-19992
Novel Listen-Before-Talk Access Scheme With Adaptive Backoff Procedure for Uplink Centric Broadband Communication
To cater for the data-hungry Internet of Things (IoT) applications, uplink centric broadband communication (UCBC) has been identified as a new service class in the vision of 5.5G, where the unlicensed spectrum has been regarded as a promising solution to boost the uplink capacity. The new radio unlicensed (NR-U) network adopts category-4 (Cat4) listen before talk (LBT) access scheme to exploit the unlicensed spectrum and fairly coexist with the incumbent wireless fidelity (WiFi) network. However, the existing Cat4 LBT access scheme adopts single fixed energy detection (ED) threshold and backoff speed, which cannot adapt to the sophisticated interference and achieve the expected uplink system throughput. To tackle this issue, in this article, we develop a novel Cat4 LBT access scheme with adaptive backoff procedure for UCBC, which includes instantaneous interference level quantification, instantaneous interference level sharing, and backoff speed determination. The results have shown that our proposed adaptive Cat4 LBT scheme achieves over 70% uplink system throughput performance gain where cell throughput of NR-U network rises by over 100%, and cell throughput of WiFi network increases by 25%.
- Open Access
- 19 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Communications
- Vol. 71 (3) , 1475-1490
Deep Reinforcement Learning-Based Grant-Free NOMA Optimization for mURLLC
Grant-free non-orthogonal multiple access (GF-NOMA) is a potential technique to support massive Ultra-Reliable and Low-Latency Communication (mURLLC) service. However, the dynamic resource configuration in GF-NOMA systems is challenging due to random traffics and collisions, that are unknown at the base station (BS). Meanwhile, joint consideration of the latency and reliability requirements makes the resource configuration of GF-NOMA for mURLLC more complex. To address this problem, we develop a novel learning framework for signature-based GF-NOMA in mURLLC service taking into account the multiple access signature collision, the UE detection, as well as the data decoding procedures for the K-repetition GF and the Proactive GF schemes. The goal of our learning framework is to maximize the long-term average number of successfully served users (UEs) under the latency constraint. We first perform a real-time repetition value configuration based on a double deep Q-Network (DDQN) and then propose a Cooperative Multi-Agent learning technique based DQN (CMA-DQN) to optimize the configuration of both the repetition values and the contention-transmission unit (CTU) numbers. Our results show the superior performance of CMA-DQN over the conventional load estimation-based approach (LE-URC) in heavy traffic and demonstrate its capability in dynamically configuring in long term for mURLLC service. In addition, with our learning optimization, the Proactive scheme always outperforms the K-repetition scheme in terms of the number of successfully served UEs, especially under the high backlog traffic scenario.
- 19 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Communications
- Vol. 71 (3) , 1475-1490
Open AccessDeep Reinforcement Learning-Based Grant-Free NOMA Optimization for mURLLC
Grant-free non-orthogonal multiple access (GF-NOMA) is a potential technique to support massive Ultra-Reliable and Low-Latency Communication (mURLLC) service. However, the dynamic resource configuration in GF-NOMA systems is challenging due to random traffics and collisions, that are unknown at the base station (BS). Meanwhile, joint consideration of the latency and reliability requirements makes the resource configuration of GF-NOMA for mURLLC more complex. To address this problem, we develop a novel learning framework for signature-based GF-NOMA in mURLLC service taking into account the multiple access signature collision, the UE detection, as well as the data decoding procedures for the K-repetition GF and the Proactive GF schemes. The goal of our learning framework is to maximize the long-term average number of successfully served users (UEs) under the latency constraint. We first perform a real-time repetition value configuration based on a double deep Q-Network (DDQN) and then propose a Cooperative Multi-Agent learning technique based DQN (CMA-DQN) to optimize the configuration of both the repetition values and the contention-transmission unit (CTU) numbers. Our results show the superior performance of CMA-DQN over the conventional load estimation-based approach (LE-URC) in heavy traffic and demonstrate its capability in dynamically configuring in long term for mURLLC service. In addition, with our learning optimization, the Proactive scheme always outperforms the K-repetition scheme in terms of the number of successfully served UEs, especially under the high backlog traffic scenario.
- 10 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Communications
- Vol. 70 (4) , 2805-2819
Analyzing Novel Grant-Based and Grant-Free Access Schemes for Small Data Transmission
Fifth Generation (5G) New Radio (NR) does not support data transmission during random access (RA) procedures, which results in unnecessary control signalling overhead and power consumption, especially for small data transmission (SDT). Motivated by this, 3GPP has proposed 4/2-step SDT RA schemes based on the existing grant-based (4-step) and grant-free (2-step) RA schemes, with the aim to enable data transmission during RA procedures in Radio Resource Control (RRC) Inactive state. To compare the 4/2-step SDT RA schemes with the benchmark 4/2-step RA schemes, we provide a spatio-temporal analytical framework to evaluate the RA schemes, which jointly models the preamble detection, Physical Uplink Shared Channel (PUSCH) decoding, and data transmission procedures. Based on this analytical model, we derive the analytical expressions for the overall packet transmission success probability and average throughput in each RACH attempt. We also derive the average energy consumption in each RACH attempt. Our results show that 2-step SDT RA scheme provides the highest overall packet transmission success probability, and the lowest average energy consumption, but the performance gain decreases with the increase of device intensity.
- 10 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Communications
- Vol. 70 (4) , 2805-2819
Analyzing Novel Grant-Based and Grant-Free Access Schemes for Small Data Transmission
Fifth Generation (5G) New Radio (NR) does not support data transmission during random access (RA) procedures, which results in unnecessary control signalling overhead and power consumption, especially for small data transmission (SDT). Motivated by this, 3GPP has proposed 4/2-step SDT RA schemes based on the existing grant-based (4-step) and grant-free (2-step) RA schemes, with the aim to enable data transmission during RA procedures in Radio Resource Control (RRC) Inactive state. To compare the 4/2-step SDT RA schemes with the benchmark 4/2-step RA schemes, we provide a spatio-temporal analytical framework to evaluate the RA schemes, which jointly models the preamble detection, Physical Uplink Shared Channel (PUSCH) decoding, and data transmission procedures. Based on this analytical model, we derive the analytical expressions for the overall packet transmission success probability and average throughput in each RACH attempt. We also derive the average energy consumption in each RACH attempt. Our results show that 2-step SDT RA scheme provides the highest overall packet transmission success probability, and the lowest average energy consumption, but the performance gain decreases with the increase of device intensity.
- 28 April 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 10 (8) , 1657-1661
Real-Time Video Streaming and Control of Cellular-Connected UAV System: Prototype and Performance Evaluation
Unmanned aerial vehicles (UAVs) play an increasingly important role in military, public, and civilian applications, where providing connectivity to UAVs is crucial for its real-time control, video streaming, and data collection. Considering that cellular networks offer wide area, high speed, and secure wireless connectivity, cellular-connected UAVs have been considered as an appealing solution to provide UAV connectivity with enhanced reliability, coverage, throughput, and security. Due to the nature of UAVs mobility, the throughput, reliability and End-to-End (E2E) delay of UAVs communication under various flight heights, video resolutions, and transmission frequencies remain unknown. To evaluate these parameters, we develop a cellular-connected UAV testbed based on the Long Term Evolution (LTE) network with its uplink video transmission and downlink control&command (CC) transmission. We also design algorithms for sending control signal and controlling UAV. The indoor experimental results provide fundamental insights for the cellular-connected UAV system design from the perspective of transmission frequency, adaptability, and link outage, respectively.
- 28 April 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 10 (8) , 1657-1661
Real-Time Video Streaming and Control of Cellular-Connected UAV System: Prototype and Performance Evaluation
Unmanned aerial vehicles (UAVs) play an increasingly important role in military, public, and civilian applications, where providing connectivity to UAVs is crucial for its real-time control, video streaming, and data collection. Considering that cellular networks offer wide area, high speed, and secure wireless connectivity, cellular-connected UAVs have been considered as an appealing solution to provide UAV connectivity with enhanced reliability, coverage, throughput, and security. Due to the nature of UAVs mobility, the throughput, reliability and End-to-End (E2E) delay of UAVs communication under various flight heights, video resolutions, and transmission frequencies remain unknown. To evaluate these parameters, we develop a cellular-connected UAV testbed based on the Long Term Evolution (LTE) network with its uplink video transmission and downlink control&command (CC) transmission. We also design algorithms for sending control signal and controlling UAV. The indoor experimental results provide fundamental insights for the cellular-connected UAV system design from the perspective of transmission frequency, adaptability, and link outage, respectively.
- 1 October 2020
- Published by IGI Global Scientific Publishing in International Journal of Web Services Research
- Vol. 17 (4) , 55-75
A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition
Traditional service composition methods usually address the constraint-satisfied service composition (CSSC) problem with static web services. Such solutions however are inapplicable to the dynamic scenarios where the services or their QoS values may change over time. Some recent studies are proposed to use reinforcement learning, especially, integrate the idea of Q-learning, to solve the dynamic CSSC problem. However, such Q-learning algorithm relies on Q-table to search for optimal candidate services. When the problem of CSSC becomes complex, the number of states in Q-table is very large and the cost of the Q-learning model will become extremely high. In this paper, the authors propose a novel solution to address this issue. By training a DQN network to replace the Q-table, this solution can effectively model the uncertainty of services with fine-grained QoS attributes and choose suitable candidate services to compose on the fly in the dynamic scenarios. Experimental results on both artificial and real datasets demonstrate the effectiveness of the method.
- 1 October 2020
- Published by IGI Global Scientific Publishing in International Journal of Web Services Research
- Vol. 17 (4) , 55-75
A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition
Traditional service composition methods usually address the constraint-satisfied service composition (CSSC) problem with static web services. Such solutions however are inapplicable to the dynamic scenarios where the services or their QoS values may change over time. Some recent studies are proposed to use reinforcement learning, especially, integrate the idea of Q-learning, to solve the dynamic CSSC problem. However, such Q-learning algorithm relies on Q-table to search for optimal candidate services. When the problem of CSSC becomes complex, the number of states in Q-table is very large and the cost of the Q-learning model will become extremely high. In this paper, the authors propose a novel solution to address this issue. By training a DQN network to replace the Q-table, this solution can effectively model the uncertainty of services with fine-grained QoS attributes and choose suitable candidate services to compose on the fly in the dynamic scenarios. Experimental results on both artificial and real datasets demonstrate the effectiveness of the method.
- 1 January 2009
- Published by Inderscience Publishers in International Journal of Modelling, Identification and Control
- Vol. 8 (2) , 122-129
Control of fuzzy discrete event systems and its application to air conditioning system
The non-linear, asynchronous and uncertain nature must be considered in the control of air-conditioning (AC) system as the AC systems tend to become large-scale and more complicated. In this paper, a fuzzy discrete event systems (FDES) is introduced into the AC control. A fuzzy automaton for AC system is given. A new modelling and control method is then proposed. Cost and effectiveness functions are optimised. The simulation results show that the optimal control can be better achieved using the FDES for the AC systems.
- 1 January 2009
- Published by Inderscience Publishers in International Journal of Modelling, Identification and Control
- Vol. 8 (2) , 122-129
Control of fuzzy discrete event systems and its application to air conditioning system
The non-linear, asynchronous and uncertain nature must be considered in the control of air-conditioning (AC) system as the AC systems tend to become large-scale and more complicated. In this paper, a fuzzy discrete event systems (FDES) is introduced into the AC control. A fuzzy automaton for AC system is given. A new modelling and control method is then proposed. Cost and effectiveness functions are optimised. The simulation results show that the optimal control can be better achieved using the FDES for the AC systems.