Jiayuan Chen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jiayuan Chen has a total of 46 co-authors. Here are the top co-authors by number of shared publications:
- Changyan Yi
Nanjing University of Aeronautics and Astronautics
15 shared publications - Jun Cai
Network Intelligence and Innovation Lab (NI2L), Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada
10 shared publications - Dusit Niyato
Nanyang technological university, Singapore, Singapore
6 shared publications - Samuel Dayo Okegbile
Department of Computer Science and Physics, Faculty of Science, Wilfrid Laurier University, Milton, ON, Canada
5 shared publications - Jiawen Kang
Guangdong University of Technology
4 shared publications - Xuemin Shen
University of Waterloo
4 shared publications
Latest Publications
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Magazine
- Vol. 9 (6) , 128-135
Collaborative Embodied Learning for Digital Twin Deployment in Industrial IoT: Challenges and Solutions
- 1 November 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Magazine
- Vol. 9 (6) , 128-135
Collaborative Embodied Learning for Digital Twin Deployment in Industrial IoT: Challenges and Solutions
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 75 (10) , 23187-23202
High-Order Feature-Guided Efficient Semantic Communication System for Point Cloud Transmission
Recently, semantic communication has emerged as a promising solution for the efficient transmission of point cloud data. However, effectively extracting robust semantic features and achieving precise recovery under channel impairments remain formidable challenges. Recognizing the critical role of high-order correlations in compact representation and robust recovery, we propose a High-order Feature-guided Semantic Communication System (HFSCS). At the transmitter, a high-order structured semantic encoder integrating hypergraph convolution with lightweight squeeze-and-excitation attention mechanism is devised to extract and refine high-order features. These features are subsequently projected into a compact semantic vector via a feature compression and mapping module, thereby significantly reducing bandwidth overhead. At the receiver, we design a noise-resilient semantic reconstruction architecture comprising a semantic space recovery decoder and a prior-guided refinement module. Treating the received semantics as structural priors, it performs coarse-to-fine denoising and multi-level progressive fusion within a high-dimensional space, accurately recovering fine-grained geometric details. Extensive experiments across AWGN, Rayleigh, Rician, and 3GPP channels demonstrate that HFSCS significantly outperforms traditional codecs and the state-of-the-art semantic communication baseline in reconstruction accuracy. Notably, it exhibits strong robustness against low SNR, low Channel Bandwidth Ratio (CBR), and training-test SNR mismatch. Furthermore, compared to the baseline semantic approach, HFSCS improves codec efficiency by 81.82% while reducing FLOPs by 52.02%.
- 1 October 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 75 (10) , 23187-23202
High-Order Feature-Guided Efficient Semantic Communication System for Point Cloud Transmission
Recently, semantic communication has emerged as a promising solution for the efficient transmission of point cloud data. However, effectively extracting robust semantic features and achieving precise recovery under channel impairments remain formidable challenges. Recognizing the critical role of high-order correlations in compact representation and robust recovery, we propose a High-order Feature-guided Semantic Communication System (HFSCS). At the transmitter, a high-order structured semantic encoder integrating hypergraph convolution with lightweight squeeze-and-excitation attention mechanism is devised to extract and refine high-order features. These features are subsequently projected into a compact semantic vector via a feature compression and mapping module, thereby significantly reducing bandwidth overhead. At the receiver, we design a noise-resilient semantic reconstruction architecture comprising a semantic space recovery decoder and a prior-guided refinement module. Treating the received semantics as structural priors, it performs coarse-to-fine denoising and multi-level progressive fusion within a high-dimensional space, accurately recovering fine-grained geometric details. Extensive experiments across AWGN, Rayleigh, Rician, and 3GPP channels demonstrate that HFSCS significantly outperforms traditional codecs and the state-of-the-art semantic communication baseline in reconstruction accuracy. Notably, it exhibits strong robustness against low SNR, low Channel Bandwidth Ratio (CBR), and training-test SNR mismatch. Furthermore, compared to the baseline semantic approach, HFSCS improves codec efficiency by 81.82% while reducing FLOPs by 52.02%.
- Top Cited Papers
- 16 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Surveys & Tutorials
- Vol. 28, 4915-4947
From Data Mirror to Smart Copilot: A Survey on NextG Semantic Communication for Propelling Digital Twin World Into Cognitive Stage
The revolution of information technologies is blur-ring the boundary between physical and virtual worlds, with digital twin (DT) at the forefront of this transformation. Mean-while, DT is evolving from offering simple data mirrors to smart copilots, capable of understanding user’s intents and proactively providing profound insights. This ushers in the pivotal cognitive stage of the DT, where humans or embodied artificial intelligence agents (EAIs) can obtain cognitive perceptions within the DT world. Among various issues, in the cognitive stage, establishing strong interactions between the physical and DT worlds is critical. This paper thus explores the Next-Generation Semantic Communication (NextG-SemCom), well-suited for this issue, to fully enable the DT world with human-like cognitive capabilities. NextG-SemCom is envisioned as a cognitive-native paradigm that leverages Large AI Models (LAMs) as its core engine to perform intent understanding, contextual planning, and intent-oriented generative extraction. NextG-SemCom establishes a closed cognitive loop that shifts communication from data-driven to cognitive-driven, thereby not only reducing the traffic overhead, but also achieving cognitive comprehension of the transmitted information. This paper provides the first survey of the NextG-SemCom driven DT world, focusing on the advancement, trend and vision. We start by tracing the evolution of the DT from the initial virtual mapping stage to the current cognitive stage, and detail the distinguishing features of NextG-SemCom. We then present a holistic framework of cognitive interactions in the DT world, analyzing its core components, including the NextG-SemCom codec and network management, along with its design requirements and challenges. Furthermore, we discuss potential applications across a spectrum of human-human, human-EAI, and EAI-EAI interactive scenarios. Finally, we outline future research directions to provide a roadmap and inspire further studies in this promising field.
- 16 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Surveys & Tutorials
- Vol. 28, 4915-4947
Top Cited PapersFrom Data Mirror to Smart Copilot: A Survey on NextG Semantic Communication for Propelling Digital Twin World Into Cognitive Stage
The revolution of information technologies is blur-ring the boundary between physical and virtual worlds, with digital twin (DT) at the forefront of this transformation. Mean-while, DT is evolving from offering simple data mirrors to smart copilots, capable of understanding user’s intents and proactively providing profound insights. This ushers in the pivotal cognitive stage of the DT, where humans or embodied artificial intelligence agents (EAIs) can obtain cognitive perceptions within the DT world. Among various issues, in the cognitive stage, establishing strong interactions between the physical and DT worlds is critical. This paper thus explores the Next-Generation Semantic Communication (NextG-SemCom), well-suited for this issue, to fully enable the DT world with human-like cognitive capabilities. NextG-SemCom is envisioned as a cognitive-native paradigm that leverages Large AI Models (LAMs) as its core engine to perform intent understanding, contextual planning, and intent-oriented generative extraction. NextG-SemCom establishes a closed cognitive loop that shifts communication from data-driven to cognitive-driven, thereby not only reducing the traffic overhead, but also achieving cognitive comprehension of the transmitted information. This paper provides the first survey of the NextG-SemCom driven DT world, focusing on the advancement, trend and vision. We start by tracing the evolution of the DT from the initial virtual mapping stage to the current cognitive stage, and detail the distinguishing features of NextG-SemCom. We then present a holistic framework of cognitive interactions in the DT world, analyzing its core components, including the NextG-SemCom codec and network management, along with its design requirements and challenges. Furthermore, we discuss potential applications across a spectrum of human-human, human-EAI, and EAI-EAI interactive scenarios. Finally, we outline future research directions to provide a roadmap and inspire further studies in this promising field.
- Top Cited Papers
- 17 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 25 (6) , 7888-7905
Generative AI-Aided QoE-Aware Resource Allocations for RlS-Assisted Digital Twin Interaction With Uncertain Evolution
In this paper, we propose a novel generative artificial intelligence (GAI)-aided approach to address the quality of experience (QoE)-aware resource allocation for reconfigurable intelligent surface (RIS)-assisted digital twin (DT) interactions with uncertain evolutions. In the considered system, mobile users interact with a DT model, hosted by a DT server deployed on a wireless base station via an RIS, for gaining DT services, such as real-time monitoring and predictive analytics. Notably, DT interactions involve round-trip communications with both uplink and downlink, and concern not only objective performance but also subjective experience. As such, we formulate an optimization problem for RIS-assisted DT interactions to maximize the sum of all users. mixed objective and subjective QoE, by jointly determining the phase shift matrix, receive/transmit beamforming matrices, feedback signal rendering resolution and computing resource configuration. Further taking into account the DT model's uncertain evolutions and the resulted DT scene variations, we extend the resource allocation problem to a series of scene-specific ones. To obtain a generalized approach with low complexity, we develop a GAI-aided approach, called prompt-guided decision transformer integrated with zero-forcing optimization (PG-ZFO). Specifically, in PG-ZFO, we first reformulate each scene-specific problem into a Markov decision process. Then, we design a “decision-making trajectory” prompt to capture the scene-specific information and develop a prompt-guided decision transformer. Furthermore, a zero-forcing based optimization algorithm is integrated to help derive high-dimensional beamforming decisions. Simulations show the effectiveness of the proposed approach, and demonstrate its superiority over counterparts, i.e., rigid optimization method and decision transformer without prompt.
- 17 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 25 (6) , 7888-7905
Top Cited PapersGenerative AI-Aided QoE-Aware Resource Allocations for RlS-Assisted Digital Twin Interaction With Uncertain Evolution
In this paper, we propose a novel generative artificial intelligence (GAI)-aided approach to address the quality of experience (QoE)-aware resource allocation for reconfigurable intelligent surface (RIS)-assisted digital twin (DT) interactions with uncertain evolutions. In the considered system, mobile users interact with a DT model, hosted by a DT server deployed on a wireless base station via an RIS, for gaining DT services, such as real-time monitoring and predictive analytics. Notably, DT interactions involve round-trip communications with both uplink and downlink, and concern not only objective performance but also subjective experience. As such, we formulate an optimization problem for RIS-assisted DT interactions to maximize the sum of all users. mixed objective and subjective QoE, by jointly determining the phase shift matrix, receive/transmit beamforming matrices, feedback signal rendering resolution and computing resource configuration. Further taking into account the DT model's uncertain evolutions and the resulted DT scene variations, we extend the resource allocation problem to a series of scene-specific ones. To obtain a generalized approach with low complexity, we develop a GAI-aided approach, called prompt-guided decision transformer integrated with zero-forcing optimization (PG-ZFO). Specifically, in PG-ZFO, we first reformulate each scene-specific problem into a Markov decision process. Then, we design a “decision-making trajectory” prompt to capture the scene-specific information and develop a prompt-guided decision transformer. Furthermore, a zero-forcing based optimization algorithm is integrated to help derive high-dimensional beamforming decisions. Simulations show the effectiveness of the proposed approach, and demonstrate its superiority over counterparts, i.e., rigid optimization method and decision transformer without prompt.
- 7 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 22 (3) , 2780-2794
QoE-Aware Joint Visual and Haptic Signal Transmission With Adaptive Data Compression for Immersive Interactions in Human Digital Twin
Human digital twin (HDT) is envisioned as a system interconnecting physical twins (PTs) in the real world with virtual twins (VTs) in the digital world, enabling advanced human-centric applications. Unlike optimizing the quality of experience (QoE) of users in single-modal signal transmission for conventional services, users’ QoE in multi-modal signal transmission required by HDT is difficult to guarantee. To tackle this, we study an optimization of QoE in multi-modal transmission, focusing on joint visual and haptic signal feedback transmissions from VT to its PT, for providing immersive interactions in HDT. To evaluate a synthesized performance of visual and haptic experiences, we design a comprehensive QoE model, taking into account video quality, continuous video quality switching rate and average haptic feedback error. Then, to maximize QoE with a guarantee on synchronization between visual and haptic signal transmissions, we dynamically optimize bandwidth allocation, bitrate and rendering mode of the video, and haptic signal’s compression threshold. To this end, we propose a deep reinforcement learning based algorithm, called VisHap. Furthermore, we build an HDT multi-modal interaction platform for collecting an authentic dataset, and by using it, we conduct experiments, showing that VisHap is not only feasible but also outperforms the counterparts.
- 7 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 22 (3) , 2780-2794
QoE-Aware Joint Visual and Haptic Signal Transmission With Adaptive Data Compression for Immersive Interactions in Human Digital Twin
Human digital twin (HDT) is envisioned as a system interconnecting physical twins (PTs) in the real world with virtual twins (VTs) in the digital world, enabling advanced human-centric applications. Unlike optimizing the quality of experience (QoE) of users in single-modal signal transmission for conventional services, users’ QoE in multi-modal signal transmission required by HDT is difficult to guarantee. To tackle this, we study an optimization of QoE in multi-modal transmission, focusing on joint visual and haptic signal feedback transmissions from VT to its PT, for providing immersive interactions in HDT. To evaluate a synthesized performance of visual and haptic experiences, we design a comprehensive QoE model, taking into account video quality, continuous video quality switching rate and average haptic feedback error. Then, to maximize QoE with a guarantee on synchronization between visual and haptic signal transmissions, we dynamically optimize bandwidth allocation, bitrate and rendering mode of the video, and haptic signal’s compression threshold. To this end, we propose a deep reinforcement learning based algorithm, called VisHap. Furthermore, we build an HDT multi-modal interaction platform for collecting an authentic dataset, and by using it, we conduct experiments, showing that VisHap is not only feasible but also outperforms the counterparts.
- 25 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 39 (6) , 261-269
AIGC-Driven Real-Time Interactive 4-D Traffic Scene Generation in Vehicular Networks
Real-time, interactive 4D traffic scene generation enables rapid digital twinning of traffic scenarios, improving management and decision-making in intelligent transportation systems. However, current text-to-video models, such as Sora, struggle to maintain the temporal coherence of traffic elements and interact with dynamic environments and users when generating 4D scenes. This article introduces a novel cloud-edge-terminal collaborative framework that leverages Artificial Intelligence-Generated Content (AIGC) in vehicular networks to tackle these challenges, ensuring long-term coherence and improved interactivity. The framework presents a comprehensive architecture for real-time interactive 4D scene generation, encompassing data collection, management, model pre-training, fine-tuning, and inference. We examine key design requirements and challenges, demonstrating that our microservice-based framework enables the system to generate and update 4D traffic scenes in real time, effectively responding to traffic data and user inputs. To the best of our knowledge, this is the first successful implementation of real-time, interactive 4D traffic scene generation. Performance evaluations show the superiority of our framework, powered by microservice-based code fine-tuning, over traditional frameworks. Finally, we discuss future research directions to enhance AIGC-driven 4D traffic scene generation.
- 25 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 39 (6) , 261-269
AIGC-Driven Real-Time Interactive 4-D Traffic Scene Generation in Vehicular Networks
Real-time, interactive 4D traffic scene generation enables rapid digital twinning of traffic scenarios, improving management and decision-making in intelligent transportation systems. However, current text-to-video models, such as Sora, struggle to maintain the temporal coherence of traffic elements and interact with dynamic environments and users when generating 4D scenes. This article introduces a novel cloud-edge-terminal collaborative framework that leverages Artificial Intelligence-Generated Content (AIGC) in vehicular networks to tackle these challenges, ensuring long-term coherence and improved interactivity. The framework presents a comprehensive architecture for real-time interactive 4D scene generation, encompassing data collection, management, model pre-training, fine-tuning, and inference. We examine key design requirements and challenges, demonstrating that our microservice-based framework enables the system to generate and update 4D traffic scenes in real time, effectively responding to traffic data and user inputs. To the best of our knowledge, this is the first successful implementation of real-time, interactive 4D traffic scene generation. Performance evaluations show the superiority of our framework, powered by microservice-based code fine-tuning, over traditional frameworks. Finally, we discuss future research directions to enhance AIGC-driven 4D traffic scene generation.
- Open Access
- 5 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
QoE-Aware Joint Visual and Haptic Signal Transmission with Adaptive Data Compression for Immersive Interactions in Human Digital Twin
Human digital twin (HDT) is envisioned as a system interconnecting physical twins (PTs) in the real world with virtual twins (VTs) in the digital world, enabling advanced humancentric applications. Unlike optimizing the quality of experience (QoE) of users in single-modal signal transmission for conventional services, users' QoE in multi-modal signal transmission required by HDT is difficult to guarantee. To tackle this, we study an optimization of QoE in multi-modal transmission, focusing on joint visual and haptic signal feedback transmissions from VT to its PT, for providing immersive interactions in HDT. To evaluate a synthesized performance of visual and haptic experiences, we design a comprehensive QoE model, taking into account video quality, continuous video quality switching rate and average haptic feedback error. Then, to maximize QoE with a guarantee on synchronization between visual and haptic signal transmissions, we dynamically optimize bandwidth allocation, bitrate and rendering mode of the video, and haptic signal's compression threshold. To this end, we propose a deep reinforcement learning based algorithm, called VisHap. Furthermore, we build an HDT multi-modal interaction platform for collecting an authentic dataset, and by using it, we conduct experiments, showing that VisHap is not only feasible but also outperforms the counterparts.
- 5 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessQoE-Aware Joint Visual and Haptic Signal Transmission with Adaptive Data Compression for Immersive Interactions in Human Digital Twin
Human digital twin (HDT) is envisioned as a system interconnecting physical twins (PTs) in the real world with virtual twins (VTs) in the digital world, enabling advanced humancentric applications. Unlike optimizing the quality of experience (QoE) of users in single-modal signal transmission for conventional services, users' QoE in multi-modal signal transmission required by HDT is difficult to guarantee. To tackle this, we study an optimization of QoE in multi-modal transmission, focusing on joint visual and haptic signal feedback transmissions from VT to its PT, for providing immersive interactions in HDT. To evaluate a synthesized performance of visual and haptic experiences, we design a comprehensive QoE model, taking into account video quality, continuous video quality switching rate and average haptic feedback error. Then, to maximize QoE with a guarantee on synchronization between visual and haptic signal transmissions, we dynamically optimize bandwidth allocation, bitrate and rendering mode of the video, and haptic signal's compression threshold. To this end, we propose a deep reinforcement learning based algorithm, called VisHap. Furthermore, we build an HDT multi-modal interaction platform for collecting an authentic dataset, and by using it, we conduct experiments, showing that VisHap is not only feasible but also outperforms the counterparts.
- 17 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 11 (4) , 2440-2455
A Prediction-Enhanced Physical-to-Virtual Twin Connectivity Framework for Human Digital Twin
This paper proposes a new secure and privacy-preserving prediction-enhanced solution for reliable physical-to-virtual communications in human digital twin (HDT) systems. With such a prediction-enhanced connectivity (PeHDT) framework, the evolution of any virtual twin (VT) could be triggered in real-time or in advance using the expected state of its physical counterpart. This ensures the continuous maintenance of a true replica of each physical twin (PT), thus relieving the need for timely PT-VT synchronization while the VT-experienced delay is reduced to zero or close to zero. We adopted a secured federated multi-task learning technique to meet the security and privacy constraints of HDT and employed a single server discrete-time batch-service queue framework when characterizing the batching process to reduce the communication burden. Furthermore, we introduced a prediction verification framework to improve the performance of the proposed PeHDT framework. The resulting problem was formulated as a constrained Markov decision process and was solved by introducing a primary-dual deep deterministic policy gradient (DDPG) algorithm. Through a joint investigation of communication, batching and prediction verification schemes, the simulation results show that the proposed PeHDT framework can greatly reduce both the VT-experienced delay and the PT-VT communication time without compromising the specific requirements of HDT.
- 17 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 11 (4) , 2440-2455
A Prediction-Enhanced Physical-to-Virtual Twin Connectivity Framework for Human Digital Twin
This paper proposes a new secure and privacy-preserving prediction-enhanced solution for reliable physical-to-virtual communications in human digital twin (HDT) systems. With such a prediction-enhanced connectivity (PeHDT) framework, the evolution of any virtual twin (VT) could be triggered in real-time or in advance using the expected state of its physical counterpart. This ensures the continuous maintenance of a true replica of each physical twin (PT), thus relieving the need for timely PT-VT synchronization while the VT-experienced delay is reduced to zero or close to zero. We adopted a secured federated multi-task learning technique to meet the security and privacy constraints of HDT and employed a single server discrete-time batch-service queue framework when characterizing the batching process to reduce the communication burden. Furthermore, we introduced a prediction verification framework to improve the performance of the proposed PeHDT framework. The resulting problem was formulated as a constrained Markov decision process and was solved by introducing a primary-dual deep deterministic policy gradient (DDPG) algorithm. Through a joint investigation of communication, batching and prediction verification schemes, the simulation results show that the proposed PeHDT framework can greatly reduce both the VT-experienced delay and the PT-VT communication time without compromising the specific requirements of HDT.
- 27 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 39 (4) , 271-279
Realizing Immersive Communications in Human Digital Twin by Edge Computing Empowered Tactile Internet: Visions and Case Study
Human digital twin (HDT) is expected to revolutionize the future human lifestyle and prompt the development of advanced human-centric applications (e.g., Metaverse) by bridging physical and virtual spaces. However, the fulfillment of HDT poses stringent demands on the pervasive connectivity, real-time feedback, multi-modal data transmission and ultra-high reliability, which urge the need of enabling immersive communications. In this article, we shed light on the design of an immersive communication framework for HDT by edge computing empowered tactile Internet (namely IC-HDT-ECoTI). Aiming at offering strong interactions and extremely immersive quality of experience, we introduce the system architecture of IC-HDT-ECoTI, and analyze its major design requirements and challenges. Moreover, we present core guidelines and detailed steps for system implementations. In addition, we conduct an experimental study based on our recently built testbed, which shows a particular use case of IC-HDT-ECoTI in physical therapy, and the obtained results indicate that the proposed framework can significantly improve the effectiveness of the system. Finally, we conclude this article with a brief discussion of open issues and future directions.
- 27 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 39 (4) , 271-279
Realizing Immersive Communications in Human Digital Twin by Edge Computing Empowered Tactile Internet: Visions and Case Study
Human digital twin (HDT) is expected to revolutionize the future human lifestyle and prompt the development of advanced human-centric applications (e.g., Metaverse) by bridging physical and virtual spaces. However, the fulfillment of HDT poses stringent demands on the pervasive connectivity, real-time feedback, multi-modal data transmission and ultra-high reliability, which urge the need of enabling immersive communications. In this article, we shed light on the design of an immersive communication framework for HDT by edge computing empowered tactile Internet (namely IC-HDT-ECoTI). Aiming at offering strong interactions and extremely immersive quality of experience, we introduce the system architecture of IC-HDT-ECoTI, and analyze its major design requirements and challenges. Moreover, we present core guidelines and detailed steps for system implementations. In addition, we conduct an experimental study based on our recently built testbed, which shows a particular use case of IC-HDT-ECoTI in physical therapy, and the obtained results indicate that the proposed framework can significantly improve the effectiveness of the system. Finally, we conclude this article with a brief discussion of open issues and future directions.
- Open Access
- 30 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Generative AI over Mobile Networks for Human Digital Twin in Human-Centric Applications: A Comprehensive Survey
Generative artificial intelligence (GenAI) is a powerful technology that can leverage advanced AI algorithms to automatically create, manipulate, and modify valuable while diverse data. GenAI has recently attracted phenomenal attentions and can serve as a key supplement for empowering the other techniques, e.g., the emerging human digital twin (HDT) that requires high-fidelity virtual modeling and strong information interactions but possibly with scarce, biased and noisy data. This survey focuses on the implementation of GenAI enabled HDT over mobile networks, i.e., mobile GenAI-driven HDT, that particularly addresses human-centric applications, demanding customized service, user-friendly experience, context-aware response and seamless integration, while suffering from uncertain user mobility, time-varying internal/external factors, unstable end-to-end network performance, etc. We begin by elaborating the core requirements of human-centric applications, and then envision the potential of utilizing mobile GenAI-driven HDT. Following this, we delve into the fundamentals of mobile GenAI-driven HDT by discussing both GenAI and HDT in detail, and exploring how GenAI-driven HDT can be implemented under the end-edge-cloud collaborative framework over mobile networks. After that, we introduce several typical human-centric applications that may be well supported by mobile GenAI-driven HDT, including healthcare, manufacturing and intelligent transportation. Moreover, we analyze and review in-depth the technical issues and promising solutions for the realization of mobile GenAI-driven HDT, focusing on the large model deployment, personalized model evolution and immersive interactions over mobile networks. Finally, we conclude this survey by highlighting some open issues and future research directions.
- 30 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessGenerative AI over Mobile Networks for Human Digital Twin in Human-Centric Applications: A Comprehensive Survey
Generative artificial intelligence (GenAI) is a powerful technology that can leverage advanced AI algorithms to automatically create, manipulate, and modify valuable while diverse data. GenAI has recently attracted phenomenal attentions and can serve as a key supplement for empowering the other techniques, e.g., the emerging human digital twin (HDT) that requires high-fidelity virtual modeling and strong information interactions but possibly with scarce, biased and noisy data. This survey focuses on the implementation of GenAI enabled HDT over mobile networks, i.e., mobile GenAI-driven HDT, that particularly addresses human-centric applications, demanding customized service, user-friendly experience, context-aware response and seamless integration, while suffering from uncertain user mobility, time-varying internal/external factors, unstable end-to-end network performance, etc. We begin by elaborating the core requirements of human-centric applications, and then envision the potential of utilizing mobile GenAI-driven HDT. Following this, we delve into the fundamentals of mobile GenAI-driven HDT by discussing both GenAI and HDT in detail, and exploring how GenAI-driven HDT can be implemented under the end-edge-cloud collaborative framework over mobile networks. After that, we introduce several typical human-centric applications that may be well supported by mobile GenAI-driven HDT, including healthcare, manufacturing and intelligent transportation. Moreover, we analyze and review in-depth the technical issues and promising solutions for the realization of mobile GenAI-driven HDT, focusing on the large model deployment, personalized model evolution and immersive interactions over mobile networks. Finally, we conclude this survey by highlighting some open issues and future research directions.