Jianli Pan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Jianli Pan has a total of 30 co-authors. Here are the top co-authors by number of shared publications:
- Ismail AlQerm
CEMSE Division, King Abdullah University of Science and Technology, Saudi Arabia
7 shared publications - Yuanni Liu
School of Cyber Security and Information Law, Chongqing University of Posts and Telecommunications, Chongqing, China
4 shared publications Austin Hester
Department of Mathematics and Computer Science in University of Missouri, St. Louis, MO 63121, USA
2 shared publicationsJianyu Wang
University of Missouri, USA
2 shared publications- Jianyu Wang
Department of Computer Science, University of Missouri-St. Louis, St. Louis, MO, USA
2 shared publications - Nuo Cheng
Information Sciences and Technology, George Mason University
2 shared publications
Latest Publications
- 5 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 13 (2) , 1988-2005
REPA: Resilient and Proactive Resource Allocation for Last-Mile Heterogeneous Edge-IoT Systems
The emerging heterogeneous Edge-IoT systems are supporting various essential and critical applications in public safety, transportation, education, and health. The reliability and resiliency of such systems are crucial given the varied demands of IoT applications and the potential for edge failure. This paper tackles two key Edge-IoT resiliency challenges: i) how to cushion the impact of sudden workload increase and allow graceful performance degradation for heterogeneous applications; ii) how to better prepare for and handle severe disruptions to avoid significant application performance loss. These are complicated challenges due to limited edge resources, heterogeneity of IoT applications, and the dynamicity of the Edge-IoT environment. Therefore, we develop a novel intelligent resource allocation framework named REPA that is application-centric to enable proactive resiliency and offer graceful degradation of IoT applications. The new framework: 1) proactively cushions and absorbs the disruptive impacts of edge workload increases, and provides graceful application degradation in moderate to severe edge system loads, across multiple Edge-IoT systems; 2) features a two-level optimization model that jointly optimizes the intra-zone and inter-zone edge resource allocation such that the application’s performance degradation and service disruption are minimized; 3) includes novel deep reinforcement learning (DRL) designs for resource allocation that are specialized for the complex Edge-IoT environment and provide faster and stable decision-making capabilities than the existing methods. Performance evaluation demonstrates the ability of REPA to maintain the best performance of the IoT applications regardless of disruptive situations.
- 5 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 13 (2) , 1988-2005
REPA: Resilient and Proactive Resource Allocation for Last-Mile Heterogeneous Edge-IoT Systems
The emerging heterogeneous Edge-IoT systems are supporting various essential and critical applications in public safety, transportation, education, and health. The reliability and resiliency of such systems are crucial given the varied demands of IoT applications and the potential for edge failure. This paper tackles two key Edge-IoT resiliency challenges: i) how to cushion the impact of sudden workload increase and allow graceful performance degradation for heterogeneous applications; ii) how to better prepare for and handle severe disruptions to avoid significant application performance loss. These are complicated challenges due to limited edge resources, heterogeneity of IoT applications, and the dynamicity of the Edge-IoT environment. Therefore, we develop a novel intelligent resource allocation framework named REPA that is application-centric to enable proactive resiliency and offer graceful degradation of IoT applications. The new framework: 1) proactively cushions and absorbs the disruptive impacts of edge workload increases, and provides graceful application degradation in moderate to severe edge system loads, across multiple Edge-IoT systems; 2) features a two-level optimization model that jointly optimizes the intra-zone and inter-zone edge resource allocation such that the application’s performance degradation and service disruption are minimized; 3) includes novel deep reinforcement learning (DRL) designs for resource allocation that are specialized for the complex Edge-IoT environment and provide faster and stable decision-making capabilities than the existing methods. Performance evaluation demonstrates the ability of REPA to maintain the best performance of the IoT applications regardless of disruptive situations.
- Top Cited PapersOpen Access
- 8 September 2025
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 58 (2) , 1-37
Future UAV/Drone Systems for Intelligent Active Surveillance and Monitoring
The rapid development of the Internet of Things (IoT) has fueled the widespread adoption of Unmanned Aerial Vehicles (UAVs) or drones across various fields, including their use in applications such as surveillance and monitoring. UAVs flight capabilities allow it to effortlessly access previously inaccessible locations, providing real-time, high-resolution data—images and videos—of any desired area or target. Furthermore, the growth of Artificial Intelligence (AI), and edge computing technologies has empowered UAVs with high computational capabilities, making them suitable for diverse applications such as agriculture, transportation and border security. These technology advancements also equip UAVs with powerful on-board processing for sophisticated decision-making that enhances UAV activeness and intelligence. This survey explores the promising areas of UAVs for intelligent active surveillance and monitoring across diverse applications. First, the various levels of UAV activeness within applications are discussed; second, prior research is examined to identify the key technologies and architectures that power intelligent UAV systems; and third, several UAV applications in surveillance and monitoring, ranging from basic tasks to highly intelligent operations are explored. Finally, the survey concludes by discussing emerging research challenges and outlines a guiding road map for future research of highly interdisciplinary and emerging areas in UAV-based systems for surveillance and monitoring.
- 8 September 2025
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 58 (2) , 1-37
Top Cited PapersOpen AccessFuture UAV/Drone Systems for Intelligent Active Surveillance and Monitoring
The rapid development of the Internet of Things (IoT) has fueled the widespread adoption of Unmanned Aerial Vehicles (UAVs) or drones across various fields, including their use in applications such as surveillance and monitoring. UAVs flight capabilities allow it to effortlessly access previously inaccessible locations, providing real-time, high-resolution data—images and videos—of any desired area or target. Furthermore, the growth of Artificial Intelligence (AI), and edge computing technologies has empowered UAVs with high computational capabilities, making them suitable for diverse applications such as agriculture, transportation and border security. These technology advancements also equip UAVs with powerful on-board processing for sophisticated decision-making that enhances UAV activeness and intelligence. This survey explores the promising areas of UAVs for intelligent active surveillance and monitoring across diverse applications. First, the various levels of UAV activeness within applications are discussed; second, prior research is examined to identify the key technologies and architectures that power intelligent UAV systems; and third, several UAV applications in surveillance and monitoring, ranging from basic tasks to highly intelligent operations are explored. Finally, the survey concludes by discussing emerging research challenges and outlines a guiding road map for future research of highly interdisciplinary and emerging areas in UAV-based systems for surveillance and monitoring.
- Open Access
- 6 May 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
PREUS: Proactive and Robust Edge-UAV Systems for Autonomous Monitoring in Dynamic Environments
Edge computing and artificial intelligence can potentially empower Unmanned Aerial Vehicle (UAV) systems with automated decision-making and resource support for monitoring in future science tasks such as emergency response, search and rescue, inspections, and wildfires. However, it is challenging to achieve autonomous and robust monitoring in such systems, given the dynamic environmental situations and the limited capabilities and the unbalanced load of the UAVs. For instance, the monitoring activity levels at different locations might vary, which leads to an unbalanced monitoring load for the corresponding UAVs. Moreover, the UAVs require regular recharging/maintenance and can have malfunctions that will disrupt the monitoring task. In this paper, we develop a novel proactive and robust Edge-UAV framework named PREUS to enable autonomous and efficient monitoring of dynamic environments when faced with dynamic environment situations and various UAV workload stresses that can jeopardize the monitoring performance. PREUS features a unique design to handle the varying UAV workload stress of the monitored area. It incorporates novel spatial, temporal, and proactive exploration vs. exploitation planning to balance the UAVs’ workloads in various locations with fluctuating activities. In addition, PREUS includes novel deep reinforcement learning (DRL) design specialized to maximize coverage in the complex environments and provides faster and stabler decision-making capabilities than the existing methods. The positive impact brought by PREUS is demonstrated in terms of the achieved monitoring performance, including coverage and balanced UAV load.
- 6 May 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
Open AccessPREUS: Proactive and Robust Edge-UAV Systems for Autonomous Monitoring in Dynamic Environments
Edge computing and artificial intelligence can potentially empower Unmanned Aerial Vehicle (UAV) systems with automated decision-making and resource support for monitoring in future science tasks such as emergency response, search and rescue, inspections, and wildfires. However, it is challenging to achieve autonomous and robust monitoring in such systems, given the dynamic environmental situations and the limited capabilities and the unbalanced load of the UAVs. For instance, the monitoring activity levels at different locations might vary, which leads to an unbalanced monitoring load for the corresponding UAVs. Moreover, the UAVs require regular recharging/maintenance and can have malfunctions that will disrupt the monitoring task. In this paper, we develop a novel proactive and robust Edge-UAV framework named PREUS to enable autonomous and efficient monitoring of dynamic environments when faced with dynamic environment situations and various UAV workload stresses that can jeopardize the monitoring performance. PREUS features a unique design to handle the varying UAV workload stress of the monitored area. It incorporates novel spatial, temporal, and proactive exploration vs. exploitation planning to balance the UAVs’ workloads in various locations with fluctuating activities. In addition, PREUS includes novel deep reinforcement learning (DRL) design specialized to maximize coverage in the complex environments and provides faster and stabler decision-making capabilities than the existing methods. The positive impact brought by PREUS is demonstrated in terms of the achieved monitoring performance, including coverage and balanced UAV load.
- 16 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (5) , 3954-3967
I-HARF: Intelligent and Hierarchical Framework for Adaptive Resource Facilitation in Edge-IoT Systems
Edge computing is being used to facilitate closer computing, storage and networking resources to support various IoT applications including delay-sensitive ones. It is envisioned that the future Edge-IoT systems will incorporate heterogeneous IoT devices distributed over multiple geographical zones of certain institution with edge resource demands that vary according to time and location. Edge servers (resource facilitators) are with limited resources and are susceptible to “outlandish” situations such as service overloading, outage, and external attacks; they may also have to handle the roaming of IoT devices among different zones. These situations induce the need for alternative edge servers using an adaptive resource facilitation scheme to fulfill the demands of the IoT applications. In this paper, we develop a novel intelligent and hierarchical resource facilitation framework named I-HARF that adapts to dynamic Edge-IoT situations including outlandish situations, mobility, application’s sensitivity and varying resource demand of IoT applications based on time and location. I-HARF achieves an adaptive facilitation and holistically addresses the facilitation technical barriers by: 1) adopting hierarchical structure which efficiently migrates the resource facilitation from intra-zone to inter-zone levels; 2) extending novel intra-zone and inter-zone optimization models to boost the utilities of the edge servers and the IoT applications; and 3) developing a novel and unique actor dual-critic and collective actor-critic Deep Reinforcement Learning (DRL) designs that intelligently facilitate the edge resources in both intra-zone and inter-zone respectively. The evaluation results demonstrate I-HARF’s capability enabling adaptive resource facilitation that adjusts according to the dynamic Edge-IoT situations.
- 16 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (5) , 3954-3967
I-HARF: Intelligent and Hierarchical Framework for Adaptive Resource Facilitation in Edge-IoT Systems
Edge computing is being used to facilitate closer computing, storage and networking resources to support various IoT applications including delay-sensitive ones. It is envisioned that the future Edge-IoT systems will incorporate heterogeneous IoT devices distributed over multiple geographical zones of certain institution with edge resource demands that vary according to time and location. Edge servers (resource facilitators) are with limited resources and are susceptible to “outlandish” situations such as service overloading, outage, and external attacks; they may also have to handle the roaming of IoT devices among different zones. These situations induce the need for alternative edge servers using an adaptive resource facilitation scheme to fulfill the demands of the IoT applications. In this paper, we develop a novel intelligent and hierarchical resource facilitation framework named I-HARF that adapts to dynamic Edge-IoT situations including outlandish situations, mobility, application’s sensitivity and varying resource demand of IoT applications based on time and location. I-HARF achieves an adaptive facilitation and holistically addresses the facilitation technical barriers by: 1) adopting hierarchical structure which efficiently migrates the resource facilitation from intra-zone to inter-zone levels; 2) extending novel intra-zone and inter-zone optimization models to boost the utilities of the edge servers and the IoT applications; and 3) developing a novel and unique actor dual-critic and collective actor-critic Deep Reinforcement Learning (DRL) designs that intelligently facilitate the edge resources in both intra-zone and inter-zone respectively. The evaluation results demonstrate I-HARF’s capability enabling adaptive resource facilitation that adjusts according to the dynamic Edge-IoT situations.
- 29 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 18 (4) , 3942-3954
DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications
Edge computing is emerging to empower the future of Internet of Things (IoT) applications. However, due to heterogeneity of applications, it is a significant challenge for the edge cloud to effectively allocate multidimensional limited resources (CPU, memory, storage, bandwidth, etc.) with constraints of applications’ Quality of Service (QoS) requirements. In this paper, we address the resource allocation problem in Edge-IoT systems through developing a novel framework named DeepEdge that allocates resources to the heterogeneous IoT applications with the goal of maximizing users’ Quality of Experience (QoE). To achieve this goal, we develop a novel QoE model that considers aligning the heterogeneous requirements of IoT applications to the available edge resources. The alignment is achieved through selection of QoS requirement range that can be satisfied by the available resources. In addition, we propose a novel two-stage deep reinforcement learning (DRL) scheme that effectively allocates edge resources to serve the IoT applications and maximize the users’ QoE. Unlike the typical DRL, our scheme exploits deep neural networks (DNN) to improve actions’ exploration by using DNN to map the Edge-IoT state to joint resource allocation action that consists of resource allocation and QoS class. The joint action not only maximize users’ QoE and satisfies heterogeneous applications’ requirements but also align the QoS requirements to the available resources. In addition, we develop a Q-value approximation approach to tackle the large space problem of Edge-IoT. Further evaluation shows that DeepEdge brings considerable improvements in terms of QoE, latency and application tasks’ success ratio in comparison to the existing resource allocation schemes.
- 29 October 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 18 (4) , 3942-3954
DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications
Edge computing is emerging to empower the future of Internet of Things (IoT) applications. However, due to heterogeneity of applications, it is a significant challenge for the edge cloud to effectively allocate multidimensional limited resources (CPU, memory, storage, bandwidth, etc.) with constraints of applications’ Quality of Service (QoS) requirements. In this paper, we address the resource allocation problem in Edge-IoT systems through developing a novel framework named DeepEdge that allocates resources to the heterogeneous IoT applications with the goal of maximizing users’ Quality of Experience (QoE). To achieve this goal, we develop a novel QoE model that considers aligning the heterogeneous requirements of IoT applications to the available edge resources. The alignment is achieved through selection of QoS requirement range that can be satisfied by the available resources. In addition, we propose a novel two-stage deep reinforcement learning (DRL) scheme that effectively allocates edge resources to serve the IoT applications and maximize the users’ QoE. Unlike the typical DRL, our scheme exploits deep neural networks (DNN) to improve actions’ exploration by using DNN to map the Edge-IoT state to joint resource allocation action that consists of resource allocation and QoS class. The joint action not only maximize users’ QoE and satisfies heterogeneous applications’ requirements but also align the QoS requirements to the available resources. In addition, we develop a Q-value approximation approach to tackle the large space problem of Edge-IoT. Further evaluation shows that DeepEdge brings considerable improvements in terms of QoE, latency and application tasks’ success ratio in comparison to the existing resource allocation schemes.
- 3 May 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 59 (3) , 45-51
ORCA: Enabling an Owner-Centric and Data-Driven Management Paradigm for Future Heterogeneous Edge-IoT Systems
Integrating the Internet of Things (IoT) and edge computing in Edge-IoT systems, converged with machine intelligence, has the potential to enable a wide range of applications in smart homes, factories, and cities. Edge-IoT can connect many diverse devices, and IoT asset owners can run heterogeneous IoT systems supported by various vendors or service providers (SPs), using either cloud or local edge computing (or both) for resource assistance. The existing methods typically manage the systems as separate vertical silos, or in a vendor-/SP-centric way, which suffers from significant challenges. In this article, we present a novel owner-centric management paradigm named ORCA to address the gaps left by the owner-centric paradigm and empower IoT asset owners to effectively identify and mitigate potential issues in their own network premises, regardless of vendors'/SPs' situations. ORCA aims to be scalable and extensible in assisting IoT owners to perform intelligent management through a behavior-oriented and data-driven approach. ORCA is an ongoing project, and the preliminary results indicate that it can significantly empower IoT system owners to better manage their IoT assets.
- 3 May 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 59 (3) , 45-51
ORCA: Enabling an Owner-Centric and Data-Driven Management Paradigm for Future Heterogeneous Edge-IoT Systems
Integrating the Internet of Things (IoT) and edge computing in Edge-IoT systems, converged with machine intelligence, has the potential to enable a wide range of applications in smart homes, factories, and cities. Edge-IoT can connect many diverse devices, and IoT asset owners can run heterogeneous IoT systems supported by various vendors or service providers (SPs), using either cloud or local edge computing (or both) for resource assistance. The existing methods typically manage the systems as separate vertical silos, or in a vendor-/SP-centric way, which suffers from significant challenges. In this article, we present a novel owner-centric management paradigm named ORCA to address the gaps left by the owner-centric paradigm and empower IoT asset owners to effectively identify and mitigate potential issues in their own network premises, regardless of vendors'/SPs' situations. ORCA aims to be scalable and extensible in assisting IoT owners to perform intelligent management through a behavior-oriented and data-driven approach. ORCA is an ongoing project, and the preliminary results indicate that it can significantly empower IoT system owners to better manage their IoT assets.
- 24 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 21 (15361233) , 1
BEHAVE: Behavior-Aware, Intelligent, and Fair Resource Management for Heterogeneous Edge-IoT Systems
Edge computing is an emerging solution to support the future Internet of Things (IoT) applications that are delay-sensitive, processing-intensive or that require closer intelligence. Machine intelligence and data-driven approaches are envisioned to build future Edge-IoT systems that satisfy IoT devices’ demands for edge resources. However, significant challenges and technical barriers exist which complicate the resource management for such Edge-IoT systems. IoT devices running various applications can demonstrate a wide range of behaviors in the devices’ resource demand that are extremely difficult to manage. In addition, the management of multidimensional resources fairly and efficiently by the edge in such a setting is a challenging task. In this paper, we develop a novel data-driven resource management framework named BEHAVE that intelligently and fairly allocates edge resources to heterogeneous IoT devices with consideration of their behavior of resource demand (BRD). BEHAVE aims to holistically address the management technical barriers by: 1) building an efficient scheme for modeling and assessment of the BRD of IoT devices based on their resource requests and resource usage; 2) expanding a new Rational, Fair, and Truthful Resource Allocation (RFTA) model that binds the devices’ BRD and resource allocation to achieve fair allocation and encourage truthfulness in resource demand; and 3) developing an enhanced deep reinforcement learning (EDRL) scheme to achieve the RFTA goals. The evaluation results demonstrate BEHAVE 's capability to analyze the IoT devices’ BRD and adjust its resource management policy accordingly.
- 24 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 21 (15361233) , 1
BEHAVE: Behavior-Aware, Intelligent, and Fair Resource Management for Heterogeneous Edge-IoT Systems
Edge computing is an emerging solution to support the future Internet of Things (IoT) applications that are delay-sensitive, processing-intensive or that require closer intelligence. Machine intelligence and data-driven approaches are envisioned to build future Edge-IoT systems that satisfy IoT devices’ demands for edge resources. However, significant challenges and technical barriers exist which complicate the resource management for such Edge-IoT systems. IoT devices running various applications can demonstrate a wide range of behaviors in the devices’ resource demand that are extremely difficult to manage. In addition, the management of multidimensional resources fairly and efficiently by the edge in such a setting is a challenging task. In this paper, we develop a novel data-driven resource management framework named BEHAVE that intelligently and fairly allocates edge resources to heterogeneous IoT devices with consideration of their behavior of resource demand (BRD). BEHAVE aims to holistically address the management technical barriers by: 1) building an efficient scheme for modeling and assessment of the BRD of IoT devices based on their resource requests and resource usage; 2) expanding a new Rational, Fair, and Truthful Resource Allocation (RFTA) model that binds the devices’ BRD and resource allocation to achieve fair allocation and encourage truthfulness in resource demand; and 3) developing an enhanced deep reinforcement learning (EDRL) scheme to achieve the RFTA goals. The evaluation results demonstrate BEHAVE 's capability to analyze the IoT devices’ BRD and adjust its resource management policy accordingly.
- 23 February 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 8 (15) , 12231-12241
An Intelligent Edge-Chain-Enabled Access Control Mechanism for IoV
The current security method of Internet-of-Vehicles (IoV) systems is rare, which makes it vulnerable to various attacks. The malicious and unauthorized nodes can easily invade the IoV systems to destroy the integrity, availability, and confidentiality of information resources shared among vehicles. Indeed, access control mechanism can remedy this. However, as a static method, it cannot timely response to these attacks. To solve this problem, we propose an intelligent edge-chain-enabled access control framework with vehicle nodes and roadside units (RSUs) in this study. In our scenario, vehicle nodes act as lightweight nodes, whereas RUSs serve as full and edge nodes to provide access control services. Considering the low accuracy of risk prediction due to limited training sets, we leverage a generative adversarial networks (GANs) to convert the risk prediction to a sequence generation. Moreover, aiming at the problems of gradient disappearance and mode collapse existed in the original GANs, we devise a Wasserstein combined GANs (WCGANs). Simulation results demonstrate that WCGAN has higher prediction accuracy than the original GANs. Additionally, it can also improve the accuracy of access control of risk prediction-based access control (RPBAC) model.
- 23 February 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 8 (15) , 12231-12241
An Intelligent Edge-Chain-Enabled Access Control Mechanism for IoV
The current security method of Internet-of-Vehicles (IoV) systems is rare, which makes it vulnerable to various attacks. The malicious and unauthorized nodes can easily invade the IoV systems to destroy the integrity, availability, and confidentiality of information resources shared among vehicles. Indeed, access control mechanism can remedy this. However, as a static method, it cannot timely response to these attacks. To solve this problem, we propose an intelligent edge-chain-enabled access control framework with vehicle nodes and roadside units (RSUs) in this study. In our scenario, vehicle nodes act as lightweight nodes, whereas RUSs serve as full and edge nodes to provide access control services. Considering the low accuracy of risk prediction due to limited training sets, we leverage a generative adversarial networks (GANs) to convert the risk prediction to a sequence generation. Moreover, aiming at the problems of gradient disappearance and mode collapse existed in the original GANs, we devise a Wasserstein combined GANs (WCGANs). Simulation results demonstrate that WCGAN has higher prediction accuracy than the original GANs. Additionally, it can also improve the accuracy of access control of risk prediction-based access control (RPBAC) model.
- 11 August 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 7 (4) , 3074-3086
Enhanced Online Q-Learning Scheme for Resource Allocation with Maximum Utility and Fairness in Edge-IoT Networks
Internet of Things (IoT) is experiencing an explosion in the data traffic due to the increase in the number of heterogeneous applications. The existing cloud computing models will not be capable to support the IoT applications that are delay-sensitive and using high bandwidth. The Edge-IoT systems represented by shared edge clouds support a wide range of IoT applications. Edge clouds provide resources closer to the IoT devices to tackle the delay sensitivity and bandwidth issues. However, the allocation of these resources with guaranteed application's utility in the context of Edge-IoT with multiple heterogeneous IoT applications, various resource demands, and limited resource availability is challenging. In this paper, we propose a novel enhanced online Q-learning scheme to allocate resources from edge clouds to IoT applications to maximize their utility and maintain allocation fairness them. To achieve these goals, the developed scheme is characterized by a high convergence rate and requires less computation through approximation of Q-value. It is implemented using two settings: centralized through a dedicated controller at the edge cloud and decentralized where each edge server plays the role of a learning agent. Extensive numerical results demonstrate the capability of the proposed scheme in improving applications' utilities and allocation fairness.
- 11 August 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 7 (4) , 3074-3086
Enhanced Online Q-Learning Scheme for Resource Allocation with Maximum Utility and Fairness in Edge-IoT Networks
Internet of Things (IoT) is experiencing an explosion in the data traffic due to the increase in the number of heterogeneous applications. The existing cloud computing models will not be capable to support the IoT applications that are delay-sensitive and using high bandwidth. The Edge-IoT systems represented by shared edge clouds support a wide range of IoT applications. Edge clouds provide resources closer to the IoT devices to tackle the delay sensitivity and bandwidth issues. However, the allocation of these resources with guaranteed application's utility in the context of Edge-IoT with multiple heterogeneous IoT applications, various resource demands, and limited resource availability is challenging. In this paper, we propose a novel enhanced online Q-learning scheme to allocate resources from edge clouds to IoT applications to maximize their utility and maintain allocation fairness them. To achieve these goals, the developed scheme is characterized by a high convergence rate and requires less computation through approximation of Q-value. It is implemented using two settings: centralized through a dedicated controller at the edge cloud and decentralized where each edge server plays the role of a learning agent. Extensive numerical results demonstrate the capability of the proposed scheme in improving applications' utilities and allocation fairness.
- Top Cited Papers
- 26 October 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 6 (3) , 4719-4732
EdgeChain: An Edge-IoT Framework and Prototype Based on Blockchain and Smart Contracts
The emerging Internet of Things (IoT) is facing significant scalability and security challenges. On one hand, IoT devices are “weak” and need external assistance. Edge computing provides a promising direction addressing the deficiency of centralized cloud computing in scaling massive number of devices. On the other hand, IoT devices are also relatively “vulnerable” facing malicious hackers due to resource constraints. The emerging blockchain and smart contracts technologies bring a series of new security features for IoT and edge computing. In this paper, to address the challenges, we design and prototype an edge-IoT framework named “EdgeChain” based on blockchain and smart contracts. The core idea is to integrate a permissioned blockchain and the internal currency or “coin” system to link the edge cloud resource pool with each IoT device’ account and resource usage, and hence behavior of the IoT devices. EdgeChain uses a credit-based resource management system to control how much resource IoT devices can obtain from edge servers, based on pre-defined rules on priority, application types and past behaviors. Smart contracts are used to enforce the rules and policies to regulate the IoT device behavior in a non-deniable and automated manner. All the IoT activities and transactions are recorded into blockchain for secure data logging and auditing. We implement an EdgeChain prototype and conduct extensive experiments to evaluate the ideas. The results show that while gaining the security benefits of blockchain and smart contracts, the cost of integrating them into EdgeChain is within a reasonable and acceptable range.
- 26 October 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 6 (3) , 4719-4732
Top Cited PapersEdgeChain: An Edge-IoT Framework and Prototype Based on Blockchain and Smart Contracts
The emerging Internet of Things (IoT) is facing significant scalability and security challenges. On one hand, IoT devices are “weak” and need external assistance. Edge computing provides a promising direction addressing the deficiency of centralized cloud computing in scaling massive number of devices. On the other hand, IoT devices are also relatively “vulnerable” facing malicious hackers due to resource constraints. The emerging blockchain and smart contracts technologies bring a series of new security features for IoT and edge computing. In this paper, to address the challenges, we design and prototype an edge-IoT framework named “EdgeChain” based on blockchain and smart contracts. The core idea is to integrate a permissioned blockchain and the internal currency or “coin” system to link the edge cloud resource pool with each IoT device’ account and resource usage, and hence behavior of the IoT devices. EdgeChain uses a credit-based resource management system to control how much resource IoT devices can obtain from edge servers, based on pre-defined rules on priority, application types and past behaviors. Smart contracts are used to enforce the rules and policies to regulate the IoT device behavior in a non-deniable and automated manner. All the IoT activities and transactions are recorded into blockchain for secure data logging and auditing. We implement an EdgeChain prototype and conduct extensive experiments to evaluate the ideas. The results show that while gaining the security benefits of blockchain and smart contracts, the cost of integrating them into EdgeChain is within a reasonable and acceptable range.