Shaofei Tang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Shaofei Tang has a total of 25 co-authors. Here are the top co-authors by number of shared publications:
- Zuqing Zhu
University of Science and Technology of China, Hefei, China
8 shared publications Bin Niu
2 shared publications- Jiawei Kong
Department of Electrical Engineering and Information Science, University of Science and Technology of China, Hefei, Anhui China
2 shared publications - Qitao Zheng
School of Information Science and Technology, University of Science and Technology of China, Hefei, Anhui, China
2 shared publications Sicheng Zhao
School of Information Science and Technology, University of Science and Technology of China, Hefei, China
2 shared publications- Siqi Liu
Department of Electrical Engineering and Information Science, University of Science and Technology of China, Hefei, Anhui China
2 shared publications
Latest Publications
- 8 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 20 (4) , 4047-4060
On Orchestration of Segment Routing and In-Band Network Telemetry
With the rapid development of programmable data plane (PDP), both segment routing (SR) and in-band network telemetry (INT) have attracted intensive interests. Hence, we have previously proposed the technique of SR-INT, which explores the benefits of SR and INT simultaneously and gets rid of the hassle of the accumulated overheads of them. In this work, we further expand the advantage of SR-INT by studying how to plan the SR-INT schemes of flows at the network level to balance the tradeoff between bandwidth usage and coverage of network monitoring, namely, the problem of “SR-INT orchestration". A mixed integer linear programming model (MILP) is first formulated for the problem, and we prove its NP-hardness. Then, to reduce the time complexity of problem-solving, we propose a novel greedy algorithm based on path ranking and a column generation (CG) based approximation algorithm. Extensive simulations verify the performance of our proposed algorithms.
- 8 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 20 (4) , 4047-4060
On Orchestration of Segment Routing and In-Band Network Telemetry
With the rapid development of programmable data plane (PDP), both segment routing (SR) and in-band network telemetry (INT) have attracted intensive interests. Hence, we have previously proposed the technique of SR-INT, which explores the benefits of SR and INT simultaneously and gets rid of the hassle of the accumulated overheads of them. In this work, we further expand the advantage of SR-INT by studying how to plan the SR-INT schemes of flows at the network level to balance the tradeoff between bandwidth usage and coverage of network monitoring, namely, the problem of “SR-INT orchestration". A mixed integer linear programming model (MILP) is first formulated for the problem, and we prove its NP-hardness. Then, to reduce the time complexity of problem-solving, we propose a novel greedy algorithm based on path ranking and a column generation (CG) based approximation algorithm. Extensive simulations verify the performance of our proposed algorithms.
- 29 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Networking
- Vol. 31 (1) , 421-435
How to Use In-Band Network Telemetry Wisely: Network-Wise Orchestration of Sel-INT
As a promising network monitoring technique, in-band network telemetry (INT) helps to visualize networks in a fine-grained and real-time manner. Meanwhile, to address the overheads of INT, people have proposed a few selective INT (Sel-INT) approaches that only select a portion of packets in each flow to insert INT fields and distribute different types of INT fields over the selected packets. In this paper, we study how to use Sel-INT wisely in a network such that the tradeoff between monitoring accuracy/coverage and INT overheads can be balanced well. Specifically, we try to orchestrate the Sel-INT schemes of flows in both network-and flow-levels. For the network-level optimization, we model it as an INT planning problem in which the Sel-INT schemes of flows should be determined to maximize the information gain of INT as well as minimize the bandwidth overheads of INT. We formulate an integer linear programming (ILP) model to tackle the problem, prove its$\mathcal{NP}$ -hardness, and leverage Lagrangian relaxation to design a polynomial-time approximation algorithm for it. The flow-level optimization considers a dynamic network environment, and we propose to combine deep learning (DL) based traffic prediction with Sel-INT, such that the Sel-INT scheme of each individual flow can be updated timely and adaptively. We implement the proposal in a small but real network testbed and experimentally demonstrate self-adaptive orchestration of Sel-INT with it.- 29 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Networking
- Vol. 31 (1) , 421-435
How to Use In-Band Network Telemetry Wisely: Network-Wise Orchestration of Sel-INT
As a promising network monitoring technique, in-band network telemetry (INT) helps to visualize networks in a fine-grained and real-time manner. Meanwhile, to address the overheads of INT, people have proposed a few selective INT (Sel-INT) approaches that only select a portion of packets in each flow to insert INT fields and distribute different types of INT fields over the selected packets. In this paper, we study how to use Sel-INT wisely in a network such that the tradeoff between monitoring accuracy/coverage and INT overheads can be balanced well. Specifically, we try to orchestrate the Sel-INT schemes of flows in both network-and flow-levels. For the network-level optimization, we model it as an INT planning problem in which the Sel-INT schemes of flows should be determined to maximize the information gain of INT as well as minimize the bandwidth overheads of INT. We formulate an integer linear programming (ILP) model to tackle the problem, prove its$\mathcal{NP}$ -hardness, and leverage Lagrangian relaxation to design a polynomial-time approximation algorithm for it. The flow-level optimization considers a dynamic network environment, and we propose to combine deep learning (DL) based traffic prediction with Sel-INT, such that the Sel-INT scheme of each individual flow can be updated timely and adaptively. We implement the proposal in a small but real network testbed and experimentally demonstrate self-adaptive orchestration of Sel-INT with it.- 7 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Quantum Electronics
- Vol. 28 (4) , 1-13
Entropy-Driven Adaptive INT and Its Applications in Network Automation of IP-Over-EONs
Recently, IP over elastic optical network (IP-over-EON) has become a promising architecture for metro and core networks. This work studies how to visualize both layers of an IP-over-EON in real time, at different granularities ( e.g. , at flow-level, lightpath-level, and link-level), and with self-adaptivity. Specifically, we consider the multilayer application of in-band telemetry (INT) and propose entropy-driven adaptive INT (namely, EntropyINT). We introduce stateful processing to programmable data plane (PDP) switches for EntropyINT, such that they can make local decisions to determine whether and what type of telemetry data about the IP and EON layers should be encoded in each packet. The local decisions are designed to be based on the amount of information that can be conveyed by telemetry data to the network automation system. Meanwhile, we make EntropyINT cooperate with out-of-band monitoring, to detect and locate exceptions in the EON layer. Our proposal is implemented in a real-world testbed of IP-over-EON, to evaluate its assistance to network automation. Experimental results verify the effectiveness of our proposal, and indicate that the telemetry data collected by EntropyINT and out-of-band monitoring can better assist the machine learning in network automation, for status prediction and anomaly detection.
- 7 March 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Quantum Electronics
- Vol. 28 (4) , 1-13
Entropy-Driven Adaptive INT and Its Applications in Network Automation of IP-Over-EONs
Recently, IP over elastic optical network (IP-over-EON) has become a promising architecture for metro and core networks. This work studies how to visualize both layers of an IP-over-EON in real time, at different granularities ( e.g. , at flow-level, lightpath-level, and link-level), and with self-adaptivity. Specifically, we consider the multilayer application of in-band telemetry (INT) and propose entropy-driven adaptive INT (namely, EntropyINT). We introduce stateful processing to programmable data plane (PDP) switches for EntropyINT, such that they can make local decisions to determine whether and what type of telemetry data about the IP and EON layers should be encoded in each packet. The local decisions are designed to be based on the amount of information that can be conveyed by telemetry data to the network automation system. Meanwhile, we make EntropyINT cooperate with out-of-band monitoring, to detect and locate exceptions in the EON layer. Our proposal is implemented in a real-world testbed of IP-over-EON, to evaluate its assistance to network automation. Experimental results verify the effectiveness of our proposal, and indicate that the telemetry data collected by EntropyINT and out-of-band monitoring can better assist the machine learning in network automation, for status prediction and anomaly detection.
- 18 June 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Lightwave Technology
- Vol. 39 (17) , 5371-5382
Scheduling Virtual Network Reconfigurations in Parallel in Hybrid Optical/Electrical Datacenter Networks
A hybrid optical/electrical datacenter network (HOE-DCN) integrates the benefits of electrical packet switching (EPS) and optical circuit switching (OCS) for better architectural scalability. Meanwhile, as each network service usually involves multiple virtual machines (VMs) that form a virtual network (VNT), how to reconfigure the VNTs in an HOE-DCN to adapt to the dynamic network environment becomes an interesting and important problem to tackle. In this work, we optimize the procedure of VNT reconfigurations that remap VNTs to given virtual network embedding (VNE) schemes, i.e. , scheduling the required VM migrations and optical cross-connect (OXC) reconfiguration properly such that the overall VNT reconfiguration latency can be minimized. We first assume that all the VM migrations should be scheduled before the OXC reconfiguration to minimize service interruptions, and formulate a mixed integer linear programming (MILP) model to solve the scheduling problem exactly. Then, with the same assumption, we propose a time-efficient heuristic to schedule parallel VM migrations in batches such that the bandwidth competition can be significantly relieved. Finally, we divide the OXC reconfiguration into several progressive steps, and design a joint scheduling algorithm to arrange VM migrations together with the OXC reconfiguration steps.
- 18 June 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Lightwave Technology
- Vol. 39 (17) , 5371-5382
Scheduling Virtual Network Reconfigurations in Parallel in Hybrid Optical/Electrical Datacenter Networks
A hybrid optical/electrical datacenter network (HOE-DCN) integrates the benefits of electrical packet switching (EPS) and optical circuit switching (OCS) for better architectural scalability. Meanwhile, as each network service usually involves multiple virtual machines (VMs) that form a virtual network (VNT), how to reconfigure the VNTs in an HOE-DCN to adapt to the dynamic network environment becomes an interesting and important problem to tackle. In this work, we optimize the procedure of VNT reconfigurations that remap VNTs to given virtual network embedding (VNE) schemes, i.e. , scheduling the required VM migrations and optical cross-connect (OXC) reconfiguration properly such that the overall VNT reconfiguration latency can be minimized. We first assume that all the VM migrations should be scheduled before the OXC reconfiguration to minimize service interruptions, and formulate a mixed integer linear programming (MILP) model to solve the scheduling problem exactly. Then, with the same assumption, we propose a time-efficient heuristic to schedule parallel VM migrations in batches such that the bandwidth competition can be significantly relieved. Finally, we divide the OXC reconfiguration into several progressive steps, and design a joint scheduling algorithm to arrange VM migrations together with the OXC reconfiguration steps.
- 26 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 18 (3) , 2587-2597
Highly-Efficient and Adaptive Network Monitoring: When INT Meets Segment Routing
The rapid development of software-defined networking (SDN) has promoted the idea of programmable data plane (PDP), which opens up unprecedented opportunities for realizing powerful and timely network monitoring. This work explores the advantages of PDP to merge two famous techniques (i.e., the segment routing (SR) and in-band network telemetry (INT)) seamlessly for highly-efficient and adaptive network monitoring. Specifically, by leveraging the protocol-oblivious forwarding (POF), we propose SR-INT, which time-multiplexes the header fields in each packet for INT and SR, and keeps packet length constant end-to-end even though both INT and SR are used. Hence, our proposal can enjoy the benefits of INT and SR, while avoiding the accumulated overheads due to simultaneous usage. We design the packet format of SR-INT, and lay out its packet processing procedure to guarantee that the configuration of SR-INT can be adjusted dynamically to adapt to the requirements of network monitoring. We implement and experimentally demonstrate SR-INT in a POF-based SDN environment. Our results show that SR-INT not only reduces the bandwidth overheads of using SR and INT simultaneously but also simplifies the operations in software-based POF switches.
- 26 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 18 (3) , 2587-2597
Highly-Efficient and Adaptive Network Monitoring: When INT Meets Segment Routing
The rapid development of software-defined networking (SDN) has promoted the idea of programmable data plane (PDP), which opens up unprecedented opportunities for realizing powerful and timely network monitoring. This work explores the advantages of PDP to merge two famous techniques (i.e., the segment routing (SR) and in-band network telemetry (INT)) seamlessly for highly-efficient and adaptive network monitoring. Specifically, by leveraging the protocol-oblivious forwarding (POF), we propose SR-INT, which time-multiplexes the header fields in each packet for INT and SR, and keeps packet length constant end-to-end even though both INT and SR are used. Hence, our proposal can enjoy the benefits of INT and SR, while avoiding the accumulated overheads due to simultaneous usage. We design the packet format of SR-INT, and lay out its packet processing procedure to guarantee that the configuration of SR-INT can be adjusted dynamically to adapt to the requirements of network monitoring. We implement and experimentally demonstrate SR-INT in a POF-based SDN environment. Our results show that SR-INT not only reduces the bandwidth overheads of using SR and INT simultaneously but also simplifies the operations in software-based POF switches.
- 7 July 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Lightwave Technology
- Vol. 38 (21) , 5855-5866
Privacy-Preserving Multilayer In-Band Network Telemetry and Data Analytics: For Safety, Please do Not Report Plaintext Data
With the evolution of Internet infrastructure and network services, multilayer in-band network telemetry (ML-INT) and data analytics (DA) have been considered as key enabling techniques to realize real-time and fine-grained network monitoring, especially for backbone IP-over-Optical networks. However, the existing ML-INT&DA systems have privacy and security issues, because plaintext ML-INT data is reported from the data plane and gets analyzed in the control plane. In this work, we address these issues by designing a privacy-preserving ML-INT&DA system for IP-over-Optical networks. We first leverage vector homomorphic encryption (VHE) to design a lightweight encryption scheme, which overcomes the security breaches due to eavesdropping and preserves the delicate correlations buried in multi-dimensional ML-INT data. Then, we develop an effective data compression scheme to further encode the encrypted ML-INT data and make the results suitable for hash-based signature. The signature is for data certification and enables the DA in the control plane to verify the integrity of received ML-INT data. Hence, the threats from data tampering are removed. Next, we architect a deep learning (DL) model that can directly operate on encrypted ML-INT data for anomaly detection. Finally, we implement the proposed ML-INT&DA system, and experimentally demonstrate its effectiveness in a real IP over elastic optical network (IP-over-EON) testbed, whose key elements, i.e., optical line system (OLS), bandwidth-variable wavelength-selective switches (BV-WSS') and programmable data plane (PDP) switches, are all commercial products.
- 7 July 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Lightwave Technology
- Vol. 38 (21) , 5855-5866
Privacy-Preserving Multilayer In-Band Network Telemetry and Data Analytics: For Safety, Please do Not Report Plaintext Data
With the evolution of Internet infrastructure and network services, multilayer in-band network telemetry (ML-INT) and data analytics (DA) have been considered as key enabling techniques to realize real-time and fine-grained network monitoring, especially for backbone IP-over-Optical networks. However, the existing ML-INT&DA systems have privacy and security issues, because plaintext ML-INT data is reported from the data plane and gets analyzed in the control plane. In this work, we address these issues by designing a privacy-preserving ML-INT&DA system for IP-over-Optical networks. We first leverage vector homomorphic encryption (VHE) to design a lightweight encryption scheme, which overcomes the security breaches due to eavesdropping and preserves the delicate correlations buried in multi-dimensional ML-INT data. Then, we develop an effective data compression scheme to further encode the encrypted ML-INT data and make the results suitable for hash-based signature. The signature is for data certification and enables the DA in the control plane to verify the integrity of received ML-INT data. Hence, the threats from data tampering are removed. Next, we architect a deep learning (DL) model that can directly operate on encrypted ML-INT data for anomaly detection. Finally, we implement the proposed ML-INT&DA system, and experimentally demonstrate its effectiveness in a real IP over elastic optical network (IP-over-EON) testbed, whose key elements, i.e., optical line system (OLS), bandwidth-variable wavelength-selective switches (BV-WSS') and programmable data plane (PDP) switches, are all commercial products.
- 1 January 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 58 (1) , 26-32
Programmable Multilayer INT: An Enabler for AI-Assisted Network Automation
- 1 January 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 58 (1) , 26-32
Programmable Multilayer INT: An Enabler for AI-Assisted Network Automation
- 13 November 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 17 (2) , 708-721
Sel-INT: A Runtime-Programmable Selective In-Band Network Telemetry System
It is known that by leveraging programmable data plane, in-band network telemetry (INT) can be realized to provide a powerful and promising method to collect realtime network statistics for monitoring and troubleshooting. However, existing INT implementations still exhibit a few drawbacks such as lack of runtime-programmability and relatively high overheads due to per-packet operation. In this work, we propose and design a runtime-programmable selective INT system, namely, Sel-INT, to resolve these issues. Specifically, we first design a runtime-programmable selective INT scheme based on protocol oblivious forwarding (POF), and then prototype our design by extending the famous OpenvSwitch (OVS) platform to obtain a software switch that supports Sel-INT and implementing a Data Analyzer to parse, extract and analyze the INT data. Our implementation of Sel-INT is verified and evaluated in a real network testbed that consists of a few stand-alone software switches. The experimental results demonstrate that Sel-INT can not only adjust the sampling rate of INT in runtime but also program the corresponding data types dynamically, and they also confirm that our proposal can ensure proper accuracy and timeliness for network monitoring while greatly reducing the overheads of INT.
- 13 November 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 17 (2) , 708-721
Sel-INT: A Runtime-Programmable Selective In-Band Network Telemetry System
It is known that by leveraging programmable data plane, in-band network telemetry (INT) can be realized to provide a powerful and promising method to collect realtime network statistics for monitoring and troubleshooting. However, existing INT implementations still exhibit a few drawbacks such as lack of runtime-programmability and relatively high overheads due to per-packet operation. In this work, we propose and design a runtime-programmable selective INT system, namely, Sel-INT, to resolve these issues. Specifically, we first design a runtime-programmable selective INT scheme based on protocol oblivious forwarding (POF), and then prototype our design by extending the famous OpenvSwitch (OVS) platform to obtain a software switch that supports Sel-INT and implementing a Data Analyzer to parse, extract and analyze the INT data. Our implementation of Sel-INT is verified and evaluated in a real network testbed that consists of a few stand-alone software switches. The experimental results demonstrate that Sel-INT can not only adjust the sampling rate of INT in runtime but also program the corresponding data types dynamically, and they also confirm that our proposal can ensure proper accuracy and timeliness for network monitoring while greatly reducing the overheads of INT.
- 27 June 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Lightwave Technology
- Vol. 37 (17) , 4426-4438
DL-Assisted Cross-Layer Orchestration in Software-Defined IP-Over-EONs: From Algorithm Design to System Prototype
Recently, with the development of IP and elastic optical networks (EONs), the network control and management (NC&M) scheme for IP-over-EONs, which can facilitate effective cross-layer orchestration (XLyr-O), has become an interesting but challenging research topic. In this paper, we consider a software-defined IP-over-EON (SD-IPoEON), leverage deep learning (DL) to analyze and predict the traffic fluctuation on established lightpaths in it, and design a proactive DL-assisted XLyr-O scheme. Specifically, we study the DL-assisted XLyr-O scheme from algorithm design to system prototype. A DL module based on the long/short-term memory based neural network (LSTM-NN) is first designed and optimized for precise IP traffic prediction. Then, we develop algorithms to explore the traffic prediction for realizing proactive XLyr-O to deal with hard/soft failures constantly, i.e., making intelligent on-line decisions to re-groom and reroute IP flows and to reconfigure lightpaths such that the performance tradeoff among lightpath utilization, congestion probability, and reconfiguration frequency is balanced well. Finally, we implement our proposed algorithm in a small-scale but real SD-IPoEON testbed to prototype the DL-assisted XLyr-O, and conduct experiments with it. Experimental results demonstrate that compared with the reactive benchmark without DL-assistance, our proposal not only invokes less network reconfigurations but also reduces packet losses significantly.
- 27 June 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Journal of Lightwave Technology
- Vol. 37 (17) , 4426-4438
DL-Assisted Cross-Layer Orchestration in Software-Defined IP-Over-EONs: From Algorithm Design to System Prototype
Recently, with the development of IP and elastic optical networks (EONs), the network control and management (NC&M) scheme for IP-over-EONs, which can facilitate effective cross-layer orchestration (XLyr-O), has become an interesting but challenging research topic. In this paper, we consider a software-defined IP-over-EON (SD-IPoEON), leverage deep learning (DL) to analyze and predict the traffic fluctuation on established lightpaths in it, and design a proactive DL-assisted XLyr-O scheme. Specifically, we study the DL-assisted XLyr-O scheme from algorithm design to system prototype. A DL module based on the long/short-term memory based neural network (LSTM-NN) is first designed and optimized for precise IP traffic prediction. Then, we develop algorithms to explore the traffic prediction for realizing proactive XLyr-O to deal with hard/soft failures constantly, i.e., making intelligent on-line decisions to re-groom and reroute IP flows and to reconfigure lightpaths such that the performance tradeoff among lightpath utilization, congestion probability, and reconfiguration frequency is balanced well. Finally, we implement our proposed algorithm in a small-scale but real SD-IPoEON testbed to prototype the DL-assisted XLyr-O, and conduct experiments with it. Experimental results demonstrate that compared with the reactive benchmark without DL-assistance, our proposal not only invokes less network reconfigurations but also reduces packet losses significantly.