Zhengyu Yang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Zhengyu Yang has a total of 65 co-authors. Here are the top co-authors by number of shared publications:
Ningfang Mi
Dept. of Electrical & Computer Engineering, Northeastern University, Boston, MA 02115
15 shared publicationsJanki Bhimani
Northeastern University
9 shared publicationsJiayin Wang
6 shared publications- Ningfang Mi
Northeastern University
6 shared publications - Xin Xie
Department of Electrical and Computer Engineering Northeastern University Boston USA
5 shared publications Bo Sheng
4 shared publications
Latest Publications
- 19 September 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 8 (2) , 332-345
I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership
Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffer from write amplification, which, if unaccounted, can substantially increase the TCO of a storage system. In this paper, we first develop a TCO model for datacenter all-flash storage systems, and then plug a Write Amplification model (WAF) of NVMe SSDs we build based on empirical data into this TCO model. Our new WAF model accounts for workload characteristics like write rate and percentage of sequential writes. Furthermore, using both the TCO and WAF models as the optimization criterion, we design new flash resource management schemes (MINTCO) to guide datacenter managers to make workload allocation decisions under the consideration of TCO for SSDs. Based on that, we also develop MINTCO-RAID to support RAID SSDs and MINTCO-OFFLINE to optimize the offline workload-disk deployment problem during the initialization phase. Experimental results show that MINTCO can reduce the TCO and keep relatively high throughput and space utilization of the entire datacenter storage resources.
- 19 September 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 8 (2) , 332-345
I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership
Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffer from write amplification, which, if unaccounted, can substantially increase the TCO of a storage system. In this paper, we first develop a TCO model for datacenter all-flash storage systems, and then plug a Write Amplification model (WAF) of NVMe SSDs we build based on empirical data into this TCO model. Our new WAF model accounts for workload characteristics like write rate and percentage of sequential writes. Furthermore, using both the TCO and WAF models as the optimization criterion, we design new flash resource management schemes (MINTCO) to guide datacenter managers to make workload allocation decisions under the consideration of TCO for SSDs. Based on that, we also develop MINTCO-RAID to support RAID SSDs and MINTCO-OFFLINE to optimize the offline workload-disk deployment problem during the initialization phase. Experimental results show that MINTCO can reduce the TCO and keep relatively high throughput and space utilization of the entire datacenter storage resources.
- 29 August 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 9 (2) , 696-709
New YARN Non-Exclusive Resource Management Scheme through Opportunistic Idle Resource Assignment
Efficiently managing resources and improving throughput in a large-scale cluster has become a crucial problem with the explosion of data processing applications in recent years. Hadoop YARN and Mesos, as two universal resource manage- ment platforms, have been widely adopted in the commodity cluster for co-deploying multiple data processing frameworks, such as Hadoop MapReduce and Apache Spark. However, in the existing resource management, a certain amount of resources are exclusively allocated to a running task and can only be re-assigned after that task is completed. This exclusive mode unfortunately leads to a potential problem that may under-utilize the cluster resources and degrade system performance. To address this issue, we propose a novel opportunistic and efficient resource allocation scheme, named O P ERA, which breaks the barriers among the encapsulated resource containers by leveraging the knowledge of actual runtime resource utilizations to re-assign opportunistic available resources to the pending tasks. O P ERA avoids incurring severe performance interference to active tasks by further using two approaches to efficiently balances the starvations of reserved tasks and normal queued tasks. We implement and evaluate O P ERA in Hadoop YARN v2.5.
- 29 August 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 9 (2) , 696-709
New YARN Non-Exclusive Resource Management Scheme through Opportunistic Idle Resource Assignment
Efficiently managing resources and improving throughput in a large-scale cluster has become a crucial problem with the explosion of data processing applications in recent years. Hadoop YARN and Mesos, as two universal resource manage- ment platforms, have been widely adopted in the commodity cluster for co-deploying multiple data processing frameworks, such as Hadoop MapReduce and Apache Spark. However, in the existing resource management, a certain amount of resources are exclusively allocated to a running task and can only be re-assigned after that task is completed. This exclusive mode unfortunately leads to a potential problem that may under-utilize the cluster resources and degrade system performance. To address this issue, we propose a novel opportunistic and efficient resource allocation scheme, named O P ERA, which breaks the barriers among the encapsulated resource containers by leveraging the knowledge of actual runtime resource utilizations to re-assign opportunistic available resources to the pending tasks. O P ERA avoids incurring severe performance interference to active tasks by further using two approaches to efficiently balances the starvations of reserved tasks and normal queued tasks. We implement and evaluate O P ERA in Hadoop YARN v2.5.
- Open Access
Intermediate Data Caching Optimization for Multi-Stage and Parallel Big Data Frameworks
In the era of big data and cloud computing, large amounts of data are generated from user applications and need to be processed in the datacenter. Data-parallel computing frameworks, such as Apache Spark, are widely used to perform such data processing at scale. Specifically, Spark leverages distributed memory to cache the intermediate results, represented as Resilient Distributed Datasets (RDDs). This gives Spark an advantage over other parallel frameworks for implementations of iterative machine learning and data mining algorithms, by avoiding repeated computation or hard disk accesses to retrieve RDDs. By default, caching decisions are left at the programmer's discretion, and the LRU policy is used for evicting RDDs when the cache is full. However, when the objective is to minimize total work, LRU is woefully inadequate, leading to arbitrarily suboptimal caching decisions. In this paper, we design an algorithm for multi-stage big data processing platforms to adaptively determine and cache the most valuable intermediate datasets that can be reused in the future. Our solution automates the decision of which RDDs to cache: this amounts to identifying nodes in a direct acyclic graph (DAG) representing computations whose outputs should persist in the memory. Our experiment results show that our proposed cache optimization solution can improve the performance of machine learning applications on Spark decreasing the total work to recompute RDDs by 12%.
Open AccessIntermediate Data Caching Optimization for Multi-Stage and Parallel Big Data Frameworks
In the era of big data and cloud computing, large amounts of data are generated from user applications and need to be processed in the datacenter. Data-parallel computing frameworks, such as Apache Spark, are widely used to perform such data processing at scale. Specifically, Spark leverages distributed memory to cache the intermediate results, represented as Resilient Distributed Datasets (RDDs). This gives Spark an advantage over other parallel frameworks for implementations of iterative machine learning and data mining algorithms, by avoiding repeated computation or hard disk accesses to retrieve RDDs. By default, caching decisions are left at the programmer's discretion, and the LRU policy is used for evicting RDDs when the cache is full. However, when the objective is to minimize total work, LRU is woefully inadequate, leading to arbitrarily suboptimal caching decisions. In this paper, we design an algorithm for multi-stage big data processing platforms to adaptively determine and cache the most valuable intermediate datasets that can be reused in the future. Our solution automates the decision of which RDDs to cache: this amounts to identifying nodes in a direct acyclic graph (DAG) representing computations whose outputs should persist in the memory. Our experiment results show that our proposed cache optimization solution can improve the performance of machine learning applications on Spark decreasing the total work to recompute RDDs by 12%.
- 11 March 2018
- Published by Scalable Computing: Practice and Experience in Scalable Computing: Practice and Experience
- Vol. 19 (1) , 53-68
AutoAdmin: Automatic and Dynamic Resource Reservation Admission Control in Hadoop YARN Clusters
- 11 March 2018
- Published by Scalable Computing: Practice and Experience in Scalable Computing: Practice and Experience
- Vol. 19 (1) , 53-68
AutoAdmin: Automatic and Dynamic Resource Reservation Admission Control in Hadoop YARN Clusters
- 7 March 2018
- Published by Springer Nature in Arabian Journal for Science and Engineering
- Vol. 43 (9) , 4811-4820
Pelletization Characteristics of the Hydrothermal Pretreated Rice Straw with Added Binders
- 7 March 2018
- Published by Springer Nature in Arabian Journal for Science and Engineering
- Vol. 43 (9) , 4811-4820
Pelletization Characteristics of the Hydrothermal Pretreated Rice Straw with Added Binders
- 7 March 2018
- Published by Springer Nature in Cluster Computing
- Vol. 21 (3) , 1561-1579
EAD: elasticity aware deduplication manager for datacenters with multi-tier storage systems
- 7 March 2018
- Published by Springer Nature in Cluster Computing
- Vol. 21 (3) , 1561-1579
EAD: elasticity aware deduplication manager for datacenters with multi-tier storage systems
- Open Access
Bolt Detection Signal Analysis Method Based on ICEEMD
The construction quality of the bolt is directly related to the safety of the project, and as such, it must be tested. In this paper, the improved complete ensemble empirical mode decomposition (ICEEMD) method is introduced to the bolt detection signal analysis. The ICEEMD is used in order to decompose the anchor detection signal according to the approximate entropy of each intrinsic mode function (IMF). The noise of the IMFs is eliminated by the wavelet soft threshold de-noising technique. Based on the approximate entropy, and the wavelet de-noising principle, the ICEEMD-De anchor signal analysis method is proposed. From the analysis of the vibration analog signal, as well as the bolt detection signal, the result shows that the ICEEMD-De method is capable of correctly separating the different IMFs under noisy conditions, and also that the IMF can effectively identify the reflection signal of the end of the bolt.
Open AccessBolt Detection Signal Analysis Method Based on ICEEMD
The construction quality of the bolt is directly related to the safety of the project, and as such, it must be tested. In this paper, the improved complete ensemble empirical mode decomposition (ICEEMD) method is introduced to the bolt detection signal analysis. The ICEEMD is used in order to decompose the anchor detection signal according to the approximate entropy of each intrinsic mode function (IMF). The noise of the IMFs is eliminated by the wavelet soft threshold de-noising technique. Based on the approximate entropy, and the wavelet de-noising principle, the ICEEMD-De anchor signal analysis method is proposed. From the analysis of the vibration analog signal, as well as the bolt detection signal, the result shows that the ICEEMD-De method is capable of correctly separating the different IMFs under noisy conditions, and also that the IMF can effectively identify the reflection signal of the end of the bolt.
- Open Access
Pelletization Characteristics of the Hydrothermal Pretreated Rice Straw with Added Binders
Pelletization of the loose rice straw is an attractive option to produce renewable fuels. In this paper, we focus on the problem of how to improve this pelletization process, especially to reduce energy consumption and improve product quality. In detail, we first pretreat rice straw, and then investigate the densification characteristics of the pretreated materials. Pretreatment methods of the materials include hydrothermal treatment and adding a certain proportion of economic additives, such as rapeseed meal and waste engine oil respectively. In addition, the pretreated rice straw was pelletized by using a biomass densification platform, meanwhile energy consumption and pellet quality were tested. Experimental results indicate that the hydrothermal pretreatment played an important role in reducing energy consumption and improving the product quality, and waste engine oil has a better effect than the rapeseed meal. We also observe that the obtained pellet quality reaches the standard of middle-grade coal, and the proposed pretreatment method realizes the comprehensive utilization of waste agricultural resources.
Open AccessPelletization Characteristics of the Hydrothermal Pretreated Rice Straw with Added Binders
Pelletization of the loose rice straw is an attractive option to produce renewable fuels. In this paper, we focus on the problem of how to improve this pelletization process, especially to reduce energy consumption and improve product quality. In detail, we first pretreat rice straw, and then investigate the densification characteristics of the pretreated materials. Pretreatment methods of the materials include hydrothermal treatment and adding a certain proportion of economic additives, such as rapeseed meal and waste engine oil respectively. In addition, the pretreated rice straw was pelletized by using a biomass densification platform, meanwhile energy consumption and pellet quality were tested. Experimental results indicate that the hydrothermal pretreatment played an important role in reducing energy consumption and improving the product quality, and waste engine oil has a better effect than the rapeseed meal. We also observe that the obtained pellet quality reaches the standard of middle-grade coal, and the proposed pretreatment method realizes the comprehensive utilization of waste agricultural resources.
- Open Access
A Review of Smart Materials in Tactile Actuators for Information Delivery
As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery.
Open AccessA Review of Smart Materials in Tactile Actuators for Information Delivery
As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery.
- Open Access
A Review of Smart Materials in Tactile Actuators for Information Delivery
As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery.
Open AccessA Review of Smart Materials in Tactile Actuators for Information Delivery
As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery.