ZYZhengyu Yang

Zhengyu Yang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Zhengyu Yang has a total of 65 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership

    by Zhengyu Yang, Manu Awasthi, Mrinmoy Ghosh, Janki Bhimani, Ningfang Mi

    Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large shared storage installations in datacenters, where metrics like Total Cost of Ownership (TCO) are of paramount importance. On the other hand, flash devices suffer from write amplification, which, if unaccounted, can substantially increase the TCO of a storage system. In this paper, we first develop a TCO model for datacenter all-flash storage systems, and then plug a Write Amplification model (WAF) of NVMe SSDs we build based on empirical data into this TCO model. Our new WAF model accounts for workload characteristics like write rate and percentage of sequential writes. Furthermore, using both the TCO and WAF models as the optimization criterion, we design new flash resource management schemes (MINTCO) to guide datacenter managers to make workload allocation decisions under the consideration of TCO for SSDs. Based on that, we also develop MINTCO-RAID to support RAID SSDs and MINTCO-OFFLINE to optimize the offline workload-disk deployment problem during the initialization phase. Experimental results show that MINTCO can reduce the TCO and keep relatively high throughput and space utilization of the entire datacenter storage resources.


  • New YARN Non-Exclusive Resource Management Scheme through Opportunistic Idle Resource Assignment

    by Zhengyu Yang, Yi Yao, Han Gao, Jiayin Wang, Ningfang Mi, Bo Sheng

    Efficiently managing resources and improving throughput in a large-scale cluster has become a crucial problem with the explosion of data processing applications in recent years. Hadoop YARN and Mesos, as two universal resource manage- ment platforms, have been widely adopted in the commodity cluster for co-deploying multiple data processing frameworks, such as Hadoop MapReduce and Apache Spark. However, in the existing resource management, a certain amount of resources are exclusively allocated to a running task and can only be re-assigned after that task is completed. This exclusive mode unfortunately leads to a potential problem that may under-utilize the cluster resources and degrade system performance. To address this issue, we propose a novel opportunistic and efficient resource allocation scheme, named O P ERA, which breaks the barriers among the encapsulated resource containers by leveraging the knowledge of actual runtime resource utilizations to re-assign opportunistic available resources to the pending tasks. O P ERA avoids incurring severe performance interference to active tasks by further using two approaches to efficiently balances the starvations of reserved tasks and normal queued tasks. We implement and evaluate O P ERA in Hadoop YARN v2.5.


  • Open Access

    Intermediate Data Caching Optimization for Multi-Stage and Parallel Big Data Frameworks

    by Zhengyu Yang, Danlin Jia, Stratis Ioannidis, Ningfang Mi, Bo Sheng

    In the era of big data and cloud computing, large amounts of data are generated from user applications and need to be processed in the datacenter. Data-parallel computing frameworks, such as Apache Spark, are widely used to perform such data processing at scale. Specifically, Spark leverages distributed memory to cache the intermediate results, represented as Resilient Distributed Datasets (RDDs). This gives Spark an advantage over other parallel frameworks for implementations of iterative machine learning and data mining algorithms, by avoiding repeated computation or hard disk accesses to retrieve RDDs. By default, caching decisions are left at the programmer's discretion, and the LRU policy is used for evicting RDDs when the cache is full. However, when the objective is to minimize total work, LRU is woefully inadequate, leading to arbitrarily suboptimal caching decisions. In this paper, we design an algorithm for multi-stage big data processing platforms to adaptively determine and cache the most valuable intermediate datasets that can be reused in the future. Our solution automates the decision of which RDDs to cache: this amounts to identifying nodes in a direct acyclic graph (DAG) representing computations whose outputs should persist in the memory. Our experiment results show that our proposed cache optimization solution can improve the performance of machine learning applications on Spark decreasing the total work to recompute RDDs by 12%.

  • EAD: elasticity aware deduplication manager for datacenters with multi-tier storage systems

    by Zhengyu Yang, Yufeng Wang, Janki Bhamini, Chiu C. Tan, Ningfang Mi


  • Open Access

    Bolt Detection Signal Analysis Method Based on ICEEMD

    by Chunhui Guo, Zhan Zhang, Xin Xie, Zhengyu Yang

    The construction quality of the bolt is directly related to the safety of the project, and as such, it must be tested. In this paper, the improved complete ensemble empirical mode decomposition (ICEEMD) method is introduced to the bolt detection signal analysis. The ICEEMD is used in order to decompose the anchor detection signal according to the approximate entropy of each intrinsic mode function (IMF). The noise of the IMFs is eliminated by the wavelet soft threshold de-noising technique. Based on the approximate entropy, and the wavelet de-noising principle, the ICEEMD-De anchor signal analysis method is proposed. From the analysis of the vibration analog signal, as well as the bolt detection signal, the result shows that the ICEEMD-De method is capable of correctly separating the different IMFs under noisy conditions, and also that the IMF can effectively identify the reflection signal of the end of the bolt.

  • Open Access

    Pelletization Characteristics of the Hydrothermal Pretreated Rice Straw with Added Binders

    by Xianfei Xia, Hongru Xiao, Zhengyu Yang, Xin Xie, Janki Bhimani

    Pelletization of the loose rice straw is an attractive option to produce renewable fuels. In this paper, we focus on the problem of how to improve this pelletization process, especially to reduce energy consumption and improve product quality. In detail, we first pretreat rice straw, and then investigate the densification characteristics of the pretreated materials. Pretreatment methods of the materials include hydrothermal treatment and adding a certain proportion of economic additives, such as rapeseed meal and waste engine oil respectively. In addition, the pretreated rice straw was pelletized by using a biomass densification platform, meanwhile energy consumption and pellet quality were tested. Experimental results indicate that the hydrothermal pretreatment played an important role in reducing energy consumption and improving the product quality, and waste engine oil has a better effect than the rapeseed meal. We also observe that the obtained pellet quality reaches the standard of middle-grade coal, and the proposed pretreatment method realizes the comprehensive utilization of waste agricultural resources.

  • Open Access

    A Review of Smart Materials in Tactile Actuators for Information Delivery

    by Xin Xie, Sanwei Liu, Chenye Yang, Zhengyu Yang, Tian Liu, Juncai Xu, Cheng Zhang, Xianglin Zhai

    As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery.


  • Open Access

    A Review of Smart Materials in Tactile Actuators for Information Delivery

    by Xin Xie, Sanwei Liu, Chenye Yang, Zhengyu Yang, Juncai Xu, Cheng Zhang, Xianglin Zhai

    As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery.