Xinyuan Lin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Xinyuan Lin has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
Ansheng Li
1 shared publication- Avinash Kumar
Independent Researcher, Mountain View, USA
1 shared publication - Binmei Sun
Key Laboratory of Horticultural Crop Biology and Germplasm Innovation in South China, College of Horticulture, South China Agricultural Univ CN‐510642 Guangzhou PR China
1 shared publication - Chen Li
University of California, Irvine, Irvine, USA
1 shared publication - Jiahao Chen
Key Laboratory of Tea Science of Ministry of Education, Hunan Agricultural University, Changsha, 410128, China; National Research Center of Engineering & Technology for Utilization of Functional Ingredients from Botanicals, Hunan Agricultural University, Changsha, 410128, China
1 shared publication Jiyuan Yao
1 shared publication
Latest Publications
- Open Access
- 18 December 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Management of Data
- Vol. 2 (6) , 1-26
Pasta: A Cost-Based Optimizer for Generating Pipelining Schedules for Dataflow DAGs
Data analytics tasks are often formulated as data workflows represented as directed acyclic graphs (DAGs) of operators. The recent trend of adopting machine learning (ML) techniques in workflows results in increasingly complicated DAGs with many operators and edges. Compared to the operator-at-a-time execution paradigm, pipelined execution has benefits of reducing the materialization cost of intermediate results and allowing operators to produce results early, which are critical in iterative analysis on large data volumes. Correctly scheduling a workflow DAG for pipelined execution is non-trivial due to the richer semantics of operators and the increasing complexity of DAGs. Several existing data systems adopt simple heuristics to solve the problem without considering costs such as materialization sizes. In this paper, we systematically study the problem of scheduling a workflow DAG for pipelined execution, and develop a novel cost-based optimizer called Pasta for generating a high-quality schedule. The Pasta optimizer is not only general and applicable to a wide variety of cost functions, but also capable of utilizing properties inherent in a broad class of cost functions to improve its performance significantly. We conducted a thorough evaluation of developed techniques on real-world workflows and show the efficiency and efficacy of these solutions.
- 18 December 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Management of Data
- Vol. 2 (6) , 1-26
Open AccessPasta: A Cost-Based Optimizer for Generating Pipelining Schedules for Dataflow DAGs
Data analytics tasks are often formulated as data workflows represented as directed acyclic graphs (DAGs) of operators. The recent trend of adopting machine learning (ML) techniques in workflows results in increasingly complicated DAGs with many operators and edges. Compared to the operator-at-a-time execution paradigm, pipelined execution has benefits of reducing the materialization cost of intermediate results and allowing operators to produce results early, which are critical in iterative analysis on large data volumes. Correctly scheduling a workflow DAG for pipelined execution is non-trivial due to the richer semantics of operators and the increasing complexity of DAGs. Several existing data systems adopt simple heuristics to solve the problem without considering costs such as materialization sizes. In this paper, we systematically study the problem of scheduling a workflow DAG for pipelined execution, and develop a novel cost-based optimizer called Pasta for generating a high-quality schedule. The Pasta optimizer is not only general and applicable to a wide variety of cost functions, but also capable of utilizing properties inherent in a broad class of cost functions to improve its performance significantly. We conducted a thorough evaluation of developed techniques on real-world workflows and show the efficiency and efficacy of these solutions.
- 30 July 2024
- Published by Elsevier in Scientia Horticulturae
- Vol. 337, 113528
Metabolic profiling reveal changes in shoots and roots of nitrogen-deficient tea plants (Camellia sinensis cv. Jinxuan)
- 30 July 2024
- Published by Elsevier in Scientia Horticulturae
- Vol. 337, 113528
Metabolic profiling reveal changes in shoots and roots of nitrogen-deficient tea plants (Camellia sinensis cv. Jinxuan)