Yanjie Song
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yanjie Song has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Guancheng Li
ShanghaiTech University, Shanghai, China
2 shared publications - Shu Yin
School of Information Science and Technology, ShanghaiTech University, Shanghai, China
2 shared publications - Junchao Wang
China Meteorological Administration, Basin Heavy Rainfall Key Lab/Hubei Key Lab for HV. Rain Mtrg. & WRNG., Wuhan, Hubei, China
1 shared publication - Tianyuan Wu
School of Info. Sci. & Tech., ShanghaiTech University, Shanghai, China
1 shared publication - Wei Xue
Tsinghua University, Beijing, China
1 shared publication - Xuanjun Wen
ShanghaiTech University, Shanghai, China
1 shared publication
Latest Publications
- Open Access
- 15 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 837-854
Optimizing Data Acquisitions in Multi-Robot Systems
- 15 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 837-854
Open AccessOptimizing Data Acquisitions in Multi-Robot Systems
- Open Access
- 20 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 883-897
A Data Optimizer for Region-Aware Self-describing Files in Scientific Computing
Acquiring data from scientific simulations for analytical purposes is inherently challenging due to the complex and irregularly shaped regions within which the data resides, particularly when using self-describing data formats. The process of region-based data distillation becomes even more arduous when employing persistent memory or parallel file systems. To tackle this challenge, we introduce RASTER (Region-Aware Self-describing daTa optimizER), a lightweight middleware designed for region-aware data preprocessing. RASTER dynamically reorganizes data into variable groups based on regional identifiers during runtime, thereby eliminating the need for sequential searches to locate the required data. We have developed a prototype of RASTER and successfully integrated it into three distinct computing environments: a single-node server equipped with Intel® Optane™ DC persistent memory, the Huawei® OceanStor cloud storage platform, and the Sunway TaihuLight supercomputer. We then conducted a thorough evaluation of the RASTER prototype on the latter two platforms using a real-world scientific application, CESM (Community Earth System Model). Our experimental results demonstrate that RASTER enhances data acquisition performance by up to 2.83× and achieves a 2.36× speedup over conventional netCDF and the state-of-the-art ADIOS2. Additionally, RASTER significantly reduces memory usage by up to 400%, showcasing its scalability potential.
- 20 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 883-897
Open AccessA Data Optimizer for Region-Aware Self-describing Files in Scientific Computing
Acquiring data from scientific simulations for analytical purposes is inherently challenging due to the complex and irregularly shaped regions within which the data resides, particularly when using self-describing data formats. The process of region-based data distillation becomes even more arduous when employing persistent memory or parallel file systems. To tackle this challenge, we introduce RASTER (Region-Aware Self-describing daTa optimizER), a lightweight middleware designed for region-aware data preprocessing. RASTER dynamically reorganizes data into variable groups based on regional identifiers during runtime, thereby eliminating the need for sequential searches to locate the required data. We have developed a prototype of RASTER and successfully integrated it into three distinct computing environments: a single-node server equipped with Intel® Optane™ DC persistent memory, the Huawei® OceanStor cloud storage platform, and the Sunway TaihuLight supercomputer. We then conducted a thorough evaluation of the RASTER prototype on the latter two platforms using a real-world scientific application, CESM (Community Earth System Model). Our experimental results demonstrate that RASTER enhances data acquisition performance by up to 2.83× and achieves a 2.36× speedup over conventional netCDF and the state-of-the-art ADIOS2. Additionally, RASTER significantly reduces memory usage by up to 400%, showcasing its scalability potential.