Jun Zhao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Jun Zhao has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Beichuan Zhang
Bytedance, Beijing, China
1 shared publication - Chengfan Li
Shanghai University
1 shared publication - Chenggen Sun
Kuaishou, Beijing, China
1 shared publication - Chengru Song
Kuaishou Inc., Beijing, China
1 shared publication - Jianchao Tan
Kuaishou Technology, Beijing, China
1 shared publication Jing Yuan Yin
Earthquake Administration of Shanghai Municipality
1 shared publication
Latest Publications
- Open Access
- 21 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 4930-4937
SHARK: A Lightweight Model Compression Approach for Large-scale Recommender Systems
Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of computing and storage costs. To save resources while maintaining model performances, we propose SHARK, the model compression practice we have summarized in the recommender system of industrial scenarios. SHARK consists of two main components. First, we use the novel first-order component of Taylor expansion as importance scores to prune the number of embedding tables (feature fields). Second, we introduce a new row-wise quantization method to apply different quantization strategies to each embedding. We conduct extensive experiments on both public and industrial datasets, demonstrating that each component of our proposed SHARK framework outperforms previous approaches. We conduct A/B tests in multiple models on Kuaishou, such as short video, e-commerce, and advertising recommendation models. The results of the online A/B test showed SHARK can effectively reduce the memory footprint of the embedded layer. For the short-video scenarios, the compressed model without any performance drop significantly saves 70% storage and thousands of machines, improves 30% queries per second (QPS), and has been deployed to serve hundreds of millions of users and process tens of billions of requests every day.
- 21 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 4930-4937
Open AccessSHARK: A Lightweight Model Compression Approach for Large-scale Recommender Systems
Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of computing and storage costs. To save resources while maintaining model performances, we propose SHARK, the model compression practice we have summarized in the recommender system of industrial scenarios. SHARK consists of two main components. First, we use the novel first-order component of Taylor expansion as importance scores to prune the number of embedding tables (feature fields). Second, we introduce a new row-wise quantization method to apply different quantization strategies to each embedding. We conduct extensive experiments on both public and industrial datasets, demonstrating that each component of our proposed SHARK framework outperforms previous approaches. We conduct A/B tests in multiple models on Kuaishou, such as short video, e-commerce, and advertising recommendation models. The results of the online A/B test showed SHARK can effectively reduce the memory footprint of the embedded layer. For the short-video scenarios, the compressed model without any performance drop significantly saves 70% storage and thousands of machines, improves 30% queries per second (QPS), and has been deployed to serve hundreds of millions of users and process tens of billions of requests every day.
- 16 June 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12639, 616-622
Research and experiment of double-layer composite metal plate sound absorption structure
Most of the sound absorption methods in noise control used fibrous materials, which are prone to generate dust particles and other problems. Micro-perforated sound absorption structure can have good sound absorption performance without filling any sound absorption materials. It can effectively solve the problem of dust particles caused by fibrous soundabsorbing materials. Based on the micro-perforation theory, the sound absorption structure of double-layer composite metal plate is studied according to the acoustic and electrical analogy method, and the sound absorption performance of different size structures is calculated and simulated in MATLAB. The two structures with ideal simulation results are processed for sample preparation, and the performance test verification is completed in the reverberation room.
- 16 June 2023
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12639, 616-622
Research and experiment of double-layer composite metal plate sound absorption structure
Most of the sound absorption methods in noise control used fibrous materials, which are prone to generate dust particles and other problems. Micro-perforated sound absorption structure can have good sound absorption performance without filling any sound absorption materials. It can effectively solve the problem of dust particles caused by fibrous soundabsorbing materials. Based on the micro-perforation theory, the sound absorption structure of double-layer composite metal plate is studied according to the acoustic and electrical analogy method, and the sound absorption performance of different size structures is calculated and simulated in MATLAB. The two structures with ideal simulation results are processed for sample preparation, and the performance test verification is completed in the reverberation room.
- 2 October 2019
- Published by Springer Nature
- p. 423-430
Spatiotemporal Evolution Simulation of Volcanic Ash Cloud from Remote Sensing Image
- 2 October 2019
- Published by Springer Nature
- p. 423-430
Spatiotemporal Evolution Simulation of Volcanic Ash Cloud from Remote Sensing Image