QLQinyi Luo
Qinyi Luo
*This is an algorithmically generated author record based on publicly available information.
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Qinyi Luo has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Fan Lai
University of Illinois Urbana-Champaign, Champaign, USA
1 shared publication Jiachen Mao
Meta, Menlo Park, CA, USA
1 shared publicationJun Song
Meta, Menlo Park, CA, USA
1 shared publication- Penghan Wang
Purdue University, West Lafayette, IN, USA
1 shared publication Shuai Yang
Meta, Menlo Park, CA, USA
1 shared publication- Wei Zhang
Department of Computer Engineering, University of Virginia, Charlottesville, Virginia 22904, USA
1 shared publication
Latest Publications
- 17 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 75 (2) , 448-461
FIITED: Fine-Grained Embedding Dimension Optimization During Training for Recommender Systems
Huge embedding tables in modern deep learning recommender models (DLRM) require prohibitively large memory during training and inference. This paper proposes FIITED, a system to automatically reduce the memory footprint via FIne-grained In-Training Embedding Dimension pruning. By leveraging the key insight that embedding vectors are not equally important, FIITED adaptively adjusts the dimension of each individual embedding vector during model training, assigning larger dimensions to more important embeddings while adapting to dynamic changes in data. We prioritize embedding dimensions with higher frequencies and gradients as more important. To enable efficient pruning of embeddings and their dimensions during model training, we propose an embedding storage system based on virtually-hashed physically-indexed hash tables. Experiments on two industry models and months of realistic datasets show that FIITED can reduce DLRM embedding size by more than 65% while preserving model quality, outperforming state-of-the-art in-training embedding pruning methods and increasing the reduction ratio by 1.3$\boldsymbol{\times}$ to 1.67$\boldsymbol{\times}$ . On public datasets, FIITED can reduce the size of embedding tables by 2.2$\boldsymbol{\times}$ to 800$\boldsymbol{\times}$ with negligible accuracy drop, achieving 1.05$\boldsymbol{\times}$ to 12.5$\boldsymbol{\times}$ improvement in reduction ratio compared to baselines while improving model throughput.- 17 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 75 (2) , 448-461
FIITED: Fine-Grained Embedding Dimension Optimization During Training for Recommender Systems
Huge embedding tables in modern deep learning recommender models (DLRM) require prohibitively large memory during training and inference. This paper proposes FIITED, a system to automatically reduce the memory footprint via FIne-grained In-Training Embedding Dimension pruning. By leveraging the key insight that embedding vectors are not equally important, FIITED adaptively adjusts the dimension of each individual embedding vector during model training, assigning larger dimensions to more important embeddings while adapting to dynamic changes in data. We prioritize embedding dimensions with higher frequencies and gradients as more important. To enable efficient pruning of embeddings and their dimensions during model training, we propose an embedding storage system based on virtually-hashed physically-indexed hash tables. Experiments on two industry models and months of realistic datasets show that FIITED can reduce DLRM embedding size by more than 65% while preserving model quality, outperforming state-of-the-art in-training embedding pruning methods and increasing the reduction ratio by 1.3$\boldsymbol{\times}$ to 1.67$\boldsymbol{\times}$ . On public datasets, FIITED can reduce the size of embedding tables by 2.2$\boldsymbol{\times}$ to 800$\boldsymbol{\times}$ with negligible accuracy drop, achieving 1.05$\boldsymbol{\times}$ to 12.5$\boldsymbol{\times}$ improvement in reduction ratio compared to baselines while improving model throughput.