Topology-Aware Tokenization for Generative Recommendation

Authors:
  • YLYaokun Liu
    Yaokun Liu
  • YLYifan Liu
    Yifan Liu
  • ZYZhenrui Yue
    Zhenrui Yue
  • GLGyuseok Lee
    Gyuseok Lee
  • ZLZelin Li
    Zelin Li
  • RYRuichen Yao
    Ruichen Yao
  • DWDong Wang
    Dong Wang

Abstract
Generative recommendation reformulates sequential recommendation as an autoregressive generation task, yet a critical issue in this paradigm remains overlooked: topology distortion in item tokenization. In particular, we observe that the intrinsic adjacency relationships of items in the pretrained semantic embedding space are significantly disrupted after quantization. This topology distortion misleads the model's perception of item similarity, ultimately bottlenecking the accuracy of generative recommendations. To address this issue, we propose Topology-Aware Tokenization (TopoTok), an item tokenization framework that preserves item relational structure throughout the quantization hierarchy. Different from the prior monolithic supervision in tokenization, TopoTok introduces a multi-level distillation scheme to progressively recover the topology from coarse to fine granularity: 1) Inter-Group Distillation to capture global cluster-wise relations; 2) Intra-Group Distillation to refine local structures within semantic clusters; and 3) Inter-Item Distillation to enforce fine-grained alignment at the individual item level. Extensive experiments on three benchmark datasets demonstrate that TopoTok effectively alleviates topology distortion and consistently outperforms state-of-the-art tokenizers, achieving significant performance gains of up to 9.42% in Recall@5.
All Related Versions