Intra-head pruning for vision transformers via inter-layer dimension relationship modeling
- 4 June 2025
- journal article
- Published by Elsevier in Neural Networks
- Vol. 190, 107656
Abstract
No abstract availableKeywords
Funding Information
- National Key Research and Development Program of China (2018AAA0103202)
- National Natural Science Foundation of China (62192734, 62192730)
This publication has 13 references indexed in Scilit:
- Making Vision Transformers Efficient from A Token Sparsification View2023
- DepGraph: Towards Any Structural Pruning2023
- EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attention2023
- Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space2022
- A-ViT: Adaptive Tokens for Efficient Vision Transformer2022
- CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows2022
- CvT: Introducing Convolutions to Vision Transformers2021
- Scalable Vision Transformers with Hierarchical Pooling2021
- Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet2021
- Vision Transformer with Progressive Sampling2021