LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
Authors:
- Mostafa ElhoushiMEMostafa Elhoushi
- Akshat ShrivastavaASAkshat Shrivastava
- Diana LiskovichDLDiana Liskovich
- Basil HosmerBHBasil Hosmer
- Bram WastiBWBram Wasti
- Liangzhen LaiLLLiangzhen Lai
- Anas MahmoudAMAnas Mahmoud
- Bilge AcunBABilge Acun
- Saurabh AgarwalSASaurabh Agarwal
- Ahmed RomanARAhmed Roman
- Ahmed A AlyAAAhmed A Aly
- Beidi ChenBCBeidi Chen
Preprint