Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code

Authors:
  • CNChangan Niu
    Changan Niu
  • CLChuanyi Li
    Chuanyi Li
  • BLBin Luo
    Bin Luo
  • VNVincent Ng
    Vincent Ng

Abstract
Recent years have seen the successful application of deep learning to software engineering (SE). In particular, the development and use of pre-trained models of source code has enabled state-of-the-art results to be achieved on a wide variety of SE tasks. This paper provides an overview of this rapidly advancing field of research and reflects on future research directions.
All Related Versions