RedPajama: an Open Dataset for Training Large Language Models

Authors:
  • MWMaurice Weber
    Maurice Weber
  • DFDaniel Fu
    Daniel Fu
  • QAQuentin Anthony
    Quentin Anthony
  • YOYonatan Oren
    Yonatan Oren
  • SAShane Adams
    Shane Adams
  • AAAnton Alexandrov
    Anton Alexandrov
  • XLXiaozhong Lyu
    Xiaozhong Lyu
  • HNHuu Nguyen
    Huu Nguyen
  • XYXiaozhe Yao
    Xiaozhe Yao
  • VAVirginia Adams
    Virginia Adams
  • BABen Athiwaratkun
    Ben Athiwaratkun
  • RCRahul Chalamala
    Rahul Chalamala

Abstract
No abstract available