Instruction-tuned Language Models are Better Knowledge Learners
Authors:
- Zhengbao JiangZJZhengbao Jiang
- Pedro RodriguezPRPedro Rodriguez
- Chunting ZhouCZChunting Zhou
- Graham NeubigGNGraham Neubig
- Xi LinXLXi Lin
- Wen-Tau YihWYWen-Tau Yih
- Srini IyerSISrini Iyer
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 5421-5434
Abstract
Zhengbao Jiang, Zhiqing Sun, Weijia Shi, Pedro Rodriguez, Chunting Zhou, Graham Neubig, Xi Lin, Wen-tau Yih, Srini Iyer. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- PMC-LLaMA: toward building open-source language models for medicineJournal of the American Medical Informatics Association, 2024
- WebCPM: Interactive Web Search for Chinese Long-form Question Answering2023
- Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer2022
- You Only Need One Model for Open-domain Question Answering2022
- Cross-Task Generalization via Natural Language Crowdsourcing Instructions2022
- Can Generative Pre-trained Language Models Serve As Knowledge Bases for Closed-book QA?2021
- How Can We Know What Language Models Know?Transactions of the Association for Computational Linguistics, 2020
- How Much Knowledge Can You Pack Into the Parameters of a Language Model?2020
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020
- Natural Questions: A Benchmark for Question Answering ResearchTransactions of the Association for Computational Linguistics, 2019