Automatic Question Generation with Large Language Models: A Survey
Open Access
- 22 August 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 58 (15) , 1-34
Abstract
Test-based learning is effective in fostering knowledge retention, but manually creating assessment questions remains time-consuming and limits personalized student practice. The advent of Large Language Models (LLMs) has introduced new possibilities for Automatic Question Generation (AQG). Motivated by this context, this survey provides a comprehensive overview of AQG using LLMs, focusing on educational applications. Following the PRISMA methodology, we reviewed 132 studies published between 2023 and 2025. Our contributions include a taxonomy of question types by response openness, an analysis of AQG efforts across knowledge fields, educational levels, evaluation strategies, and difficulty control. We also identify recurring challenges and research opportunities.Keywords
Funding Information
- Postdoctoral Researcher Program (PPPD) at UNICAMP, São Paulo Research Foundation (2025/19399-8, 2026/01653-8, and 2025/10403-2)
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (316067/2023-7, 301337/2025-0, and 400456/2025-7)
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Finance Code 001)
This publication has 91 references indexed in Scilit:
- Automatic Question Generation2025
- Question Generation Capabilities of “Small" Large Language Models2024
- BEQuizzer: AI-Based Quiz Automatic Generation in the Portuguese Language2024
- Comparison of Large Language Models for Generating Contextually Relevant Questions2024
- A Strategy for Implementing Domain-Based Task Generation and Evaluation System Using Text-Text Generative Models2024
- Automatic Generation of a Large Multiple-Choice Question-Answer Corpus2024
- Automatic Question Generation: A Comparative Analysis of Rule-Based and Neural Network-Based Models2024
- Automatic Generation of Multiple-Choice Questions for CS0 and CS1 Curricula Using Large Language Models2024
- Automating Question Generation From Educational Text2023
- Comparative Quality Analysis of GPT-Based Multiple Choice Question Generation2023