Leveraging LLMs for Efficient Topic Reviews
Open Access
- 30 August 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (17) , 7675
Abstract
This paper presents the topic review (TR), a novel semi-automatic framework designed to enhance the efficiency and accuracy of literature reviews. By leveraging the capabilities of large language models (LLMs), TR addresses the inefficiencies and error-proneness of traditional review methods, especially in rapidly evolving fields. The framework significantly improves literature review processes by integrating advanced text mining and machine learning techniques. Through a case study approach, TR offers a step-by-step methodology that begins with query generation and refinement, followed by semi-automated text mining to identify relevant articles. LLMs are then employed to extract and categorize key themes and concepts, facilitating an in-depth literature analysis. This approach demonstrates the transformative potential of natural language processing in literature reviews. With an average similarity of 69.56% between generated and indexed keywords, TR effectively manages the growing volume of scientific publications, providing researchers with robust strategies for complex text synthesis and advancing knowledge in various domains. An expert analysis highlights a positive Fleiss’ Kappa score, underscoring the significance and interpretability of the results.Keywords
Funding Information
- National Agency for Research and Development (ANID)/Scholarship Program/DOCTORADO NACIONAL (2024-21240115, 039.463/2024)
- Beca INF-PUCV (2024-21240115, 039.463/2024)
- VINCI-DI (2024-21240115, 039.463/2024)
This publication has 49 references indexed in Scilit:
- A mapping exercise using automated techniques to develop a search strategy to identify systematic review toolsResearch Synthesis Methods, 2023
- Artificial intelligence to automate the systematic review of scientific literatureComputing, 2023
- A novel application of machine learning and zero-shot classification methods for automated abstract screening in systematic reviewsDecision Analytics Journal, 2023
- Machine learning techniques applied to construction: A hybrid bibliometric analysis of advances and future directionsAutomation in Construction, 2022
- Investigation of text‐mining methodologies to aid the construction of search strategies in systematic reviews of diagnostic test accuracy—a case studyResearch Synthesis Methods, 2022
- Automatic classification of literature in systematic reviews on food safety using machine learningCurrent Research in Food Science, 2021
- PROTOCOL: Searching and reporting in Campbell Collaboration systematic reviews: An assessment of current methodsCampbell Systematic Reviews, 2021
- Information extraction from scientific articles: a surveyScientometrics, 2018
- Density-Based Clustering Based on Hierarchical Density Estimates2013
- Using content-based and bibliometric features for machine learning models to predict citation counts in the biomedical literatureScientometrics, 2010