Generative Pre-Trained Transformer (GPT) in Research: A Systematic Review on Data Augmentation
Author:
Top Cited Papers
Open Access
- 8 February 2024
- journal article
- review article
- Published by MDPI AG in Information
- Vol. 15 (2) , 99
Abstract
GPT (Generative Pre-trained Transformer) represents advanced language models that have significantly reshaped the academic writing landscape. These sophisticated language models offer invaluable support throughout all phases of research work, facilitating idea generation, enhancing drafting processes, and overcoming challenges like writer’s block. Their capabilities extend beyond conventional applications, contributing to critical analysis, data augmentation, and research design, thereby elevating the efficiency and quality of scholarly endeavors. Strategically narrowing its focus, this review explores alternative dimensions of GPT and LLM applications, specifically data augmentation and the generation of synthetic data for research. Employing a meticulous examination of 412 scholarly works, it distills a selection of 77 contributions addressing three critical research questions: (1) GPT on Generating Research data, (2) GPT on Data Analysis, and (3) GPT on Research Design. The systematic literature review adeptly highlights the central focus on data augmentation, encapsulating 48 pertinent scholarly contributions, and extends to the proactive role of GPT in critical analysis of research data and shaping research design. Pioneering a comprehensive classification framework for “GPT’s use on Research Data”, the study classifies existing literature into six categories and 14 sub-categories, providing profound insights into the multifaceted applications of GPT in research data. This study meticulously compares 54 pieces of literature, evaluating research domains, methodologies, and advantages and disadvantages, providing scholars with profound insights crucial for the seamless integration of GPT across diverse phases of their scholarly pursuits.Keywords
This publication has 71 references indexed in Scilit:
- DATLMedQA: A Data Augmentation and Transfer Learning Based Solution for Medical Question AnsweringApplied Sciences, 2021
- Augmenting Open-Domain Event Detection with Synthetic Data from GPT-22021
- Exploring Conditional Language Model Based Data Augmentation Approaches for Hate Speech Classification2021
- Data augmentation for low‐resource languages NMT guided by constrained samplingInternational Journal of Intelligent Systems, 2021
- Synthetic Biological Signals Machine-Generated by GPT-2 Improve the Classification of EEG and EMG Through Data AugmentationIEEE Robotics and Automation Letters, 2021
- Data Augmentation with Transformers for Text Classification2020
- Do Not Have Enough Data? Deep Learning to the Rescue!Proceedings of the AAAI Conference on Artificial Intelligence, 2020
- Textual Data Augmentation for Efficient Active Learning on Tiny Datasets2020
- Which academic search systems are suitable for systematic reviews or meta‐analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resourcesResearch Synthesis Methods, 2019
- Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the LiteratureJournal of Informetrics, 2017