Trend Analysis of Large Language Models through a Developer Community: A Focus on Stack Overflow
Open Access
- 6 November 2023
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 14 (11) , 602
Abstract
In the rapidly advancing field of large language model (LLM) research, platforms like Stack Overflow offer invaluable insights into the developer community’s perceptions, challenges, and interactions. This research aims to analyze LLM research and development trends within the professional community. Through the rigorous analysis of Stack Overflow, employing a comprehensive dataset spanning several years, the study identifies the prevailing technologies and frameworks underlining the dominance of models and platforms such as Transformer and Hugging Face. Furthermore, a thematic exploration using Latent Dirichlet Allocation unravels a spectrum of LLM discussion topics. As a result of the analysis, twenty keywords were derived, and a total of five key dimensions, “OpenAI Ecosystem and Challenges”, “LLM Training with Frameworks”, “APIs, File Handling and App Development”, “Programming Constructs and LLM Integration”, and “Data Processing and LLM Functionalities”, were identified through intertopic distance mapping. This research underscores the notable prevalence of specific Tags and technologies within the LLM discourse, particularly highlighting the influential roles of Transformer models and frameworks like Hugging Face. This dominance not only reflects the preferences and inclinations of the developer community but also illuminates the primary tools and technologies they leverage in the continually evolving field of LLMs.Keywords
This publication has 28 references indexed in Scilit:
- Keeping Up with the Trends: Analyzing the Dynamics of Online Learning and Hiring Platforms in the Software Programming DomainInternational Journal of Artificial Intelligence in Education, 2020
- What do Programmers Discuss about Deep Learning FrameworksEmpirical Software Engineering, 2020
- Features that Predict the Acceptability of Java and JavaScript Answers on Stack Overflow2019
- Paradise unplugged: identifying barriers for female participation on stack overflow2016
- How do API changes trigger stack overflow discussions? a study on the Android SDK2014
- Answering questions about unanswered questions of Stack Overflow2013
- What are developers talking about? An analysis of topics and trends in Stack OverflowEmpirical Software Engineering, 2012
- NLTK2006
- Long Short-Term MemoryNeural Computation, 1997
- A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVALJournal of Documentation, 1972