Exploring the Potential of Offline LLMs in Data Science: A Study on Code Generation for Data Analysis
Open Access
- 1 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 64087-64114
Abstract
Large Language Models (LLMs) have recently attracted considerable attention from the scientific community, due to their advanced capabilities and potential to serve as vital tools across various industries and academic fields. An important implementation domain for LLMs is Data Science, in which they could enhance the efficiency of Data Analysis and Profiling tasks.With the utilization of LLMs in Data Analytics tools, end-users could directly issue data analysis queries in natural language, bypassing the need for specialized user interfaces. However, due to the sensitive nature of certain data in some organizations, it is unwise to consider using established, cloud-based LLMs. This article explores the feasibility and effectiveness of a standalone, offline LLM in generating code for performing data analytics, given a set of natural language queries. A methodology tailored to a code-specific LLM is presented, evaluating its performance in generating Python Spark code and successfully producing the desired result. The model is assessed on its efficiency and ability to handle natural language queries of varying complexity, exploring the potential for wider adoption of offline LLMs in future data analysis frameworks and software solutions.Keywords
Funding Information
- European Commission through the Horizon Europe Program through the Project “Reliable biomeTric tEchNologies to asSist Police authorities in cOmbating terrorism and oRganized crime (TENSOR)” (101073920)
This publication has 45 references indexed in Scilit:
- Scalable Data Profiling for Quality Analytics Extraction2024
- Integrating Large Language Models in Bioinformatics Education for Medical Students: Opportunities and ChallengesAnnals of Biomedical Engineering, 2024
- Investigating large language models capabilities for automatic code repair in PythonCluster Computing, 2024
- Enhancing Large Language Models-Based Code Generation by Leveraging Genetic Improvement2024
- A Pilot Study on AI-Assisted Code Generation with Large Language Models for Software Engineering2024
- Query Generation Using Large Language Models2024
- Prompt Engineering in Large Language Models2024
- Prompting Change: Exploring Prompt Engineering in Large Language Model AI and Its Potential to Transform EducationTechTrends, 2023
- Knowledge Bases and Language Models: Complementing Forces2023
- Query Classification2020