TestSpark: IntelliJ IDEA's Ultimate Test Generation Companion
Preprint
Abstract
Writing software tests is laborious and time-consuming. To address this, prior studies introduced various automated test-generation techniques. A well-explored research direction in this field is unit test generation, wherein artificial intelligence (AI) techniques create tests for a method/class under test. While many of these techniques have primarily found applications in a research context, existing tools (e.g., EvoSuite, Randoop, and AthenaTest) are not user-friendly and are tailored to a single technique. This paper introduces TestSpark, a plugin for IntelliJ IDEA that enables users to generate unit tests with only a few clicks directly within their Integrated Development Environment (IDE). Furthermore, TestSpark also allows users to easily modify and run each generated test and integrate them into the project workflow. TestSpark leverages the advances of search-based test generation tools, and it introduces a technique to generate unit tests using Large Language Models (LLMs) by creating a feedback cycle between the IDE and the LLM. Since TestSpark is an open-source (https://github.com/JetBrains-Research/TestSpark), extendable, and well-documented tool, it is possible to add new test generation methods into the plugin with the minimum effort. This paper also explains our future studies related to TestSpark and our preliminary results. Demo video: https://youtu.be/0F4PrxWfiXoKeywords
All Related Versions
This publication has 7 references indexed in Scilit:
- An Empirical Evaluation of Using Large Language Models for Automated Unit Test GenerationIEEE Transactions on Software Engineering, 2023
- SBFT Tool Competition 2023 - Java Test Case Generation Track2023
- Generating Class-Level Integration Tests Using Call Site InformationIEEE Transactions on Software Engineering, 2022
- RESTful API Automated Test Case Generation with EvoMasterACM Transactions on Software Engineering and Methodology, 2019
- A large scale empirical comparison of state-of-the-art search-based test case generatorsInformation and Software Technology, 2018
- Automated Test Case Generation as a Many-Objective Optimisation Problem with Dynamic Selection of the TargetsIEEE Transactions on Software Engineering, 2017
- Do Automatically Generated Test Cases Make Debugging Easier? An Experimental Assessment of Debugging Effectiveness and EfficiencyACM Transactions on Software Engineering and Methodology, 2015