SPROUT: An Interactive Authoring Tool for Generating Programming Tutorials With the Visualization of Large Language Models
- 14 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (9) , 4761-4775
Abstract
The rapid development of large language models (LLMs), such as ChatGPT, has revolutionized the efficiency of creating programming tutorials. LLMs can be instructed with text prompts to generate comprehensive text descriptions for code snippets provided by users. However, the lack of transparency in the end-to-end generation process has hindered the understanding of model behavior and limited user control over the generated results. To tackle this challenge, we introduce a novel approach that breaks down the programming tutorial creation task into actionable steps. By employing the tree-of-thought method, LLMs engage in an exploratory process to generate diverse and faithful programming tutorials. We then present SPROUT, an authoring tool equipped with a series of interactive visualizations that empower users to have greater control and understanding of the programming tutorial creation process. A formal user study demonstrated the effectiveness of SPROUT, showing that our tool assists users to actively participate in the programming tutorial creation process, leading to more reliable and customizable results. By providing users with greater control and understanding, SPROUT enhances the user experience and improves the overall quality of programming tutorial.Keywords
All Related Versions
This publication has 54 references indexed in Scilit:
- PubExplorer: An interactive analytical system for visualizing publication dataVisual Informatics, 2023
- Large language models in medicineNature Medicine, 2023
- VIS+AI: integrating visualization with artificial intelligence for efficient data analysisFrontiers of Computer Science, 2023
- Large Language Models for Software Engineering: Survey and Open Problems2023
- ChatGPT for good? On opportunities and challenges of large language models for educationLearning and Individual Differences, 2023
- TCMFVis: A visual analytics system toward bridging together traditional Chinese medicine and modern medicineVisual Informatics, 2022
- Human-machine interactive streaming anomaly detection by online self-adaptive forestFrontiers of Computer Science, 2022
- iPoet: interactive painting poetry creation with visual multimodal analysisJournal of Visualization, 2021
- An Unsupervised Approach for Discovering Relevant Tutorial Fragments for APIs2017
- JTourBus: Simplifying Program Understanding by Documentation that Provides Tours Through the Source Code2007 IEEE International Conference on Software Maintenance, 2007