Semantic Constraint Inference for Web Form Test Generation
Open Access
- 11 September 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 932-944
Abstract
Automated test generation for web forms has been a longstanding challenge, exacerbated by the intrinsic human-centric design of forms and their complex, device-agnostic structures. We introduce an innovative approach, called FormNexus, for automated web form test generation, which emphasizes deriving semantic insights from individual form elements and relations among them, utilizing textual content, DOM tree structures, and visual proximity. The insights gathered are transformed into a new conceptual graph, the Form Entity Relation Graph (FERG), which offers machine-friendly semantic information extraction. Leveraging LLMs, FormNexus adopts a feedback-driven mechanism for generating and refining input constraints based on real-time form submission responses. The culmination of this approach is a robust set of test cases, each produced by methodically invalidating constraints, ensuring comprehensive testing scenarios for web forms. This work bridges the existing gap in automated web form testing by intertwining the capabilities of LLMs with advanced semantic inference methods. Our evaluation demonstrates that FormNexus combined with GPT-4 achieves 89% coverage in form submission states. This outcome significantly outstrips the performance of the best baseline model by a margin of 25%.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- A Reinforcement Learning Approach to Generating Test Cases for Web Applications2023
- Practical GUI Testing of Android Applications Via Model Abstraction and Refinement2019
- Deep Web crawling: a surveyWorld Wide Web, 2018
- Form Filling Based on Constraint Solving2018
- DroidBot: a lightweight UI-Guided test input generator for android2017
- Automatic generation of valid and invalid test data for string validation routines using web searches and regular expressionsScience of Computer Programming, 2015
- Learning to crawl deep webInformation Systems, 2013
- The ontological key: automatically understanding and integrating forms to access the deep WebThe VLDB Journal, 2013
- Automated web application testing using search based software engineering2011
- Automatic generation of agents for collecting hidden Web pages for data extractionData & Knowledge Engineering, 2003