A robustness testing approach for SOAP Web services
Open Access
- 14 July 2012
- journal article
- Published by Sociedade Brasileira de Computação in Journal of Internet Services and Applications
- Vol. 3 (2) , 215-232
Abstract
The use of Web services in enterprise applications is quickly increasing. In a Web services environment, providers supply a set of services for consumers. However, although Web services are being used in business-critical environments, there are no practical means to test or compare their robustness to invalid and malicious inputs. In fact, client applications are typically developed with the assumption that the services being used are robust, which is not always the case. Robustness failures in such environments are particularly dangerous, as they may originate vulnerabilities that can be maliciously exploited, with severe consequences for the systems under attack. This paper addresses the problem of robustness testing in Web services environments. The proposed approach is based on a set of robustness tests (including both malicious and non-malicious invalid call parameters) that is used to discover programming and design errors. This approach, useful for both service providers and consumers, is demonstrated by two sets of experiments, showing, respectively, the use of Web services Robustness testing from the consumer and the provider points of view. The experiments comprise the robustness testing of 1,204 Web service operations publicly available in the Internet and of 29 home-implemented services, including two different implementations of the Web services specified by the standard TPC-App performance benchmark. Results show that many Web services are deployed with critical robustness problems and that robustness testing is an effective approach to improve services quality.Keywords
This publication has 20 references indexed in Scilit:
- Quality analysis of composed services through fault injectionInformation Systems Frontiers, 2008
- Benchmarking the Robustness of Web Services2007
- Comparing the robustness of POSIX operating systems2003
- Development of a benchmark to measure system robustness2002
- Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDIIEEE Internet Computing, 2002
- Machine learning in automated text categorizationACM Computing Surveys, 2002
- MAFALDA: Microkernel Assessment by Fault Injection and Design Aid1999
- Testing component-based software: a cautionary taleIEEE Software, 1998
- Measuring software dependability by robustness benchmarkingIEEE Transactions on Software Engineering, 1997
- Software dependability in the Tandem GUARDIAN systemIEEE Transactions on Software Engineering, 1995