A Metamorphic Relation-Based Approach to Testing Web Services Without Oracles
- 1 January 2012
- journal article
- Published by IGI Global Scientific Publishing in International Journal of Web Services Research
- Vol. 9 (1) , 51-73
Abstract
Service Oriented Architecture (SOA) has become a major application development paradigm. As a basic unit of SOA applications, Web services significantly affect the quality of the applications constructed from them. In the context of SOA, the specification and implementation of Web services are completely separated. The lack of source code and the restricted control of Web services limit the testability of Web services, and make the oracle problem prominent. In this context, can one alleviate the test oracle problem, or effectively and efficiently test such Web services even without oracles? It is an important issue which has not been yet adequately addressed. To address the challenge of testing Web services, the authors propose a metamorphic relation-based approach to testing Web services without oracles. The proposed approach leverages so-called metamorphic relations to generate test cases and evaluate test results. To make the proposed approach practical and effective, the authors proposed a framework taking into account the unique features of SOA, and developed a prototype which partially automates the framework. Three case studies are conducted to validate the feasibility and effectiveness of the proposed approach. The work presented in the paper not only alleviates the test oracle problem of testing Web services, but also delivers an effective and efficient test technique without oracles.Keywords
This publication has 24 references indexed in Scilit:
- A Mobile Agent-Based Tool Supporting Web Services TestingWireless Personal Communications, 2010
- An innovative approach for testing bioinformatics programs using metamorphic testingBMC Bioinformatics, 2009
- SERVICE-ORIENTED COMPUTING: A RESEARCH ROADMAPInternational Journal of Cooperative Information Systems, 2008
- A Metamorphic Testing Approach for Online Testing of Service-Oriented Software ApplicationsInternational Journal of Web Services Research, 2007
- Towards Contract-based Testing of Web ServicesElectronic Notes in Theoretical Computer Science, 2005
- Metamorphic Testing and Special Case Testing: A Case StudyJournal of Software, 2005
- An experimental mutation system for JavaACM SIGSOFT Software Engineering Notes, 2004
- Generating test cases for web services using data perturbationACM SIGSOFT Software Engineering Notes, 2004
- Fault-based testing without the need of oraclesInformation and Software Technology, 2003
- On Testing Non-Testable ProgramsThe Computer Journal, 1982