Infrastructure-Aware Functional Testing of MapReduce Programs
- 18 October 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 171-176
Abstract
Programs that process a large volume of data generally run in a distributed and parallel architecture, such as the programs implemented in the processing model MapReduce. In these programs, developers can abstract the infrastructure where the program will run and focus on the functional issues. However, the infrastructure configuration and its state cause different parallel executions of the program and some could derive in functional faults which are hard to reveal. In general, the infrastructure that executes the program is not considered during the testing, because the tests usually contain few input data and then the parallelization is not necessary. In this paper a testing technique is proposed to generate different infrastructure configurations for a given test input data, and then the program is executed in these configurations in order to reveal functional faults. This testing technique is automatized by using a test engine and is applied to a case study. As a result, several infrastructure configurations are automatically generated and executed for a test case revealing a functional fault that is then fixed by the developer.Keywords
This publication has 17 references indexed in Scilit:
- I8K|DQ-BigData: I8K Architecture Extension for Data Quality in Big DataLecture Notes in Computer Science, 2015
- Testing data transformations in MapReduce programs2015
- Method for testing the fault tolerance of MapReduce frameworksComputer Networks, 2015
- Investigating the inclinations of research and practices in Hadoop: A systematic review2014
- Trustworthiness of Big DataInternational Journal of Computer Applications, 2013
- Getting ready for BigData testing: A practitioner's perception2013
- PREFAILACM SIGPLAN Notices, 2011
- Characterizing cloud computing hardware reliability2010
- Software Testing Research: Achievements, Challenges, Dreams2007
- Combination testing strategies: a surveySoftware Testing, Verification and Reliability, 2005