Towards a framework and a benchmark for testing tools for multi‐threaded programs
Authors:
- 1 August 2006
- journal article
- conference paper
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 19 (3) , 267-279
Abstract
Multi‐threaded code is becoming very common, both on the server side, and very recently for personal computers as well. Consequently, looking for intermittent bugs is a problem that is receiving more and more attention. As there is no silver bullet, research focuses on a variety of partial solutions. We outline a road map for combining the research within the different disciplines of testing multi‐threaded programs and for evaluating the quality of this research. We have three main goals. First, to create a benchmark that can be used to evaluate different solutions. Second, to create a framework with open application programming interfaces that enables the combination of techniques in the multi‐threading domain. Third, to create a focus for the research in this area around which a community of people who try to solve similar problems with different techniques can congregate. We have started creating such a benchmark and describe the lessons learned in the process. The framework will enable technology developers, for example, developers of race detection algorithms, to concentrate on their components and use other ready made components (e.g. an instrumentor) to create a testing solution. Copyright © 2006 John Wiley & Sons, Ltd.Keywords
This publication has 19 references indexed in Scilit:
- Multi-threaded Testing with AOP Is Easy, and It Finds Bugs!Lecture Notes in Computer Science, 2005
- Rule-Based Runtime Verification2004
- Using Block-Local Atomicity to Detect Stale-Value Concurrency ErrorsLecture Notes in Computer Science, 2004
- Tool support for testing concurrent java componentsIEEE Transactions on Software Engineering, 2003
- Ownership types for safe programming2002
- Model checking JAVA programs using JAVA PathFinderInternational Journal on Software Tools for Technology Transfer, 2000
- Runtime Checking of Multithreaded Applications with Visual Threads2000
- Toward Integration of Data Race Detection in DSM SystemsJournal of Parallel and Distributed Computing, 1999
- All-du-path coverage for parallel programsACM SIGSOFT Software Engineering Notes, 1998
- EraserACM Transactions on Computer Systems, 1997