On the Use of DEA for Software Development Productivity Measurement
Authors:
- 26 October 2016
- journal article
- Published by Emerald Publishing in Data Envelopment Analysis Journal
- Vol. 2 (1) , 81-111
Abstract
This paper first, based on a thorough review of the relevant literature, provides a general discussion of some of the many aspects one should consider when using Data Envelopment Analysis (DEA) to measure the efficiency of software development. It then contains a case study which investigates a few of the important aspects. Finally it provides recommendations and directions for future research in the area. Rather than simply presenting a “final” set of results, the empirical study takes a step-by-step approach to considering, and thus illustrating, some of the issues to be aware of when doing empirical analysis, many of which are not limited to efficiency assessment of software development. Thus this paper, besides providing a thorough literature review and resulting guidelines specifically for the analysis of software development productivity, also aims at providing a practical “how to” guide for the empirical analysis that can be used more generally. In terms of actual empirical results, we find a clear indication of variable returns to scale, of differences between new and evolutions developments and some indications of differences between programming languages. We also include potentially relevant variables such as requirements volatility, reliability (number of defects) and discuss many other relevant variables, for which data were not available here.Keywords
This publication has 31 references indexed in Scilit:
- Measuring and predicting software productivity: A systematic map and reviewInformation and Software Technology, 2011
- Economies and diseconomies of scale in software developmentJournal of Software Maintenance and Evolution: Research and Practice, 2011
- Using Data Envelopment Analysis in software development productivity measurementSoftware Process: Improvement and Practice, 2006
- An empirical study of maintenance and development estimation accuracyJournal of Systems and Software, 2002
- The question of scale economies in software—why cannot researchers agree?Information and Software Technology, 2002
- Applications of DEA to measure the efficiency of software production at two large Canadian banksAnnals of Operations Research, 1997
- Evidence on economies of scale in software developmentInformation and Software Technology, 1994
- Returns-to-Scale in Software Production: A Comparison of Approaches1993
- Programming methodology, organizational environment, and programming productivityJournal of Systems and Software, 1981
- Measuring the efficiency of decision making unitsEuropean Journal of Operational Research, 1978