Evaluating the Relative Performance of Engineering Design Projects: A Case Study Using Data Envelopment Analysis
Authors:
- 24 July 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Engineering Management
- Vol. 53 (3) , 471-482
Abstract
This paper presents a case study of how Data Envelopment Analysis (DEA) was applied to generate objective cross-project comparisons of project duration within an engineering department of the Belgian Armed Forces. To date, DEA has been applied to study projects within certain domains (e.g., software and R&D); however, DEA has not been proposed as a general project evaluation tool within the project management literature. In this case study, we demonstrate how DEA fills a gap not addressed by commonly applied project evaluation methods (such as earned value management) by allowing the objective comparison of projects on actual measures, such as duration and cost, by explicitly considering differences in key input characteristics across these projects. Thus, DEA can overcome the paradigm of project uniqueness and facilitate cross-project learning. We describe how DEA allowed the department to gain new insight about the impact of changes to its engineering design process (redesigned based on ISO 15288), creating a performance index that simultaneously considers project duration and key input variables that determine project duration. We conclude with directions for future research on the application of DEA as a project evaluation tool for project managers, program office managers, and other decision-makers in project-based organizationsKeywords
This publication has 58 references indexed in Scilit:
- DEA Evaluation of a Y2K Software Retrofit ProgramIEEE Transactions on Engineering Management, 2004
- Assessing joint maintenance shops in the Taiwanese Army using data envelopment analysisJournal of Operations Management, 2004
- Toward a theory of project interdependencies in high tech R&D environmentsJournal of Operations Management, 2002
- Success factors and future challenges in the management of faster-better-cheaper projects: lessons learned from NASAIEEE Transactions on Engineering Management, 2001
- Concurrent Engineering within British IndustryConcurrent Engineering, 2000
- A DEA Framework to Assess the Efficiency of the Software Requirements Capture and Analysis Process*Decision Sciences, 1999
- Evaluation of project outcomesConstruction Management and Economics, 1998
- Operational competitiveness analysis on software developmentJournal of the Operational Research Society, 1997
- Data Envelopment Analysis in the Presence of Both Quantitative and Qualitative FactorsJournal of the Operational Research Society, 1996
- A developmental study of data envelopment analysis in measuring the efficiency of maintenance units in the U.S. air forcesAnnals of Operations Research, 1984