Applying empirical software engineering to software architecture: challenges and lessons learned
Authors:
Preprint
Abstract
In the last 15 years, software architecture has emerged as an important software engineering field for managing the development and maintenance of large, software- intensive systems. Software architecture community has developed numerous methods, techniques, and tools to support the architecture process (analysis, design, and review). Historically, most advances in software architecture have been driven by talented people and industrial experience, but there is now a growing need to systematically gather empirical evidence about the advantages or otherwise of tools and methods rather than just rely on promotional anecdotes or rhetoric. The aim of this paper is to promote and facilitate the application of the empirical paradigm to software architecture. To this end, we describe the challenges and lessons learned when assessing software architecture research that used controlled experiments, replications, expert opinion, systematic literature reviews, obser- vational studies, and surveys. Our research will support the emergence of a body of knowledge consisting of the more widely-accepted and well-formed software architecture theories.Keywords
All Related Versions
- Version 1, 2017-01-21, ArXiv
- Published version: Empirical Software Engineering, 15 (3), 250.
This publication has 30 references indexed in Scilit:
- Empirical studies of agile software development: A systematic reviewInformation and Software Technology, 2008
- The role of replications in empirical software engineering—a word of warningEmpirical Software Engineering, 2008
- Building Theories in Software Engineering2008
- Selecting Empirical Methods for Software Engineering Research2008
- Experiences using systematic review guidelinesJournal of Systems and Software, 2007
- Lessons from applying the systematic literature review process within the software engineering domainJournal of Systems and Software, 2007
- A Characterisation Schema for Software Testing TechniquesEmpirical Software Engineering, 2005
- Architecture-level modifiability analysis (ALMA)Journal of Systems and Software, 2004
- Using Students as Subjects—A Comparative Study of Students and Professionals in Lead-Time Impact AssessmentEmpirical Software Engineering, 2000
- Sharing the Wealth: Accumulating and Sharing Lessons Learned in Empirical Software Engineering ResearchEmpirical Software Engineering, 1998