A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering
Authors:
- Muhammad UsmanMUMuhammad Usman
- Nauman Bin AliNANauman Bin Ali
- Claes WohlinCWClaes Wohlin
Open Access
- 1 January 2023
- journal article
- research article
- Published by Politechnika Wroclawska Oficyna Wydawnicza in e-Informatica Software Engineering Journal
- Vol. 17 (1)
Abstract
Background: Systematic literature reviews (SLRs) have become a standard practice as part of software engineering (SE) research, although their quality varies. To build on the reviews, both for future research and industry practice, they need to be of high quality. Aim: To assess the quality of SLRs in SE, we put forward an appraisal instrument for SLRs. Method: A well-established appraisal instrument from research in healthcare was used as a starting point to develop the instrument. It is adapted to SE using guidelines, checklists, and experiences from SE. The first version was reviewed by four external experts on SLRs in SE and updated based on their feedback. To demonstrate its use, the updated version was also used by the authors to assess a sample of six selected systematic literature studies. Results: The outcome of the research is an appraisal instrument for quality assessment of SLRs in SE. The instrument includes 15 items with different options to capture the quality. The instrument also supports consolidating the items into groups, which are then used to assess the overall quality of an SLR. Conclusion: The presented instrument may be helpful support for an appraiser in assessing the quality of SLRs in SE.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- A paradigmatic object-oriented programming language: Design, static typing and semanticsJournal of Functional Programming, 2008
- A lambda calculus of objects and method specialization2002
- PolyTOIL: A Type-Safe Polymorphic Object-Oriented Language2000
- A Subtyping for Extensible, Incomplete ObjectsFundamenta Informaticae, 1999
- A behavioral notion of subtypingACM Transactions on Programming Languages and Systems, 1994
- An axiomatic basis for computer programmingCommunications of the ACM, 1969