On the value of user preferences in search-based software engineering: A case study in software product lines
- 1 May 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 02705257,p. 492-501
Abstract
Software design is a process of trading off competing objectives. If the user objective space is rich, then we should use optimizers that can fully exploit that richness. For example, this study configures software product lines (expressed as feature maps) using various search-based software engineering methods. As we increase the number of optimization objectives, we find that methods in widespread use (e.g. NSGA-II, SPEA2) perform much worse than IBEA (Indicator-Based Evolutionary Algorithm). IBEA works best since it makes most use of user preference knowledge. Hence it does better on the standard measures (hypervolume and spread) but it also generates far more products with 0% violations of domain constraints. Our conclusion is that we need to change our methods for search-based software engineering, particularly when studying complex decision spaces.Keywords
This publication has 26 references indexed in Scilit:
- A genetic algorithm for optimized feature selection with resource constraints in software product linesJournal of Systems and Software, 2011
- Simulating and optimising design decisions in quantitative goal models2011
- S.P.L.O.T.2009
- Software project planning for robustness and completion time in the presence of uncertainty using multi objective search based software engineering2009
- Decision-making coordination in collaborative product configuration2008
- Optimal antenna placement using a new multi-objective chc algorithm2007
- The Current State and Future of Search Based Software Engineering2007
- Feature-oriented product line engineeringIEEE Software, 2002
- Search-based software engineeringInformation and Software Technology, 2001
- Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approachIEEE Transactions on Evolutionary Computation, 1999