Revealing Domain-Spatiality Patterns for Configuration Tuning: Domain Knowledge Meets Fitness Landscapes
Open Access
- 26 March 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
Abstract
Configuration tuning for better performance is crucial in quality assurance. Yet, there has long been a mystery on tuners’ effectiveness, due to the black-box nature of configurable systems. Prior efforts predominantly adopt static domain analysis (e.g., static taint analysis), which often lacks generalizability, or dynamic data analysis (e.g., benchmarking performance analysis), limiting explainability. In this work, we embrace Fitness Landscape Analysis (FLA) as a bridge between domain knowledge and difficulty of the tuning. We propose Domland , a two-pronged methodology that synergizes the spatial information obtained from FLA and domain-driven analysis to systematically capture the hidden characteristics of configuration tuning cases, explaining how and why a tuner might succeed or fail. This helps to better interpret and contextualize the behavior of tuners and inform tuner design. To evaluate Domland , we conduct a case study of nine software systems and 93 workloads, from which we reveal several key findings: (1) configuration landscapes are inherently system-specific, with no single domain factor (e.g., system area, programming language, or resource intensity) consistently shaping their structure; (2) the core options (e.g., pic-struct of x264), which control the main functional flows, exert a stronger influence on landscape ruggedness (i.e. the difficulty of tuning) compared to resource options (e.g., cpu-independent of x264); (3) Workload effects on landscape structure are not uniformly tied to type or scale. Both contribute to landscape variations, but their impact is system-dependent.Keywords
All Related Versions
This publication has 57 references indexed in Scilit:
- CoTune: Co-evolutionary Configuration Tuning2025
- Twins or False Friends? A Study on Energy Consumption and Performance of Configurable Software2023
- A survey of fitness landscape analysis for optimizationNeurocomputing, 2022
- An Evolutionary Study of Configuration Design and Implementation in Cloud Systems2021
- ConfigCrusher: towards white-box performance analysis for configurable systemsAutomated Software Engineering, 2020
- A self-feedback strategy differential evolution with fitness landscape analysisSoft Computing, 2018
- Empirical fitness landscapes and the predictability of evolutionNature Reviews Genetics, 2014
- A survey of techniques for characterising fitness landscapes and some possible ways forwardInformation Sciences, 2013
- Benchmarking Kappa: Interrater Agreement in Software Process AssessmentsEmpirical Software Engineering, 1999
- Landscapes and their correlation functionsJournal of Mathematical Chemistry, 1996