Cognitive Evolutionary Search to Select Feature Interactions for Click-Through Rate Prediction
Open Access
- 4 August 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 3151-3161
Abstract
Click-Through Rate (CTR) prediction of intelligent marketing systems is of great importance, in which feature interaction selection plays a key role. Most approaches model interactions of features by the same pre-defined operation under expert guidance, among which improper interactions may bring unnecessary noise and complicate the training process. To that end, in this paper, we aim to adaptively evolve the model to select proper operations to interact on feature pairs under task guidance. Inspired by natural evolution, we propose a general Cognitive EvoLutionary Search (CELS) framework, where cognitive ability refers to the malleability of organisms to orientate to the environment. Specifically, we conceptualize interactions as genomes, models as organisms, and tasks as natural environments. Mirroring how genetic malleability develops environmental adaptability, we thus diagnose the fitness of models to simulate the survival rates of organisms for natural selection, thereby an evolution path can be planned and visualized, offering an intuitive interpretation of the mechanisms underlying interaction modeling and selection. Based on the CELS framework, we develop four instantiations including individual-based search and population-based search. We demonstrate how individual mutation and population crossover enable CELS to evolve into diverse models suitable for various tasks and data, providing ready-to-use models. Extensive experiments on real-world datasets demonstrate that CELS significantly outperforms state-of-the-art approaches.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFF0901003)
- National Natural Science Foundation of China (U20A20229)
This publication has 50 references indexed in Scilit:
- Negatively Correlated SearchIEEE Journal on Selected Areas in Communications, 2016
- A Survey on Evolutionary Computation Approaches to Feature SelectionIEEE Transactions on Evolutionary Computation, 2015
- Family environment and the malleability of cognitive ability: A Swedish national home-reared and adopted-away cosibling control studyProceedings of the National Academy of Sciences, 2015
- Plasticity of the aging brain: New directions in cognitive neuroscienceScience, 2014
- Classifier design with feature selection and feature extraction using layered genetic programmingExpert Systems with Applications, 2008
- Evolution strategiesScholarpedia, 2007
- Genetic programming for simultaneous feature selection and classifier designIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2006
- From an individual to a population: an analysis of the first hitting time of population-based evolutionary algorithmsIEEE Transactions on Evolutionary Computation, 2002
- Understanding the nature of the general factor of intelligence: The role of individual differences in neural plasticity as an explanatory mechanism.Psychological Review, 2002
- Wrappers for feature subset selectionArtificial Intelligence, 1997