Explaining evolutionary feature selection via local optima networks

Citation

Adair J, Thomson SL & Brownlee AEI (2024) Explaining evolutionary feature selection via local optima networks. In: GECCO '24 Companion: Genetic and Evolutionary Computation Conference Companion, Melbourne, Australia, 14.07.2024-18.05.2024. ACMDL. https://doi.org/10.1145/3638530.3664183

Abstract
We analyse tness landscapes of evolutionary feature selection to obtain information about feature importance in supervised machine learning. Local optima networks (LONs) are a compact representation of a landscape, and can potentially be adapted for use in explainable artiicial intelligence (XAI). This work examines their applicability for discerning feature importance in supervised machine learning datasets. We visualise aspects of feature selection LONs for a breast cancer prediction dataset as case study, and this process reveals information about the composition of feature sets for the underlying ML models. The estimations of feature importance obtained from LONs are compared with the coeecients extracted from logistic regression models (interpretable AI), and also against feature importances obtained through an established XAI technique: SHAP (explainable AI). We nd that the features present in the LON are not strongly correlated with the model coeecients and SHAP values derived from a model trained prior to feature selection, nor are they strongly correlated within similar groups of local optima after feature selection, calling into question the eeects of constraining the feature space for wrapper-based techniques based on such ranking metrics.

Keywords
CCS CONCEPTS; Mathematics of computing; Graph algorithms; Combina- torial algorithms; Theory of computation → Evolutionary algorithms KEYWORDS Fitness Landscapes; Explainable AI; Local Optima Networks (LONs)