Martínez, Yuliana and Trujillo, Leonardo and Legrand, Pierrick and Galván López, Edgar (2016) Prediction of expected performance for a genetic programming classifier. Genetic Programming and Evolvable Machines, 17. pp. 409-449. ISSN 1573-7632

Preview

Download (2MB) | Preview

Abstract

The estimation of problem difficulty is an open issue in genetic programming (GP). The goal of this work is to generate models that predict the expected performance of a GP-based classifier when it is applied to an unseen task. Classification problems are described using domain-specific features, some of which are proposed in this work, and these features are given as input to the predictive models. These models are referred to as predictors of expected performance. We extend this approach by using an ensemble of specialized predictors (SPEP), dividing classification problems into groups and choosing the corresponding SPEP. The proposed predictors are trained using 2D synthetic classification problems with balanced datasets. The models are then used to predict the performance of the GP classifier on unseen real-world datasets that are multidimensional and imbalanced. This work is the first to provide a performance prediction of a GP system on test data, while previous works focused on predicting training performance. Accurate predictive models are generated by posing a symbolic regression task and solving it with GP. These results are achieved by using highly descriptive features and including a dimensionality reduction stage that simplifies the learning and testing process. The proposed approach could be extended to other classification algorithms and used as the basis of an expert system for algorithm selection.

Item Type:	Article
Keywords:	Problem difficulty; Prediction of expected performance; Genetic programming; Supervised learning;
Academic Unit:	Faculty of Science and Engineering > Computer Science Faculty of Science and Engineering > Research Institutes > Hamilton Institute
Item ID:	12329
Identification Number:	https://doi.org/10.1007/s10710-016-9265-9
Depositing User:	Edgar Galvan
Date Deposited:	31 Jan 2020 11:44
Journal or Publication Title:	Genetic Programming and Evolvable Machines
Publisher:	Springer
Refereed:	Yes
URI:	Publisher
Use Licence:	This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

Repository Staff Only(login required)

Item control page

Downloads

Origin of downloads