Research Output
Augmenting Novelty Search with a Surrogate Model to Engineer Meta-Diversity in Ensembles of Classifiers
  Using Neuroevolution combined with Novelty Search to promote behavioural diversity is capable of constructing high-performing ensembles for classification. However, using gradient descent to train evolved architectures during the search can be computationally prohibitive. Here we propose a method to overcome this limitation by using a surrogate model which estimates the behavioural distance between two neural network architectures required to calculate the sparseness term in Novelty Search. We demonstrate a speedup of 10 times over previous work and significantly improve on previous reported results on three benchmark datasets from Computer Vision-CIFAR-10, CIFAR-100, and SVHN. This results from the expanded architecture search space facilitated by using a surrogate. Our method represents an improved paradigm for implementing horizontal scaling of learning algorithms by making an explicit search for diversity considerably more tractable for the same bounded resources.

  • Date:

    15 April 2022

  • Publication Status:

    Published

  • DOI:

  • Funders:

    Edinburgh Napier Funded

Citation

麻豆社区

Cardoso, R. P., Hart, E., Burth Kurka, D., & Pitt, J. (2022). Augmenting Novelty Search with a Surrogate Model to Engineer Meta-Diversity in Ensembles of Classifiers. In Applications of Evolutionary Computation: EvoApplications 2022 (418-434). https://doi.org/10.1007/978-3-031-02462-7_27

Authors

Keywords

diversity, ensemble, novelty search, surrogate

Monthly Views:

Available Documents