Analysis of algorithm components and parameters : some case studies
MetadataShow full item record
Altmetrics Handle Statistics
Altmetrics DOI Statistics
Modern high-performing algorithms are usually highly parameterised, and can be configured either manually or by an automatic algorithm configurator. The algorithm performance dataset obtained after the configuration step can be used to gain insights into how different algorithm parameters influence algorithm performance. This can be done by a number of analysis methods that exploit the idea of learning prediction models from an algorithm performance dataset and then using them for the data analysis on the importance of variables. In this paper, we demonstrate the complementary usage of three methods along this line, namely forward selection, fANOVA and ablation analysis with surrogates on three case studies, each of which represents some special situations that the analyses can fall into. By these examples, we illustrate how to interpret analysis results and discuss the advantage of combining different analysis methods.
Dang , N & De Causmaecker , P 2018 , Analysis of algorithm components and parameters : some case studies . in R Battiti , M Brunato , I Kotsireas & P M Pardalos (eds) , Learning and Intelligent Optimization : 12th International Conference, LION 12, Kalamata, Greece, June 10–15, 2018, Revised Selected Papers . Lecture Notes in Computer Science (Theoretical Computer Science and General Issues) , vol. 11353 , Springer , Cham , pp. 288-303 , Learning and Intelligent Optimization Conference (LION 12) , Kalamata , Greece , 10/06/18 . https://doi.org/10.1007/978-3-030-05348-2_25conference
Learning and Intelligent Optimization
© 2019, Springer Nature Switzerland AG. This work has been made available online in accordance with the publisher's policies. This is the author created accepted version manuscript following peer review and as such may differ slightly from the final published version. The final published version of this work is available at https://doi.org/10.1007/978-3-030-05348-2_25
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.