[Zurück]

A. Wendt, M. Wuschnig, M. Lechner:
"Speeding up Common Hyperparameter Optimization Methods by a Two-Phase-Search";
in: "IECON 2020 The 46th Annual Conference of the IEEE Industrial Electronics Society", herausgegeben von: Ieee Ies; IEEE Industrial Electronics Society, Singapore (online), 2020, ISBN: 978-1-7281-5413-8, S. 517 - 522.

Hyperparameter search concerns everybody who works with machine learning. We compare publicly available hyperparameter searches on four datasets. We develop metrics to measure the performance of hyperparameter searches across datasets of different sizes as well as machine learning algorithms. Further, we propose a method of speeding up the search by using subsets of data. Results show that random search performs well compared to Bayesian methods and that a
combined search can speed up the search by a factor of 5.

hyperparameter, machine learning, support vector machine, random forest, Bayesian optimization, optimization