Iterated Population Based Training with Task-Agnostic Restarts [ICML]

TL;DR We introduce a PBT variant that uses task-agnostic restarts to automatically adjust its step size and efficiently optimize hyperparameter schedules. | Paper | Code

Check out the poster for a high-level overview:

IPBT poster

P.S. Shout out to my supervisors & co-authors Tanja Alderliesten and Peter Bosman for their help with this research!