pytorch-image-models

Commit Graph

Author	SHA1	Message	Date
Ross Wightman	f0507f6da6	Fix k_decay default arg != 1.0 in poly scheduler	3 years ago
Ross Wightman	29a37e23ee	LR scheduler update: * add polynomial decay 'poly' * cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt * add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909 * change default tanh ub/lb to push inflection to later epochs	3 years ago

Author

SHA1

Message

Date

Ross Wightman

f0507f6da6

Fix k_decay default arg != 1.0 in poly scheduler

Ross Wightman

29a37e23ee

LR scheduler update:

* add polynomial decay 'poly'
* cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt
* add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909
* change default tanh ub/lb to push inflection to later epochs

2 Commits (69e90dcd8c466b3045877ed39f00a8e36331eaf5)