You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. ... * Add some of the trendy new optimizers. Decent results but not clearly better than the standards. * Can create a None scheduler for constant LR * ResNet defaults to zero_init of last BN in residual * add resnet50d config		5 years ago
..
__init__.py	…
cosine_lr.py	…
plateau_lr.py	…
scheduler.py	A number of tweaks to arguments, epoch handling, config	5 years ago
scheduler_factory.py	Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.	5 years ago
step_lr.py	…
tanh_lr.py	Remove all prints, change most to logging calls, tweak alignment of batch logs, improve setup.py	5 years ago