Commit Graph

12 Commits (1ea0be1b17d2238ae9c884b28ac38207f06f2f26)

Author SHA1 Message Date
alec.tu 74d6afb4cd Add Adan to __init__.py 2 years ago
Ross Wightman a16a753852 Add lamb/lars to optim init imports, remove stray comment 3 years ago
Ross Wightman 8a9eca5157 A few optimizer comments, dead import, missing import 3 years ago
Ross Wightman ac469b50da Optimizer improvements, additions, cleanup 3 years ago
juntang addfc7c1ac adabelief 4 years ago
Ross Wightman 288682796f Update benchmark script to add precision arg. Fix some downstream (DeiT) compat issues with latest changes. Bump version to 0.4.7 4 years ago
Ross Wightman 0e16d4e9fb Add benchmark.py script, and update optimizer factory to be more friendly to use outside of argparse interface. 4 years ago
Ross Wightman 80078c47bb Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 4 years ago
Sangdoo Yun e93e571f7a Add `adamp` and 'sgdp' optimizers. 5 years ago
Ross Wightman 64966f61f7 Add Nvidia's NovogGrad impl from Jasper (cleaner/faster than current) and Apex Fused optimizers 5 years ago
Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak. 5 years ago
Ross Wightman aa4354f466 Big re-org, working towards making pip/module as 'timm' 6 years ago