Commit Graph

3 Commits (029a2cb4490740b7768aedee5e5ad89c66a72340)

Author SHA1 Message Date
Ross Wightman a426511c95 More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.
4 years ago
Ross Wightman ac469b50da Optimizer improvements, additions, cleanup
4 years ago
Ross Wightman fac58f609a Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.
6 years ago