Commit Graph

4 Commits (c9f208f7f8d5917f9a900ef2f96d9aa2ffb9264e)

Author SHA1 Message Date
Ross Wightman a426511c95 More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.
4 years ago
Ross Wightman ac469b50da Optimizer improvements, additions, cleanup
4 years ago
Ross Wightman 64966f61f7 Add Nvidia's NovogGrad impl from Jasper (cleaner/faster than current) and Apex Fused optimizers
6 years ago
Ross Wightman ba3c97c3ad Some Lookahead cleanup and fixes
6 years ago