You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
pytorch-image-models/timm/optim
Ross Wightman f35d6ea57b
Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers
2 years ago
..
__init__.py Add Adan to __init__.py 2 years ago
adabelief.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
adafactor.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
adahessian.py Add Adafactor and Adahessian optimizers, cleanup optimizer arg passing, add gradient clipping support. 4 years ago
adamp.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
adamw.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
adan.py Add Adan optimizer 2 years ago
lamb.py MOAR optimizer changes. Woo! 3 years ago
lars.py fix lars 3 years ago
lion.py Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers 2 years ago
lookahead.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
madgrad.py MOAR optimizer changes. Woo! 3 years ago
nadam.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
nvnovograd.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
optim_factory.py Add multi-tensor (foreach) version of Lion in style of upcoming PyTorch 2.0 optimizers 2 years ago
radam.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
rmsprop_tf.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago
sgdp.py More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars. 3 years ago