You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ross Wightman e520553e3e Update batchnorm freezing to handle NormAct variants, Add GroupNorm1Act, update BatchNormAct2d tracing change from PyTorch		2 years ago
..
__init__.py	Pass through --model-kwargs (and --opt-kwargs for train) from command line through to model __init__. Update some models to improve arg overlay. Cleanup along the way.	2 years ago
agc.py	Initial AGC impl. Still testing.	4 years ago
checkpoint_saver.py	Fix #387 so that checkpoint saver works with max history of 1. Add checkpoint-hist arg to train.py.	4 years ago
clip_grad.py	Initial AGC impl. Still testing.	4 years ago
cuda.py	Initial AGC impl. Still testing.	4 years ago
decay_batch.py	Add bulk_runner script and updates to benchmark.py and validate.py for better error handling in bulk runs (used for benchmark and validation result runs). Improved batch size decay stepping on retry...	2 years ago
distributed.py	Refactor device handling in scripts, distributed init to be less 'cuda' centric. More device args passed through where needed.	2 years ago
jit.py	disable nvfuser for jit te/legacy modes (for PT 1.12+)	2 years ago
log.py	…
metrics.py	Tweak accuracy topk safety. Fix #807	3 years ago
misc.py	Pass through --model-kwargs (and --opt-kwargs for train) from command line through to model __init__. Update some models to improve arg overlay. Cleanup along the way.	2 years ago
model.py	Update batchnorm freezing to handle NormAct variants, Add GroupNorm1Act, update BatchNormAct2d tracing change from PyTorch	2 years ago
model_ema.py	…
random.py	Remove commented code, add more consistent seed fn	4 years ago
summary.py	Scheduler update, add v2 factory method, support scheduling on updates instead of just epochs. Add LR to summary csv. Add lr_base scaling calculations to train script. Fix #1168	2 years ago