9 Commits (0f2803de7a029aab8858afbb1fafa72da62a1fbb)

Author	SHA1	Message	Date
Fredo Guan	81ca323751	Davit update formatting and fix grad checkpointing (#7) ... fixed head to gap->norm->fc as per convnext, along with option for norm->gap->fc failed tests due to clip convnext models, davit tests passed	2 years ago
Ross Wightman	87939e6fab	Refactor device handling in scripts, distributed init to be less 'cuda' centric. More device args passed through where needed.	2 years ago
Ross Wightman	0dbd9352ce	Add bulk_runner script and updates to benchmark.py and validate.py for better error handling in bulk runs (used for benchmark and validation result runs). Improved batch size decay stepping on retry...	2 years ago
Ross Wightman	f0f9eccda8	Add --fuser arg to train/validate/benchmark scripts to select jit fuser type	3 years ago
Ross Wightman	e5da481073	Small post-merge tweak for freeze/unfreeze, add to __init__ for utils	3 years ago
Ross Wightman	7c97e66f7c	Remove commented code, add more consistent seed fn	4 years ago
Ross Wightman	4f49b94311	Initial AGC impl. Still testing.	4 years ago
Ross Wightman	27bbc70d71	Add back old ModelEma and rename new one to ModelEmaV2 to avoid compat breaks in dependant code. Shuffle train script, add a few comments, remove DataParallel support, support experimental torchscript training.	4 years ago
Ross Wightman	532e3b417d	Reorg of utils into separate modules	4 years ago