7 Commits (9bcd65181badec95213b47edbf3a96bc12f8e39b)

Author	SHA1	Message	Date
Ross Wightman	9bcd65181b	Add exponential moving average for model weights + few other additions and cleanup ... * ModelEma class added to track an EMA set of weights for the model being trained * EMA handling added to train, validation and clean_checkpoint scripts * Add multi checkpoint or multi-model validation support to validate.py * Add syncbn option (APEX) to train script for experimentation * Cleanup interface of CheckpointSaver while adding ema functionality	5 years ago
Ross Wightman	4d2056722a	Mixup and prefetcher improvements ... * Do mixup in custom collate fn if prefetcher enabled, reduces performance impact * Move mixup code to own file * Add arg to disable prefetcher * Fix no cuda transfer when prefetcher off * Random erasing when prefetcher off wasn't changed to match new args, fixed * Default random erasing to off (prob = 0.) for train	5 years ago
Ross Wightman	fee607edf6	Mixup implemention in progress ... * initial impl w/ label smoothing converging, but needs more testing	5 years ago
Ross Wightman	db1fe34d0c	Update a few comment, add some references	6 years ago
Ross Wightman	f1cd1a5ce3	Cleanup CheckpointSaver, add support for increasing or decreasing metric, switch to prec1 metric in train loop	6 years ago
Ross Wightman	a336e5bff3	Minor updates	6 years ago
Ross Wightman	5855b07ae0	Initial commit, puting some ol pieces together	6 years ago