8 Commits (7bbbd5ef1b2ad03ace04982152a8ca395fed4f43)

Author	SHA1	Message	Date
Ross Wightman	7bbbd5ef1b	EvoNorm and GroupNormAct options for debugging TPU / XLA concerns	3 years ago
Ross Wightman	af607b75cc	Prep a set of ResNetV2 models with GroupNorm, EvoNormB0, EvoNormS0 for BN free model experiments on TPU and IPU	3 years ago
Ross Wightman	9811e229f7	Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.	3 years ago
Ross Wightman	231d04e91a	ResNetV2 pre-act and non-preact model, w/ BiT pretrained weights and support for ViT R50 model. Tweaks for in21k num_classes passing. More to do... tests failing.	3 years ago
Ross Wightman	3aebc2f06c	Switch DPN to use BnAct layer, train a new DPN 68b model with RA to 79.21	4 years ago
Ross Wightman	f28170df3f	Fix an an untested change, remove a debug print	4 years ago
Ross Wightman	eb7653614f	Monster commit, activation refactor, VoVNet, norm_act improvements, more ... * refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto * implement hard-mish, better grad for hard-swish * add initial VovNet V1/V2 impl, fix #151 * VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN) * Wrap IABN for any models that use it * make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests	4 years ago
Ross Wightman	14edacdf9a	DenseNet converted to support ABN (norm + act) modules. Experimenting with EvoNorm, IABN	4 years ago