21 Commits (ba2ca4b46440c9fcf579fc66ca6df3082db44475)

Author	SHA1	Message	Date
Ross Wightman	ba2ca4b464	One codepath for stdconv, switch layernorm to batchnorm so gain included. Tweak epsilon values for nfnet, resnetv2, vit hybrid.	3 years ago
Ross Wightman	8e4ac3549f	All ScaledStdConv and StdConv uses default to using F.layernorm so that they work with PyTorch XLA. eps value tweaking is a WIP.	3 years ago
Ross Wightman	742c2d5247	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	3 years ago
Ross Wightman	18bf520ad1	Add eca_nfnet_l2/l3 defs for future training	3 years ago
Ross Wightman	21812d33aa	Add prelim efficientnet_v2s weights from 224x224 train, eval 83.3 @ 288. Add eca_nfnet_l1 weights, train at 256, eval 84 @ 320.	3 years ago
Ross Wightman	2bb65bd875	Wrong default_cfg pool_size for L1	3 years ago
Ross Wightman	9071568f0e	Add weights for SE NFNet-L0 model, rename nfnet_l0b -> nfnet_l0. 82.75 top-1 @ 288. Add nfnet_l1 model def for training.	3 years ago
Ross Wightman	14ac4abf74	Change huggingface hub revision delimiter to '@', add hf_hub reference for eca_nfnet_l0 model as an example.	3 years ago
Ross Wightman	740f32c96a	Add ECA-NFNet-L0 weights and update model name. Update README and bump version to 0.4.6	3 years ago
Ross Wightman	317ea3e599	Tweak NFNet, ResNetV2, RexNet feature extraction, use pre-act features for simplicty. Update tests for pytorch 1.8. 0.4.5 version bump.	3 years ago
Ross Wightman	678ba4e0a2	Add NFNet-F model weights ported from DeepMind Haiku impl and new set of models w/ compatible config.	3 years ago
Ross Wightman	5f9aff395c	Fix stem width in NFNet-F models, add some more comments, add some 'light' NFNet models for testing.	3 years ago
Ross Wightman	d86dbe45c2	Update README.md and few more comments	3 years ago
Ross Wightman	0d253e2c5e	Fix issue with nfnet tests, bit more cleanup.	3 years ago
Ross Wightman	cb06c7a910	Add NFNet-F models and tweak existing NF models.	3 years ago
Ross Wightman	e4de077021	Add first 'Normalizer Free' models. nf_regnet_b1 79.3 @ 288x288 test, and nf_resnet50 80.3 @ 256x256 test (80.68 @ 288x288).	3 years ago
Ross Wightman	dc85e5a237	Add ByobNet w/ GPU-EfficientNets and RepVGG. Also add classic vgg models.	3 years ago
Ross Wightman	f0e65e37b7	Fix NF-ResNet101 model defs	3 years ago
Ross Wightman	2de54d174a	Fix pool size defs for NFNet models, add a comment.	3 years ago
Ross Wightman	90980de4a9	Fix up a few details in NFResNet models, managed stable training. Add support for gamma gain to be applied in activation or ScaleStdConv. Some tweaks to ScaledStdConv.	3 years ago
Ross Wightman	5a8e1e643e	Initial Normalizer-Free Reg/ResNet impl. A bit of related layer refactoring.	3 years ago