10 Commits (57992509f9f663036faa59d1ef553226badd84d4)

Author	SHA1	Message	Date
Ross Wightman	925e102982	Update attention / self-attn based models from a series of experiments: ... * remove dud attention, involution + my swin attention adaptation don't seem worth keeping * add or update several new 26/50 layer ResNe(X)t variants that were used in experiments * remove models associated with dead-end or uninteresting experiment results * weights coming soon...	3 years ago
Ross Wightman	307a935b79	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	3 years ago
Ross Wightman	742c2d5247	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	3 years ago
Ross Wightman	9811e229f7	Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.	3 years ago
Ross Wightman	5a8e1e643e	Initial Normalizer-Free Reg/ResNet impl. A bit of related layer refactoring.	3 years ago
Ross Wightman	6c17d57a2c	Fix some attributions, add copyrights to some file docstrings	4 years ago
Ross Wightman	eb7653614f	Monster commit, activation refactor, VoVNet, norm_act improvements, more ... * refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto * implement hard-mish, better grad for hard-swish * add initial VovNet V1/V2 impl, fix #151 * VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN) * Wrap IABN for any models that use it * make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests	4 years ago
Chris Ha	06a50a94a8	Fix minor typos in create_attn.py and resnet.py ... 'eca'->'ceca' and doest not-> does not	4 years ago
Ross Wightman	5e6dbbaf30	Add CBAM for experimentation	4 years ago
Ross Wightman	f902bcd54c	Layer refactoring continues, ResNet downsample rewrite for proper dilation in 3x3 and avg_pool cases ... * select_conv2d -> create_conv2d * added create_attn to create attention module from string/bool/module * factor padding helpers into own file, use in both conv2d_same and avg_pool2d_same * add some more test eca resnet variants * minor tweaks, naming, comments, consistency	4 years ago