10 Commits (b57a03bd0d52c6a0aebd9c35b2f23e97a10ec33d)

Author	SHA1	Message	Date
Ross Wightman	307a935b79	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	3 years ago
Ross Wightman	8bf63b6c6c	Able to use other attn layer in EfficientNet now. Create test ECA + GC B0 configs. Make ECA more configurable.	3 years ago
Ross Wightman	f615474be3	Fix broken test, repvgg block doesn't have attn_last attr.	3 years ago
Ross Wightman	742c2d5247	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	3 years ago
Ross Wightman	110a7c4982	AdaptiveAvgPool2d -> mean((2,3)) for all SE/attn layers to avoid NaN with AMP + channels_last layout. See https://github.com/pytorch/pytorch/issues/43992	4 years ago
Sepehr Sameni	20290b5b56	fix typo in eca	4 years ago
Ross Wightman	569419b38d	Tweak some comments, add SKNet models with weights to sotabench, remove an unused branch	4 years ago
Ross Wightman	d725991870	Remove debug print from ECA module	4 years ago
Ross Wightman	f902bcd54c	Layer refactoring continues, ResNet downsample rewrite for proper dilation in 3x3 and avg_pool cases ... * select_conv2d -> create_conv2d * added create_attn to create attention module from string/bool/module * factor padding helpers into own file, use in both conv2d_same and avg_pool2d_same * add some more test eca resnet variants * minor tweaks, naming, comments, consistency	4 years ago
Ross Wightman	4defbbbaa8	Fix module name mistake, start layers sub-package	4 years ago