Commit Graph

6 Commits (d4c0588012a9b5d9fddd13035a9682acd9db0ad7)

Author SHA1 Message Date
Ross Wightman ab49d275de Significant norm update
3 years ago
Ross Wightman 742c2d5247 Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.
3 years ago
Ross Wightman 110a7c4982 AdaptiveAvgPool2d -> mean((2,3)) for all SE/attn layers to avoid NaN with AMP + channels_last layout. See https://github.com/pytorch/pytorch/issues/43992
4 years ago
Ross Wightman 6c17d57a2c Fix some attributions, add copyrights to some file docstrings
4 years ago
Ross Wightman 569419b38d Tweak some comments, add SKNet models with weights to sotabench, remove an unused branch
4 years ago
Ross Wightman 5e6dbbaf30 Add CBAM for experimentation
5 years ago