Commit Graph

23 Commits (de5fa791c623eaa08760672b51e605781342195f)

Author SHA1 Message Date
Ross Wightman ab49d275de Significant norm update
3 years ago
Ross Wightman bda8ab015a Remove min channels for SelectiveKernel, divisor should cover cases well enough.
3 years ago
Ross Wightman a27f4aec4a Missed args for skresnext w/ refactoring.
3 years ago
Ross Wightman 307a935b79 Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.
3 years ago
Ross Wightman d5473c17f7 Fix incorrect name of shortcut/identity paths in many residual nets. Inherited from naming in old old torchvision, long fixed there.
4 years ago
Ross Wightman d584e7f617 Support for huggingface hub via create_model and default_cfgs.
4 years ago
Yusuke Uchida f6b56602f9 fix test_model_default_cfgs
4 years ago
Ross Wightman 6c17d57a2c Fix some attributions, add copyrights to some file docstrings
4 years ago
Ross Wightman 3b9004bef9 Lots of changes to model creation helpers, close to finalizing feature extraction / interfaces
4 years ago
Ross Wightman d23a2697d0 Working on feature extraction, interfaces refined, a number of models working, some in progress.
4 years ago
Ross Wightman 8d8677e03b Fix #139. Broken SKResNets after BlurPool addition, as a plus, SKResNets support AA now too.
5 years ago
Ross Wightman f1d5f8a6c4 Update comments for Selective Kernel and DropBlock/Path impl, add skresnet34 weights
5 years ago
Ross Wightman 569419b38d Tweak some comments, add SKNet models with weights to sotabench, remove an unused branch
5 years ago
Ross Wightman fa38f24967 Update SK network configs, add weights for skresnet8 and skresnext50
5 years ago
Ross Wightman f902bcd54c Layer refactoring continues, ResNet downsample rewrite for proper dilation in 3x3 and avg_pool cases
5 years ago
Ross Wightman 13746a33fc Big move, layer modules and fn to timm/models/layers
5 years ago
Ross Wightman 13e8da2b46 SelectKernel split_input works best when input channels split like grouped conv, but output is full width. Disable zero_init for SK nets, seems a bad combo.
5 years ago
Ross Wightman 7d07ebb660 Adding some configs to sknet, incl ResNet50 variants from 'Compounding ... Assembled Techniques' paper and original SKNet50
5 years ago
Ross Wightman a9d2424fd1 Add separate zero_init_last_bn function to support more block variety without a mess
5 years ago
Ross Wightman 9f11b4e8a2 Add ConvBnAct layer to parallel integrated SelectKernelConv, add support for DropPath and DropBlock to ResNet base and SK blocks
5 years ago
Ross Wightman cefc9b7761 Move SelectKernelConv to conv2d_layers and more
5 years ago
Ross Wightman 9abe610931 Used wrong channel var for split
5 years ago
Ross Wightman 58e28dc7e7 Move Selective Kernel blocks/convs to their own sknet.py file
5 years ago