Commit Graph

173 Commits (f66e5f0e35c83f086f5fe788af7d6ef5f1804001)

Author SHA1 Message Date
Ross Wightman 9811e229f7 Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.
4 years ago
Ross Wightman a39c3ee216
Merge branch 'master' into eca-weights
4 years ago
Ross Wightman 68a4144882 Add new weights for ecaresnet26t/50t/269d models. Remove distinction between 't' and 'tn' (tiered models), tn is now t. Add test time img size spec to default cfg.
4 years ago
Ross Wightman b9843f954b
Merge pull request #282 from tigert1998/patch-1
4 years ago
hwangdeyu 7a4be5c035 add operator HardSwishJitAutoFn export to onnx
4 years ago
Ross Wightman 90980de4a9 Fix up a few details in NFResNet models, managed stable training. Add support for gamma gain to be applied in activation or ScaleStdConv. Some tweaks to ScaledStdConv.
4 years ago
Ross Wightman 5a8e1e643e Initial Normalizer-Free Reg/ResNet impl. A bit of related layer refactoring.
4 years ago
Ross Wightman 231d04e91a ResNetV2 pre-act and non-preact model, w/ BiT pretrained weights and support for ViT R50 model. Tweaks for in21k num_classes passing. More to do... tests failing.
4 years ago
Ross Wightman 2ed8f24715 A few more changes for 0.3.2 maint release. Linear layer change for mobilenetv3 and inception_v3, support no bias for linear wrapper.
4 years ago
Ross Wightman 460eba7f24 Work around casting issue with combination of native torch AMP and torchscript for Linear layers
4 years ago
Ross Wightman 5f4b6076d8 Fix inplace arg compat for GELU and PreLU via activation factory
4 years ago
Ross Wightman fd962c4b4a Native SiLU (Swish) op doesn't export to ONNX
4 years ago
tigertang 43f2500c26
Add symbolic for SwishJitAutoFn to support onnx
4 years ago
Ross Wightman e90edce438 Support native silu activation (aka swish). An optimized ver is available in PyTorch 1.7.
4 years ago
Ross Wightman f31933cb37 Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.
4 years ago
Ross Wightman fcb6258877 Add missing leaky_relu layer factory defn, update Apex/Native loss scaler interfaces to support unscaled grad clipping. Bump ver to 0.2.2 for pending release.
4 years ago
Ross Wightman e8ca45854c More models in sotabench, more control over sotabench run, dataset filename extraction consistency
4 years ago
Ross Wightman 80c9d9cc72 Add 'fast' global pool option, remove redundant SEModule from tresnet, normal one is now 'fast'
4 years ago
Ross Wightman 110a7c4982 AdaptiveAvgPool2d -> mean((2,3)) for all SE/attn layers to avoid NaN with AMP + channels_last layout. See https://github.com/pytorch/pytorch/issues/43992
4 years ago
Ross Wightman fc8b8afb6f Fix a silly bug in Sample version of EvoNorm missing x* part of swish, update EvoNormBatch to accumulated unbiased variance.
4 years ago
Ross Wightman b1f1a54de9 More uniform treatment of classifiers across all models, reduce code duplication.
4 years ago
Ross Wightman 7995295968 Merge branch 'logger' into features. Change 'logger' to '_logger'.
4 years ago
Ross Wightman 1998bd3180 Merge branch 'feature/AB/logger' of https://github.com/antoinebrl/pytorch-image-models into logger
4 years ago
Ross Wightman 6c17d57a2c Fix some attributions, add copyrights to some file docstrings
4 years ago
Ross Wightman 7ba5a384d3 Add ReXNet w/ remapped weights, feature support
4 years ago
Ross Wightman 298fba09ac Back out some activation hacks trialing upcoming pytorch changes
4 years ago
Ross Wightman 3b9004bef9 Lots of changes to model creation helpers, close to finalizing feature extraction / interfaces
4 years ago
Ross Wightman 3b6cce4c95 Add initial impl of CrossStagePartial networks, yet to be trained, not quite the same as darknet cfgs.
4 years ago
Ross Wightman 3aebc2f06c Switch DPN to use BnAct layer, train a new DPN 68b model with RA to 79.21
4 years ago
Ross Wightman f122f0274b Significant ResNet refactor:
4 years ago
Ross Wightman d0113f9cdb Fix a few issues that came up in tests
4 years ago
Ross Wightman 151679c2f1 Add custom grad tests, fix cut & paste error with hard_mish ME, add a few more pytorch act fns to factory
4 years ago
Antoine Broyelle 78fa0772cc Leverage python hierachical logger
4 years ago
Ross Wightman 4ddde1d3a4 Fix two regressions
4 years ago
Ross Wightman 88129b2569 Add set_layer_config contextmgr to adjust all layer configs at once, use in create_module with new args. Remove a few old warning causing constant annotations for jit.
4 years ago
Ross Wightman f28170df3f Fix an an untested change, remove a debug print
4 years ago
Ross Wightman eb7653614f Monster commit, activation refactor, VoVNet, norm_act improvements, more
4 years ago
Ross Wightman 0ea53cecc3 Merge branch 'master' into densenet_update_and_more
4 years ago
Ross Wightman 50658b9a67 Add RegNet models and weights
4 years ago
Ross Wightman 7df83258c9 Merge branch 'master' into densenet_update_and_more
4 years ago
Ross Wightman 1904ed8fec Improve dropblock impl, add fast variant, and better AMP speed, inplace, batchwise... few ResNeSt cleanups
4 years ago
Ross Wightman 17270c69b9 Remove annoying InceptionV3 dependency on scipy and insanely slow trunc_norm init. Bring InceptionV3 code into this codebase and use upcoming torch trunch_norm_ init.
4 years ago
Ross Wightman 208e7912f7 Missed one of the abalation model entrypoints, update README
4 years ago
Ross Wightman f4cdc2ac31 Add ResNeSt models
4 years ago
Ross Wightman 780860d140 Add norm_act factory method, move JIT of norm layers to factory
4 years ago
Ross Wightman 14edacdf9a DenseNet converted to support ABN (norm + act) modules. Experimenting with EvoNorm, IABN
4 years ago
Ross Wightman 8d8677e03b Fix #139. Broken SKResNets after BlurPool addition, as a plus, SKResNets support AA now too.
4 years ago
Ross Wightman 2c438c4e0d Merge branch 'master' of github.com:rwightman/pytorch-models
4 years ago
Ross Wightman 2681a8d618 Final blurpool2d cleanup and add resnetblur50 weights, match tresnet Downsample arg order to BlurPool2d for interop
4 years ago
Ross Wightman 9590f301a9 Merge branch 'blur' of https://github.com/VRandme/pytorch-image-models into VRandme-blur
4 years ago
Ross Wightman a5220ad3aa
Merge pull request #125 from Separius/patch-1
4 years ago
Ross Wightman e3a98171b2 Remove some CRLF that made it into TResNet merge
4 years ago
Ross Wightman 0004f37d25 Some TResNet cleanup.
4 years ago
Sepehr Sameni 20290b5b56
fix typo in eca
4 years ago
talrid 6209146738 TResNet models
4 years ago
Ross Wightman 1a8f5900ab Update EfficientNet feature extraction for EfficientDet. Add needed MaxPoolSame as well.
4 years ago
Chris Ha 06a50a94a8 Fix minor typos in create_attn.py and resnet.py
4 years ago
Ross Wightman 1a9ab07307 One too many changes at a time, fix missing C
4 years ago
Ross Wightman f17b42bc33 Blur filter no longer a buffer
4 years ago
Ross Wightman 6cdeca24a3 Some cleanup and fixes for initial BlurPool impl. Still some testing and tweaks to go...
4 years ago
Chris Ha acd1b6cccd Implement Functional Blur on resnet.py
4 years ago
Chris Ha ce3d82b58b Update blurpool.py
4 years ago
Chris Ha 3a287a6e76 Create blurpool.py
4 years ago
Ross Wightman c60069c1eb Annotate types on drop fns to avoid torchscript error
4 years ago
Ross Wightman f1d5f8a6c4 Update comments for Selective Kernel and DropBlock/Path impl, add skresnet34 weights
5 years ago
Ross Wightman 569419b38d Tweak some comments, add SKNet models with weights to sotabench, remove an unused branch
5 years ago
Ross Wightman 5e6dbbaf30 Add CBAM for experimentation
5 years ago
Ross Wightman d725991870 Remove debug print from ECA module
5 years ago
Ross Wightman 2a7d256fd5 Re-enable mem-efficient/jit activations after torchscript tests
5 years ago
Ross Wightman f902bcd54c Layer refactoring continues, ResNet downsample rewrite for proper dilation in 3x3 and avg_pool cases
5 years ago
Ross Wightman a99ec4e7d1 A bunch more layer reorg, splitting many layers into own files. Improve torchscript compatibility.
5 years ago
Ross Wightman 13746a33fc Big move, layer modules and fn to timm/models/layers
5 years ago
Ross Wightman 4defbbbaa8 Fix module name mistake, start layers sub-package
5 years ago