780860d140
Add norm_act factory method, move JIT of norm layers to factory
5 years ago
14edacdf9a
DenseNet converted to support ABN (norm + act) modules. Experimenting with EvoNorm, IABN
5 years ago
022ed001f3
Update DenseNet to latest in Torchvision (torchscript compat, checkpointing, proper init). Start adding ehanced configurability, stem options...
5 years ago
a7ebe09029
Replace all None by nn.Identity() in all models reset_classifier when False-values num_classes is given.
...
Make small code refactoring
5 years ago
f0eb021620
Replace all None by nn.Identity() in HRNet modules
5 years ago
a7f570c9b7
added MultiEpochsDataLoader
5 years ago
8d8677e03b
Fix #139 . Broken SKResNets after BlurPool addition, as a plus, SKResNets support AA now too.
5 years ago
c9b6f415ca
Bump version for Pypi release
5 years ago
9c15d57505
added efficientnet pruned weights
5 years ago
ea300709f0
Fix model create fn not passing num_classes through. Fix #135
5 years ago
2c438c4e0d
Merge branch 'master' of github.com:rwightman/pytorch-models
5 years ago
2681a8d618
Final blurpool2d cleanup and add resnetblur50 weights, match tresnet Downsample arg order to BlurPool2d for interop
5 years ago
9590f301a9
Merge branch 'blur' of https://github.com/VRandme/pytorch-image-models into VRandme-blur
5 years ago
a5220ad3aa
Merge pull request #125 from Separius/patch-1
...
fix typo in eca
5 years ago
0834fbc01c
Move pruned model adapt strings to separate txt files. A few minor formatting alignment tweaks.
5 years ago
ba793f5c1c
Merge branch 'adding_ECA_resnet' of https://github.com/yoniaflalo/pytorch-image-models into yoniaflalo-adding_ECA_resnet
5 years ago
07f19dd699
added eca resnet
5 years ago
1d4ac1b165
Bump version for pypi release. Fix #130
5 years ago
be7c784d21
Small TResNet simplification, just use SelectAdaptivePool, don't notice any perf difference
5 years ago
e3a98171b2
Remove some CRLF that made it into TResNet merge
5 years ago
0004f37d25
Some TResNet cleanup.
...
* allow use of global pool arg, test-time-pooling
* clean checkpoints to just contain state dict, add 448 res checkpoints
* support DataParallel via lazy filter creation for JIT Downsample
* some minor formatting (mostly alignment) preferences
5 years ago
64fe37d008
Remove old mean/std helper, rely fully on cmd line or default_cfg now. Fixes #126
5 years ago
e6f24e5578
Add 'momentum' optimizer (SGD w/o nesterov) for stable EfficientDet training defaults
5 years ago
20290b5b56
fix typo in eca
5 years ago
ebf82b84ac
Merge pull request #122 from mrT23/master
...
TResNet models
5 years ago
bdb165a8a4
Merge changes in feature extraction interface to MobileNetV3
...
Experimental feature extraction interface seems to be changed
a little bit with the most up to date version apparently found
in EfficientNet class. Here these changes are added to
MobileNetV3 class to make it support it and work again, too.
5 years ago
8a63c1add8
finalizing
5 years ago
6209146738
TResNet models
5 years ago
13cf68850b
Remove poorly named metrics from torch imagenet example origins. Use top1/top5 in csv output for consistency with existing validation results files, acc elsewhere. Fixes #111
5 years ago
56608c9070
Bump version for pypi
5 years ago
1a8f5900ab
Update EfficientNet feature extraction for EfficientDet. Add needed MaxPoolSame as well.
5 years ago
06a50a94a8
Fix minor typos in create_attn.py and resnet.py
...
'eca'->'ceca'
and
doest not-> does not
5 years ago
1a9ab07307
One too many changes at a time, fix missing C
5 years ago
f17b42bc33
Blur filter no longer a buffer
5 years ago
6cdeca24a3
Some cleanup and fixes for initial BlurPool impl. Still some testing and tweaks to go...
5 years ago
acd1b6cccd
Implement Functional Blur on resnet.py
...
1. add ResNet argument blur=''
2. implement blur for maxpool and strided convs in downsampling blocks
5 years ago
ce3d82b58b
Update blurpool.py
...
clean up code for PR
5 years ago
3a287a6e76
Create blurpool.py
...
Initial implementation of blur layer.
currently tests as correct against Downsample of original github
5 years ago
c99a5abed4
Merge pull request #115 from rwightman/mobilenetv2-experiment
...
MobileNet-V2 experiments
5 years ago
e34074b4da
Add final weights for MobileNet-V2 experiments
5 years ago
a6a5565de7
Fiddling...
5 years ago
5a16c533ff
Add better resnext50_32x4d weights trained by andravin
5 years ago
bc998cad91
Experimenting with some MobileNetV2 variations to compare against EfficientNet-Lite
5 years ago
3406e582cf
Add EfficientNet-Lite results, update README
5 years ago
bd05258f7b
EfficientNet-Lite model added w/ converted checkpoints, validation in progress...
5 years ago
d92cc4da54
Modified save_checkpoint to always save last checkpoint. Fixes #98 .
5 years ago
56e2ac3a6d
Merge pull request #94 from rwightman/lr_noise
...
Learning rate noise, MobileNetV3 weights, and activate MobileNetV3/EfficientNet weight init change
5 years ago
c16f25ced2
Add MobileNetV3 Large weights, results, update README and sotabench for merge
5 years ago
c60069c1eb
Annotate types on drop fns to avoid torchscript error
5 years ago
9fee316752
Enable fixed fanout calc in EfficientNet/MobileNetV3 weight init by default. Fix #84
5 years ago
27b3680d49
Revamp LR noise, move logic to scheduler base. Fixup PlateauLRScheduler and add it as an option.
5 years ago
cc5a11abba
version bump for PyPi update
5 years ago
514b0938c4
Experimenting with per-epoch learning rate noise w/ step scheduler
5 years ago
43225d110c
Unify drop connect vs drop path under 'drop path' name, switch all EfficientNet/MobilenetV3 refs to 'drop_path'. Update factory to handle new drop args.
5 years ago
f1d5f8a6c4
Update comments for Selective Kernel and DropBlock/Path impl, add skresnet34 weights
5 years ago
670c61b28f
Some cutmix/mixup cleanup/fixes
5 years ago
b3cb5f3275
Working on CutMix impl as per #8 , integrating with Mixup, currently experimenting...
5 years ago
569419b38d
Tweak some comments, add SKNet models with weights to sotabench, remove an unused branch
5 years ago
53c47479c4
Batch validation batch size adjustment, tweak L2 crop pct
5 years ago
08553e16b3
Merge branch 'master' into attention
5 years ago
fa38f24967
Update SK network configs, add weights for skresnet8 and skresnext50
5 years ago
f098fda2ca
Add map_location='cpu' to ModelEma resume, should improve #72
5 years ago
ba15ca47e8
Add ported EfficientNet-L2, B0-B7 NoisyStudent weights from TF TPU
5 years ago
5e6dbbaf30
Add CBAM for experimentation
5 years ago
d725991870
Remove debug print from ECA module
5 years ago
2a7d256fd5
Re-enable mem-efficient/jit activations after torchscript tests
5 years ago
f902bcd54c
Layer refactoring continues, ResNet downsample rewrite for proper dilation in 3x3 and avg_pool cases
...
* select_conv2d -> create_conv2d
* added create_attn to create attention module from string/bool/module
* factor padding helpers into own file, use in both conv2d_same and avg_pool2d_same
* add some more test eca resnet variants
* minor tweaks, naming, comments, consistency
5 years ago
a99ec4e7d1
A bunch more layer reorg, splitting many layers into own files. Improve torchscript compatibility.
5 years ago
13746a33fc
Big move, layer modules and fn to timm/models/layers
5 years ago
f54612f648
Merge branch 'select_kernel' into attention
5 years ago
4defbbbaa8
Fix module name mistake, start layers sub-package
5 years ago
7011cd0902
A little bit of ECA cleanup
5 years ago
46471df7b2
Merge pull request #82 from VRandme/eca
...
ECA-Net Efficient Channel Attention
5 years ago
d0eb59ef46
Remove unused default_init for EfficientNets, experimenting with fanout calc for #84
5 years ago
e6a762346a
Implement Adaptive Kernel selection
...
When channel size is given,
calculate adaptive kernel size according to original paper.
Otherwise use the given kernel size(k_size), which defaults to 3
5 years ago
13e8da2b46
SelectKernel split_input works best when input channels split like grouped conv, but output is full width. Disable zero_init for SK nets, seems a bad combo.
5 years ago
6db087a1ff
Merge remote-tracking branch 'upstream/master' into eca
5 years ago
904c618040
Update EcaModule.py
...
Make pylint happy
(commas, unused imports, missed imports)
5 years ago
db91ba053b
EcaModule(CamelCase)
...
CamelCased EcaModule.
Renamed all instances of ecalayer to EcaModule.
eca_module.py->EcaModule.py
5 years ago
5c4991a088
Add PyTorch trained EfficientNet-ES weights from Andrew Lavin
5 years ago
d04ff95eda
Merge branch 'master' into eca
5 years ago
d63ae121d5
Clean up eca_module code
...
functionally similar
adjusted rwightman's version of reshaping and viewing.
Use F.pad for circular eca version for cleaner code
5 years ago
d66819d1f3
Indentation mistake. Fixes #81
5 years ago
f87fcd7e88
Implement Eca modules
...
implement ECA module by
1. adopting original eca_module.py into models folder
2. adding use_eca layer besides every instance of SE layer
5 years ago
4808b3c32f
Bump version for PyPi update, fix few out of date README items/mistakes, add README updates for TF EfficientNet-B8 (RandAugment)
5 years ago
7d07ebb660
Adding some configs to sknet, incl ResNet50 variants from 'Compounding ... Assembled Techniques' paper and original SKNet50
5 years ago
a9d2424fd1
Add separate zero_init_last_bn function to support more block variety without a mess
5 years ago
355aa152d5
Just leave it float for now, will look at fp16 later. Remove unused reference code.
5 years ago
ef457555d3
BlockDrop working on GPU
5 years ago
3ff19079f9
Missed nn_ops.py from last commit
5 years ago
9f11b4e8a2
Add ConvBnAct layer to parallel integrated SelectKernelConv, add support for DropPath and DropBlock to ResNet base and SK blocks
5 years ago
cefc9b7761
Move SelectKernelConv to conv2d_layers and more
...
* always apply attention in SelectKernelConv, leave MixedConv for no attention alternative
* make MixedConv torchscript compatible
* refactor first/previous dilation name to make more sense in ResNet* networks
5 years ago
9abe610931
Used wrong channel var for split
5 years ago
58e28dc7e7
Move Selective Kernel blocks/convs to their own sknet.py file
5 years ago
a93bae6dc5
A SelectiveKernelBasicBlock for more experiments
5 years ago
ad087b4b17
Missed bias=False in selection conv
5 years ago
c8b3d6b81a
Initial impl of Selective Kernel Networks. Very much a WIP.
5 years ago
1daa303744
Add support to Dataset for class id mapping file, clean up a bit of old logic. Add results file arg for validation and update script.
5 years ago
91534522f9
Add newly added TF ported EfficientNet-B8 weights (RandAugment)
5 years ago
12dbc74742
New ResNet50 JSD + RandAugment weights
5 years ago
2f41905ba5
Update ResNet50 weights to AuxMix trained 78.994 top-1. A few commentes re 'tiered_narrow' tn variant.
5 years ago
d9a6a9d0af
Merge pull request #74 from rwightman/augmix-jsd
...
AugMix, JSD loss, SplitBatchNorm (Auxiliary BN), and more
5 years ago
3eb4a96eda
Update AugMix, JSD, etc comments and references
5 years ago
a28117ea46
Add tiered narrow ResNet (tn) and weights for seresnext26tn_32x4d
5 years ago
833066b540
A few minor things in SplitBN
5 years ago
7547119891
Add SplitBatchNorm. AugMix, Rand/AutoAugment, Split (Aux) BatchNorm, Jensen-Shannon Divergence, RandomErasing all working together
5 years ago
2e955cfd0c
Update RandomErasing with some improved arg names, tweak to aspect range
5 years ago
3cc0f91e23
Fix augmix variable name scope overlap, default non-blended mode
5 years ago
ec0dd4053a
Add updated RandAugment trained EfficientNet-B0 trained weights from @michaelklachko
5 years ago
40fea63ebe
Add checkpoint averaging script. Add headers, shebangs, exec perms to all scripts
5 years ago
4666cc9aed
Add --pin-mem arg to enable dataloader pin_memory (showing more benefit in some scenarios now), also add --torchscript arg to validate.py for testing models with jit.script
5 years ago
53001dd292
ResNet / Res2Net additions:
...
* ResNet torchscript compat
* output_stride arg supported to limit network stride via dilations (support for dilation added to Res2Net)
* allow activation layer to be changed via act_layer arg
5 years ago
f96b3e5e92
InceptionResNetV2 torchscript compatible
5 years ago
19d93fe454
Add selecsls60 weights
5 years ago
0062c15fb0
Update checkpoint url with modelzoo compatible ones.
5 years ago
b5315e66b5
Streamline SelecSLS model without breaking checkpoint compat. Move cfg handling out of model class. Update feature/pooling behaviour to match current.
5 years ago
d59a756c16
Run PyCharm autoformat on selecsls and change mix cap variables and model names to all lower
5 years ago
fb3a0f4bb8
Merge pull request #65 from mehtadushy/selecsls
...
Incorporate SelecSLS Models
5 years ago
19fc205a4d
Update comments on the new SE-ResNeXt26 models
5 years ago
acc3ed2b8c
Add EfficientNet-B3 weights, trained from scratch with RA.
5 years ago
2404361f62
correct asset paths
5 years ago
31939311f6
Added SelecSLS models
5 years ago
1f4498f217
Add ResNet deep tiered stem and model weights for seresnext26t_32x4d and seresnext26d_32x4d
5 years ago
32012a44fd
Added SelecSLS model
5 years ago
73b78459dc
Add update RandAugment MixNet-XL weights
5 years ago
3afc2a4dc0
Some cleanup/improvements to AugMix impl:
...
* make 'increasing' levels for Contrast, Color, Brightness, Saturation ops
* remove recursion from faster blending mix
* add config striing parsing for AugMix
5 years ago
232ab7fb12
Working on an implementation of AugMix with JensenShannonDivergence loss that's compatible with my AutoAugment and RandAugment impl
5 years ago
a435ea1327
Change reduce_bn to distribute_bn, add ability to choose between broadcast and reduce (mean). Add crop_pct arg to allow selecting validation crop while training.
5 years ago
3bff2b21dc
Add support for keeping running bn stats the same across distributed training nodes before eval/save
5 years ago
0161de0127
Switch RandoErasing back to on GPU normal sampling
5 years ago
ff421e5e09
New PyTorch trained EfficientNet-B2 weights with my RandAugment impl
5 years ago
3bef524f9c
Finish with HRNet, weights and models updated. Improve consistency in model classifier/global pool treatment.
5 years ago
6ca0828166
Update EfficientNet comments, MobileNetV3 non-TF create fns, fix factory arg checks, bump PyTorch version req to 1.2
5 years ago
eccbadca74
Update EfficientNet comments
5 years ago
902d32fb16
Renamed gen_efficientnet.py -> efficientnet.py
5 years ago
5a0a8de7e3
ResNet updates:
...
* remove redundant GluonResNet model/blocks and use the code in ResNet for Gluon weights
* change SEModules back to using AdaptiveAvgPool instead of mean, PyTorch issue long fixed
5 years ago
a39cc43374
Bring EfficientNet and MobileNetV3 up to date with my gen-efficientnet repo
...
* Split MobileNetV3 and EfficientNet model files and put builder and blocks in own files (getting too large)
* Finalize CondConv EfficientNet variant
* Add the AdvProp weights files and B8 EfficientNet model
* Refine the feature extraction module for EfficientNet and MobileNetV3
5 years ago
ad93347548
Initial HRNet classification model commit
5 years ago
2393708650
Missed stashing of out_indices in model
5 years ago
35e8f0c5e7
Fixup a few comments, add PyTorch version aware Flatten and finish as_sequential for GenEfficientNet
5 years ago
7ac6db4543
Missed activations.py
5 years ago
506df0e3d0
Add CondConv support for EfficientNet into WIP for GenEfficientNet Feature extraction setup
5 years ago
576d360f20
Bring in JIT version of optimized swish activation from gen_efficientnet as default (while working on feature extraction functionality here).
5 years ago
7b83e67f77
Pass drop connect arg through to EfficientNet models
5 years ago
31453b039e
Update Auto/RandAugment comments, README, more.
...
* Add a weighted choice option for RandAugment
* Adjust magnitude noise/std naming, config
5 years ago
4243f076f1
Adding RandAugment to AutoAugment impl, some tweaks to AA included
5 years ago
0d58c50fb1
Add TF RandAug weights for B5/B7 EfficientNet models.
5 years ago
c099374771
Map pretrained checkpoint to cpu to avoid issue with some pretrained checkpoints still having CUDA tensors. Fixes #42
5 years ago
b93fcf0708
Add Facebook Research Semi-Supervised and Semi-Weakly Supervised ResNet model weights.
5 years ago
a9eb484835
Add memory efficient Swish impl
5 years ago
d3ba34ee7e
Fix Mobilenet V3 model name for sotabench. Minor res2net cleanup.
5 years ago
2680ad14bb
Add Res2Net and DLA to README
5 years ago
adbf770f16
Add Res2Net and DLA models w/ pretrained weights. Update sotabench.
5 years ago
4002c0d4ce
Fix AutoAugment abs translate calc
5 years ago
c06274e5a2
Add note on random selection of magnitude value
5 years ago
b750b76f67
More AutoAugment work. Ready to roll...
5 years ago
25d2088d9e
Working on auto-augment
5 years ago
aff194f42c
Merge pull request #32 from rwightman/opt
...
More optimizer work
5 years ago
64966f61f7
Add Nvidia's NovogGrad impl from Jasper (cleaner/faster than current) and Apex Fused optimizers
5 years ago
3d9c8a6489
Add support for new AMP checkpointing support w/ amp.state_dict
5 years ago
ba3c97c3ad
Some Lookahead cleanup and fixes
5 years ago
e9d2ec4d8e
Merge pull request #31 from rwightman/opt
...
Optimizers and more
5 years ago
fac58f609a
Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.
...
* Add some of the trendy new optimizers. Decent results but not clearly better than the standards.
* Can create a None scheduler for constant LR
* ResNet defaults to zero_init of last BN in residual
* add resnet50d config
5 years ago
81875d52a6
Update sotabench model list, add Mean-Max pooling DPN variants, disable download progress
5 years ago
f37e633e9b
Merge remote-tracking branch 'origin/re-exp' into opt
5 years ago
b06dce8d71
Bump version for next push to pypi
5 years ago
73fbd97ed4
Add weights for my MixNet-XL creation, include README updates for EdgeTPU models
5 years ago
51a2375b0c
Experimenting with a custom MixNet-XL and MixNet-XXL definition
5 years ago
9ec6824bab
Finally got around to adding EdgeTPU EfficientNet variant
5 years ago
daeaa113e2
Add initial sotabench attempt. Split create_transform out of create_loader. Update requirements.txt
5 years ago
66634d2200
Add support to split random erasing blocks into randomly selected number with --recount arg. Fix random selection of aspect ratios.
5 years ago
6946281fde
Experimenting with random erasing changes
5 years ago
aeaaad7304
Merge pull request #24 from rwightman/gluon_xception
...
Port Gluon Aligned Xception models
5 years ago
3b4868f6dc
A few more additions to Gluon Xception models to match interface of others.
5 years ago
4d505e0785
Add working Gluon Xception-65 model. Some cleanup still needed.
5 years ago
4e7a854dd0
Update helpers.py
...
Fixing out of memory error by loading the checkpoint onto the CPU.
5 years ago
0c874195db
Update results csv files, bump version for timm pip release
5 years ago
4fe2da558c
Add MixNet Small and Large PyTorch native weights (no same padding)
5 years ago
e879cf52fa
Update validation scores for new TF EfficientNet weights.
5 years ago
77e2e0c4e3
Add new auto-augmentation Tensorflow EfficientNet weights, incl B6 and B7 models. Validation scores still pending but looking good.
5 years ago
857f33015a
Add native PyTorch weights for MixNet-Medium with no SAME padding necessary. Remove unused block of code.
5 years ago
e7c8a37334
Make min-lr and cooldown-epochs cmdline args, change dash in color_jitter arg for consistency
5 years ago
d4debe6597
Update version, results csv files, and move remaining dropbox weights to github
5 years ago
dfa9298b4e
Add MixNet ( https://arxiv.org/abs/1907.09595 ) with pretrained weights converted from Tensorflow impl
...
* refactor 'same' convolution and add helper to use MixedConv2d when needed
* improve performance of 'same' padding for cases that can be handled statically
* add support for extra exp, pw, and dw kernel specs with grouping support to decoder/string defs for MixNet
* shuffle some args for a bit more consistency, a little less clutter overall in gen_efficientnet.py
6 years ago
7a92caa560
Add basic image folder style dataset to read directly out of tar files, example in validate.py
6 years ago
d6ac5bbc48
EfficientNet and related cleanup
...
* remove folded_bn support and corresponding untrainable tflite ported weights
* combine bn args into dict
* add inplace support to activations and use where possible for reduced mem on large models
6 years ago
3d9be78fc6
A bit more ResNet cleanup.
...
* add inplace=True back
* minor comment improvements
* few clarity changes
6 years ago
33436fafad
Add weights for ResNeXt50d model
6 years ago
e78cd79073
Move ResNet additions for Gluon into main ResNet impl. Add ResNet-26 and ResNet-26d models with weights.
6 years ago
6cdf35e670
Add explicit half/fp16 support to loader and validation script
6 years ago
a6b2f6eca5
Update README, bump version
6 years ago
949b7a81c4
Fix typo in Densenet default resolutions
6 years ago
da52fcf78a
Add NASNet-Large model
6 years ago
6057496409
Register dpn107
6 years ago
3d1a66b6fc
Version 0.1.6
6 years ago
a6878b5218
Fix DPN config keys that I broke
6 years ago
9b0070edc9
Add two comments back, fix typo
6 years ago
188aeae8f4
Bump version 0.1.4
6 years ago
c3287aafb3
Slight improvement in EfficientNet-B2 native PyTorch weights
6 years ago
b8762cc67d
Model updates. Add my best ResNet50 weights top-1=78.47. Add some other torchvision weights.
...
* Remove some models that don't exist as pretrained an likely never will (se)resnext152
* Add some torchvision weights as tv_ for models that I have added better weights for
* Add wide resnet recently added to torchvision along with resnext101-32x8d
* Add functionality to model registry to allow filtering on pretrained weight presence
6 years ago
65a634626f
Switch random erasing to doing normal_() on CPU to avoid instability, remove a debug print
6 years ago
c6b32cbe73
A number of tweaks to arguments, epoch handling, config
...
* reorganize train args
* allow resolve_data_config to be used with dict args, not just arparse
* stop incrementing epoch before save, more consistent naming vs csv, etc
* update resume and start epoch handling to match above
* stop auto-incrementing epoch in scheduler
6 years ago
9d653b68a2
Make drop_connect rate scaling match official impl. Fixes #14
6 years ago
13c19e213d
Add native PyTorch EfficientNet B1 and B2 weights. Not quite where I want them, but hitting the brick wall and moving on to other projects...
6 years ago
a0275cfa2f
Fix arg positions in two entrypoint aliases
6 years ago
fe59249701
Bump version to 0.1.2
6 years ago
171c0b88b6
Add model registry and model listing fns, refactor model_factory/create_model fn
6 years ago
8512436436
Add instagram pretrained ResNeXt models from https://pytorch.org/hub/facebookresearch_WSL-Images_resnext/ , update README
6 years ago
87b92c528e
Some pretrianed URL changes
...
* host some of Cadene's weights on github instead of .fr for speed
* add my old port of ensemble adversarial inception resnet v2
* switch to my TF port of normal inception res v2 and change FC layer back to 'classif' for compat with ens_adv
6 years ago
827a3d6010
Add current checkpoints output back to CheckpointSaver (via logger)
6 years ago
63961b36a2
Missed pnasnet entrypoint
6 years ago
6cc214bd7a
Consistency in model entrypoints
...
* move pretrained entrypoint arg to first pos to be closer to torchvision/hub
* change DPN weight URLS to my github location
6 years ago
6fc886acaf
Remove all prints, change most to logging calls, tweak alignment of batch logs, improve setup.py
6 years ago
aa4354f466
Big re-org, working towards making pip/module as 'timm'
6 years ago
Ross Wightman