41dc49a337
Vision Transformer refactoring and Rel Pos impl
3 years ago
b049a5c5c6
Merge remote-tracking branch 'origin/master' into norm_norm_norm
3 years ago
372ad5fa0d
Significant model refactor and additions:
...
* All models updated with revised foward_features / forward_head interface
* Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head')
* WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types
* Add gradient checkpointing support to a significant % of models, especially popular architectures
* Formatting and interface consistency improvements across models
* layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler
* Poolformer and Volo architectures added
3 years ago
c6e4b7895a
Swin V2 CR impl refactor.
...
* reformat and change some naming so closer to existing timm vision transformers
* remove typing that wasn't adding clarity (or causing torchscript issues)
* support non-square windows
* auto window size adjust from image size
* post-norm + main-branch no
3 years ago
58ba49c8ef
Add MobileViT models (w/ ByobNet base). Close #1038 .
3 years ago
5f81d4de23
Move DeiT to own file, vit getting crowded. Working towards fixing #1029 , make pooling interface for transformers and mlp closer to convnets. Still working through some details...
3 years ago
95cfc9b3e8
Merge remote-tracking branch 'origin/master' into norm_norm_norm
3 years ago
abc9ba2544
Transitioning default_cfg -> pretrained_cfg. Improving handling of pretrained_cfg source (HF-Hub, files, timm config, etc). Checkpoint handling tweaks.
3 years ago
18934debc5
Add initial ConvNeXt impl (mods of official code)
3 years ago
44d6d51668
Add ConvMixer
3 years ago
1c9284c640
Add BeiT 'finetuned' 1k weights and pretrained 22k weights, pretraining specific (masked) model excluded for now
3 years ago
f1808e0970
Post crossvit merge cleanup, change model names to reflect input size, cleanup img size vs scale handling, fix tests
3 years ago
7ab9d4555c
add crossvit
3 years ago
623e8b8eb8
wip xcit
3 years ago
23bb72ce5e
nested_transformer wip
3 years ago
742c2d5247
Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.
4 years ago
bfc72f75d3
Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights.
4 years ago
f45de37690
Merge branch 'master' into levit_visformer_rednet
4 years ago
306c86b668
Merge branch 'convit' of https://github.com/amaarora/pytorch-image-models into amaarora-convit
4 years ago
40c506ba1e
Add ConViT
4 years ago
00548b8427
Add Twins
4 years ago
ecc7552c5c
Add levit, levit_c, and visformer model defs. Largely untested and not finished cleanup.
4 years ago
5fcddb96a8
Merge branch 'master' into cait
4 years ago
12efffa6b1
Initial MLP-Mixer attempt...
4 years ago
1daa15ecc3
Initial Cait commit. Still some cleanup to do.
4 years ago
1e3b6d4dfc
Update __init__.py
4 years ago
fd022fd6a2
Update __init__.py
4 years ago
d793deb51a
Merge branch 'master' of https://github.com/iamhankai/pytorch-image-models into iamhankai-master
4 years ago
f606c45c38
Add Swin Transformer models from https://github.com/microsoft/Swin-Transformer
4 years ago
de445e7827
Add GhostNet
4 years ago
16f7aa9f54
Add default_cfg options for min_input_size / fixed_input_size, queries in model registry, and use for testing self-attn models
4 years ago
ce62f96d4d
ByoaNet with bottleneck transformer, lambda resnet, and halo net experiments
4 years ago
a5310a3451
Merge remote-tracking branch 'origin/benchmark-fixes-vit_hybrids' into pit_and_vit_update
4 years ago
0dfc5a66bb
Add PiT model from https://github.com/naver-ai/pit
4 years ago
51febd869b
Small tweak to tests for tnt model, reorder model imports.
4 years ago
4a09bc851e
Add TNT model
4 years ago
d584e7f617
Support for huggingface hub via create_model and default_cfgs.
...
* improve consistency of model creation helper fns
* add comments to some of the model helpers
* support passing external default_cfgs so they can be sourced from hub
4 years ago
82c1fe958a
added hardcorenas model
...
refactoring to support feature extraction
4 years ago
4f49b94311
Initial AGC impl. Still testing.
4 years ago
dc85e5a237
Add ByobNet w/ GPU-EfficientNets and RepVGG. Also add classic vgg models.
4 years ago
5a8e1e643e
Initial Normalizer-Free Reg/ResNet impl. A bit of related layer refactoring.
4 years ago
231d04e91a
ResNetV2 pre-act and non-preact model, w/ BiT pretrained weights and support for ViT R50 model. Tweaks for in21k num_classes passing. More to do... tests failing.
4 years ago
f31933cb37
Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.
4 years ago
14ef7a0dd6
Rename csp.py -> cspnet.py
4 years ago
7ba5a384d3
Add ReXNet w/ remapped weights, feature support
4 years ago
3b6cce4c95
Add initial impl of CrossStagePartial networks, yet to be trained, not quite the same as darknet cfgs.
4 years ago
a66df5fb91
More model feature extraction support, start to deprecate senet.py, dilations added to regnet, add proper aligned xception
4 years ago
eb7653614f
Monster commit, activation refactor, VoVNet, norm_act improvements, more
...
* refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto
* implement hard-mish, better grad for hard-swish
* add initial VovNet V1/V2 impl, fix #151
* VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN)
* Wrap IABN for any models that use it
* make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests
5 years ago
50658b9a67
Add RegNet models and weights
5 years ago
f4cdc2ac31
Add ResNeSt models
5 years ago
Ross Wightman