Commit Graph

760 Commits (f8cbda6b55b385403fe6a99a74920779b054ee25)

Author SHA1 Message Date
Ross Wightman 93cc08fdc5 Make evonorm variables 1d to match other PyTorch norm layers, will break weight compat for any existing use (likely minimal, easy to fix).
4 years ago
Ross Wightman af607b75cc Prep a set of ResNetV2 models with GroupNorm, EvoNormB0, EvoNormS0 for BN free model experiments on TPU and IPU
4 years ago
Ross Wightman c976a410d9 Add ResNet-50 w/ GN (resnet50_gn) and SEBotNet-33-TS (sebotnet33ts_256) model defs and weights. Update halonet50ts weights w/ slightly better variant in1k val, more robust to test sets.
4 years ago
Ross Wightman f2006b2437 Cleanup qkv_bias cat in beit model so it can be traced
4 years ago
Ross Wightman 1076a65df1 Minor post FX merge cleanup
4 years ago
Ross Wightman 32c9937dec Merge branch 'fx-feature-extract-new' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-fx-feature-extract-new
4 years ago
Alexander Soare 65d827c7a6 rename notrace registration and standardize trace_utils imports
4 years ago
Ross Wightman 9b2daf2a35 Add ResNeXt-50 weights 81.1 top-1 @ 224, 82 @ 288 with A1 'high aug' recipe
4 years ago
Martins Bruveris 5220711d87 Added B/8 models to ViT.
4 years ago
Alexander Soare 0262a0e8e1 fx ready for review
4 years ago
Alexander Soare d2994016e9 Add try/except guards
4 years ago
Alexander Soare b25ff96768 wip - pre-rebase
4 years ago
Alexander Soare e051dce354 Make all models FX traceable
4 years ago
Alexander Soare cf4561ca72 Add FX based FeatureGraphNet capability
4 years ago
Alexander Soare 0149ec30d7 wip - attempting to rebase
4 years ago
Alexander Soare 02c3a75a45 wip - make it possible to use fx graph in train and eval mode
4 years ago
Alexander Soare bc3d4eb403 wip -rebase
4 years ago
Alexander Soare ab3ac3f25b Add FX based FeatureGraphNet capability
4 years ago
Ross Wightman ddc29da974 Add ResNet101 and ResNet152 weights from higher aug RSB recipes. 81.93 and 82.82 top-1 at 224x224.
4 years ago
Ross Wightman b328e56f49 Update eca_halonext26ts weights to a better set
4 years ago
Ross Wightman 2ddef942b9 Better fix for #954 that doesn't break torchscript, pull torch._assert into timm namespace when it exists
4 years ago
Ross Wightman 4f0f9cb348 Fix #954 by bringing traceable _assert into timm to allow compat w/ PyTorch < 1.8
4 years ago
Ross Wightman ae72d009fa Add weights for lambda_resnet50ts, halo2botnet50ts, lamhalobotnet50ts, updated halonet50ts
4 years ago
Ross Wightman b745d30a3e Fix formatting of last commit
4 years ago
Ross Wightman 3478f1d7f1 Traceability fix for vit models for some experiments
4 years ago
Ross Wightman f658a72e72 Cleanup re-use of Dropout modules in Mlp modules after some twitter feedback :p
4 years ago
Thomas Viehmann f805ba86d9 use .unbind instead of explicitly listing the indices
4 years ago
Ross Wightman 0fe4fd3f1f add d8 and e8 regnetz models with group size 8
4 years ago
Ross Wightman 25e7c8c5e5 Update broken resnetv2_50 weight url, add resnetv1_101 a1h recipe weights for 224x224 train
4 years ago
Ross Wightman b6caa356d2 Fixed eca_botnext26ts_256 weights added, 79.27
4 years ago
Ross Wightman c02334d9fa Add weights for regnetz_d and haloregnetz_c, update regnetz_c weights. Add commented PyTorch XLA code for halo attention
4 years ago
Ross Wightman 02daf2ab94 Add option to include relative pos embedding in the attention scaling as per references. See discussion #912
4 years ago
Ross Wightman cd34913278 Remove some outdated comments, botnet networks working great now.
4 years ago
Ross Wightman 6ed4cdccca Update lambda_resnet26t weights with better set
4 years ago
ICLR Author 44d6d51668 Add ConvMixer
4 years ago
Ross Wightman a85df34993 Update lambda_resnet26rpt weights to 78.9, add better halonet26t weights at 79.1 with tweak to attention dim
4 years ago
Ross Wightman b544ad4d3f regnetz model default cfg tweaks
4 years ago
Ross Wightman e2b8d44ff0 Halo, bottleneck attn, lambda layer additions and cleanup along w/ experimental model defs
4 years ago
Ross Wightman fbf59c04ee Change crop ratio on correct resnet50 variant.
4 years ago
Ross Wightman ae1ff5792f Clean a1/a2/3 rsb _0 checkpoints properly, fix v2 loading.
4 years ago
Ross Wightman da0d39bedd Update default crop_pct for byoanet
4 years ago
Ross Wightman cc9bedf373 Add initial ResNet Strikes Back weights for ResNet50 and ResNetV2-50 models
4 years ago
Ross Wightman 64495505b7 Add updated lambda resnet26 and botnet26 checkpoints with fixes applied
4 years ago
Ross Wightman b2094f4ee8 support bits checkpoints in avg/load
4 years ago
Ross Wightman 007bc39323 Some halo and bottleneck attn code cleanup, add halonet50ts weights, use optimal crop ratios
4 years ago
Ross Wightman b1c2e3eb92 Match rel_pos_indices attr rename in conv branch
4 years ago
Ross Wightman b49630a138 Add relative pos embed option to LambdaLayer, fix last transpose/reshape.
4 years ago
Ross Wightman d657e2cc0b Remove dead code line from efficientnet
4 years ago
Ross Wightman 0ca687f224 Make 'regnetz' model experiments closer to actual RegNetZ, bottleneck expansion, expand from in_chs, no shortcut on stride 2, tweak model sizes
4 years ago
Ross Wightman b81e79aae9 Fix bottleneck attn transpose typo, hopefully these train better now..
4 years ago
Ross Wightman 6478bcd02c Fix regnetz_d conv layer name, use inception mean/std
4 years ago
Ross Wightman 515121cca1 Use reshape instead of view in std_conv, causing issues in recent PyTorch in channels_last
4 years ago
Ross Wightman da06cc61d4 ResNetV2 seems to work best without zero_init residual
4 years ago
Ross Wightman 8e11da0ce3 Add experimental RegNetZ(ish) models for training / perf trials.
4 years ago
Alexander Soare 6bbc50beb4 make it possible to provide norm_layer via create_model
4 years ago
nateraw adcb74f87f 🎨 Import load_state_dict_from_url directly
4 years ago
nateraw e65a2cba3d 🎨 cleanup and add a couple comments
4 years ago
nateraw 2b6ade24b3 🎨 write model card to enable inference
4 years ago
Ross Wightman cf5ac2800c BotNet models were still off, remove weights for bad configs. Add good SE-HaloNet33-TS weights.
4 years ago
Ross Wightman 24720abe3b Merge branch 'master' into attn_update
4 years ago
Ross Wightman 1c9284c640 Add BeiT 'finetuned' 1k weights and pretrained 22k weights, pretraining specific (masked) model excluded for now
4 years ago
Ross Wightman f8a215cfe6 A few more crossvit tweaks, fix training w/ no_weight_decay names, add crop option for scaling, adjust default crop_pct for large img size to 1.0 for better results
4 years ago
Ross Wightman 7ab2491ab7 Better handling of crossvit for tests / forward_features, fix torchscript regression in my changes
4 years ago
Ross Wightman f1808e0970 Post crossvit merge cleanup, change model names to reflect input size, cleanup img size vs scale handling, fix tests
4 years ago
Ross Wightman 4027412757 Add resnet33ts weights, update resnext26ts baseline weights
4 years ago
Richard Chen 9fe5798bee fix bug for reset classifier and fix for validating the dimension
4 years ago
Richard Chen 3718c5a5bd fix loading pretrained model
4 years ago
Richard Chen bb50b69a57 fix for torch script
4 years ago
nateraw abf9d51bc3 🚧 wip
4 years ago
Ross Wightman 5bd04714e4 Cleanup weight init for byob/byoanet and related
4 years ago
Ross Wightman 8642401e88 Swap botnet 26/50 weights/models after realizing a mistake in arch def, now figuring out why they were so low...
4 years ago
Ross Wightman 5f12de4875 Add initial AttentionPool2d that's being trialed. Fix comment and still trying to improve reliability of sgd test.
4 years ago
Ross Wightman 76881d207b Add baseline resnet26t @ 256x256 weights. Add 33ts variant of halonet with at least one halo in stage 2,3,4
4 years ago
Ross Wightman 484e61648d Adding the attn series weights, tweaking model names, comments...
4 years ago
nateraw 28d2841acf 💄 apply isort
4 years ago
Ross Wightman 492c0a4e20 Update HaloAttn comment
4 years ago
nateraw e72c989973 add ability to push to hf hub
4 years ago
Richard Chen 7ab9d4555c add crossvit
4 years ago
Ross Wightman 3b9032ea48 Use Tensor.unfold().unfold() for HaloAttn, fast like as_strided but more clarity
4 years ago
Ross Wightman 78933122c9 Fix silly typo
4 years ago
Ross Wightman 2568ffc5ef Merge branch 'master' into attn_update
4 years ago
Ross Wightman 708d87a813 Fix ViT SAM weight compat as weights at URL changed to not use repr layer. Fix #825. Tweak optim test.
4 years ago
Ross Wightman 8449ba210c Improve performance of HaloAttn, change default dim calc. Some cleanup / fixes for byoanet. Rename resnet26ts to tfs to distinguish (extra fc).
4 years ago
Ross Wightman a8b65695f1 Add resnet26ts and resnext26ts models for non-attn baselines
4 years ago
Ross Wightman a5a542f17d Fix typo
4 years ago
Ross Wightman 925e102982 Update attention / self-attn based models from a series of experiments:
4 years ago
Ross Wightman 01cb46a9a5 Add gc_efficientnetv2_rw_t weights (global context instead of SE attn). Add TF XL weights even though the fine-tuned ones don't validate that well. Change default arg for GlobalContext to use scal (mul) mode.
4 years ago
Ross Wightman d3f7440650 Add EfficientNetV2 XL model defs
4 years ago
Ross Wightman 72b227dcf5
Merge pull request #750 from drjinying/master
4 years ago
Ross Wightman 748ab852ca Allow act_layer switch for xcit, fix in_chans for some variants
4 years ago
Ying Jin 20b2d4b69d Use bicubic interpolation in resize_pos_embed()
4 years ago
Ross Wightman d3255adf8e Merge branch 'xcit' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-xcit
4 years ago
Ross Wightman f8039c7492 Fix gc effv2 model cfg name
4 years ago
Alexander Soare 3a55a30ed1 add notes from author
4 years ago
Alexander Soare 899cf84ccc bug fix - missing _dist postfix for many of the 224_dist models
4 years ago
Alexander Soare 623e8b8eb8 wip xcit
4 years ago
Ross Wightman 392368e210 Add efficientnetv2_rw_t defs w/ weights, and gc variant, as well as gcresnet26ts for experiments. Version 0.4.13
4 years ago
Ross Wightman 6d8272e92c Add SAM pretrained model defs/weights for ViT B16 and B32 models.
4 years ago
Ross Wightman ee4d8fc69a Remove unecessary line from nest post refactor
4 years ago
Ross Wightman 8165cacd82 Realized LayerNorm2d won't work in all cases as is, fixed.
4 years ago
Ross Wightman 81cd6863c8 Move aggregation (convpool) for nest into NestLevel, cleanup and enable features_only use. Finalize weight url.
4 years ago
Ross Wightman 6ae0ac6420 Merge branch 'nested_transformer' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-nested_transformer
4 years ago
Alexander Soare 7b8a0017f1 wip to review
4 years ago
Alexander Soare b11d949a06 wip checkpoint with some feature extraction work
4 years ago
Alexander Soare 23bb72ce5e nested_transformer wip
4 years ago
Ross Wightman 766b4d3262 Fix features for resnetv2_50t
4 years ago
Ross Wightman e8045e712f Fix BatchNorm for ResNetV2 non GN models, add more ResNetV2 model defs for future experimentation, fix zero_init of last residual for pre-act.
4 years ago
Ross Wightman 20a2be14c3 Add gMLP-S weights, 79.6 top-1
4 years ago
Ross Wightman 85f894e03d Fix ViT in21k representation (pre_logits) layer handling across old and new npz checkpoints
4 years ago
Ross Wightman b41cffaa93 Fix a few issues loading pretrained vit/bit npz weights w/ num_classes=0 __init__ arg. Missed a few other small classifier handling detail on Mlp, GhostNet, Levit. Should fix #713
4 years ago
Ross Wightman 9c9755a808 AugReg release
4 years ago
Ross Wightman 381b279785 Add hybrid model fwds back
4 years ago
Ross Wightman 26f04a8e3e Fix a weight link
4 years ago
Ross Wightman 8f4a0222ed Add GMixer-24 MLP model weights, trained w/ TPU + PyTorch XLA
4 years ago
Ross Wightman b319eb5b5d Update ViT weights, more details to be added before merge.
4 years ago
Ross Wightman 8257b86550 Fix up resnetv2 bit/bitm model default res
4 years ago
Ross Wightman 1228f5a3d8 Add BiT distilled 50x1 and teacher 152x2 models from 'A good teacher is patient and consistent' paper.
4 years ago
Ross Wightman 511a8e8c96 Add official ResMLP weights.
4 years ago
Ross Wightman b9cfb64412 Support npz custom load for vision transformer hybrid models. Add posembed rescale for npz load.
4 years ago
Ross Wightman 8319e0c373 Add file docstring to std_conv.py
4 years ago
Ross Wightman 4d96165989 Merge branch 'master' into cleanup_xla_model_fixes
4 years ago
Ross Wightman 8880f696b6 Refactoring, cleanup, improved test coverage.
4 years ago
Ross Wightman ba2ca4b464 One codepath for stdconv, switch layernorm to batchnorm so gain included. Tweak epsilon values for nfnet, resnetv2, vit hybrid.
4 years ago
Ross Wightman b7a568f065 Fix torchscript issue in bat
4 years ago
Ross Wightman d17b374f0f Minimum input_size needed to be higher
4 years ago
Ross Wightman b3b90d944d Add min_input_size to bat_resnext to prevent test breakage.
4 years ago
Ross Wightman d413eef1bf Add ResMLP-24 model weights that I trained in PyTorch XLA on TPU-VM. 79.2 top-1.
4 years ago
Ross Wightman 10d8fa4620 Add gc and bat attention resnext26ts variants to byob for test.
4 years ago
Ross Wightman 2f5ed2dec1 Update `init_values` const for 24 and 36 layer ResMLP models
4 years ago
Ross Wightman 8e4ac3549f All ScaledStdConv and StdConv uses default to using F.layernorm so that they work with PyTorch XLA. eps value tweaking is a WIP.
4 years ago
Ross Wightman 2a63d0246b Post merge cleanup
4 years ago
Ross Wightman 45dec179e5
Merge pull request #681 from lmk123568/master
4 years ago
Dongyoon Han ded1671483 Fix stochastic depth working only with a shortcut
4 years ago
Mike b87d98b238
Update convit.py
4 years ago
Ross Wightman bda8ab015a Remove min channels for SelectiveKernel, divisor should cover cases well enough.
4 years ago
Ross Wightman a27f4aec4a Missed args for skresnext w/ refactoring.
4 years ago
Ross Wightman 307a935b79 Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.
4 years ago
Ross Wightman 8bf63b6c6c Able to use other attn layer in EfficientNet now. Create test ECA + GC B0 configs. Make ECA more configurable.
4 years ago
Ross Wightman bcec14d3b5 Bring EfficientNet SE layer in line with others, pull se_ratio outside of blocks. Allows swapping w/ other attn layers.
4 years ago
Ross Wightman 9611458e19 Throw in some FBNetV3 code I had lying around, some refactoring of SE reduction channel calcs for all EffNet archs.
4 years ago
Ross Wightman 01b9108619 Merge branch 'master' into more_attn
4 years ago
Ross Wightman d7bab8a6c5 Fix strict flag change for checkpoint load.
4 years ago
Ross Wightman 02f9d4bc34 Add weights for resnet51q model, add 61q def.
4 years ago
Ross Wightman f615474be3 Fix broken test, repvgg block doesn't have attn_last attr.
4 years ago
Ross Wightman 742c2d5247 Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.
4 years ago
Ross Wightman 9c78de8c02 Fix #661, move hardswish out of default args for LeViT. Enable native torch support for hardswish, hardsigmoid, mish if present.
4 years ago
Ross Wightman 5db7452173 Fix visformer in_chans stem handling
4 years ago
Ross Wightman 11ae795e99 Redo LeViT attention bias caching in a way that works with both torchscript and DataParallel
4 years ago
Ross Wightman d400f1dbdd Filter test models before creation for backward/torchscript tests
4 years ago
Ross Wightman c4572cc5aa Add Visformer-small weighs, tweak torchscript jit test img size.
4 years ago
Ross Wightman bfc72f75d3 Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights.
4 years ago
Ross Wightman 18bf520ad1 Add eca_nfnet_l2/l3 defs for future training
4 years ago
Ross Wightman f45de37690 Merge branch 'master' into levit_visformer_rednet
4 years ago
Ross Wightman 23c18a33e4 Add efficientnetv2_rw_m weights trained in PyTorch. 84.8 top-1 @ 416 test. 53M params.
4 years ago
Ross Wightman c2ba229d99 Prep for effcientnetv2_rw_m model weights that started training before official release..
4 years ago
Ross Wightman 30b9880d06 Minor adjustment, mutable default arg, extra check of valid len...
4 years ago
Ross Wightman be0abfbcce Merge branch 'master' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-master
4 years ago
Ross Wightman b7de82e835 ConViT cleanup, fix torchscript, bit of reformatting, reuse existing layers.
4 years ago
Ross Wightman 306c86b668 Merge branch 'convit' of https://github.com/amaarora/pytorch-image-models into amaarora-convit
4 years ago
Ross Wightman a569635045 Update twin weights to a copy in GitHub releases for faster dl. Tweak model class comment.
4 years ago
Ross Wightman be99eef9c1 Remove redundant code, cleanup, fix torchscript.
4 years ago
Ross Wightman 5ab372a3ec Merge branch 'master' of https://github.com/abcdvzz/pytorch-image-models into abcdvzz-master
4 years ago
Aman Arora 5db1eb6ba5 Add defaults
4 years ago
Aman Arora 8b1f2e8e1f remote unused matplotlib import
4 years ago
Aman Arora 40c506ba1e Add ConViT
4 years ago
Alexander Soare 7976019864 extend positional embedding resizing functionality to tnt
4 years ago
Alexander Soare 8086943b6f allow resize positional embeddings to non-square grid
4 years ago
talrid dc1a4efd28 mixer_b16_224_miil, mixer_b16_224_miil_in21k models
4 years ago
李鑫杰 7b799c4e79 add latest code
4 years ago
Ross Wightman d5af752117 Add preliminary gMLP and ResMLP impl to Mlp-Mixer
4 years ago
李鑫杰 00548b8427 Add Twins
4 years ago
Ross Wightman e7f0db8664 Fix drop/drop_path arg on MLP-Mixer model. Fix #641
4 years ago
Ross Wightman 9a3ae97311 Another set of byoanet models w/ ECA channel + SA + groups
4 years ago
Ross Wightman 7077f16c6a Change 21k model naming from _21k to _in21k for consistency with existing 21k models.
4 years ago
Ross Wightman 94d4b53352 Add temporary default_cfgs to visformer models so they pass tests
4 years ago
Ross Wightman 3bffc701f1 Merge branch 'master' into levit_visformer_rednet
4 years ago
Ross Wightman ecc7552c5c Add levit, levit_c, and visformer model defs. Largely untested and not finished cleanup.
4 years ago
Ross Wightman 165fb354b2 Add initial RedNet model / Involution layer impl for testing
4 years ago
Ross Wightman 328249f11a Update README, tweak fine-tune effv2 model names.
4 years ago
Ross Wightman c4f482a08b EfficientNetV2 official impl w/ weights ported from TF. Cleanup/refactor of related EfficientNet classes and models.
4 years ago
Ross Wightman 4fbc32d3d0 Fix crop_pct for cait models.
4 years ago
Ross Wightman 715519a5ef Rethink name of patch embed grid info
4 years ago
Ross Wightman b2c305c2aa Move Mlp and PatchEmbed modules into layers. Being used in lots of models now...
4 years ago
Ross Wightman 3ba6b55cb2 More adjustments to ByoaNet models for further experiments.
4 years ago
Ross Wightman 5fcddb96a8 Merge branch 'master' into cait
4 years ago
Ross Wightman 3db12b4b6a Finish CaiT cleanup
4 years ago
Ross Wightman 2d8b09fe8b Add official pretrained weights to MLP-Mixer, complete model cfgs.
4 years ago
Ross Wightman 12efffa6b1 Initial MLP-Mixer attempt...
4 years ago
Ross Wightman 0721559511 Improved (hopefully) init for SA/SA-like layers used in ByoaNets
4 years ago
Ross Wightman d5473c17f7 Fix incorrect name of shortcut/identity paths in many residual nets. Inherited from naming in old old torchvision, long fixed there.
4 years ago
Ross Wightman 0d87650fea Remove filter hack from BlurPool w/ non-persistent buffer. Use BlurPool2d instead of AntiAliasing.. for TResNet. Breaks PyTorch < 1.6.
4 years ago
Ross Wightman ddc743fdf8 Update ResNet-RS models to EMA weights
4 years ago
Ross Wightman 08d60f4a9a resnetrs50 pool sizing wrong
4 years ago
Ross Wightman 1daa15ecc3 Initial Cait commit. Still some cleanup to do.
4 years ago
Ross Wightman 67d0665b46 Post ResNet-RS merge cleanup. Add weight urls, adjust train/test/crop pct.
4 years ago
Aman Arora 560eae38f5
[WIP] Add ResNet-RS models (#554)
4 years ago
Ross Wightman 9cc7dda6e5 Fixup byoanet configs to pass unit tests. Add swin_attn and swinnet26t model for testing.
4 years ago
Ross Wightman e15c3886ba Defaul lambda r=7. Define '26t' stage 4/5 256x256 variants for all of bot/halo/lambda nets for experiment. Add resnet50t for exp. Fix a few comments.
4 years ago
Ross Wightman e5e15754c9 Fix coat first conv ident
4 years ago
Ross Wightman 76739a7589 CoaT merge. Bit of formatting, fix torchscript (for non features), remove einops/einsum dep, add pretrained weight hub (url) support.
4 years ago
Ross Wightman 026430c083 Merge branch 'master' of https://github.com/morizin/pytorch-image-models-1 into morizin-master
4 years ago
Ross Wightman a0492e3b48 A few miil weights naming tweaks to improve compat with model registry and filtering wildcards.
4 years ago
talrid 8c1f03e56c comment
4 years ago
talrid 19e1b67a84 old spaces
4 years ago
talrid a443865876 update naming and scores
4 years ago
talrid cf0e371594 84_0
4 years ago
talrid 0968bdeca3 vit, tresnet and mobilenetV3 ImageNet-21K-P weights
4 years ago
morizin 1e3b6d4dfc
Update __init__.py
4 years ago
morizin fd022fd6a2
Update __init__.py
4 years ago
morizin c2d5087eae
Add files via upload
4 years ago
Ross Wightman c1cf9712fc Add updated EfficientNet-V2S weights, 83.8 @ 384x384 test. Add PyTorch trained EfficientNet-B4 weights, 83.4 @ 384x384 test. Tweak non TF EfficientNet B1-B4 train/test res scaling.
4 years ago
Ross Wightman e8a64fb881 Test input size for efficientnet_v2s was wrong in last results run
4 years ago
Ross Wightman 2df77ee5cb Fix torchscript compat and features_only behaviour in GhostNet PR. A few minor formatting changes. Reuse existing layers.
4 years ago
Ross Wightman d793deb51a Merge branch 'master' of https://github.com/iamhankai/pytorch-image-models into iamhankai-master
4 years ago
Ross Wightman f606c45c38 Add Swin Transformer models from https://github.com/microsoft/Swin-Transformer
4 years ago
iamhankai de445e7827 Add GhostNet
4 years ago
Ross Wightman b3d7580df1 Update ByoaNet comments. Fix first Steam feat chs for ByobNet.
4 years ago
Ross Wightman 16f7aa9f54 Add default_cfg options for min_input_size / fixed_input_size, queries in model registry, and use for testing self-attn models
4 years ago
Ross Wightman 4e4b863b15 Missed norm.py
4 years ago
Ross Wightman 7c97e66f7c Remove commented code, add more consistent seed fn
4 years ago
Ross Wightman ce62f96d4d ByoaNet with bottleneck transformer, lambda resnet, and halo net experiments
4 years ago
Ross Wightman 21812d33aa Add prelim efficientnet_v2s weights from 224x224 train, eval 83.3 @ 288. Add eca_nfnet_l1 weights, train at 256, eval 84 @ 320.
4 years ago
Ross Wightman fb896c0b26 Update some comments re preliminary EfficientNet-V2 assumptions
4 years ago
Ross Wightman 2b49ab7a36 Fix ResNetV2 pretrained classifier issue. Fixes #540
4 years ago
Ross Wightman de9dff933a EfficientNet-V2S preliminary model def (for experimentation)
4 years ago
Ross Wightman 2bb65bd875 Wrong default_cfg pool_size for L1
4 years ago
Ross Wightman bf2ca6bdf4 Merge jax and original weight init
4 years ago
Ross Wightman acbd698c83 Update README.md with updates. Small tweak to head_dist handling.
4 years ago
Ross Wightman 9071568f0e Add weights for SE NFNet-L0 model, rename nfnet_l0b -> nfnet_l0. 82.75 top-1 @ 288. Add nfnet_l1 model def for training.
4 years ago
Ross Wightman c468c47a9c Add regnety_160 weights from DeiT teacher model, update that and my regnety_032 weights to use higher test size.
4 years ago
Ross Wightman 288682796f Update benchmark script to add precision arg. Fix some downstream (DeiT) compat issues with latest changes. Bump version to 0.4.7
4 years ago
Ross Wightman ea9c9550b2 Fully move ViT hybrids to their own file, including embedding module. Remove some extra DeiT models that were for benchmarking only.
4 years ago
Ross Wightman a5310a3451 Merge remote-tracking branch 'origin/benchmark-fixes-vit_hybrids' into pit_and_vit_update
4 years ago
Ross Wightman 7953e5d11a Fix pos_embed scaling for ViT and num_classes != 1000 for pretrained distilled deit and pit models. Fix #426 and fix #433
4 years ago
Ross Wightman a760a4c3f4 Some ViT cleanup, merge distilled model with main, fixup torchscript support for distilled models
4 years ago
Ross Wightman 0dfc5a66bb Add PiT model from https://github.com/naver-ai/pit
4 years ago
Ross Wightman 51febd869b Small tweak to tests for tnt model, reorder model imports.
4 years ago
contrastive de86314655 Update TNT
4 years ago
contrastive cfc15283a4 Update TNT url
4 years ago
contrastive 4a09bc851e Add TNT model
4 years ago
Ross Wightman cf5fec5047 Cleanup experimental vit weight init a bit
4 years ago
Ross Wightman cbcb76d72c Should have included Conv2d layers in original weight init. Lets see what the impact is...
4 years ago
Ross Wightman 4de57ccf01 Add weight init scheme that's closer to JAX impl
4 years ago
Ross Wightman 14ac4abf74 Change huggingface hub revision delimiter to '@', add hf_hub reference for eca_nfnet_l0 model as an example.
4 years ago
Ross Wightman 740f32c96a Add ECA-NFNet-L0 weights and update model name. Update README and bump version to 0.4.6
4 years ago
Ross Wightman 5e2e4e7fb6
Merge pull request #502 from khatami-mehrdad/efficientnet_dg
4 years ago
Ross Wightman 45c048ba13 A few minor fixes and bit more cleanup on the huggingface hub integration.
4 years ago
Mehrdad 97f49d163c adding efficientnet_el, efficientnet_es_prunedefficientnet_es_pruned and efficientnet_el_pruned pretrained models to timm/models
4 years ago
Ross Wightman ead80d33c5 Fix typo, naming consistency
4 years ago
Ross Wightman d584e7f617 Support for huggingface hub via create_model and default_cfgs.
4 years ago