Commit Graph

329 Commits (ea9c9550b24dfaf30fdcca960b9cc24a65c359fe)

Author SHA1 Message Date
Ross Wightman ea9c9550b2 Fully move ViT hybrids to their own file, including embedding module. Remove some extra DeiT models that were for benchmarking only.
3 years ago
Ross Wightman a5310a3451 Merge remote-tracking branch 'origin/benchmark-fixes-vit_hybrids' into pit_and_vit_update
3 years ago
Ross Wightman 7953e5d11a Fix pos_embed scaling for ViT and num_classes != 1000 for pretrained distilled deit and pit models. Fix #426 and fix #433
3 years ago
Ross Wightman a760a4c3f4 Some ViT cleanup, merge distilled model with main, fixup torchscript support for distilled models
3 years ago
Ross Wightman 0dfc5a66bb Add PiT model from https://github.com/naver-ai/pit
3 years ago
Ross Wightman 51febd869b Small tweak to tests for tnt model, reorder model imports.
3 years ago
contrastive de86314655 Update TNT
3 years ago
contrastive cfc15283a4 Update TNT url
3 years ago
contrastive 4a09bc851e Add TNT model
3 years ago
Ross Wightman cf5fec5047 Cleanup experimental vit weight init a bit
3 years ago
Ross Wightman cbcb76d72c Should have included Conv2d layers in original weight init. Lets see what the impact is...
3 years ago
Ross Wightman 4de57ccf01 Add weight init scheme that's closer to JAX impl
3 years ago
Ross Wightman 14ac4abf74 Change huggingface hub revision delimiter to '@', add hf_hub reference for eca_nfnet_l0 model as an example.
3 years ago
Ross Wightman 740f32c96a Add ECA-NFNet-L0 weights and update model name. Update README and bump version to 0.4.6
3 years ago
Ross Wightman 5e2e4e7fb6
Merge pull request #502 from khatami-mehrdad/efficientnet_dg
3 years ago
Ross Wightman 45c048ba13 A few minor fixes and bit more cleanup on the huggingface hub integration.
3 years ago
Mehrdad 97f49d163c adding efficientnet_el, efficientnet_es_prunedefficientnet_es_pruned and efficientnet_el_pruned pretrained models to timm/models
3 years ago
Ross Wightman ead80d33c5 Fix typo, naming consistency
3 years ago
Ross Wightman d584e7f617 Support for huggingface hub via create_model and default_cfgs.
3 years ago
Ross Wightman 1f799afcb3 Remove capital letters in model names
3 years ago
AFLALO, Jonathan Isaac 82c1fe958a added hardcorenas model
3 years ago
Ross Wightman f57db99101 Update README, fix iabn pip version print.
3 years ago
Ross Wightman 7ef7788ee9 Fix CUDA crash w/ channels-last + CSP models. Remove use of chunk()
3 years ago
Ross Wightman 317ea3e599 Tweak NFNet, ResNetV2, RexNet feature extraction, use pre-act features for simplicty. Update tests for pytorch 1.8. 0.4.5 version bump.
3 years ago
Ross Wightman 17cdee7354 Fix C&P patch_size error, and order of op patch_size arg resolution bug. Remove a test vit model.
3 years ago
Ross Wightman 0706d05d52 Benchmark models listed in txt file. Add more hybrid vit variants for testing
3 years ago
Ross Wightman de97be9146 Spell out diff between my small and deit small vit models.
3 years ago
Ross Wightman f0ffdf89b3 Add numerous experimental ViT Hybrid models w/ ResNetV2 base. Update the ViT naming for hybrids. Fix #426 for pretrained vit resizing.
3 years ago
Ross Wightman 4bc103f504 Fix CUDA crash w/ channels-last + CSP models. Remove use of chunk()
3 years ago
Ross Wightman 8563609b28 Update notes in ScaledStdConv impl
3 years ago
Ross Wightman 678ba4e0a2 Add NFNet-F model weights ported from DeepMind Haiku impl and new set of models w/ compatible config.
3 years ago
Ross Wightman 4f49b94311 Initial AGC impl. Still testing.
3 years ago
Ross Wightman 5f9aff395c Fix stem width in NFNet-F models, add some more comments, add some 'light' NFNet models for testing.
3 years ago
Ross Wightman d86dbe45c2 Update README.md and few more comments
3 years ago
Ross Wightman 0d253e2c5e Fix issue with nfnet tests, bit more cleanup.
3 years ago
Ross Wightman cb06c7a910 Add NFNet-F models and tweak existing NF models.
3 years ago
Ross Wightman e4de077021 Add first 'Normalizer Free' models. nf_regnet_b1 79.3 @ 288x288 test, and nf_resnet50 80.3 @ 256x256 test (80.68 @ 288x288).
3 years ago
Ross Wightman d8e69206be
Merge pull request #419 from rwightman/byob_vgg_models
3 years ago
Ross Wightman 6853b07bbd Improve RegVGG block identity/vs non for clariy and fix attn usage. Add comments.
3 years ago
Ross Wightman 0356e773f5 Default to native PyTorch AMP instead of APEX amp. Too many APEX issues cropping up lately.
3 years ago
Reuben 94ca140b67 update collections.abc import
3 years ago
Ross Wightman b4e216e377 Fix a few small things.
3 years ago
Ross Wightman dc85e5a237 Add ByobNet w/ GPU-EfficientNets and RepVGG. Also add classic vgg models.
3 years ago
Ross Wightman 1bcc69e0ad Use in_channels for depthwise groups, allows using `out_channels=N * in_channels` (does not impact existing models). Fix #354.
3 years ago
Ross Wightman 9811e229f7 Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.
3 years ago
Ross Wightman a39c3ee216
Merge branch 'master' into eca-weights
3 years ago
Ross Wightman 666de85cf1 Move stride in EdgeResidual block to 3x3 expansion conv. Fix #414
3 years ago
Ross Wightman 3b57490a63 Fix some half removed resnet model defs, pooling for ecaresnet269d
3 years ago
Ross Wightman 68a4144882 Add new weights for ecaresnet26t/50t/269d models. Remove distinction between 't' and 'tn' (tiered models), tn is now t. Add test time img size spec to default cfg.
3 years ago
Ross Wightman b9843f954b
Merge pull request #282 from tigert1998/patch-1
3 years ago