9 Commits (main)

Author	SHA1	Message	Date
Ross Wightman	122621daef	Add Final annotation to attn_fas to avoid symbol lookup of new scaled_dot_product_attn fn on old PyTorch in jit	2 years ago
Ross Wightman	621e1b2182	Add ideas from 'Scaling ViT to 22-B Params', testing PyTorch 2.0 fused F.scaled_dot_product_attention impl in vit, vit_relpos, maxxvit / coatnet.	2 years ago
Ross Wightman	9a51e4ea2e	Add FlexiViT models and weights, refactoring, push more weights ... * push all vision_transformer*.py weights to HF hub * finalize more pretrained tags for pushed weights * refactor pos_embed files and module locations, move some pos embed modules to layers * tweak hf hub helpers to aid bulk uploading and updating	2 years ago
Ross Wightman	927f031293	Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models	2 years ago
Ross Wightman	ce65a7b29f	Update vit_relpos w/ some additional weights, some cleanup to match recent vit updates, more MLP log coord experiments.	2 years ago
Ross Wightman	7d657d2ef4	Improve resolve_pretrained_cfg behaviour when no cfg exists, warn instead of crash. Improve usability ex #1311	2 years ago
Ross Wightman	4b30bae67b	Add updated vit_relpos weights, and impl w/ support for official swin-v2 differences for relpos. Add bias control support for MLP layers	3 years ago
Ross Wightman	f5ca4141f7	Adjust arg order for recent vit model args, add a few comments	3 years ago
Ross Wightman	41dc49a337	Vision Transformer refactoring and Rel Pos impl	3 years ago