8 Commits (e987e29036507b014bb2aef0bf3b3f5c7bcff273)

Author	SHA1	Message	Date
Ross Wightman	909705e7ff	Remove some redundant requires_grad=True from nn.Parameter in third party code	2 years ago
Li Dong	09e9f3defb	migrate azure blob for beit checkpoints ... ## Motivation We are going to use a new blob account to store the checkpoints. ## Modification Modify the azure blob storage URLs for BEiT checkpoints.	3 years ago
Ross Wightman	372ad5fa0d	Significant model refactor and additions: ... * All models updated with revised foward_features / forward_head interface * Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head') * WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types * Add gradient checkpointing support to a significant % of models, especially popular architectures * Formatting and interface consistency improvements across models * layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler * Poolformer and Volo architectures added	3 years ago
Ross Wightman	5f81d4de23	Move DeiT to own file, vit getting crowded. Working towards fixing #1029, make pooling interface for transformers and mlp closer to convnets. Still working through some details...	3 years ago
Ross Wightman	abc9ba2544	Transitioning default_cfg -> pretrained_cfg. Improving handling of pretrained_cfg source (HF-Hub, files, timm config, etc). Checkpoint handling tweaks.	3 years ago
Ross Wightman	f2006b2437	Cleanup qkv_bias cat in beit model so it can be traced	3 years ago
Thomas Viehmann	f805ba86d9	use .unbind instead of explicitly listing the indices	3 years ago
Ross Wightman	1c9284c640	Add BeiT 'finetuned' 1k weights and pretrained 22k weights, pretraining specific (masked) model excluded for now	3 years ago