16 Commits (7266c5c7162b3f23d3e9ab910d9e549a64bc792c)

Author	SHA1	Message	Date
Ross Wightman	8ece53e194	Switch BEiT to HF hub weights	2 years ago
Ross Wightman	d5e7d6b27e	Merge remote-tracking branch 'origin/main' into refactor-imports	2 years ago
Ross Wightman	98047ef5e3	Add EVA FT results, hopefully fix BEiT test failures	2 years ago
Ross Wightman	3cc4d7a894	Fix missing register for 224 eva model	2 years ago
Ross Wightman	eba07b0de7	Add eva models to beit.py	2 years ago
Ross Wightman	927f031293	Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models	2 years ago
Ross Wightman	c8ab747bf4	BEiT-V2 checkpoints didn't remove 'module' from weights, adapt checkpoint filter	2 years ago
Ross Wightman	914544fc81	Add beitv2 224x224 checkpoints from https://github.com/microsoft/unilm/tree/master/beit2	2 years ago
Ross Wightman	909705e7ff	Remove some redundant requires_grad=True from nn.Parameter in third party code	2 years ago
Li Dong	09e9f3defb	migrate azure blob for beit checkpoints ... ## Motivation We are going to use a new blob account to store the checkpoints. ## Modification Modify the azure blob storage URLs for BEiT checkpoints.	3 years ago
Ross Wightman	372ad5fa0d	Significant model refactor and additions: ... * All models updated with revised foward_features / forward_head interface * Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head') * WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types * Add gradient checkpointing support to a significant % of models, especially popular architectures * Formatting and interface consistency improvements across models * layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler * Poolformer and Volo architectures added	3 years ago
Ross Wightman	5f81d4de23	Move DeiT to own file, vit getting crowded. Working towards fixing #1029, make pooling interface for transformers and mlp closer to convnets. Still working through some details...	3 years ago
Ross Wightman	abc9ba2544	Transitioning default_cfg -> pretrained_cfg. Improving handling of pretrained_cfg source (HF-Hub, files, timm config, etc). Checkpoint handling tweaks.	3 years ago
Ross Wightman	f2006b2437	Cleanup qkv_bias cat in beit model so it can be traced	3 years ago
Thomas Viehmann	f805ba86d9	use .unbind instead of explicitly listing the indices	3 years ago
Ross Wightman	1c9284c640	Add BeiT 'finetuned' 1k weights and pretrained 22k weights, pretraining specific (masked) model excluded for now	3 years ago