Commit Graph

20 Commits (1ea0be1b17d2238ae9c884b28ac38207f06f2f26)

Author SHA1 Message Date
Ross Wightman 1ea0be1b17 Improve tracing of window attn models with simpler reshape logic
1 year ago
Ross Wightman 927f031293 Major module / path restructure, timm.models.layers -> timm.layers, add _ prefix to all non model modules in timm.models
1 year ago
Ross Wightman d4c0588012 Remove persistent buffers from Swin-V2. Change SwinV2Cr cos attn + tau/logit_scale to match official, add ckpt convert, init_value zeros resid LN weight by default
2 years ago
Ross Wightman c0211b0bf7 Swin-V2 test fixes, typo
2 years ago
Ross Wightman 9a86b900fa Official SwinV2 models
2 years ago
Ross Wightman b7cb8d0337 Add Swin-V2 Small-NS weights (83.5 @ 224). Add layer scale like 'init_values' via post-norm LN weight scaling
2 years ago
Ross Wightman c5a8e929fb Add initial swinv2 tiny / small weights
2 years ago
Ross Wightman 024fc4d9ab version 0.6.1 for master
2 years ago
Ross Wightman e1e037ba52 Fix bad tuple typing fix that was on XLA branch bust missed on master merge
2 years ago
Ross Wightman fe457c1996 Update SwinTransformerV2Cr post-merge, update with grad checkpointing / grad matcher
2 years ago
Ross Wightman 1420c118df Missed comitting outstanding changes to default_cfg keys and test exclusions for swin v2
2 years ago
Ross Wightman c6e4b7895a Swin V2 CR impl refactor.
2 years ago
Christoph Reich 67d140446b Fix bug in classification head
2 years ago
Christoph Reich 29add820ac Refactor (back to relative imports)
2 years ago
Christoph Reich 74a04e0016 Add parameter to change normalization type
2 years ago
Christoph Reich 2a4f6c13dd Create model functions
2 years ago
Christoph Reich 87b4d7a29a Add get and reset classifier method
2 years ago
Christoph Reich ff5f6bcd6c Check input resolution
2 years ago
Christoph Reich 81bf0b4033 Change parameter names to match Swin V1
2 years ago
Christoph Reich f227b88831 Add initials (CR) to model and file
2 years ago