24 Commits (5a40c6a3c48672cf11a1995f9ebdb54f44903f09)

Author	SHA1	Message	Date
Ross Wightman	dff33730b3	Merge remote-tracking branch 'origin/master' into bits_and_tpu	3 years ago
Ross Wightman	d4c0588012	Remove persistent buffers from Swin-V2. Change SwinV2Cr cos attn + tau/logit_scale to match official, add ckpt convert, init_value zeros resid LN weight by default	3 years ago
Ross Wightman	c0211b0bf7	Swin-V2 test fixes, typo	3 years ago
Ross Wightman	9a86b900fa	Official SwinV2 models	3 years ago
Ross Wightman	b7cb8d0337	Add Swin-V2 Small-NS weights (83.5 @ 224). Add layer scale like 'init_values' via post-norm LN weight scaling	3 years ago
Ross Wightman	754e11402a	Merge remote-tracking branch 'origin/master' into bits_and_tpu	3 years ago
Ross Wightman	c5a8e929fb	Add initial swinv2 tiny / small weights	3 years ago
Ross Wightman	024fc4d9ab	version 0.6.1 for master	3 years ago
Ross Wightman	e1e037ba52	Fix bad tuple typing fix that was on XLA branch bust missed on master merge	3 years ago
Ross Wightman	749856cf25	Merge remote-tracking branch 'origin/norm_norm_norm' into bits_and_tpu	3 years ago
Ross Wightman	fe457c1996	Update SwinTransformerV2Cr post-merge, update with grad checkpointing / grad matcher ... * weight compat break, activate norm3 for final block of final stage (equivalent to pre-head norm, but while still in BLC shape) * remove fold/unfold for TPU compat, add commented out roll code for TPU * add option for end of stage norm in all stages * allow weight_init to be selected between pytorch default inits and xavier / moco style vit variant	3 years ago
Ross Wightman	ef57561d51	Fix some TPU (XLA) issues with swin transformer v2	3 years ago
Ross Wightman	15cc9eae3e	Fix Swin v2 tuple type hint	3 years ago
Ross Wightman	bb85b09d2a	swin v2 fixup for latest changes on norm_norm_norm / bits_and_tpu branch	3 years ago
Ross Wightman	1420c118df	Missed comitting outstanding changes to default_cfg keys and test exclusions for swin v2	3 years ago
Ross Wightman	c6e4b7895a	Swin V2 CR impl refactor. ... * reformat and change some naming so closer to existing timm vision transformers * remove typing that wasn't adding clarity (or causing torchscript issues) * support non-square windows * auto window size adjust from image size * post-norm + main-branch no	3 years ago
Christoph Reich	67d140446b	Fix bug in classification head	3 years ago
Christoph Reich	29add820ac	Refactor (back to relative imports)	3 years ago
Christoph Reich	74a04e0016	Add parameter to change normalization type	3 years ago
Christoph Reich	2a4f6c13dd	Create model functions	3 years ago
Christoph Reich	87b4d7a29a	Add get and reset classifier method	3 years ago
Christoph Reich	ff5f6bcd6c	Check input resolution	3 years ago
Christoph Reich	81bf0b4033	Change parameter names to match Swin V1	3 years ago
Christoph Reich	f227b88831	Add initials (CR) to model and file	3 years ago