4 Commits (6c3d02a7e51ef834aa042cd2041709c04e6f8a44)

Author	SHA1	Message	Date
Ross Wightman	909705e7ff	Remove some redundant requires_grad=True from nn.Parameter in third party code	2 years ago
Ross Wightman	eca09b8642	Add MobileVitV2 support. Fix #1332. Move GroupNorm1 to common layers (used in poolformer + mobilevitv2). Keep ol custom ConvNeXt LayerNorm2d impl as LayerNormExp2d for reference.	2 years ago
Ross Wightman	78a32655fa	Fix poolformer group_matcher to merge proj downsample with previous block, support coarse	3 years ago
Ross Wightman	372ad5fa0d	Significant model refactor and additions: ... * All models updated with revised foward_features / forward_head interface * Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head') * WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types * Add gradient checkpointing support to a significant % of models, especially popular architectures * Formatting and interface consistency improvements across models * layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler * Poolformer and Volo architectures added	3 years ago