7 Commits (7c7ecd24923b19338ca083d56369193e153294f0)

Author	SHA1	Message	Date
Ross Wightman	372ad5fa0d	Significant model refactor and additions: ... * All models updated with revised foward_features / forward_head interface * Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head') * WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types * Add gradient checkpointing support to a significant % of models, especially popular architectures * Formatting and interface consistency improvements across models * layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler * Poolformer and Volo architectures added	3 years ago
Ross Wightman	834a9ec721	Disable use of timm nn.Linear wrapper since AMP autocast + torchscript use appears fixed	3 years ago
Ross Wightman	8880f696b6	Refactoring, cleanup, improved test coverage. ... * Add eca_nfnet_l2 weights, 84.7 @ 384x384 * All 'non-std' (ie transformer / mlp) models have classifier / default_cfg test added * Fix #694 reset_classifer / num_features / forward_features / num_classes=0 consistency for transformer / mlp models * Add direct loading of npz to vision transformer (pure transformer so far, hybrid to come) * Rename vit_deit* to deit_* * Remove some deprecated vit hybrid model defs * Clean up classifier flatten for conv classifiers and unusual cases (mobilenetv3/ghostnet) * Remove explicit model fns for levit conv, just pass in arg	3 years ago
Ross Wightman	231d04e91a	ResNetV2 pre-act and non-preact model, w/ BiT pretrained weights and support for ViT R50 model. Tweaks for in21k num_classes passing. More to do... tests failing.	4 years ago
Ross Wightman	460eba7f24	Work around casting issue with combination of native torch AMP and torchscript for Linear layers	4 years ago
Ross Wightman	b1f1a54de9	More uniform treatment of classifiers across all models, reduce code duplication.	4 years ago
Ross Wightman	3b9004bef9	Lots of changes to model creation helpers, close to finalizing feature extraction / interfaces	4 years ago