pytorch-image-models

Commit Graph

Author	SHA1	Message	Date
Ross Wightman	372ad5fa0d	Significant model refactor and additions: * All models updated with revised foward_features / forward_head interface * Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head') * WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types * Add gradient checkpointing support to a significant % of models, especially popular architectures * Formatting and interface consistency improvements across models * layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler * Poolformer and Volo architectures added	3 years ago
Ross Wightman	2c3870e107	semobilevit_s for good measure	3 years ago
Ross Wightman	58ba49c8ef	Add MobileViT models (w/ ByobNet base). Close #1038 .	3 years ago

Author

SHA1

Message

Date

Ross Wightman

372ad5fa0d

Significant model refactor and additions:

* All models updated with revised foward_features / forward_head interface
* Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head')
* WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types
* Add gradient checkpointing support to a significant % of models, especially popular architectures
* Formatting and interface consistency improvements across models
* layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler
* Poolformer and Volo architectures added

Ross Wightman

2c3870e107

semobilevit_s for good measure

Ross Wightman

58ba49c8ef

Add MobileViT models (w/ ByobNet base). Close #1038 .

3 Commits (7cedc8d4743f2b2bbf835fc387c917461fa4911a)