From 58ccf431502d1850b7613d36220f635c0636d834 Mon Sep 17 00:00:00 2001 From: Ross Wightman Date: Sat, 16 Jan 2021 12:30:02 -0800 Subject: [PATCH] Add BiT references and knowledge distill links to readme/docs --- README.md | 5 +++++ docs/models.md | 4 ++++ 2 files changed, 9 insertions(+) diff --git a/README.md b/README.md index dc8423c6..a6d21164 100644 --- a/README.md +++ b/README.md @@ -130,6 +130,7 @@ All model architecture families include variants with pretrained weights. The ar A full version of the list below with source links can be found in the [documentation](https://rwightman.github.io/pytorch-image-models/models/). +* Big Transfer ResNetV2 (BiT) - https://arxiv.org/abs/1912.11370 * CspNet (Cross-Stage Partial Networks) - https://arxiv.org/abs/1911.11929 * DenseNet - https://arxiv.org/abs/1608.06993 * DLA - https://arxiv.org/abs/1707.06484 @@ -242,6 +243,10 @@ One of the greatest assets of PyTorch is the community and their contributions. * Albumentations - https://github.com/albumentations-team/albumentations * Kornia - https://github.com/kornia/kornia +### Knowledge Distillation +* RepDistiller - https://github.com/HobbitLong/RepDistiller +* torchdistill - https://github.com/yoshitomo-matsubara/torchdistill + ### Metric Learning * PyTorch Metric Learning - https://github.com/KevinMusgrave/pytorch-metric-learning diff --git a/docs/models.md b/docs/models.md index f62cdf5f..5522eb2d 100644 --- a/docs/models.md +++ b/docs/models.md @@ -10,6 +10,10 @@ Most included models have pretrained weights. The weights are either: The validation results for the pretrained weights can be found [here](results.md) +## Big Transfer ResNetV2 (BiT) [[resnetv2.py](https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/resnetv2.py)] +* Paper: `Big Transfer (BiT): General Visual Representation Learning` - https://arxiv.org/abs/1912.11370 +* Reference code: https://github.com/google-research/big_transfer + ## Cross-Stage Partial Networks [[cspnet.py](https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/cspnet.py)] * Paper: `CSPNet: A New Backbone that can Enhance Learning Capability of CNN` - https://arxiv.org/abs/1911.11929 * Reference impl: https://github.com/WongKinYiu/CrossStagePartialNetworks