From 745bc5f723b642509ced3386a7b5119d37756cd1 Mon Sep 17 00:00:00 2001 From: Ross Wightman Date: Mon, 25 Jan 2021 12:03:13 -0800 Subject: [PATCH] Mention 21k ViT weights in README.md --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index da938f8a..70c9efcc 100644 --- a/README.md +++ b/README.md @@ -5,6 +5,8 @@ ### Jan 25, 2021 * Add ResNetV2 Big Transfer (BiT) models w/ ImageNet-1k and 21k weights from https://github.com/google-research/big_transfer * Add official R50+ViT-B/16 hybrid models + weights from https://github.com/google-research/vision_transformer +* ImageNet-21k ViT weights are added w/ model defs and representation layer (pre logits) support + * NOTE: ImageNet-21k classifier heads were zero'd in original weights, they are only useful for transfer learning * Add model defs and weights for DeiT Vision Transformer models from https://github.com/facebookresearch/deit * Refactor dataset classes into ImageDataset/IterableImageDataset + dataset specific parser classes * Add Tensorflow-Datasets (TFDS) wrapper to allow use of TFDS image classification sets with train script