047a5ec05f
Fix bugs that Mixup does not work device=cpu
3 years ago
80075b0b8a
Add worker_seeding arg to allow selecting old vs updated data loader worker seed for (old) experiment repeatability
3 years ago
f8a63a3b71
Add worker_init_fn to loader for numpy seed per worker
3 years ago
fb94350896
Update training script and loader factory to allow use of scheduler updates, repeat augment, and bce loss
3 years ago
f262137ff2
Add RepeatAugSampler as per DeiT RASampler impl, showing promise for current (distributed) training experiments.
3 years ago
3cdaf5ed56
Add `mmax` config key to auto_augment for increasing upper bound of RandAugment magnitude beyond 10. Make AugMix uniform sampling default not override config setting.
3 years ago
d53e91218e
Fix tf.data options setting for newer TF versions
4 years ago
79640fcc1f
Enable uniform augmentation magnitude sampling and set AugMix default
4 years ago
a5310a3451
Merge remote-tracking branch 'origin/benchmark-fixes-vit_hybrids' into pit_and_vit_update
4 years ago
f42f1df26c
Improve evenness of per-worker split for validation set with TFDS
4 years ago
d584e7f617
Support for huggingface hub via create_model and default_cfgs.
...
* improve consistency of model creation helper fns
* add comments to some of the model helpers
* support passing external default_cfgs so they can be sourced from hub
4 years ago
2db2d87ff7
Add epoch-repeats arg to multiply the number of dataset passes per epoch. Currently for iterable datasets (read TFDS wrapper) only.
4 years ago
68a4144882
Add new weights for ecaresnet26t/50t/269d models. Remove distinction between 't' and 'tn' (tiered models), tn is now t. Add test time img size spec to default cfg.
4 years ago
22748f1a2d
Convert samples/targets in ParserImageInTar to numpy arrays, slightly less mem usage for massive datasets. Add a few more se/eca model defs to resnet.py
4 years ago
5d4c3d0af3
Add enhanced ParserImageInTar that can read images from tars within tars, folders with multiple tars, etc. Additional comment cleanup.
4 years ago
855d6cc217
More dataset work including factories and a tensorflow datasets (TFDS) wrapper
...
* Add parser/dataset factory methods for more flexible dataset & parser creation
* Add dataset parser that wraps TFDS image classification datasets
* Tweak num_classes handling bug for 21k models
* Add initial deit models so they can be benchmarked in next csv results runs
4 years ago
59ec7e6a53
Merge branch 'master' into imagenet21k_datasets_more
4 years ago
e7a9ddf982
Merge pull request #334 from kecsap/links
...
Follow symbolic links during dataset scanning
4 years ago
7cae7e7035
Follow links during dataset scanning
4 years ago
0167f749d3
Remove some old __future__ imports
4 years ago
e35e9760a6
More work on dataset / parser split and imagenet21k (tar) support
4 years ago
de6046e213
Initial commit for dataset / parser reorg to support additional datasets / types
4 years ago
de15b43865
Fix a bug with accuracy retrieving from RealLabels
4 years ago
e8ca45854c
More models in sotabench, more control over sotabench run, dataset filename extraction consistency
4 years ago
47a7b3b5b1
More flexible mixup mode, add 'half' mode.
4 years ago
8c9814e3f5
Final cleanup of mixup/cutmix. Element/batch modes working with both collate (prefetcher active) and without prefetcher.
4 years ago
cd23f55397
Fix mixed prec issues with new mixup code
4 years ago
f471c17c9d
More cutmix/mixup overhaul, ready to kick-off some trials.
4 years ago
92f2d0d65d
Merge branch 'master' into cutmix. Fixup a few issues.
4 years ago
e62758cf4f
More documentation updates, fix a typo
4 years ago
fa28067704
Add more augmentation arguments, including a no_aug disable flag. Fix #209
4 years ago
c53ec33ae0
Add synset/label indices for results generation. Add 'valid labels' to validation script to support imagenet-a/r label subsets properly.
4 years ago
7995295968
Merge branch 'logger' into features. Change 'logger' to '_logger'.
4 years ago
6c17d57a2c
Fix some attributions, add copyrights to some file docstrings
4 years ago
d23a2697d0
Working on feature extraction, interfaces refined, a number of models working, some in progress.
4 years ago
78fa0772cc
Leverage python hierachical logger
...
with this update one can tune the kind of logs generated by timm but
training and inference traces are unchanged
4 years ago
a7f570c9b7
added MultiEpochsDataLoader
5 years ago
64fe37d008
Remove old mean/std helper, rely fully on cmd line or default_cfg now. Fixes #126
5 years ago
670c61b28f
Some cutmix/mixup cleanup/fixes
5 years ago
b3cb5f3275
Working on CutMix impl as per #8 , integrating with Mixup, currently experimenting...
5 years ago
d66819d1f3
Indentation mistake. Fixes #81
5 years ago
1daa303744
Add support to Dataset for class id mapping file, clean up a bit of old logic. Add results file arg for validation and update script.
5 years ago
d9a6a9d0af
Merge pull request #74 from rwightman/augmix-jsd
...
AugMix, JSD loss, SplitBatchNorm (Auxiliary BN), and more
5 years ago
3eb4a96eda
Update AugMix, JSD, etc comments and references
5 years ago
7547119891
Add SplitBatchNorm. AugMix, Rand/AutoAugment, Split (Aux) BatchNorm, Jensen-Shannon Divergence, RandomErasing all working together
5 years ago
2e955cfd0c
Update RandomErasing with some improved arg names, tweak to aspect range
5 years ago
3cc0f91e23
Fix augmix variable name scope overlap, default non-blended mode
5 years ago
4666cc9aed
Add --pin-mem arg to enable dataloader pin_memory (showing more benefit in some scenarios now), also add --torchscript arg to validate.py for testing models with jit.script
5 years ago
3afc2a4dc0
Some cleanup/improvements to AugMix impl:
...
* make 'increasing' levels for Contrast, Color, Brightness, Saturation ops
* remove recursion from faster blending mix
* add config striing parsing for AugMix
5 years ago
232ab7fb12
Working on an implementation of AugMix with JensenShannonDivergence loss that's compatible with my AutoAugment and RandAugment impl
5 years ago
masafumi