a16ea1e355
Merge remote-tracking branch 'origin/norm_norm_norm' into bits_and_tpu
3 years ago
372ad5fa0d
Significant model refactor and additions:
...
* All models updated with revised foward_features / forward_head interface
* Vision transformer and MLP based models consistently output sequence from forward_features (pooling or token selection considered part of 'head')
* WIP param grouping interface to allow consistent grouping of parameters for layer-wise decay across all model types
* Add gradient checkpointing support to a significant % of models, especially popular architectures
* Formatting and interface consistency improvements across models
* layer-wise LR decay impl part of optimizer factory w/ scale support in scheduler
* Poolformer and Volo architectures added
3 years ago
066e490605
Merge branch 'norm_norm_norm' into bits_and_tpu
3 years ago
95cfc9b3e8
Merge remote-tracking branch 'origin/master' into norm_norm_norm
3 years ago
656757d26b
Fix MobileNetV2 head conv size for multiplier < 1.0. Add some missing modification copyrights, fix starting date of some old ones.
3 years ago
02ae11e526
Leaving repeat aug sampler indices as tensor thrashes worker shared process memory
3 years ago
de5fa791c6
Merge branch 'master' into norm_norm_norm
3 years ago
a0b2657497
Use `torch.repeat_interleave()` to generate repeated indices faster ( #1058 )
...
* update: use numpy to generate repeated indices faster
* update: use torch.repeat_interleave() instead of np.repeat()
* refactor: remove unused import, numpy
* refactor: torch.range to torch.arange
* update: tensor to list before appending the extra samples
* update: concatenate the paddings with torch.cat
3 years ago
ff0f709c20
Testing TFDS shuffle across epochs
3 years ago
cad170e494
Merge remote-tracking branch 'origin/norm_norm_norm' into bits_and_tpu
3 years ago
55adfbeb8d
Add commented code to increase open file limit via Python (for TFDS dataset building)
3 years ago
809c7bb1ec
Merge remote-tracking branch 'origin/master' into bits_and_tpu
3 years ago
78b36bf46c
Places365 doesn't exist in some still used torchvision version
3 years ago
cfa414cad2
Matching two bits_and_tpu changes for TFDs wrapper
...
* change 'samples' -> 'examples' for tfds wrapper to match tfds naming
* add class_to_idx for image classification datasets in tfds wrapper
3 years ago
4f338556d8
Fixes and improvements for metrics, tfds parser, loader / transform handling
...
* add back ability to create transform with loader
* change 'samples' -> 'examples' for tfds wrapper to match tfds naming
* add support for specifying feature names for input and target in tfds wrapper
* add class_to_idx for image classification datasets in tfds wrapper
* add accumulate_type to avg meters and metrics to allow float32 or float64 accumulation control with lower prec data
* minor cleanup, log output rate prev and avg
3 years ago
d9b0b3d60f
device arg wasn't removed from PrefetcherCuda instantiation of RE
3 years ago
406c486ba2
Merge remote-tracking branch 'origin/more_datasets' into bits_and_tpu
3 years ago
9ec3210c2d
More TFDS parser cleanup, support improved TFDS even_split impl (on tfds-nightly only currently).
3 years ago
ba65dfe2c6
Dataset work
...
* support some torchvision datasets
* improvements to TFDS wrapper for subsplit handling (fix #942 ), shuffle seed
* add class-map support to train (fix #957 )
3 years ago
a41de1f666
Add interpolation mode handling to transforms. Removes InterpolationMode warning. Works for torchvision versions w/ and w/o InterpolationMode enum. Fix #738 .
3 years ago
ed41d32637
Add repr to auto_augment and random_erasing impl
3 years ago
3b6ba76126
Merge remote-tracking branch 'origin/master' into bits_and_tpu
3 years ago
047a5ec05f
Fix bugs that Mixup does not work device=cpu
3 years ago
80075b0b8a
Add worker_seeding arg to allow selecting old vs updated data loader worker seed for (old) experiment repeatability
3 years ago
25d52ea71d
Merge remote-tracking branch 'origin/fixes_bce_regnet' into bits_and_tpu
3 years ago
f8a63a3b71
Add worker_init_fn to loader for numpy seed per worker
3 years ago
c2f02b08b8
Merge remote-tracking branch 'origin/attn_update' into bits_and_tpu
3 years ago
fb94350896
Update training script and loader factory to allow use of scheduler updates, repeat augment, and bce loss
3 years ago
f262137ff2
Add RepeatAugSampler as per DeiT RASampler impl, showing promise for current (distributed) training experiments.
3 years ago
cb621e0f00
Remove print, arg order
3 years ago
c06c739901
Merge branch 'master' into bits_and_tpu
3 years ago
40457e5691
Transforms, augmentation work for bits, add RandomErasing support for XLA (pushing into transforms), revamp of transform/preproc config, etc ongoing...
3 years ago
3cdaf5ed56
Add `mmax` config key to auto_augment for increasing upper bound of RandAugment magnitude beyond 10. Make AugMix uniform sampling default not override config setting.
3 years ago
b57a03bd0d
Merge branch 'master' into bits_and_tpu
4 years ago
91ab0b6ce5
Add proper TrainState checkpoint save/load. Some reorg/refactoring and other cleanup. More to go...
4 years ago
74d2829341
Merge branch 'master' into bits_and_tpu
4 years ago
aa92d7b1c5
Major timm.bits update. Updater and DeviceEnv now dataclasses, after_step closure used, metrics base impl w/ distributed reduce, many tweaks/fixes.
4 years ago
d53e91218e
Fix tf.data options setting for newer TF versions
4 years ago
938716c753
Fix import issue, use devenv for dist info in parser_tfds
4 years ago
76de984a5f
Fix some bugs with XLA support, logger, add hacky xla dist launch script since torch.dist.launch doesn't work
4 years ago
12d9a6d4d2
First timm.bits commit, add initial abstractions, WIP updates to train, val... some of it working
4 years ago
79640fcc1f
Enable uniform augmentation magnitude sampling and set AugMix default
4 years ago
a5310a3451
Merge remote-tracking branch 'origin/benchmark-fixes-vit_hybrids' into pit_and_vit_update
4 years ago
f42f1df26c
Improve evenness of per-worker split for validation set with TFDS
4 years ago
d584e7f617
Support for huggingface hub via create_model and default_cfgs.
...
* improve consistency of model creation helper fns
* add comments to some of the model helpers
* support passing external default_cfgs so they can be sourced from hub
4 years ago
2db2d87ff7
Add epoch-repeats arg to multiply the number of dataset passes per epoch. Currently for iterable datasets (read TFDS wrapper) only.
4 years ago
68a4144882
Add new weights for ecaresnet26t/50t/269d models. Remove distinction between 't' and 'tn' (tiered models), tn is now t. Add test time img size spec to default cfg.
4 years ago
22748f1a2d
Convert samples/targets in ParserImageInTar to numpy arrays, slightly less mem usage for massive datasets. Add a few more se/eca model defs to resnet.py
4 years ago
5d4c3d0af3
Add enhanced ParserImageInTar that can read images from tars within tars, folders with multiple tars, etc. Additional comment cleanup.
4 years ago
855d6cc217
More dataset work including factories and a tensorflow datasets (TFDS) wrapper
...
* Add parser/dataset factory methods for more flexible dataset & parser creation
* Add dataset parser that wraps TFDS image classification datasets
* Tweak num_classes handling bug for 21k models
* Add initial deit models so they can be benchmarked in next csv results runs
4 years ago
Ross Wightman