c2f02b08b8
Merge remote-tracking branch 'origin/attn_update' into bits_and_tpu
3 years ago
29a37e23ee
LR scheduler update:
...
* add polynomial decay 'poly'
* cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt
* add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909
* change default tanh ub/lb to push inflection to later epochs
3 years ago
f98662b9c9
Merge branch 'master' into bits_and_tpu
3 years ago
abf3e044bb
Update scheduler_factory.py
...
remove duplicate code from create_scheduler()
3 years ago
c06c739901
Merge branch 'master' into bits_and_tpu
3 years ago
daab57a6d9
1. Added a simple multi step LR scheduler
4 years ago
aa92d7b1c5
Major timm.bits update. Updater and DeviceEnv now dataclasses, after_step closure used, metrics base impl w/ distributed reduce, many tweaks/fixes.
4 years ago
12d9a6d4d2
First timm.bits commit, add initial abstractions, WIP updates to train, val... some of it working
4 years ago
7995295968
Merge branch 'logger' into features. Change 'logger' to '_logger'.
4 years ago
6c17d57a2c
Fix some attributions, add copyrights to some file docstrings
4 years ago
d72ac0db25
Fix #173 , lr cycle default 0 vs 1. Fix #177 , mirror resnest weights for future stability.
5 years ago
f225ae8e59
Update README with model results and attribution. Make scheduler factory bit more robust to arg differences, add noise to plateau lr and fix min/max.
5 years ago
6441e9cc1b
Fix memory_efficient mode for DenseNets. Add AntiAliasing (Blur) support for DenseNets and create one test model. Add lr cycle/mul params to train args.
5 years ago
c16f25ced2
Add MobileNetV3 Large weights, results, update README and sotabench for merge
5 years ago
27b3680d49
Revamp LR noise, move logic to scheduler base. Fixup PlateauLRScheduler and add it as an option.
5 years ago
514b0938c4
Experimenting with per-epoch learning rate noise w/ step scheduler
5 years ago
fac58f609a
Add RAdam, NovoGrad, Lookahead, and AdamW optimizers, a few ResNet tweaks and scheduler factory tweak.
...
* Add some of the trendy new optimizers. Decent results but not clearly better than the standards.
* Can create a None scheduler for constant LR
* ResNet defaults to zero_init of last BN in residual
* add resnet50d config
5 years ago
e7c8a37334
Make min-lr and cooldown-epochs cmdline args, change dash in color_jitter arg for consistency
5 years ago
c6b32cbe73
A number of tweaks to arguments, epoch handling, config
...
* reorganize train args
* allow resolve_data_config to be used with dict args, not just arparse
* stop incrementing epoch before save, more consistent naming vs csv, etc
* update resume and start epoch handling to match above
* stop auto-incrementing epoch in scheduler
6 years ago
6fc886acaf
Remove all prints, change most to logging calls, tweak alignment of batch logs, improve setup.py
6 years ago
aa4354f466
Big re-org, working towards making pip/module as 'timm'
6 years ago
Ross Wightman