4 Commits (a25bf974a9a2c67c72fbb780c056c8638c966a83)

Author	SHA1	Message	Date
Ross Wightman	c2f02b08b8	Merge remote-tracking branch 'origin/attn_update' into bits_and_tpu	3 years ago
Ross Wightman	29a37e23ee	LR scheduler update: ... * add polynomial decay 'poly' * cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt * add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909 * change default tanh ub/lb to push inflection to later epochs	3 years ago
Ross Wightman	aa92d7b1c5	Major timm.bits update. Updater and DeviceEnv now dataclasses, after_step closure used, metrics base impl w/ distributed reduce, many tweaks/fixes.	3 years ago
Ross Wightman	aa4354f466	Big re-org, working towards making pip/module as 'timm'	5 years ago