9 Commits (48371a33b11fc30ca23ed8988619af08902b215b)

Author	SHA1	Message	Date
Ross Wightman	f31933cb37	Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.	4 years ago
Ross Wightman	6c17d57a2c	Fix some attributions, add copyrights to some file docstrings	4 years ago
Ross Wightman	f122f0274b	Significant ResNet refactor: ... * stage creation + make_layer moved to separate fn with more sensible dilation/output_stride calc * drop path rate decay easy to impl with refactored block creation loops * fix dilation + blur pool combo	5 years ago
Ross Wightman	eb7653614f	Monster commit, activation refactor, VoVNet, norm_act improvements, more ... * refactor activations into basic PyTorch, jit scripted, and memory efficient custom auto * implement hard-mish, better grad for hard-swish * add initial VovNet V1/V2 impl, fix #151 * VovNet and DenseNet first models to use NormAct layers (support BatchNormAct2d, EvoNorm, InplaceIABN) * Wrap IABN for any models that use it * make more models torchscript compatible (DPN, PNasNet, Res2Net, SelecSLS) and add tests	5 years ago
Ross Wightman	1904ed8fec	Improve dropblock impl, add fast variant, and better AMP speed, inplace, batchwise... few ResNeSt cleanups	5 years ago
Ross Wightman	c60069c1eb	Annotate types on drop fns to avoid torchscript error	5 years ago
Ross Wightman	f1d5f8a6c4	Update comments for Selective Kernel and DropBlock/Path impl, add skresnet34 weights	5 years ago
Ross Wightman	f902bcd54c	Layer refactoring continues, ResNet downsample rewrite for proper dilation in 3x3 and avg_pool cases ... * select_conv2d -> create_conv2d * added create_attn to create attention module from string/bool/module * factor padding helpers into own file, use in both conv2d_same and avg_pool2d_same * add some more test eca resnet variants * minor tweaks, naming, comments, consistency	5 years ago
Ross Wightman	a99ec4e7d1	A bunch more layer reorg, splitting many layers into own files. Improve torchscript compatibility.	5 years ago