You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ross Wightman b745d30a3e Fix formatting of last commit		3 years ago
..
__init__.py	Update attention / self-attn based models from a series of experiments:	3 years ago
activations.py	Fix inplace arg compat for GELU and PreLU via activation factory	4 years ago
activations_jit.py	Fix some attributions, add copyrights to some file docstrings	4 years ago
activations_me.py	Merge pull request #282 from tigert1998/patch-1	4 years ago
adaptive_avgmax_pool.py	Refactoring, cleanup, improved test coverage.	4 years ago
attention_pool2d.py	Add initial AttentionPool2d that's being trialed. Fix comment and still trying to improve reliability of sgd test.	3 years ago
blur_pool.py	Remove filter hack from BlurPool w/ non-persistent buffer. Use BlurPool2d instead of AntiAliasing.. for TResNet. Breaks PyTorch < 1.6.	4 years ago
bottleneck_attn.py	Add option to include relative pos embedding in the attention scaling as per references. See discussion #912	3 years ago
cbam.py	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	4 years ago
classifier.py	Refactoring, cleanup, improved test coverage.	4 years ago
cond_conv2d.py	Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.	4 years ago
config.py	Add set_layer_config contextmgr to adjust all layer configs at once, use in create_module with new args. Remove a few old warning causing constant annotations for jit.	5 years ago
conv2d_same.py	Fix some attributions, add copyrights to some file docstrings	4 years ago
conv_bn_act.py	Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.	4 years ago
create_act.py	Fix #661, move hardswish out of default args for LeViT. Enable native torch support for hardswish, hardsigmoid, mish if present.	4 years ago
create_attn.py	Update attention / self-attn based models from a series of experiments:	3 years ago
create_conv2d.py	Use in_channels for depthwise groups, allows using `out_channels=N * in_channels` (does not impact existing models). Fix #354.	4 years ago
create_norm_act.py	Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.	4 years ago
drop.py	Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.	4 years ago
eca.py	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	4 years ago
evo_norm.py	Fix a silly bug in Sample version of EvoNorm missing x* part of swish, update EvoNormBatch to accumulated unbiased variance.	4 years ago
gather_excite.py	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	4 years ago
global_context.py	Add gc_efficientnetv2_rw_t weights (global context instead of SE attn). Add TF XL weights even though the fine-tuned ones don't validate that well. Change default arg for GlobalContext to use scal (mul) mode.	3 years ago
halo_attn.py	Add weights for regnetz_d and haloregnetz_c, update regnetz_c weights. Add commented PyTorch XLA code for halo attention	3 years ago
helpers.py	Throw in some FBNetV3 code I had lying around, some refactoring of SE reduction channel calcs for all EffNet archs.	4 years ago
inplace_abn.py	Update README, fix iabn pip version print.	4 years ago
lambda_layer.py	Halo, bottleneck attn, lambda layer additions and cleanup along w/ experimental model defs	3 years ago
linear.py	A few more changes for 0.3.2 maint release. Linear layer change for mobilenetv3 and inception_v3, support no bias for linear wrapper.	4 years ago
median_pool.py	Initial Vision Transformer impl w/ patch and hybrid variants. Refactor tuple helpers.	4 years ago
mixed_conv2d.py	Use in_channels for depthwise groups, allows using `out_channels=N * in_channels` (does not impact existing models). Fix #354.	4 years ago
mlp.py	Cleanup re-use of Dropout modules in Mlp modules after some twitter feedback :p	3 years ago
non_local_attn.py	Fix torchscript issue in bat	4 years ago
norm.py	Realized LayerNorm2d won't work in all cases as is, fixed.	4 years ago
norm_act.py	Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.	4 years ago
padding.py	Fix some attributions, add copyrights to some file docstrings	4 years ago
patch_embed.py	Fix formatting of last commit	3 years ago
pool2d_same.py	Support npz custom load for vision transformer hybrid models. Add posembed rescale for npz load.	4 years ago
selective_kernel.py	Remove min channels for SelectiveKernel, divisor should cover cases well enough.	4 years ago
separable_conv.py	Fix regression in models with 1001 class pretrained weights. Improve batchnorm arg and BatchNormAct layer handling in several models.	4 years ago
space_to_depth.py	Remove some CRLF that made it into TResNet merge	5 years ago
split_attn.py	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	4 years ago
split_batchnorm.py	Fix some attributions, add copyrights to some file docstrings	4 years ago
squeeze_excite.py	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	4 years ago
std_conv.py	Use reshape instead of view in std_conv, causing issues in recent PyTorch in channels_last	3 years ago
test_time_pool.py	Add new weights for ecaresnet26t/50t/269d models. Remove distinction between 't' and 'tn' (tiered models), tn is now t. Add test time img size spec to default cfg.	4 years ago
weight_init.py	Cleanup experimental vit weight init a bit	4 years ago