981 Commits (72cfa577614c5f6cbb23d7f9cec851ea3ed96d4e)

Author	SHA1	Message	Date
Ross Wightman	55adfbeb8d	Add commented code to increase open file limit via Python (for TFDS dataset building)	3 years ago
talrid	c11f4c3218	support CNNs	3 years ago
mrT23	d6701d8a81	Merge branch 'rwightman:master' into master	3 years ago
qwertyforce	ccb3815360	update arxiv link	3 years ago
Ross Wightman	3dc71695bf	Merge pull request #989 from martinsbruveris/feat/resmlp-dino ... Added DINO pretrained ResMLP models.	3 years ago
Ross Wightman	480c676ffa	Fix FX breaking assert in evonorm	3 years ago
Martins Bruveris	85c5ff26d7	Added DINO pretrained ResMLP models.	3 years ago
Ross Wightman	d633a014e6	Post merge cleanup. Fix potential security issue passing kwargs directly through to serialized web data.	3 years ago
Nathan Raw	b18c9e323b	Update helpers.py	3 years ago
Nathan Raw	308d0b9554	Merge branch 'master' into hf-save-and-push	3 years ago
Ross Wightman	f0507f6da6	Fix k_decay default arg != 1.0 in poly scheduler	3 years ago
talrid	41559247e9	use_ml_decoder_head	3 years ago
Ross Wightman	1f53db2ece	Updated lamhalobotnet weights, 81.5 top-1	3 years ago
Ross Wightman	15ef108eb4	Add better halo2botnet50ts weights, 82 top-1 @ 256	3 years ago
Ross Wightman	734b2244fe	Add RegNetZ-D8 (83.5 @ 256, 84 @ 320) and RegNetZ-E8 (84.5 @ 256, 85 @ 320) weights. Update names of existing RegZ models to include group size.	3 years ago
Ross Wightman	93cc08fdc5	Make evonorm variables 1d to match other PyTorch norm layers, will break weight compat for any existing use (likely minimal, easy to fix).	3 years ago
Ross Wightman	af607b75cc	Prep a set of ResNetV2 models with GroupNorm, EvoNormB0, EvoNormS0 for BN free model experiments on TPU and IPU	3 years ago
Ross Wightman	c976a410d9	Add ResNet-50 w/ GN (resnet50_gn) and SEBotNet-33-TS (sebotnet33ts_256) model defs and weights. Update halonet50ts weights w/ slightly better variant in1k val, more robust to test sets.	3 years ago
Ross Wightman	f2006b2437	Cleanup qkv_bias cat in beit model so it can be traced	3 years ago
Ross Wightman	1076a65df1	Minor post FX merge cleanup	3 years ago
Ross Wightman	32c9937dec	Merge branch 'fx-feature-extract-new' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-fx-feature-extract-new	3 years ago
Ross Wightman	78b36bf46c	Places365 doesn't exist in some still used torchvision version	3 years ago
Alexander Soare	65d827c7a6	rename notrace registration and standardize trace_utils imports	3 years ago
Ross Wightman	9b2daf2a35	Add ResNeXt-50 weights 81.1 top-1 @ 224, 82 @ 288 with A1 'high aug' recipe	3 years ago
Ross Wightman	9b5d6dc7e2	Merge branch 'add-vit-b8' of https://github.com/martinsbruveris/pytorch-image-models into martinsbruveris-add-vit-b8	3 years ago
Ross Wightman	cfa414cad2	Matching two bits_and_tpu changes for TFDs wrapper ... * change 'samples' -> 'examples' for tfds wrapper to match tfds naming * add class_to_idx for image classification datasets in tfds wrapper	3 years ago
Martins Bruveris	5220711d87	Added B/8 models to ViT.	3 years ago
Alexander Soare	0262a0e8e1	fx ready for review	3 years ago
Alexander Soare	d2994016e9	Add try/except guards	3 years ago
Alexander Soare	b25ff96768	wip - pre-rebase	3 years ago
Alexander Soare	e051dce354	Make all models FX traceable	3 years ago
Alexander Soare	cf4561ca72	Add FX based FeatureGraphNet capability	3 years ago
Alexander Soare	0149ec30d7	wip - attempting to rebase	3 years ago
Alexander Soare	02c3a75a45	wip - make it possible to use fx graph in train and eval mode	3 years ago
Alexander Soare	bc3d4eb403	wip -rebase	3 years ago
Alexander Soare	ab3ac3f25b	Add FX based FeatureGraphNet capability	3 years ago
Ross Wightman	9ec3210c2d	More TFDS parser cleanup, support improved TFDS even_split impl (on tfds-nightly only currently).	3 years ago
Ross Wightman	ba65dfe2c6	Dataset work ... * support some torchvision datasets * improvements to TFDS wrapper for subsplit handling (fix #942), shuffle seed * add class-map support to train (fix #957)	3 years ago
Ross Wightman	ddc29da974	Add ResNet101 and ResNet152 weights from higher aug RSB recipes. 81.93 and 82.82 top-1 at 224x224.	3 years ago
Ross Wightman	b328e56f49	Update eca_halonext26ts weights to a better set	3 years ago
Ross Wightman	2ddef942b9	Better fix for #954 that doesn't break torchscript, pull torch._assert into timm namespace when it exists	3 years ago
Ross Wightman	4f0f9cb348	Fix #954 by bringing traceable _assert into timm to allow compat w/ PyTorch < 1.8	3 years ago
Ross Wightman	a41de1f666	Add interpolation mode handling to transforms. Removes InterpolationMode warning. Works for torchvision versions w/ and w/o InterpolationMode enum. Fix #738.	3 years ago
Ross Wightman	ed41d32637	Add repr to auto_augment and random_erasing impl	3 years ago
Ross Wightman	ae72d009fa	Add weights for lambda_resnet50ts, halo2botnet50ts, lamhalobotnet50ts, updated halonet50ts	3 years ago
Ross Wightman	b745d30a3e	Fix formatting of last commit	3 years ago
Ross Wightman	3478f1d7f1	Traceability fix for vit models for some experiments	3 years ago
Ross Wightman	f658a72e72	Cleanup re-use of Dropout modules in Mlp modules after some twitter feedback :p	3 years ago
Thomas Viehmann	f805ba86d9	use .unbind instead of explicitly listing the indices	3 years ago
Ross Wightman	57992509f9	Fix some formatting in utils/model.py	3 years ago
Ross Wightman	0fe4fd3f1f	add d8 and e8 regnetz models with group size 8	3 years ago
Ross Wightman	25e7c8c5e5	Update broken resnetv2_50 weight url, add resnetv1_101 a1h recipe weights for 224x224 train	3 years ago
Ross Wightman	b6caa356d2	Fixed eca_botnext26ts_256 weights added, 79.27	3 years ago
Ross Wightman	c02334d9fa	Add weights for regnetz_d and haloregnetz_c, update regnetz_c weights. Add commented PyTorch XLA code for halo attention	3 years ago
Ross Wightman	02daf2ab94	Add option to include relative pos embedding in the attention scaling as per references. See discussion #912	3 years ago
masafumi	047a5ec05f	Fix bugs that Mixup does not work device=cpu	3 years ago
Ross Wightman	cd34913278	Remove some outdated comments, botnet networks working great now.	3 years ago
Ross Wightman	6ed4cdccca	Update lambda_resnet26t weights with better set	3 years ago
ICLR Author	44d6d51668	Add ConvMixer	3 years ago
Ross Wightman	a85df34993	Update lambda_resnet26rpt weights to 78.9, add better halonet26t weights at 79.1 with tweak to attention dim	3 years ago
Ross Wightman	b544ad4d3f	regnetz model default cfg tweaks	3 years ago
Ross Wightman	e5da481073	Small post-merge tweak for freeze/unfreeze, add to __init__ for utils	3 years ago
Ross Wightman	5ca72dcc75	Merge branch 'freeze-functionality' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-freeze-functionality	3 years ago
Ross Wightman	e2b8d44ff0	Halo, bottleneck attn, lambda layer additions and cleanup along w/ experimental model defs ... * align interfaces of halo, bottleneck attn and lambda layer * add qk_ratio to all of above, control q/k dim relative to output dim * add experimental haloregnetz, and trionet (lambda + halo + bottle) models	3 years ago
Alexander Soare	431e60c83f	Add acknowledgements for freeze_batch_norm inspiration	3 years ago
Ross Wightman	fbf59c04ee	Change crop ratio on correct resnet50 variant.	3 years ago
Ross Wightman	ae1ff5792f	Clean a1/a2/3 rsb _0 checkpoints properly, fix v2 loading.	3 years ago
Ross Wightman	93901e992f	Version bump to 0.5.0 for pending release post RSB and ATTN updates	3 years ago
Ross Wightman	da0d39bedd	Update default crop_pct for byoanet	3 years ago
Ross Wightman	cc9bedf373	Add initial ResNet Strikes Back weights for ResNet50 and ResNetV2-50 models	3 years ago
Ross Wightman	64495505b7	Add updated lambda resnet26 and botnet26 checkpoints with fixes applied	3 years ago
Ross Wightman	b2094f4ee8	support bits checkpoints in avg/load	3 years ago
Ross Wightman	007bc39323	Some halo and bottleneck attn code cleanup, add halonet50ts weights, use optimal crop ratios	3 years ago
Alexander Soare	65c3d78b96	Freeze unfreeze functionality finalized. Tests added	3 years ago
Alexander Soare	0cb8ea432c	wip	3 years ago
Ross Wightman	b1c2e3eb92	Match rel_pos_indices attr rename in conv branch	3 years ago
Ross Wightman	b49630a138	Add relative pos embed option to LambdaLayer, fix last transpose/reshape.	3 years ago
Ross Wightman	d657e2cc0b	Remove dead code line from efficientnet	3 years ago
Ross Wightman	0ca687f224	Make 'regnetz' model experiments closer to actual RegNetZ, bottleneck expansion, expand from in_chs, no shortcut on stride 2, tweak model sizes	3 years ago
leondgarse	51eaf9360d	Remove a duplicate layer creation in byobnet.py ... `self.conv2_kxk` is repeated in `byobnet.py`. Remove the duplicate code.	3 years ago
Ross Wightman	b81e79aae9	Fix bottleneck attn transpose typo, hopefully these train better now..	3 years ago
Ross Wightman	80075b0b8a	Add worker_seeding arg to allow selecting old vs updated data loader worker seed for (old) experiment repeatability	3 years ago
Ross Wightman	6478bcd02c	Fix regnetz_d conv layer name, use inception mean/std	3 years ago
Ross Wightman	0387e6057e	Update binary cross ent impl to use thresholding as an option (convert soft targets from mixup/cutmix to 0, 1)	3 years ago
Ross Wightman	f8a63a3b71	Add worker_init_fn to loader for numpy seed per worker	3 years ago
Ross Wightman	515121cca1	Use reshape instead of view in std_conv, causing issues in recent PyTorch in channels_last	3 years ago
Ross Wightman	da06cc61d4	ResNetV2 seems to work best without zero_init residual	3 years ago
Ross Wightman	8e11da0ce3	Add experimental RegNetZ(ish) models for training / perf trials.	3 years ago
Alexander Soare	6bbc50beb4	make it possible to provide norm_layer via create_model	3 years ago
nateraw	adcb74f87f	🎨 Import load_state_dict_from_url directly	3 years ago
nateraw	e65a2cba3d	🎨 cleanup and add a couple comments	3 years ago
nateraw	2b6ade24b3	🎨 write model card to enable inference	3 years ago
Ross Wightman	cf5ac2800c	BotNet models were still off, remove weights for bad configs. Add good SE-HaloNet33-TS weights.	3 years ago
Ross Wightman	24720abe3b	Merge branch 'master' into attn_update	3 years ago
Ross Wightman	1c9284c640	Add BeiT 'finetuned' 1k weights and pretrained 22k weights, pretraining specific (masked) model excluded for now	3 years ago
Ross Wightman	f8a215cfe6	A few more crossvit tweaks, fix training w/ no_weight_decay names, add crop option for scaling, adjust default crop_pct for large img size to 1.0 for better results	3 years ago
Ross Wightman	7ab2491ab7	Better handling of crossvit for tests / forward_features, fix torchscript regression in my changes	3 years ago
Ross Wightman	f1808e0970	Post crossvit merge cleanup, change model names to reflect input size, cleanup img size vs scale handling, fix tests	3 years ago
Ross Wightman	4027412757	Add resnet33ts weights, update resnext26ts baseline weights	3 years ago
Richard Chen	9fe5798bee	fix bug for reset classifier and fix for validating the dimension	3 years ago
Richard Chen	3718c5a5bd	fix loading pretrained model	3 years ago
Richard Chen	bb50b69a57	fix for torch script	3 years ago
nateraw	abf9d51bc3	🚧 wip	3 years ago
Ross Wightman	5bd04714e4	Cleanup weight init for byob/byoanet and related	3 years ago
Ross Wightman	8642401e88	Swap botnet 26/50 weights/models after realizing a mistake in arch def, now figuring out why they were so low...	3 years ago
Ross Wightman	5f12de4875	Add initial AttentionPool2d that's being trialed. Fix comment and still trying to improve reliability of sgd test.	3 years ago
Ross Wightman	76881d207b	Add baseline resnet26t @ 256x256 weights. Add 33ts variant of halonet with at least one halo in stage 2,3,4	3 years ago
Ross Wightman	484e61648d	Adding the attn series weights, tweaking model names, comments...	3 years ago
Ross Wightman	fb94350896	Update training script and loader factory to allow use of scheduler updates, repeat augment, and bce loss	3 years ago
Ross Wightman	f262137ff2	Add RepeatAugSampler as per DeiT RASampler impl, showing promise for current (distributed) training experiments.	3 years ago
Ross Wightman	ba9c1108a1	Add a BCE loss impl that converts dense targets to sparse /w smoothing as an alternate to CE w/ smoothing. For training experiments.	3 years ago
Ross Wightman	29a37e23ee	LR scheduler update: ... * add polynomial decay 'poly' * cleanup cycle specific args for cosine, poly, and tanh sched, t_mul -> cycle_mul, decay -> cycle_decay, default cycle_limit to 1 in each opt * add k-decay for cosine and poly sched as per https://arxiv.org/abs/2004.05909 * change default tanh ub/lb to push inflection to later epochs	3 years ago
nateraw	28d2841acf	💄 apply isort	3 years ago
Ross Wightman	492c0a4e20	Update HaloAttn comment	3 years ago
nateraw	e72c989973	✨ add ability to push to hf hub	3 years ago
Richard Chen	7ab9d4555c	add crossvit	3 years ago
Ross Wightman	3b9032ea48	Use Tensor.unfold().unfold() for HaloAttn, fast like as_strided but more clarity	3 years ago
Ross Wightman	78933122c9	Fix silly typo	3 years ago
Ross Wightman	2568ffc5ef	Merge branch 'master' into attn_update	3 years ago
Ross Wightman	708d87a813	Fix ViT SAM weight compat as weights at URL changed to not use repr layer. Fix #825. Tweak optim test.	3 years ago
Ross Wightman	8449ba210c	Improve performance of HaloAttn, change default dim calc. Some cleanup / fixes for byoanet. Rename resnet26ts to tfs to distinguish (extra fc).	3 years ago
Ross Wightman	a8b65695f1	Add resnet26ts and resnext26ts models for non-attn baselines	3 years ago
Ross Wightman	a5a542f17d	Fix typo	3 years ago
Ross Wightman	925e102982	Update attention / self-attn based models from a series of experiments: ... * remove dud attention, involution + my swin attention adaptation don't seem worth keeping * add or update several new 26/50 layer ResNe(X)t variants that were used in experiments * remove models associated with dead-end or uninteresting experiment results * weights coming soon...	3 years ago
Ross Wightman	d667351eac	Tweak accuracy topk safety. Fix #807	3 years ago
Yohann Lereclus	35c9740826	Fix accuracy when topk > num_classes	3 years ago
Ross Wightman	a16a753852	Add lamb/lars to optim init imports, remove stray comment	3 years ago
Ross Wightman	c207e02782	MOAR optimizer changes. Woo!	3 years ago
Ross Wightman	a426511c95	More optimizer cleanup. Change all to no longer use .data. Improve (b)float16 use with adabelief. Add XLA compatible Lars.	3 years ago
Ross Wightman	9541f4963b	One more scalar -> tensor fix for lamb optimizer	3 years ago
Ross Wightman	8f68193c91	Update lamp.py comment	3 years ago
Ross Wightman	4d284017b8	Merge pull request #813 from rwightman/opt_cleanup ... Optimizer cleanup and additions	3 years ago
Ross Wightman	a6af48be64	add madgradw optimizer	3 years ago
Ross Wightman	55fb5eedf6	Remove experiment from lamb impl	3 years ago
Ross Wightman	8a9eca5157	A few optimizer comments, dead import, missing import	3 years ago
Ross Wightman	ac469b50da	Optimizer improvements, additions, cleanup ... * Add MADGRAD code * Fix Lamb (non-fused variant) to work w/ PyTorch XLA * Tweak optimizer factory args (lr/learning_rate and opt/optimizer_name), may break compat * Use newer fn signatures for all add,addcdiv, addcmul in optimizers * Use upcoming PyTorch native Nadam if it's available * Cleanup lookahead opt * Add optimizer tests * Remove novograd.py impl as it was messy, keep nvnovograd * Make AdamP/SGDP work in channels_last layout * Add rectified adablief mode (radabelief) * Support a few more PyTorch optim, adamax, adagrad	3 years ago
Sepehr Sameni	abf3e044bb	Update scheduler_factory.py ... remove duplicate code from create_scheduler()	3 years ago
Ross Wightman	3cdaf5ed56	Add `mmax` config key to auto_augment for increasing upper bound of RandAugment magnitude beyond 10. Make AugMix uniform sampling default not override config setting.	3 years ago
Ross Wightman	1042b8a146	Add non fused LAMB optimizer option	3 years ago
Ross Wightman	01cb46a9a5	Add gc_efficientnetv2_rw_t weights (global context instead of SE attn). Add TF XL weights even though the fine-tuned ones don't validate that well. Change default arg for GlobalContext to use scal (mul) mode.	3 years ago
Ross Wightman	d3f7440650	Add EfficientNetV2 XL model defs	3 years ago
Ross Wightman	72b227dcf5	Merge pull request #750 from drjinying/master ... Specify "interpolation" mode in vision_transformer's resize_pos_embed	3 years ago
Ross Wightman	2907c1f967	Merge pull request #746 from samarth4149/master ... Adding a Multi Step LR Scheduler	3 years ago
Ross Wightman	748ab852ca	Allow act_layer switch for xcit, fix in_chans for some variants	3 years ago
Ying Jin	20b2d4b69d	Use bicubic interpolation in resize_pos_embed()	3 years ago
Ross Wightman	d3255adf8e	Merge branch 'xcit' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-xcit	3 years ago
Ross Wightman	f8039c7492	Fix gc effv2 model cfg name	3 years ago
Alexander Soare	3a55a30ed1	add notes from author	3 years ago
Alexander Soare	899cf84ccc	bug fix - missing _dist postfix for many of the 224_dist models	3 years ago
Alexander Soare	623e8b8eb8	wip xcit	3 years ago
Ross Wightman	392368e210	Add efficientnetv2_rw_t defs w/ weights, and gc variant, as well as gcresnet26ts for experiments. Version 0.4.13	3 years ago
samarth	daab57a6d9	1. Added a simple multi step LR scheduler	3 years ago
Ross Wightman	6d8272e92c	Add SAM pretrained model defs/weights for ViT B16 and B32 models.	3 years ago
Ross Wightman	ee4d8fc69a	Remove unecessary line from nest post refactor	3 years ago
Ross Wightman	8165cacd82	Realized LayerNorm2d won't work in all cases as is, fixed.	3 years ago
Ross Wightman	81cd6863c8	Move aggregation (convpool) for nest into NestLevel, cleanup and enable features_only use. Finalize weight url.	3 years ago
Ross Wightman	6ae0ac6420	Merge branch 'nested_transformer' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-nested_transformer	3 years ago
Alexander Soare	7b8a0017f1	wip to review	3 years ago
Alexander Soare	b11d949a06	wip checkpoint with some feature extraction work	3 years ago
Alexander Soare	23bb72ce5e	nested_transformer wip	3 years ago
Ross Wightman	766b4d3262	Fix features for resnetv2_50t	3 years ago
Ross Wightman	e8045e712f	Fix BatchNorm for ResNetV2 non GN models, add more ResNetV2 model defs for future experimentation, fix zero_init of last residual for pre-act.	3 years ago
Ross Wightman	20a2be14c3	Add gMLP-S weights, 79.6 top-1	3 years ago
Ross Wightman	85f894e03d	Fix ViT in21k representation (pre_logits) layer handling across old and new npz checkpoints	3 years ago
Ross Wightman	b41cffaa93	Fix a few issues loading pretrained vit/bit npz weights w/ num_classes=0 __init__ arg. Missed a few other small classifier handling detail on Mlp, GhostNet, Levit. Should fix #713	3 years ago
Ross Wightman	9c9755a808	AugReg release	3 years ago
Ross Wightman	381b279785	Add hybrid model fwds back	3 years ago
Ross Wightman	26f04a8e3e	Fix a weight link	3 years ago
Ross Wightman	8f4a0222ed	Add GMixer-24 MLP model weights, trained w/ TPU + PyTorch XLA	3 years ago
Ross Wightman	4c09a2f169	Bump version 0.4.12	3 years ago
Ross Wightman	b319eb5b5d	Update ViT weights, more details to be added before merge.	3 years ago
Ross Wightman	8257b86550	Fix up resnetv2 bit/bitm model default res	3 years ago
Ross Wightman	1228f5a3d8	Add BiT distilled 50x1 and teacher 152x2 models from 'A good teacher is patient and consistent' paper.	3 years ago
Ross Wightman	511a8e8c96	Add official ResMLP weights.	3 years ago
Ross Wightman	b9cfb64412	Support npz custom load for vision transformer hybrid models. Add posembed rescale for npz load.	3 years ago
Ross Wightman	8319e0c373	Add file docstring to std_conv.py	3 years ago
Ross Wightman	4d96165989	Merge branch 'master' into cleanup_xla_model_fixes	3 years ago
Ross Wightman	8880f696b6	Refactoring, cleanup, improved test coverage. ... * Add eca_nfnet_l2 weights, 84.7 @ 384x384 * All 'non-std' (ie transformer / mlp) models have classifier / default_cfg test added * Fix #694 reset_classifer / num_features / forward_features / num_classes=0 consistency for transformer / mlp models * Add direct loading of npz to vision transformer (pure transformer so far, hybrid to come) * Rename vit_deit* to deit_* * Remove some deprecated vit hybrid model defs * Clean up classifier flatten for conv classifiers and unusual cases (mobilenetv3/ghostnet) * Remove explicit model fns for levit conv, just pass in arg	3 years ago
Ross Wightman	ba2ca4b464	One codepath for stdconv, switch layernorm to batchnorm so gain included. Tweak epsilon values for nfnet, resnetv2, vit hybrid.	3 years ago
Ross Wightman	b7a568f065	Fix torchscript issue in bat	3 years ago
Ross Wightman	d17b374f0f	Minimum input_size needed to be higher	3 years ago
Ross Wightman	b3b90d944d	Add min_input_size to bat_resnext to prevent test breakage.	3 years ago
Ross Wightman	d413eef1bf	Add ResMLP-24 model weights that I trained in PyTorch XLA on TPU-VM. 79.2 top-1.	3 years ago
Ross Wightman	10d8fa4620	Add gc and bat attention resnext26ts variants to byob for test.	3 years ago
Ross Wightman	2f5ed2dec1	Update `init_values` const for 24 and 36 layer ResMLP models	3 years ago
Ross Wightman	8e4ac3549f	All ScaledStdConv and StdConv uses default to using F.layernorm so that they work with PyTorch XLA. eps value tweaking is a WIP.	3 years ago
Ross Wightman	2a63d0246b	Post merge cleanup	3 years ago
Ross Wightman	45dec179e5	Merge pull request #681 from lmk123568/master ... Update convit.py	3 years ago
Dongyoon Han	ded1671483	Fix stochastic depth working only with a shortcut	3 years ago
Mike	b87d98b238	Update convit.py ... Cut out the duplicates	3 years ago
Ross Wightman	02320c3e3d	Bump version to 0.4.11	3 years ago
Ross Wightman	bda8ab015a	Remove min channels for SelectiveKernel, divisor should cover cases well enough.	3 years ago
Ross Wightman	a27f4aec4a	Missed args for skresnext w/ refactoring.	3 years ago
Ross Wightman	307a935b79	Add non-local and BAT attention. Merge attn and self-attn factories into one. Add attention references to README. Add mlp 'mode' to ECA.	3 years ago
Ross Wightman	8bf63b6c6c	Able to use other attn layer in EfficientNet now. Create test ECA + GC B0 configs. Make ECA more configurable.	3 years ago
Ross Wightman	bcec14d3b5	Bring EfficientNet SE layer in line with others, pull se_ratio outside of blocks. Allows swapping w/ other attn layers.	3 years ago
Ross Wightman	9611458e19	Throw in some FBNetV3 code I had lying around, some refactoring of SE reduction channel calcs for all EffNet archs.	3 years ago
Ross Wightman	01b9108619	Merge branch 'master' into more_attn	3 years ago
Ross Wightman	d7bab8a6c5	Fix strict flag change for checkpoint load.	3 years ago
Ross Wightman	02f9d4bc34	Add weights for resnet51q model, add 61q def.	3 years ago
Ross Wightman	f615474be3	Fix broken test, repvgg block doesn't have attn_last attr.	3 years ago
Ross Wightman	742c2d5247	Add Gather-Excite and Global Context attn modules. Refactor existing SE-like attn for consistency and refactor byob/byoanet for less redundancy.	3 years ago
Ross Wightman	9c78de8c02	Fix #661, move hardswish out of default args for LeViT. Enable native torch support for hardswish, hardsigmoid, mish if present.	3 years ago
Ross Wightman	5db7452173	Fix visformer in_chans stem handling	3 years ago
Ross Wightman	318360c3f9	Update README.md before merge. Bump version to 0.4.10	3 years ago
Ross Wightman	11ae795e99	Redo LeViT attention bias caching in a way that works with both torchscript and DataParallel	3 years ago
Ross Wightman	d400f1dbdd	Filter test models before creation for backward/torchscript tests	3 years ago
Ross Wightman	c4572cc5aa	Add Visformer-small weighs, tweak torchscript jit test img size.	3 years ago
Ross Wightman	bfc72f75d3	Expand scope of testing for non-std vision transformer / mlp models. Some related cleanup and create fn cleanup for all vision transformer and mlp models. More CoaT weights.	3 years ago
Ross Wightman	18bf520ad1	Add eca_nfnet_l2/l3 defs for future training	3 years ago
Ross Wightman	f45de37690	Merge branch 'master' into levit_visformer_rednet	3 years ago
Ross Wightman	23c18a33e4	Add efficientnetv2_rw_m weights trained in PyTorch. 84.8 top-1 @ 416 test. 53M params.	3 years ago
Ross Wightman	c2ba229d99	Prep for effcientnetv2_rw_m model weights that started training before official release..	3 years ago
Ross Wightman	30b9880d06	Minor adjustment, mutable default arg, extra check of valid len...	3 years ago
Ross Wightman	be0abfbcce	Merge branch 'master' of https://github.com/alexander-soare/pytorch-image-models into alexander-soare-master	3 years ago
Ross Wightman	b7de82e835	ConViT cleanup, fix torchscript, bit of reformatting, reuse existing layers.	3 years ago
Ross Wightman	306c86b668	Merge branch 'convit' of https://github.com/amaarora/pytorch-image-models into amaarora-convit	3 years ago
Ross Wightman	a569635045	Update twin weights to a copy in GitHub releases for faster dl. Tweak model class comment.	3 years ago
Ross Wightman	be99eef9c1	Remove redundant code, cleanup, fix torchscript.	3 years ago
Ross Wightman	5ab372a3ec	Merge branch 'master' of https://github.com/abcdvzz/pytorch-image-models into abcdvzz-master	3 years ago
Aman Arora	5db1eb6ba5	Add defaults	3 years ago
Aman Arora	8b1f2e8e1f	remote unused matplotlib import	3 years ago
Aman Arora	40c506ba1e	Add ConViT	3 years ago
Alexander Soare	7976019864	extend positional embedding resizing functionality to tnt	3 years ago
Alexander Soare	8086943b6f	allow resize positional embeddings to non-square grid	3 years ago
talrid	dc1a4efd28	mixer_b16_224_miil, mixer_b16_224_miil_in21k models	3 years ago
李鑫杰	7b799c4e79	add latest code	3 years ago
Ross Wightman	d5af752117	Add preliminary gMLP and ResMLP impl to Mlp-Mixer	3 years ago
李鑫杰	00548b8427	Add Twins	3 years ago
Ross Wightman	e7f0db8664	Fix drop/drop_path arg on MLP-Mixer model. Fix #641	3 years ago
Ross Wightman	9a3ae97311	Another set of byoanet models w/ ECA channel + SA + groups	3 years ago
Ross Wightman	d53e91218e	Fix tf.data options setting for newer TF versions	3 years ago
Ross Wightman	7077f16c6a	Change 21k model naming from _21k to _in21k for consistency with existing 21k models.	3 years ago
Ross Wightman	94d4b53352	Add temporary default_cfgs to visformer models so they pass tests	3 years ago
Ross Wightman	3bffc701f1	Merge branch 'master' into levit_visformer_rednet	3 years ago
Ross Wightman	ecc7552c5c	Add levit, levit_c, and visformer model defs. Largely untested and not finished cleanup.	3 years ago
Ross Wightman	165fb354b2	Add initial RedNet model / Involution layer impl for testing	3 years ago
Ross Wightman	328249f11a	Update README, tweak fine-tune effv2 model names.	3 years ago
Ross Wightman	c4f482a08b	EfficientNetV2 official impl w/ weights ported from TF. Cleanup/refactor of related EfficientNet classes and models.	3 years ago
Ross Wightman	4fbc32d3d0	Fix crop_pct for cait models.	3 years ago
Ross Wightman	715519a5ef	Rethink name of patch embed grid info	3 years ago
Ross Wightman	b2c305c2aa	Move Mlp and PatchEmbed modules into layers. Being used in lots of models now...	3 years ago
Ross Wightman	3ba6b55cb2	More adjustments to ByoaNet models for further experiments.	3 years ago
Ross Wightman	5fcddb96a8	Merge branch 'master' into cait	3 years ago
Ross Wightman	3db12b4b6a	Finish CaiT cleanup	3 years ago
Ross Wightman	2d8b09fe8b	Add official pretrained weights to MLP-Mixer, complete model cfgs.	3 years ago
Ross Wightman	12efffa6b1	Initial MLP-Mixer attempt...	3 years ago
Ross Wightman	0721559511	Improved (hopefully) init for SA/SA-like layers used in ByoaNets	3 years ago
Ross Wightman	d5473c17f7	Fix incorrect name of shortcut/identity paths in many residual nets. Inherited from naming in old old torchvision, long fixed there.	3 years ago
Ross Wightman	0d87650fea	Remove filter hack from BlurPool w/ non-persistent buffer. Use BlurPool2d instead of AntiAliasing.. for TResNet. Breaks PyTorch < 1.6.	3 years ago
Ross Wightman	ddc743fdf8	Update ResNet-RS models to EMA weights	3 years ago
Ross Wightman	08d60f4a9a	resnetrs50 pool sizing wrong	3 years ago
Ross Wightman	1daa15ecc3	Initial Cait commit. Still some cleanup to do.	3 years ago
Ross Wightman	67d0665b46	Post ResNet-RS merge cleanup. Add weight urls, adjust train/test/crop pct.	3 years ago
Aman Arora	560eae38f5	[WIP] Add ResNet-RS models (#554) ... * Add ResNet-RS models * Only include resnet-rs changes * remove whitespace diff * EOF newline * Update time * increase time * Add first conv * Try running only resnetv2_101x1_bitm on Linux runner * Add to exclude filter * Run test_model_forward_features for all * Add to exclude ftrs * back to defaults * only run test_forward_features * run all tests * Run all tests * Add bigger resnetrs to model filters to fix Github CLI * Remove resnetv2_101x1_bitm from exclude feat features * Remove hardcoded values * Make sure reduction ratio in resnetrs is 0.25 * There is no bias in replaced maxpool so remove it	3 years ago
Ross Wightman	9cc7dda6e5	Fixup byoanet configs to pass unit tests. Add swin_attn and swinnet26t model for testing.	3 years ago
Ross Wightman	e15c3886ba	Defaul lambda r=7. Define '26t' stage 4/5 256x256 variants for all of bot/halo/lambda nets for experiment. Add resnet50t for exp. Fix a few comments.	3 years ago
Ross Wightman	e5e15754c9	Fix coat first conv ident	3 years ago
Ross Wightman	76739a7589	CoaT merge. Bit of formatting, fix torchscript (for non features), remove einops/einsum dep, add pretrained weight hub (url) support.	3 years ago
Ross Wightman	026430c083	Merge branch 'master' of https://github.com/morizin/pytorch-image-models-1 into morizin-master	3 years ago
Ross Wightman	a0492e3b48	A few miil weights naming tweaks to improve compat with model registry and filtering wildcards.	3 years ago
talrid	8c1f03e56c	comment	3 years ago
talrid	19e1b67a84	old spaces	3 years ago
talrid	a443865876	update naming and scores	3 years ago
talrid	cf0e371594	84_0	3 years ago
talrid	0968bdeca3	vit, tresnet and mobilenetV3 ImageNet-21K-P weights	3 years ago
morizin	1e3b6d4dfc	Update __init__.py	3 years ago
morizin	fd022fd6a2	Update __init__.py	3 years ago
morizin	c2d5087eae	Add files via upload	3 years ago
Norman Mu	79640fcc1f	Enable uniform augmentation magnitude sampling and set AugMix default	3 years ago
Ross Wightman	c1cf9712fc	Add updated EfficientNet-V2S weights, 83.8 @ 384x384 test. Add PyTorch trained EfficientNet-B4 weights, 83.4 @ 384x384 test. Tweak non TF EfficientNet B1-B4 train/test res scaling.	3 years ago
Ross Wightman	e8a64fb881	Test input size for efficientnet_v2s was wrong in last results run	3 years ago
Ross Wightman	2df77ee5cb	Fix torchscript compat and features_only behaviour in GhostNet PR. A few minor formatting changes. Reuse existing layers.	3 years ago
Ross Wightman	d793deb51a	Merge branch 'master' of https://github.com/iamhankai/pytorch-image-models into iamhankai-master	3 years ago
Ross Wightman	e685618f45	Merge pull request #550 from amaarora/wandb ... Wandb Support	3 years ago
Ross Wightman	f606c45c38	Add Swin Transformer models from https://github.com/microsoft/Swin-Transformer	3 years ago
iamhankai	de445e7827	Add GhostNet	3 years ago
Ross Wightman	5a196dddf6	Update README.md with latest, bump version to 0.4.8	3 years ago
Ross Wightman	b3d7580df1	Update ByoaNet comments. Fix first Steam feat chs for ByobNet.	3 years ago
Ross Wightman	16f7aa9f54	Add default_cfg options for min_input_size / fixed_input_size, queries in model registry, and use for testing self-attn models	3 years ago
Ross Wightman	4e4b863b15	Missed norm.py	3 years ago
Ross Wightman	7c97e66f7c	Remove commented code, add more consistent seed fn	3 years ago
Ross Wightman	364dd6a58e	Merge branch 'master' into byoanet-self_attn	3 years ago
Ross Wightman	ce62f96d4d	ByoaNet with bottleneck transformer, lambda resnet, and halo net experiments	3 years ago
Ross Wightman	cd3dc4979f	Fix adabelief imports, remove prints, preserve memory format is the default arg for zeros_like	3 years ago
Ross Wightman	21812d33aa	Add prelim efficientnet_v2s weights from 224x224 train, eval 83.3 @ 288. Add eca_nfnet_l1 weights, train at 256, eval 84 @ 320.	3 years ago
Aman Arora	5772c55c57	Make wandb optional	3 years ago
Aman Arora	f54897cc0b	make wandb not required but rather optional as huggingface_hub	3 years ago
Aman Arora	3f028ebc0f	import wandb in summary.py	3 years ago
Aman Arora	624c9b6949	log to wandb only if using using wandb	3 years ago
juntang	addfc7c1ac	adabelief	3 years ago
Ross Wightman	fb896c0b26	Update some comments re preliminary EfficientNet-V2 assumptions	3 years ago
Ross Wightman	2b49ab7a36	Fix ResNetV2 pretrained classifier issue. Fixes #540	3 years ago
Ross Wightman	de9dff933a	EfficientNet-V2S preliminary model def (for experimentation)	3 years ago
Ross Wightman	37c71a5609	Some further create_optimizer_v2 tweaks, remove some redudnant code, add back safe model str. Benchmark step times per batch.	3 years ago
Ross Wightman	2bb65bd875	Wrong default_cfg pool_size for L1	3 years ago
Ross Wightman	bf2ca6bdf4	Merge jax and original weight init	3 years ago
Ross Wightman	acbd698c83	Update README.md with updates. Small tweak to head_dist handling.	3 years ago
Ross Wightman	9071568f0e	Add weights for SE NFNet-L0 model, rename nfnet_l0b -> nfnet_l0. 82.75 top-1 @ 288. Add nfnet_l1 model def for training.	3 years ago
Ross Wightman	c468c47a9c	Add regnety_160 weights from DeiT teacher model, update that and my regnety_032 weights to use higher test size.	3 years ago