pytorch-image-models

Commit Graph

Author	SHA1	Message	Date
Ross Wightman	20d66beead	Move RMSpropTF another step closer to Tensorflow impl * init square_avg with one instead of zero as per TF * match TF order of ops for square_avg accumulation * move LR scaling to momentum buffer accumulator as per TF * add decoupled weight decay flag (not in TF)	6 years ago
Ross Wightman	bc264269c9	Morph mnasnet impl into a generic mobilenet that covers Mnasnet, MobileNetV1/V2, ChamNet, FBNet, and related * add an alternate RMSprop opt that applies eps like TF * add bn params for passing through alternates and changing defaults to TF style	6 years ago

Author

SHA1

Message

Date

Ross Wightman

20d66beead

Move RMSpropTF another step closer to Tensorflow impl

* init square_avg with one instead of zero as per TF
* match TF order of ops for square_avg accumulation
* move LR scaling to momentum buffer accumulator as per TF
* add decoupled weight decay flag (not in TF)

Ross Wightman

bc264269c9

Morph mnasnet impl into a generic mobilenet that covers Mnasnet, MobileNetV1/V2, ChamNet, FBNet, and related

* add an alternate RMSprop opt that applies eps like TF
* add bn params for passing through alternates and changing defaults to TF style

2 Commits (db8ad25a234b1d2eab90a41882651af7666542e4)