Does convolution layer has weight decay param? just as fc layer "wd_mult"


#1

fc layer has a parameter “wd_mult”, does conv layer has this? since I want to use 1x1 conv instead of fc, however the original fc’s wd_nult is 10.


#2

Yes this is available for every parameter. You can simply set it like that:

net.collect_params()['resnetv14_conv0_weight'].wd_mult = 10

Check your parameters keys using

print(net.collect_params())