Hello All,
We are trying to implement an adaptive learning rate for an item embedding model, so newer items get assigned a larger learning rate and vice versa. I wonder if there is a way to do so? I’m aware of the set_lr_mult method but that can only give different learning rates to different layers, not different rows within the same layer.
Any help is appreciated!