How to manually modify specific parameters?

1

Dear all.

I am trying to modify specific parameters manually.
For this job, get parameters (get_params()), modify specific parameters and set parameters (set_params()).
It works well when I use a single GPU, but with multi GPUs the modified parameters are initialized with the previous values. And it seems that the cause of this phenomenon is _update_params_on_kvstore.

Please advise me.

Thanks.

2

hi, can you post a code snippet showing how you’re doing this with multi GPUs.

you may have to copy the parameters to all the gpus in the context after setting them.