Deep gradient compression

Discussion
1

Hi All,

I would like to know if anyone has successfully implemented Deep Gradient Compression on MXNet in this community.
I have made a post in Reddit regarding this. Check it out. https://www.reddit.com/r/MachineLearning/comments/9bv7ri/research_deep_gradient_compression_implementation/

It would be great if someone can help me on this.

Thanks,
Anand

2

Have you come across the work on gradient compression in MXNet already?

3

Yes. I believe the compression techniques implemented in MXNet are quantization techniques. What I’m looking for specifically the Deep Gradient Compression technique published in this paper. https://arxiv.org/abs/1712.01887