KV store tutorial

Can someone explain and provide a quick tutorial on what is KV store?
When and how to use it?

You can check this tutorial: https://mxnet.incubator.apache.org/versions/master/tutorials/python/kvstore.html

The KVStore is the data store used to aggregate the gradients, especially relevant when you use multiple GPUs or multiple hosts. You usually don’t need to worry about it, the Trainer takes care of creating it. There are different kvstores, device means it is stored on gpu. local means CPU. The dist prefix is used for distributed training across multiple hosts. Full API details can be found here: http://mxnet.incubator.apache.org/api/python/kvstore/kvstore.html#mxnet.kvstore.create