Variational RNN Implementation

Gluon
1

Hi there,

Does Gluon already have an implementation of Variational RNN (Gal 2016, http://papers.nips.cc/paper/6241-a-theoretically-grounded-application-of-dropout-in-recurrent-neural-networks)? I just want to confirm that before coding by myself. I know the existence of DropoutCell and ZoneoutCell, maybe I need to implement a VariationalCell or something.

Thanks.

2

Note that I know of unfortunately. Feel free to report back once you have a working implementation.
FYI there is this repo that has a decent list of MXNet and Gluon model implementations and tools that can be found on github https://github.com/chinakook/Awesome-MXNet

3

Thanks, that repo helps. I’ll share my implementation once done.

4

We do support VariationalDropoutCell. @hankcs