Hi guys,
Does anyone know if there are plans to implement native GELU activation function - https://arxiv.org/abs/1606.08415 ?
Best,
Boris
There is a feature request that has been recently opened: https://github.com/apache/incubator-mxnet/issues/12984