GELU activation


#1

Hi guys,

Does anyone know if there are plans to implement native GELU activation function - https://arxiv.org/abs/1606.08415 ?

Best,
Boris


#2

There is a feature request that has been recently opened: https://github.com/apache/incubator-mxnet/issues/12984