What is corresponding symbol function of ELU in Gluon?

hdjsjyl · August 3, 2019, 11:35pm

spanev · August 4, 2019, 10:57am

According to Gluon implem, it is LeakyReLU with act_type='elu'.

apache/incubator-mxnet/blob/24cce9e3c99e499b696b779cbb3b863145f473f1/python/mxnet/gluon/nn/activations.py#L162




    Outputs:
        - **out**: output tensor with the same shape as `data`.
    """


    def __init__(self, alpha=1.0, **kwargs):
        super(ELU, self).__init__(**kwargs)
        self._alpha = alpha


    def hybrid_forward(self, F, x):
        return F.LeakyReLU(x, act_type='elu', slope=self._alpha)




class SELU(HybridBlock):
    r"""
    Scaled Exponential Linear Unit (SELU)
        "Self-Normalizing Neural Networks", Klambauer et al, 2017
        https://arxiv.org/abs/1706.02515




    Inputs:

hdjsjyl · August 4, 2019, 8:28pm

Yes, I got it, thanks for your reply.

Topic		Replies	Views
mxnet.ndarray.LeakyReLU in custom Gluon block Gluon	7	2221	December 6, 2017
Example of using a Gluon HybridBlock in a Symbol Program Gluon	2	1440	October 12, 2017
Custom symbol with parameters? Discussion	1	643	January 3, 2018
Deserializing Gluon Symbol in C++ Gluon	2	1494	December 11, 2017
How to apply F.softmax to Gluon Parameters Gluon	2	652	May 3, 2021

What is corresponding symbol function of ELU in Gluon?

Related Topics