leaky_relu

paddle.sparse.nn.functional. leaky_relu ( x, negative_slope=0.01, name=None ) [source]

sparse leaky_relu activation, requiring x to be a SparseCooTensor or SparseCsrTensor.

\[\begin{split}leaky\_relu(x)= \left\{ \begin{array}{rcl} x, & & if \ x >= 0 \\ negative\_slope * x, & & otherwise \\ \end{array} \right.\end{split}\]
Parameters
  • x (Tensor) – The input Sparse Tensor with data type float32, float64.

  • negative_slope (float, optional) – Slope of the activation function at \(x < 0\) . Default is 0.01.

  • name (str, optional) – Name for the operation (optional, default is None). For more information, please refer to Name.

Returns

A Sparse Tensor with the same data type and shape as x .

Examples

>>> import paddle

>>> dense_x = paddle.to_tensor([-2., 0., 5.])
>>> sparse_x = dense_x.to_sparse_coo(1)
>>> out = paddle.sparse.nn.functional.leaky_relu(sparse_x, 0.5)