InstanceNorm¶
-
class
paddle.fluid.dygraph.nn.
InstanceNorm
( num_channels, epsilon=1e-05, param_attr=None, bias_attr=None, dtype='float32' ) [source] -
This interface is used to construct a callable object of the
InstanceNorm
class. For more details, refer to code examples.Can be used as a normalizer function for convolution or fully_connected operations. The required data format for this layer is one of the following:
DataLayout: NCHW [batch, in_channels, in_height, in_width]
Refer to Instance Normalization: The Missing Ingredient for Fast Stylization for more details.
\(input\) is the input features over a mini-batch.
\[\begin{split}\\mu_{\\beta} &\\gets \\frac{1}{HW} \\sum_{i=1}^{HW} x_i \\qquad &//\\ \\ mean\ of\ one\ feature\ map\ in\ mini-batch \\\\ \\sigma_{\\beta}^{2} &\\gets \\frac{1}{HW} \\sum_{i=1}^{HW}(x_i - \\ \\mu_{\\beta})^2 \\qquad &//\ variance\ of\ one\ feature\ map\ in\ mini-batch \\\\ \\hat{x_i} &\\gets \\frac{x_i - \\mu_\\beta} {\\sqrt{\\ \\sigma_{\\beta}^{2} + \\epsilon}} \\qquad &//\ normalize \\\\ y_i &\\gets \\gamma \\hat{x_i} + \\beta \\qquad &//\ scale\ and\ shift\end{split}\]Note
H means height of feature map, W means width of feature map.
- Parameters
-
num_channels (int) – Indicate the number of channels of the input
Tensor
.epsilon (float, optional) – A value added to the denominator for numerical stability. Default is 1e-5.
param_attr (ParamAttr|bool, optional) – The parameter attribute for Parameter scale of instance_norm. If it is set to None or one attribute of ParamAttr, instance_norm will create ParamAttr as param_attr, the name of scale can be set in ParamAttr. If the Initializer of the param_attr is not set, the parameter is initialized one. If it is set to False, will not create param_attr. Default: None.
bias_attr (ParamAttr|bool, optional) – The parameter attribute for the bias of instance_norm. If it is set to None or one attribute of ParamAttr, instance_norm will create ParamAttr as bias_attr, the name of bias can be set in ParamAttr. If the Initializer of the bias_attr is not set, the bias is initialized zero. If it is set to False, will not create bias_attr. Default: None.
dtype (str, optional) – Indicate the data type of the input
Tensor
, which can be float32 or float64. Default: float32.
- Returns
-
None.
Examples
import paddle.fluid as fluid from paddle.fluid.dygraph.base import to_variable import numpy as np import paddle # x's shape is [1, 3, 1, 2] x = np.array([[[[1.0, 8.0]], [[10.0, 5.0]], [[4.0, 6.0]]]]).astype('float32') with fluid.dygraph.guard(): x = to_variable(x) instanceNorm = paddle.nn.InstanceNorm(3) ret = instanceNorm(x) # ret's shape is [1, 3, 1, 2]; value is [-1 1 0.999999 -0.999999 -0.999995 0.999995] print(ret)
-
forward
( input ) -
Defines the computation performed at every call. Should be overridden by all subclasses.
- Parameters
-
*inputs (tuple) – unpacked tuple arguments
**kwargs (dict) – unpacked dict arguments