torch.nn.GELU(approximate='none')
paddle.nn.GELU(approximate=False, name=None)
其中功能一致, 输入参数用法不一致,具体如下:
# 取值为 tanh,PyTorch 写法: m = torch.nn.GELU(approximate='tanh') y = m(x) # Paddle 写法: m = paddle.nn.GELU(approximate=True) y = m(x) # 取值为 none,PyTorch 写法: m = torch.nn.GELU(approximate='none') y = m(x) # Paddle 写法: m = paddle.nn.GELU(approximate=False) y = m(x)