paddle.distributed.fleet.utils. recompute ( function, *args, **kwargs ) [source]

recompute intermediate activations to save then memory.

  • function – layer of sequence of layers that describes part of forward pass of the model whose

  • recomputed (intermediate activations will be released to save memory in forward stage and will be) –

  • calculation. (in backward stage for gradient) –

  • preserve_rng_state (bool, optional) – if preserve the RNG state of forward and restore it in backward.

  • args – inputs to the function


Output of function on args