init_parallel_env¶
- paddle.distributed. init_parallel_env ( ) [source]
-
Initialize parallel training environment in dynamic graph mode.
Note
Now initialize both NCCL and GLOO contexts for communication.
- Parameters
-
backend (string) – A string represents the backend used by DataParallel, should be one of ‘gloo’(for cpu), ‘nccl’(for cuda), ‘bkcl’(for xpu), ‘auto’(auto detect). The auto detection prefer ‘nccl’, ‘bkcl’ than ‘gloo’.
- Returns
-
None
Examples