new_group¶

paddle.distributed. new_group ( ranks=None, backend=None, timeout=datetime.timedelta(seconds=1800) ) [source]

Creates a new distributed communication group.

Parameters

• ranks (list) – The global ranks of group members.

• backend (str) – The backend used to create group, only nccl is supported now.

• timeout (datetime.timedelta, optional) – The waiting timeout for store relevant options, default is 30 minutes.

Returns

The group instance.

Return type

Group

Examples

import paddle

paddle.distributed.init_parallel_env()
tindata = paddle.randn(shape=[2, 3])
gp = paddle.distributed.new_group([2,4,6])
paddle.distributed.all_reduce(tindata, group=gp, sync_op=False)