torchpack.distributed package

Submodules

torchpack.distributed.comm module

torchpack.distributed.comm.allreduce(data: Any, reduction: str = 'sum') → Any

torchpack.distributed.comm.allgather(data: Any) → List[T]

torchpack.distributed.comm.barrier() → None

torchpack.distributed.context module

torchpack.distributed.context.init() → None

torchpack.distributed.context.size() → int

torchpack.distributed.context.rank() → int

torchpack.distributed.context.local_size() → int

torchpack.distributed.context.local_rank() → int

torchpack.distributed.context.is_master() → bool

Module contents