Skip to content

iidsample/pytorch_distributed_experiments

Repository files navigation

python -m torch.distributed.launch --nproc_per_node=2 --nnodes=1 --node_rank=0 --master_addr=127.0.0.1 --master_port=6006 learn_all_gather.py

About

Experiments with communication collectives

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages