Add note about output_dir (#747)

tensorflow · Apr 26, 2018 · 757b529 · 757b529
1 parent 42a7883
commit 757b529
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/docs/distributed_training.md b/docs/distributed_training.md
@@ -51,6 +51,9 @@ distributed training:
 Parameter servers only need `--master=grpc://$ADDRESS` and
 `--schedule=run_std_server`.
 
+>> Note about `output_dir`: All the workers (masters and parameter servers) should use the same `output_dir`. If training
+>> on separate nodes, output_dir can be a shared filesystem like NFS or an object store like GCS.
+
 ## Utility to produce `TF_CONFIG` and flags
 
 [`t2t-make-tf-configs`](https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/bin/t2t-make-tf-configs))