Is it possible to customize TPU initialization timeout? #16690
-
I always get Is it possible to manually decrease the timeout value via some environment variables so that I do not need to wait for so long before identifying the error? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Have you tried specifying the "initialization_timeout" parameter in the call to jax.distributed.initialize() ? e.g. https://jax.readthedocs.io/en/latest/_autosummary/jax.distributed.initialize.html |
Beta Was this translation helpful? Give feedback.
Have you tried specifying the "initialization_timeout" parameter in the call to jax.distributed.initialize() ?
e.g.
jax.distributed.initialize(initialization_timeout=30)
https://jax.readthedocs.io/en/latest/_autosummary/jax.distributed.initialize.html