Any way to workaround "No replication rule"? #21942
Unanswered
southfreebird
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi everyone!
I have a replicated Pallas/Triton kernel similar to identity. I'm sharding it with
shard_map
usingcheck_rep=False
, but this leads to unwanted AllReduce operations in the background. Is there something I can do about this?Here are my thoughts:
Beta Was this translation helpful? Give feedback.
All reactions