You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ideally would like to be able to try fp16 and bf16.
I'm aware of some XLA flags like XLA_USE_BF16 and XLA_DOWNCAST_BF16 but they do nothing in my case, I believe they're either TorchXLA and/or TPU specific.
If not, would it be possible to do this manually by say AOT lowering and modifying the HLO before compiling it?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
ATT
Ideally would like to be able to try fp16 and bf16.
I'm aware of some XLA flags like
XLA_USE_BF16
andXLA_DOWNCAST_BF16
but they do nothing in my case, I believe they're either TorchXLA and/or TPU specific.If not, would it be possible to do this manually by say AOT lowering and modifying the HLO before compiling it?
Beta Was this translation helpful? Give feedback.
All reactions