Does deepspeed have chunk based memory mangement? #3459
Unanswered
skyshine102
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
As title, I'm curious about if any chunk-based memory management strategy exists in deepspeed?
I found a paper from Tencent ->
https://github.com/Tencent/PatrickStar
How does current deepspeed memory management system compared this one?
Need some pointers!
Beta Was this translation helpful? Give feedback.
All reactions