Add support for response sender in the default mode#364

Merged

kthui merged 7 commits intomainfrom

jacky-res-sender-main

Jun 6, 2024

Commits on May 31, 2024

Add response sender to non-decoupled models and unify data pipelines (#360)
kthui
authored
Fix decoupled batch statistics to account for implicit batch size (#361)
kthui
authored

Commits on Jun 3, 2024

Fix decoupled gpu output error handling (#362)
kthui
authored

Commits on Jun 4, 2024

Commits on Jun 5, 2024