You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi everyone—I'm running into trouble using the Python-backend helpers set_max_batch_size() and set_dynamic_batching() inside auto_complete_config().
Goal: read the max-batch and preferred-batch values from Dynaconf and apply them to my model.
The problem is that set_dynamic_batching() doesn’t seem to take any arguments: calling it with none just drops an empty dynamic_batching {} block into the final ModelConfig. How should I populate that block programmatically? Any guidance would be appreciated.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Hi everyone—I'm running into trouble using the Python-backend helpers
set_max_batch_size()
andset_dynamic_batching()
insideauto_complete_config()
.Goal: read the max-batch and preferred-batch values from Dynaconf and apply them to my model.
The problem is that
set_dynamic_batching()
doesn’t seem to take any arguments: calling it with none just drops an emptydynamic_batching {}
block into the finalModelConfig
. How should I populate that block programmatically? Any guidance would be appreciated.Beta Was this translation helpful? Give feedback.
All reactions