Solutions to multiprocessing with JAX

[ChristopherBrix]

My understanding is that JAX does not support multiprocessing. If this is already incorrect, please let me know.

In my use case, I need to run many (potentially hundreds to thousands) of processes in parallel, that will each run slow I/O bound commands interlaced with a few inference calls using JAX and a single GPU.
What is the best practice to implement this? Should I create a single process that is the only one that does JAX inference and is being send requests to do so by all the other processes?