How to setup a UserCodeLauncher with Dagster+ Hybrid

[ricardobrg]

In #15856 it was mentioned

For Dagster cloud hybrid, it's possible to customize the run launcher used in the agent but requires setting a custom UserCodeLauncher. Reach out for help on this.

I could not find any documentation about how to implement a UserCodeLauncher other than the source code linked in that answer.
Where could I find more information about this?

My use case is that I want to run the code in Cloudflare Worker Containers and docker-in-docker does not work in that environment.

[benpankow]

Hi Ricardo,

In Cloud, the UserCodeLauncher specifies how to launch code location servers. It also specifies the run launcher, which contains the code to launch runs in their own containers.

There are a few UserCodeLaunchers with corresponding run launchers which you can reference in our source, in particular:

• EcsUserCodeLauncher, which uses the CloudEcsRunLauncher, extending the base EcsRunLauncher
• DockerUserCodeLauncher, which uses the CloudDockerRunLauncher, extending the base DockerRunLauncher
• K8sUserCodeLauncher, which uses the CloudK8sRunLauncher, extending the base K8sRunLauncher

The main implementation logic required in a user code launcher is creating a container and returning a unique handle, and removing a container based on its handle.