[dagster pipes] How do i get log messages in the external process to output in stdout / stderr?

[alangenfeld]

When using dagster-pipes how do i get log messages in the external process to output in stdout / stderr?

[alangenfeld]

The log property on PipesContext is a logging.Logger so you can add your own handler like so:

import sys
import logging


with open_dagster_pipes(
    ...
) as pipes:
	handler = logging.StreamHandler(sys.stdout)
	handler.setLevel(logging.DEBUG)
	formatter = logging.Formatter('%(levelname)s - %(message)s')
	handler.setFormatter(formatter)
        pipes.log.addHandler(handler)
	
	pipes.log.info(f"Run ID: {pipes.run_id}")

[j-nierop]

How would this work with the dagster pipes in rust?