Skip to content

[Feature] Create TaskGroups to match the subfolder structure in the models folder #1552

@maximilianoarcieri

Description

@maximilianoarcieri

Description

When using the DbtDag class the nodes mantain the correct lineage but they are not grouped. Instead, when using the DbtTaskGroup class, the tasks are grouped but you lost the lineage between nodes of different groups. It would be great to have tasks grouped by the subfolder structure in the "models" folder.

This is an example of what the same DAG would look like now and with some changes I already made:

  • Now:
    Image

  • With changes:
    Image

I hope you find it useful!

Use case/motivation

This will improve readability, lineage reading and control of executions in the UI.

Related issues

No response

Are you willing to submit a PR?

  • Yes, I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:lineageRelated to open lineage or DBT dataset lineageenhancementNew feature or requeststaleIssue has not had recent activity or appears to be solved. Stale issues will be automatically closedtriage-neededItems need to be reviewed / assigned to milestone

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions