Skip to content

Optimize the DAG copying of CICD sample to only copy the DAGs modified in this PR #7482

New issue
New issue
Open
Open
Optimize the DAG copying of CICD sample to only copy the DAGs modified in this PR#7482
Assignees
alexshires
Labels
api: composerIssues related to the Cloud Composer API.samplesIssues that are directly related to samples.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.
@leahecole

Description

@leahecole
leahecole
opened on Feb 18, 2022

https://airflow.apache.org/docs/apache-airflow/stable/faq.html#when-there-are-a-lot-1000-of-dags-files-how-to-speed-up-parsing-of-new-files

For customers with large # of DAGs, this sample will result in all of them being marked as "modified", and as such, they'll be parsed by Airflow. Let's make sure only modified DAGs get added.

Metadata

Metadata

Assignees

Labels

api: composerIssues related to the Cloud Composer API.samplesIssues that are directly related to samples.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions