Skip to content

Upgrade to airflow 2 #158

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 16 commits into
base: master
Choose a base branch
from
Draft

Upgrade to airflow 2 #158

wants to merge 16 commits into from

Conversation

Lee-W
Copy link
Member

@Lee-W Lee-W commented May 25, 2025

Types of changes

  • Bugfix
  • New feature
  • Refactoring
  • Breaking change (any change that would cause existing functionality to not work as expected)
  • Documentation Update
  • Other (please describe)

Description

Checklist

  • Add test cases to all the changes you introduce
  • Run make lint and make test locally to ensure all linter checks and testing pass
  • Update the documentation if necessary

Steps to Test This Pull Request

Expected behavior

Related Issue

Additional context

Lee-W added 7 commits May 25, 2025 10:48
This is the highest airflow version with no package conflict and extra build needed on a
M-series mac.
The way we define in docker-compose creates a "airflow.db" directory if the `airflow.db`
file is absent, causing Airflow to load the empty directory as a SQLite database.

By changing it to "sqlite" directory, it loads the content in it if presents and creates
a new one if not.
Even thought ruff==0.0.277 is part of Airflow 2.6.3 constraint file,
it's most likely not going to break airflow as it's a dev tool for coding style.
Keeping it in the latest version brings us more good.
@Lee-W Lee-W force-pushed the upgrade-to-airflow-2 branch from 12247f8 to cf6bcd2 Compare May 25, 2025 12:39
@Lee-W Lee-W force-pushed the upgrade-to-airflow-2 branch from cf6bcd2 to bdeac52 Compare May 25, 2025 12:41
@Lee-W
Copy link
Member Author

Lee-W commented May 25, 2025

We'll need to manually backport apache/airflow#50745 if we don't want to wait for 2.11.1

@Lee-W Lee-W force-pushed the upgrade-to-airflow-2 branch from 000bef0 to c660f0d Compare May 25, 2025 12:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants