Skip to content

feat: database-backed artifact blob storage #8992

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 94 commits into from
Jun 12, 2025
Merged

feat: database-backed artifact blob storage #8992

merged 94 commits into from
Jun 12, 2025

Conversation

jennifer-richards
Copy link
Member

No description provided.

jennifer-richards and others added 30 commits March 5, 2025 15:39
Make async commit optional so that celery tasks don't spawn
other celery tasks. This is a definite fix.

Reverses order of StoredObject.create() and storage.save().
This avoids a race condition between an async commit and the
creation of a StoredObject, but need to review whether this
introduces other problems.
fix: dont test for v1 apis into the blobdb app models
jennifer-richards and others added 21 commits May 21, 2025 15:54
Use blob modified timestamp as mtime in replicated
metadata. This is the intended behavior and matches
BlobdbStorage.
chore: merge main into feat/blobstage
* chore(dev): remove assert

I like the idea, but settings are sometimes loaded
more than once so this approach doesn't work

* chore: blobdb migrations in k8s

* chore: fix typo in commet

* chore: add replicator pod for k8s deploy

* chore: drop unnecessary ports from celery/beat

* chore: fix tyop

* chore: settings for blobdb / replication

* chore: put quotes back around $@
* refactor: minor refactor + ruff style

* chore: additional logging
* fix: use correct DB for transaction

* chore: stale comment
@rjsparks rjsparks merged commit 015d6f7 into main Jun 12, 2025
7 of 8 checks passed
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Jun 16, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants