Skip to content

Include support for git-remote-s3 #6260

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: master
Choose a base branch
from
Draft

Include support for git-remote-s3 #6260

wants to merge 3 commits into from

Conversation

jorgee
Copy link
Contributor

@jorgee jorgee commented Jul 9, 2025

S3 can be used to store git repositories using the git-remote-s3 implementation of remote helper.

This branch provides support for this S3 repositories as part of the nf-amazon plugin.
It implements a JGit Transport with the Fetch and Push connection as well as the RepositoryProvider, ProviderConfig RepositoryFactory required to support s3 git repositories.
The fetch connection is used to clone and pull branches of the repository in the clone, pull and run commands
The push connection is able to push branches.

Current Limitations:

  • Due to a limitation in the access rights of some JGit transport classes, when a branch is pushed it is correctly stored in the remote repository but the local repo refs are not updated with the reference to the remote ref (origin/branch)

TODO:

  • Try to fix limitations
  • Get defaults from aws config
  • Test pull when branch is detached
  • Test push non up-to-date branch
  • Add unit tests

Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Copy link

netlify bot commented Jul 9, 2025

Deploy Preview for nextflow-docs-staging canceled.

Name Link
🔨 Latest commit ed0a5b5
🔍 Latest deploy log https://app.netlify.com/projects/nextflow-docs-staging/deploys/6870c49c9dd0e9000838c314

jorgee added 2 commits July 9, 2025 17:39
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant