Skip to content

Async pipeline improvements #123

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 38 commits into from
Sep 10, 2024

Conversation

stellasia
Copy link
Contributor

@stellasia stellasia commented Sep 8, 2024

Description

This PR doesn't fix anything but is a follow-up of #119 , where the component status are moved to the store instead of being saved into the task class, for consistency (the task results are already saved in the store).

Type of Change

  • New feature
  • Bug fix
  • Breaking change
  • Documentation update
  • Project configuration change

Complexity

Note

Please provide an estimated complexity of this PR of either Low, Medium or High

Complexity: Medium

How Has This Been Tested?

  • Unit tests
  • E2E tests
  • Manual tests

Checklist

The following requirements should have been met (depending on the changes in the branch):

  • Documentation has been updated
  • Unit tests have been updated
  • E2E tests have been updated
  • Examples have been updated
  • New files have copyright header
  • CLA (https://neo4j.com/developer/cla/) has been signed
  • CHANGELOG.md updated if appropriate

stellasia added 30 commits June 25, 2024 09:36
…to async-pipeline-improvements

# Conflicts:
#	src/neo4j_genai/experimental/pipeline/pipeline.py
#	src/neo4j_genai/experimental/pipeline/stores.py
#	tests/e2e/test_kg_builder_pipeline_e2e.py
#	tests/unit/experimental/pipeline/test_orchestrator.py
@stellasia stellasia marked this pull request as ready for review September 8, 2024 10:47
Copy link
Contributor

@willtai willtai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🍃

@stellasia stellasia merged commit b65b34f into neo4j:main Sep 10, 2024
11 checks passed
a-s-g93 pushed a commit to a-s-g93/neo4j-genai-python-dev that referenced this pull request Sep 13, 2024
* Add failing test

* Define a "run_id" in Orchestrator - save results per run_id

* Make unit test work

* Make intermediate results accessible from outside pipeline for investigation

* Remove unused imports

* Update examples and CHANGELOG

* Cleaning: remove deprecated code

* Fix ruff

* Fix examples

* Fix examples again

* Move status to store

* PR reviews

* Removing useless status assignment

* Remove unused import

* Move status to store

* Return RunStatus from method

* Fix bad merge

* Fix comments

* Deal with None statuses in the method dedicated to fetching status - Remove unused statuses

* Fix error message

* Update error message
a-s-g93 pushed a commit to a-s-g93/neo4j-genai-python-dev that referenced this pull request Sep 13, 2024
* Add failing test

* Define a "run_id" in Orchestrator - save results per run_id

* Make unit test work

* Make intermediate results accessible from outside pipeline for investigation

* Remove unused imports

* Update examples and CHANGELOG

* Cleaning: remove deprecated code

* Fix ruff

* Fix examples

* Fix examples again

* Move status to store

* PR reviews

* Removing useless status assignment

* Remove unused import

* Move status to store

* Return RunStatus from method

* Fix bad merge

* Fix comments

* Deal with None statuses in the method dedicated to fetching status - Remove unused statuses

* Fix error message

* Update error message
@stellasia stellasia deleted the async-pipeline-improvements branch September 16, 2024 08:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants