Skip to content

Releases: pwwang/pipen

0.17.4

10 May 07:32
Compare
Choose a tag to compare
  • chore: add ipykernel dependency for example pipelines
  • chore(deps): bump datar to 0.15.9 (numpy v2)
  • fix: prevent adding processes to starts if already included

Full Changelog: 0.17.3...0.17.4

0.17.3

19 Apr 03:13
Compare
Choose a tag to compare
  • chore: hide job index prefix in log messages for single-job processes
  • chore(deps): update flake8 and other dependencies in pyproject.toml
  • docs: fix outfile in the caching example
  • docs: add example in README as an example pipeline in the examples folder

Full Changelog: 0.17.2...0.17.3

0.17.2

14 Mar 05:42
Compare
Choose a tag to compare
  • fix: handle exceptions (KeyboardInterrupt) when closing counters in progress bar (enlighten v1.14)

Full Changelog: 0.17.1...0.17.2

0.17.1

14 Mar 04:10
Compare
Choose a tag to compare
  • docs: update templating documentation to clarify job metadata paths
  • fix: ensure iterables other than list/tuple are treated correctly as files/dirs

Full Changelog: 0.17.0...0.17.1

0.17.0

08 Mar 05:40
Compare
Choose a tag to compare
  • fix: handle None input case in job caching logic
  • chore(deps): update liquidpy to 0.8.4
  • refactor: replace DualPath with SpecPath in codebase to adopt xqute 0.9

Full Changelog: 0.16.0...0.17.0

0.17.0a1

07 Mar 23:13
Compare
Choose a tag to compare
  • fix: handle None input case in job caching logic
  • chore(deps): update liquidpy to 0.8.4
  • refactor: replace DualPath with SpecPath in codebase to adopt xqute 0.9

Full Changelog: 0.16.0...0.17.0a1

0.16.0a8

04 Mar 05:48
Compare
Choose a tag to compare
  • feat: support fast_mount to be a list for gbatch scheduler

Full Changelog: 0.16.0a7...0.16.0a8

0.16.0a7

04 Mar 05:05
Compare
Choose a tag to compare
  • chore(deps): bump xqute to 0.8.1
  • fix: only create mounted output directory when no MOUNTED_OUTDIR with scheduler
  • fix: update mountPath index for taskSpec volumes in GbatchScheduler

Full Changelog: 0.16.0a6...0.16.0a7

0.16.0

04 Mar 16:41
Compare
Choose a tag to compare
  • ci: update build workflow conditions and improve dependency versions
  • feat: support gbatch scheduler and cloud workdir/outdir
  • refactor: replace cloudpathlib with yunpath and update related code
  • refactor: adopt xqute 0.8.0
  • chore: add more processes in examples/gbatch.py
  • fix: make sure spec is carried for cloud output files so mtime can be check for next processes
  • ci: add Google authentication step to CI workflow
  • fix: fix specified path not carries to the next processes
  • fix: handle missing MOUNTED_OUTDIR gracefully and remove unused test
  • test: add fixture for unique ID and update cloud test to support parallel execution
  • fix: remove fake symlink output when necessary
  • docs: add cloud support documentation
  • feat: support mounted paths (e.g. path1:path2) as input
  • refactor: remove redundant validation for workdir and outdir path types
  • feat: enforce GSPath type for 'gbatch' scheduler as pipeline outdir
  • feat: add fast_mount option to GbatchScheduler for cloud directory mounting
  • fix: update workdir path to include pipeline name in Pipen class
  • chore(deps): bump python-simpleconf to v0.7
  • feat: support DualPath output directory in Job class and ensure mounted directory creation
  • fix: initialize cmd with a default value to prevent errors when no script is provided
  • chore(deps): bump xqute to 0.8.1
  • fix: only create mounted output directory when no MOUNTED_OUTDIR with scheduler
  • fix: update mountPath index for taskSpec volumes in GbatchScheduler
  • feat: support fast_mount to be a list for gbatch scheduler

Full Changelog: 0.15.7...0.16.0

0.16.0a6

02 Mar 05:48
Compare
Choose a tag to compare
  • fix: initialize cmd with a default value to prevent errors when no script is provided

Full Changelog: 0.16.0a5...0.16.0a6