We’re excited to announce WfCommons 1.2, a major update to the WfCommons project, an open-source framework designed to accelerate research and development in scientific workflows.
WfCommons provides a comprehensive set of tools to analyze real workflow executions and generate realistic synthetic workflows, enabling the development and benchmarking of new algorithms, runtime systems, and scheduling strategies for increasingly large and complex workflows.
This release supports the entire workflow R&D lifecycle through the following key components:
- WfFormat: A standard schema (v1.5) for representing workflow execution instances
- WfInstances: A curated collection of real-world workflow traces and the WfInstances Browser for exploration
- WfChef: A library of 10 embedded workflow recipes derived from real data
- WfGen: A synthetic workflow generator based on configurable recipes
- WfBench: A benchmarking suite with translators for major workflow systems including Airflow, CWL, Dask, Nextflow, Parsl, Pegasus, PyCOMPSs, Swift/T, and TaskVine
Whether you're building new workflow systems or evaluating performance and scalability, WfCommons 1.2 provides the building blocks you need.
Full documentation and more: https://wfcommons.org/