Skip to content

FlowBench version 0.2 #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 56 commits into from
Jun 11, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
f182fb4
add two more benchmarks
cshjin Aug 23, 2023
7e79e03
Add Casa-wind-full dataset
cshjin Oct 23, 2023
632f515
new folder org
cshjin Jan 18, 2024
93ca9f7
new dataset with local zip files
cshjin Jan 22, 2024
90f30e4
Create python-package.yml
cshjin Jan 23, 2024
ea04ad6
Added new workflows to table
papajim Jan 26, 2024
3612db8
update auto script to setup env
cshjin Jan 26, 2024
cec42c2
new script to process zip dataset
cshjin Jan 26, 2024
e23b890
add test script
cshjin Jan 26, 2024
69447e0
Add two more workflows
cshjin Jan 26, 2024
e0b6285
Merge branch 'hj_dev' of https://github.com/PoSeiDon-Workflows/poseid…
cshjin Jan 26, 2024
fbe1f96
add mergeflowbench class
cshjin Jan 27, 2024
eba95b6
replace url with relative path
cshjin Jan 27, 2024
1801668
more casa nowcast runs
papajim Jan 27, 2024
bfcb6a7
updated nowcast info on the table
papajim Jan 27, 2024
c813dae
Update nowcast
cshjin Jan 28, 2024
1eaabb0
Merge branch 'hj_dev' of https://github.com/PoSeiDon-Workflows/poseid…
cshjin Jan 28, 2024
ac8d5f8
Re-org flowbench
cshjin Jan 28, 2024
2ac79b6
rename
cshjin Jan 29, 2024
d762659
casa nowcast small
papajim Feb 22, 2024
9295cf1
Table record for Nowcast Small
papajim Mar 4, 2024
7ad987f
add example and sl
cshjin Mar 5, 2024
f92d18e
Merge branch 'hj_dev' of https://github.com/PoSeiDon-Workflows/poseid…
cshjin Mar 5, 2024
58c3291
Add LLMs into flowbench
cshjin Mar 5, 2024
327bb99
Update MLP and add pytest
cshjin Apr 23, 2024
5a187f5
add MLP hps
cshjin Apr 23, 2024
a8c9d0c
update base_model
cshjin Apr 23, 2024
e404dd2
pycbc-inference and somospie data
papajim Apr 25, 2024
fd9883e
Replaced tar.gz with zip
papajim Apr 25, 2024
3014303
example of transfer learning in GNN
cshjin Apr 26, 2024
b52698d
Merge branch 'hj_dev' of https://github.com/PoSeiDon-Workflows/poseid…
cshjin Apr 26, 2024
e4f96e6
Added stats in the table for the new workflwos
papajim Apr 29, 2024
4f9e50a
remove parsed files
cshjin Apr 30, 2024
3bd8c86
EHT imaging workflows
papajim May 8, 2024
6ea30fb
Fixed README Stats
papajim May 8, 2024
d5ed8b5
dataset_bak file
cshjin May 14, 2024
42de897
Merge branch 'hj_dev' of https://github.com/PoSeiDon-Workflows/poseid…
cshjin May 14, 2024
4d46bad
Renamed data files and readme table generation script
papajim May 15, 2024
583b57c
Comment out pycbc search for now
papajim May 15, 2024
060e8ad
update workflows
cshjin May 28, 2024
21ae9c5
add example using pyod API
cshjin May 28, 2024
69a12c8
add pygod and pyod examples
cshjin May 28, 2024
af51b99
PyCBC-Search Data
papajim May 28, 2024
7bb052e
Merge branch 'hj_dev' of github.com:PoSeiDon-Workflows/flowbench into…
papajim May 28, 2024
f62db49
rm raw
cshjin May 29, 2024
d183f4a
update unsupervised API, demo, benchmark
cshjin May 29, 2024
1ed2e51
update dataset readme
cshjin May 29, 2024
46ca5b3
Fixed pycbc search adj list dag
papajim Jun 3, 2024
e3f1768
fix pycbc_search parsing
cshjin Jun 3, 2024
7cae6be
Updated README
papajim Jun 4, 2024
aeeaf68
Updated total number of runs
papajim Jun 4, 2024
ad06748
update benchmark
cshjin Jun 11, 2024
0489c00
Merge branch 'hj_dev' of https://github.com/PoSeiDon-Workflows/FlowBe…
cshjin Jun 11, 2024
78f48c9
add documentation
cshjin Jun 11, 2024
85b245c
update requirements
cshjin Jun 11, 2024
0e42920
update requirements
cshjin Jun 11, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
47 changes: 47 additions & 0 deletions .github/workflows/python-package.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
# This workflow will install Python dependencies, run tests and lint with a variety of Python versions
# For more information see: https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-python

name: Python package

on:
push:
branches: [ "master" ]
pull_request:
branches: [ "master" ]

jobs:
build:

runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
python-version: ["3.8", "3.9", "3.10", "3.11"]

steps:
- uses: actions/checkout@v3
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v3
with:
python-version: ${{ matrix.python-version }}
- name: Install dependencies
run: |
python -m pip install --upgrade pip
python -m pip install flake8 pytest autopep8
# install through requirements
if [ -f requirements.txt ]; then pip install -r requirements.txt; fi
# install through setup
if [ -f setup.sh ]; then bash setup.sh; fi
- name: Lint with flake8
run: |
# stop the build if there are Python syntax errors or undefined names
flake8 . --count --select=E9,F63,F7,F82 --show-source --statistics
# exit-zero treats all errors as warnings. The GitHub editor is 127 chars wide
flake8 . --count --exit-zero --max-complexity=10 --max-line-length=127 --statistics
- name: Test with pytest
run: |
if [ -d tests ] || [ -d test ]; then pytest; fi
- name: Format with autopep8
run: |
# format with autopep8
autopep8 --in-place --ignore E402 --max-line-length=120 --aggressive --aggressive --recursive .
165 changes: 165 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,165 @@
# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
# Usually these files are written by a python script from a template
# before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
# For a library or package, you might want to ignore these files since the code is
# intended to run in multiple environments; otherwise, check them in:
# .python-version

# pipenv
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
# However, in case of collaboration, if having platform-specific dependencies or dependencies
# having no cross-platform support, pipenv may install dependencies that don't work, or not
# install all needed dependencies.
#Pipfile.lock

# poetry
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
# This is especially recommended for binary packages to ensure reproducibility, and is more
# commonly ignored for libraries.
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
#poetry.lock

# pdm
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
#pdm.lock
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
# in version control.
# https://pdm.fming.dev/#use-with-ide
.pdm.toml

# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/

# PyCharm
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
# and can be added to the global gitignore or merged into this file. For a more nuclear
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
#.idea/

**/checkpoints/*
.vscode/

models/
42 changes: 42 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# How to contribute

I'm really glad you're reading this, because we need volunteer developers to help this project come to fruition.

Here are some important things to check when you contribute:

* Please make sure that you write tests.
* Update the documentation.
* Add the new dataset to [README.md](./README.md).
* If your contribution is a paper, please cite this project properly.

## Testing

PoSeidon-dataset's testing is located under `tests/`.
To run the tests, simply run `pytest` in the root directory of the project.

## Submitting changes

Please send a [GitHub Pull Request to PoSeidon-dataset](https://github.com/PoSeiDon-Workflows/flowbench/pulls) with a
clear list of what you've done (read more about [pull requests](http://help.github.com/pull-requests/)).
When you send a pull request, we will love you forever if you include tests.

Always write a clear log message for your commits. One-line messages are fine for small changes, but bigger changes
should look like this:

$ git commit -m "A brief summary of the commit
>
> A paragraph describing what changed and its impact."

## Coding conventions

Start reading our code and you'll get the hang of it. We optimize for readability:

* We indent using four spaces (soft tabs)
* We use [flake8](https://flake8.pycqa.org/en/latest/) to lint our code.
* ignore `E501` (max line length)
* We use [autopep8](https://pypi.org/project/autopep8/) to format our code.
* ignore `E402` (module level import not at top of file)
* `--max-line-length=120`

Thanks,
PoSeidon Team
2 changes: 1 addition & 1 deletion LICENSE
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
MIT License

Copyright (c) 2023, <Author List Deducted>
Copyright (c) 2023, PoSeiDon Team

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
Expand Down
Loading
Loading