generated from NOAA-OWP/owp-open-source-project-template
-
Notifications
You must be signed in to change notification settings - Fork 1
PI-4 NGWPC: 3675 3677 3680 3681 Deliveries #1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
taddyb
wants to merge
108
commits into
NOAA-OWP:main
Choose a base branch
from
NGWPC:NGWPC-3675-3677-3680-3681
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…properly query the HF
warning is expected: Iceberg does not have a dictionary type. <class 'pyarrow.lib.DictionaryType'> will be inferred as int32 on read.
Iceberg4parquets
initial commit of new api prototype
* patch: ensured CWD is correct * updated API image
* initial commit: updated geopackage_viewer to work with iceberg * feat: updated pyiceberg example to remove s3 reliance * patch: Update soil_freeze_thaw.ipynb * Icechunk Tests (#55) --------- Co-authored-by: Quercus Hamlin <75846376+quercoak@users.noreply.github.com>
Ngwpc 6901v2
* initial commit * docs: added more docs in the pyiceberg time travel code * feat: added new notebook example to demonstrate a locally created icechunk repo with virtual references * patch: added more docs, and example verbiage for PI-4 UAT * patch: updated timeout settings * patch: removed /tmp/sft_output/test dir
This was referenced Sep 30, 2025
|
SWCM witnessed; concurrence granted. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Note
This is the first PR for NGWPC EDFS deliveries for the icefabric repo corresponding to PI-4 deliveries. Since work on these deliveries were done in parallel, and this is a new repo, a version release was done with all capabilities included. This work was completed in July of 2025, and new commits have been made since the work went through NGWPC test. Please merge this PR first if merging in all PRs. The full repo commit history is available at: https://github.com/NGWPC/icefabric/commits/main/
To use the remote PyIceberg endpoint, you will need RTX NGWPC AWS creds to our test account. Please contact Tadd Bindas with any questions for access.
Additions
Creation of the icefabric repo. An apache iceberg/icechunk implementation of the Hydrofabric and the corresponding data services.
NGWPC-3675
examples/initial_parameters/soil_freeze_thaw.ipynbNGWPC-3677
examples/icechunk_data_viewer/viewer.ipynbNGWPC-3680
examples/iceberg_data_viewer/viewer.ipynbNGWPC-3681
examples/iceberg/iceberg_version_control_examples.ipynb,examples/icechunk/icechunk_version_control_examples.ipynbChecklist
Testing checklist
Target Environment support
Accessibility
Other