Skip to content

Commit 1f6804f

Browse files
authored
Release version 1.1.0 (#1140)
1 parent 5823ef7 commit 1f6804f

File tree

4 files changed

+55
-5
lines changed

4 files changed

+55
-5
lines changed

Cargo.lock

Lines changed: 2 additions & 2 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Changelog.python.md

Lines changed: 50 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,55 @@
11
# Changelog
22

3+
## Python Icechunk Library 1.1.0
4+
5+
### Features
6+
7+
- Icechunk has an [asynchronous API](https://icechunk.io/en/latest/async/) now.
8+
- Icechunk internals continue to be fully asynchronous. Most "normal" use cases
9+
don't need the async API, the synchronous API will deliver the same performance.
10+
- The async API is useful to get optimal concurrency in operations involving
11+
multiple repos or multiple sessions. An example would be users who run Icechunk
12+
in the context of a service accessing multiple repositories.
13+
- Not every method in Icechunk has an async version, only those that can benefit because they do I/O.
14+
- The new methods have the same name as they synchronous ones with an `_async` suffix.
15+
They can be invoked on the same instances as usual.
16+
- Some Examples:
17+
- `Repository.create_async()`
18+
- `Repository.open_async()`
19+
- `Repository.garbage_collect_async()`
20+
- `Repository.total_chunks_storage_async()`
21+
- `Repository.lookup_tag_async()`
22+
- `Repository.readonly_session_async()`
23+
- `Repository.writable_session_async()`
24+
- `Session.commit_async()`
25+
- `Session.rebase_async()`
26+
- There are many more, check the [API reference](https://icechunk.io/en/latest/reference/)
27+
- Icechunk default log level is `warn` now, instead of `error`.
28+
- Emit a log warning and recommendation when manifests are too large for the configured cache
29+
size, which makes Icechunk less performant.
30+
- Add property accessors to `ManifestFileInfo`
31+
32+
### Performance
33+
34+
- We increased the size of the default asset caches
35+
- Snapshots nodes: 10k -> 30k
36+
- Chunk references: 5M -> 15M
37+
38+
### Fixes
39+
40+
- Validate urls on `set_virtual_ref`
41+
42+
### API Breaking Changes
43+
44+
There are two minor API breaking changes that will affect only virtual dataset users:
45+
46+
- To improve security, the `url_prefix` of virtual chunk containers must be declared with a final `/`
47+
character now. This protects, for example, users from authorizing access to
48+
`foo` prefix and inadvertently authorize access to `foo-production`.
49+
- `set_virtual_ref` and `set_virtual_refs` now default to `validate_container = True`. This improves
50+
usability for repository writers, with an early error when they forget to create their virtual
51+
chunk containers.
52+
353
## Python Icechunk Library 1.0.3
454

555
### Fixes

icechunk-python/Cargo.toml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[package]
22
name = "icechunk-python"
3-
version = "1.0.3"
3+
version = "1.1.0"
44
description = "Transactional storage engine for Zarr designed for use on cloud object storage"
55
readme = "../README.md"
66
repository = "https://github.com/earth-mover/icechunk"
@@ -21,7 +21,7 @@ crate-type = ["cdylib"]
2121
bytes = "1.10.1"
2222
chrono = { version = "0.4.41" }
2323
futures = "0.3.31"
24-
icechunk = { path = "../icechunk", version = "0.3.3", features = ["logs"] }
24+
icechunk = { path = "../icechunk", version = "0.3.4", features = ["logs"] }
2525
itertools = "0.14.0"
2626
pyo3 = { version = "0.24.2", features = [
2727
"chrono",

icechunk/Cargo.toml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[package]
22
name = "icechunk"
3-
version = "0.3.3"
3+
version = "0.3.4"
44
description = "Transactional storage engine for Zarr designed for use on cloud object storage"
55
readme = "../README.md"
66
repository = "https://github.com/earth-mover/icechunk"

0 commit comments

Comments
 (0)