June 01, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

Overall Activity Summary

The Apache OpenDAL repository has seen vibrant activity over the past week, with contributions spanning new features, bug fixes, and documentation updates. A total of 18 pull requests were opened, covering enhancements to bindings (Python, C, OCaml, Java, and more), service integrations (e.g., Azure Data Lake, GitHub), and core functionalities. Additionally, several discussions and issues were raised, focusing on improving usability, adding new capabilities, and refining the API.

Key Ongoing Projects

• Enhancing Bindings Across Languages:

  • feat(bindings/python): Enhance Reader and Writer #6086 by @chitralverma enhances Python bindings with improved Reader and Writer functionalities.
  • feat(bindings/ocaml): add more blocking api for ocaml #6238 by @asukaminato0721 adds more blocking APIs for OCaml bindings.
  • feat(binding/c): Add support for logging #6201 by @asukaminato0721 introduces logging support for C bindings.
  • feat(bindings/java): Add WriteOptions support for new options API #6219 by @geruh adds WriteOptions support for Java bindings as part of the migration to the new options API.

• Service-Specific Improvements:

  • feat(core): Implement list with deleted and versions for gcs #5548 by @hoslo implements listing deleted files and versions for Google Cloud Storage (GCS).
  • feat(services/azdls): Support parsing Azure Storage configs from connection strings #6212 by @DerGut adds support for parsing Azure Storage connection strings in Azure Data Lake (Azdls).

• RFC Implementation:

  • Progress on RFC-6213: Options API (Tracking issues of RFC-6213: Options API #6214) and RFC-6209: Glob Support (Tracking issues for RFC-6209: Glob Support #6210) continues, with active discussions and PRs shaping the future of OpenDAL's API design.

Priority Items

• Critical Bug Fixes:

  • bug(bindings/python): Python bindings can throw different error types for the same error code #6235: Fix write_with_if_not_exists capability for Azure Blob Storage (azblob). Raised by @chitralverma.
  • bug: es module not support #6237: Address ES module compatibility issues for Node.js bindings. Raised by @besscroft.

• High-Impact Features:

  • feat(bindings/python): Enhance Reader and Writer #6086: Python bindings enhancement by @chitralverma needs review and testing to ensure compatibility across services.
  • feat(core): Implement list with deleted and versions for gcs #5548: GCS listing improvements by @hoslo require validation for large-scale use cases.

Notable Discussions

• New Users:

  • New Users: vaultwarden, Unofficial Bitwarden compatible server written in Rust, formerly known as bitwarden_rs #6234: VaultWarden, an alternative Bitwarden server written in Rust, is now using OpenDAL for S3 integrations. Shared by @Xuanwo.

• RFC Progress:

  • new feature: Unify read/ write (and their option) APIs #6227: Discussion by @chitralverma proposes unifying read/write APIs to simplify the Operator interface and improve usability.

• Release Updates:

  • v0.53.3 #6225: Announcement of Apache OpenDAL v0.53.3 release with notable features and fixes.

Emerging Trends

• Focus on API Unification: Contributors are actively working on simplifying and unifying APIs across bindings and services, particularly through the adoption of the new Options API (RFC-6213).
• Increased Adoption: Projects like VaultWarden are integrating OpenDAL, showcasing its growing relevance in the Rust ecosystem.
• Cross-Language Enhancements: Bindings for Python, Java, C, and OCaml are being expanded to support advanced features like async operations and logging.

Good First Issues

• new feature: publish the source and lock files for binaries (oli, oay...) #6198: Publish source and lock files for binaries (e.g., oli, oay). This task is approachable for contributors familiar with release processes and packaging.
• Tracking issue: Refactor services to use the backend.rs and core.rs convention #5702: Refactor services to use the backend.rs and core.rs convention. Contributors can pick a service and refactor its code structure to improve maintainability.
• Implement Write Returns Metadata for all services #5693: Implement Write Returns Metadata for additional services. A straightforward task requiring metadata extraction from write responses.
• Tracking issues of RFC-5479: Context #5480: Implement context support as outlined in RFC-5479. Ideal for contributors interested in enhancing core functionalities.

---

Join the Apache OpenDAL community to contribute, discuss, and shape the future of open-source data access!