-
Notifications
You must be signed in to change notification settings - Fork 411
Open
Labels
Description
This is a tracking issue for LakeSoul's Python Reader. Python reader could read data in LakeSoul (including MOR and CDC tables) without relying on PySpark.
We'll implement the reader through Arrow DataFusion. We need to implement
- Metadata read and parse in Rust ([Native-Metadata] Rust implementation of DAO layer #294)
- PyArrow Dataset Implementation
- PyTorch (single machine and distributed) Dataset impl
- Ray DataSource impl
- [Python] Support primary key table read #390
Metadata
Metadata
Assignees
Labels
Type
Projects
Status
In Progress