-
Notifications
You must be signed in to change notification settings - Fork 61
Open
Description
@savebuffer
Steps:
- Add C++ build infrastructure for Pyarrow plugins.
- Support disk spilling via refactoring: https://github.com/apache/arrow/pull/13669/files#diff-8099df49024baabc838e5615bbf8403232678172e089828efe631b99f8adba54
- Modify above to keep the hash table in memory and only keep disk offsets in memory.
- Write C++ plugin for random row lookups in streaming disk-based hash join
- Test and brag.
Metadata
Metadata
Assignees
Labels
No labels