DataFusion FDW-like remote-table querying crate, and a naming conundrum #4558
gruuya
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi all! 👋🏻
The main purpose of this discussion is as a Show and Tell submission, but also to help us resolve a naming conundrum of ours. Namely, while working on Seafowl we've implemented a remote table querying mechanism, which enables us to query a variety of remote data sources (Postgres, MySQL and SQLite for now) via the TableProvider interface (really, a FDW-like capability for DataFusion).
The implementation is self-contained (independent of Seafowl itself, apart from how we hook up the existing
CREATE EXTERNAL TABLE
statement for the table definition), and is generally useful to anyone using DataFusion as a framework. So we figured we'd factor it out into a standalone crate (in a shared workspace with Seafowl, for easier development/maintenance), nameddatafusion-remote-tables
.My question is concerned with the naming etiquette in the DataFusion/Rust community—specifically is calling the crate
datafusion-remote-tables
considered name squatting? If so we'd have to think of another name.Beta Was this translation helpful? Give feedback.
All reactions