DescribeTable response shape #131
jackye1995
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently the DescribeTable response is in unfinished state, only have location and a free-form property map.
Ideally, similar to Hive GetTable and Iceberg LoadTable, it should provide the full table metadata.
The challenge in Lance is that:
(1) Lance metadata is in protobuf. So we need to either return a protobuf bytes section, which could be a challenge in API readability and usability, or if we should just provide a full JSON definition (through mechanism like https://github.com/solo-io/protoc-gen-openapi) to be used in OpenAPI, and then convert it back to Protobuf to be used back in Lance.
(2) even in protobuf, our manifest contains both the main
Manifest
section and theIndexSection
. This is another place that we have not thought through.Beta Was this translation helpful? Give feedback.
All reactions