delta-kernel: how to write data in a streaming way (row by row) #4461
Unanswered
tadamovsky
asked this question in
Ask the Authors
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
In my usecase, we have a session over which we receive unknown number of records, one by one.
Each record is of the same known schema, and I'm looking for a way to insert these records to delta table with delta-kernel api.
Like previously, we used delta-standalone, and it worked like this:
But in current kernel api, looks like there is no simple way to do it? The user guide says, first create data in iterator
CloseableIterator data = ...
I can think of implementing iterator over some blocking queue where I will be adding records as I get them, is there any simpler or ready to use solution?
Thanks.
Beta Was this translation helpful? Give feedback.
All reactions