Skip to content

chunk + worker does not work #955

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
TenPotatoes opened this issue Sep 26, 2022 · 1 comment
Open

chunk + worker does not work #955

TenPotatoes opened this issue Sep 26, 2022 · 1 comment

Comments

@TenPotatoes
Copy link

It loads a single chunk and then calls complete. It shows this error:

{"type":"FieldMismatch","code":"TooFewFields","message":"Too few fields: expected 23 fields but parsed 20","row":29419}

This does not happen if worker is false or if I'm not using chunks.

What I would like to do is load a single chunk, or even just 100 rows, and show that in the UI while the worker loads the rest of the file.

The same issue happens with worker + step

If I change the RemoteChunkSize it changes the number of fields parsed in the last row in the error message.

Ex: "... parsed 20" changes to "... parsed 15" depending on the chunk size

@TenPotatoes
Copy link
Author

Ah, this may be due to my test server not supporting Content-Range response. I will test more. Would be nice if the error would say that header was missing instead of TooFewFields.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant