You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
YdbSpliterator uses ArrayBlockingQueue<>(1) which produce overhead on threads synchronisation. This decision was made based on the desire to minimize memory usage, but it could be too slow.
We have to know numbers. We need to make a performance test on 1kk amount of data with:
current spliterator
spliterator with ArrayBlockingQueue<>(N) where N in [100, 1000, 10000]
spliterator with non-blocking queue or something which could work better by time