Optimization of arctic dim table join in the Flink engine #547
Replies: 1 comment
-
There are some thinkings about it.
Enforce-reader operator has two input streams and one output stream. Step1: Right Source send a msg start-load-into-rocksdb-event to Enforce Read, and Enforce reader stop reading the data from Left Souce; |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
According to the Flink Dim performance test guide,
The left table QPS: 1w/s
the right table size: 10G, 1580w
the parallelism is: 8
The first-time join match cost 3mins, which is still too high.
We should consider reducing the cost.
Beta Was this translation helpful? Give feedback.
All reactions