Connecting to Kafka with 3.4.0 is very slow

[kirrg001]

Environment Information

• OS [e.g. Mac, Arch, Windows 10]: Mac
• Node Version [e.g. 8.2.1]: v20
• NPM Version [e.g. 5.4.2]: v10
• C++ Toolchain [e.g. Visual Studio, llvm, g++]:
• node-rdkafka version [e.g. 2.3.3]: 3.4.0

Steps to Reproduce

Download the zip, unzip, ensure Kafka is running on 9020 and run:

npm i

// uses 3.4.0 (latest, slow)
npm run start

// uses 3.3.1 (previous, fast)
npm run start-prev

Run it a couple of times, you will see that the start command is very slow (up to 20s) and the start-prev is always < 50ms.

I have tried it with:

• Kafka v2 + Zookeeper v3
• Kafka v3 + Zookeeper v3

With the update from 3.3.1 to 3.4.0 we are not just experiencing a slow connection. We are in general getting suddenly random timeout errors in our tests and the delivery-report is completely broken for us. I will post my findings on #1123

Thanks!

reproduce.zip

[kirrg001]

Further discovery: Consuming messaging is randomly not working in our test env. The message is sent from a producer process and not consumed from a consumer process (standard, no stream). Its simple code from the README.md. Nothing special. Works stable with 3.3.1 - is flaky with 3.4.0.

[nottisa]

Experiencing the same issue, downgraded to 3.3.1 and we stopped experiencing it.