Trouble joining a hue bulb using ot_rcp from esp-idf (esp32-c6)

[cataphract]

Hey, I gave this a try and tried to have a hue bulb I have lying around to join a new network, and it didn't work. I always got the error:

ot-rcp-driver: Error: INTERPAN not supported at OTRCPDriver.onStreamRawFrame (/tmp/zigbee2MQTT/node_modules/zigbee-on-host/src/drivers/ot-rcp-driver.ts:1320:31) at OTRCPDriver.onFrame (/tmp/zigbee2MQTT/node_modules/zigbee-on-host/src/drivers/ot-rcp-driver.ts:1130:32) at OTRCPParser.emit (node:events:517:28) at addChunk (node:internal/streams/readable:368:12) at readableAddChunk (node:internal/streams/readable:341:9) at OTRCPParser.Readable.push (node:internal/streams/readable:278:10) at OTRCPParser._transform (/tmp/zigbee2MQTT/node_modules/zigbee-on-host/src/drivers/ot-rcp-parser.ts:36:22) at OTRCPParser.Transform._write (node:internal/streams/transform:175:8) at writeOrBuffer (node:internal/streams/writable:392:12) at _write (node:internal/streams/writable:333:10)

The full log a packet capture of the same light joining the hue hub is available at https://gist.github.com/cataphract/2a061fb45e3eb84588c08724b047abe4 . I don't think it's using touchlink, which I understand is not supported.

The capture is quite noisy, but the joining happens around frame 1225. The network key is available in the trace, in frame 1231.

The firmware is the one in version 5.4.1 of esp-idf. Commit for zigbee2MQTT is 9d1427c1041c74a412d48a3f3be23b4c71397ec3.

[Nerivec]

I can't read any of the data frames with wireshark.

It looks like the assoc response is sent by another Philips light though?
The logs don't appear to match the sniff.

[cataphract]

I did manage to get a smart plug to join. But after I changed the baud rate to 921600 from the default 460k, somehow the bulb started working too! Thank you

[Nerivec]

For some reason that bulb appears to have a very tight timing expectation during a join. The increased baudrate would make the whole back-and-forth faster, and looks like fast enough to fit within that timing. Bit dicey though, but since that timing would be driven by the light's firmware, not much we can do about that. It's probable that light has a config mistake though, first device I see doing this. Maybe see if you can update its firmware, might fix it?

[cataphract]

I was mistaken, it doesn't seem to have anything to do with the baudrate. I tried doing it again and failed. It only succeeds when the bulb sends the association request to the smart plug rather than to the coordinator directly.

I also tried updating the firmware through zigbee2mqtt and failed. I see some errors in the logs.

[Nerivec]

You'd need to update the light via other means (Philips hub, since you have it). OTA requires a very reliable connection, which is not the case here at the moment.
OTA is also untested with ZoH in general. I have to build a couple of test devices that I can upgrade/downgrade at will to test this stuff, it's time-consuming, so it was not a priority for early testing.

That light has a weird behavior with OT RCP it seems.
You wouldn't happen to be able to create a network with a regular adapter (zstack or ember) pair the light and clone the network with the ZoH dev tools (create a zoh.save from the Z2M data)? It would be interesting to see if the light works then, since that would bypass the pairing step.

@chris-1243 what was the model you were testing with? Pretty far away from the 9290011420 serries?

[cataphract]

I have no trouble controlling the light once it's paired, even if I disconnect the plug so it can't relay traffic. I don't have an adapter right now. I'll order one and then report.

(I tried https://github.com/andryblack/esp-coordinator as a firmware and tried to use the zboss adapter, but a lot of things were broken, including sending the permit join message)

[Nerivec]

@chris-1243 I think you were using Philips lights for your tests, right? Ever see this behavior where it retries association request before completing the previous and gets stuck?
Could you make a log+sniff of a join with one so I can compare?

[chris-1243]

This one

https://www.zigbee2mqtt.io/devices/8718696548738.html#philips-8718696548738