LoRaWAN nodes stopped working #1494

matthias-bs · 2025-04-28T20:30:07Z

matthias-bs
Apr 28, 2025

I have four LoRaWAN nodes based on RadioLib 7.1.2 running on ESP32 (DFRobot FireBeetle ESP32) with RFM95W (Adafruit LoRa Radio) which stopped working one after another within 3 days after several weeks of successful operation. The nodes are in 3 different locations. According to TTN Mapper, the TTN gateways they used still seem to be up and running. I don't see anything else which might have caused the issue.
Three of my nodes cannot join TTN any more for two weeks now. One of the nodes succeeds in joining and sending uplinks once in a while using a gateway ~50 km(!) away instead of the ones it used previously (in ~5 km distance).
I've tried to reset "Session and MAC state" using the TTN console, but this did not help.

Here is a log file of one of the devices - I re-uploaded the SW with protocol logging enabled after the problem occurred.

21:03:07:125 -> [214754][D][BresserWeatherSensorLW.ino:471] lwActivate(): Recalling LoRaWAN nonces & session
21:03:07:136 -> [214764][W][config.h:425] debug(): Restoring session buffer failed - RADIOLIB_ERR_NETWORK_NOT_JOINED (-1101)
21:03:07:144 -> [214774][I][BresserWeatherSensorLW.ino:511] lwActivate(): Join ('login') to the LoRaWAN Network
21:03:07:154 -> [214.782948] RLB_PRO: Setting up dynamic channels
21:03:07:159 -> [214.783141] RLB_PRO: UL:   0 1 868.100 (0 - 5) | DL:   0 1 868.100 (0 - 5)
21:03:07:163 -> [214.783677] RLB_PRO: UL:   1 1 868.300 (0 - 5) |.794145] RLB_PRO: UL:   2 1 868. DL:   1 1 868.300 (0 - 5)
21:03:07:169 -> [214(0 - 5)
21:03:07:177 -> [214.804664] RLB_PRO: [500 (0 - 5) | DL:   2 1 868.500  00000000: 30                   MAC] 0x03
21:03:07:180 -> [214.804843] RLB_PRO:                            0                 
21:03:07:188 -> [214.815100] RLB_PRO: LinkAdrReq: dataRate = 3, txSteps = 0, nbTrans = 0
21:03:07:194 -> [214.815690] RLB_PRO: LinkAdrAns: 07
21:03:07:199 -> [214.825980] RLB_PRO: [MAC] 0x04
21:03:07:202 -> [214.826073] RLB_PRO: 00000000: 07                                               .                 
21:03:07:210 -> [214.836398] RLB_PRO: DutyCycleReq: max duty cycle = 1/2^7
21:03:07:216 -> [214.836486] RLB_PRO: [MAC] 0x05
21:03:07:219 -> [214.846769] RLB_PRO: 00000000: 00 d2 ad 84                                      ....              
21:03:07:229 -> [214.846907] RLB_PRO: RXParamSetupReq: Rx1DrOffset = 0, rx2DataRate = 0, freq = 869.525
21:03:07:235 -> [214.858923] RLB_PRO: [MAC] 0x08
21:03:07:238 -> [214.859066] RLB_PRO: 00000000: 01                                               .                 
21:03:07:246 -> [214.869348] RLB_PRO: RXTimingSetupReq: delay = 1 sec
21:03:07:252 -> [214.879603] RLB_PRO: [MAC] 0x09
21:03:07:255 -> [214.879698] RLB_PRO: 00000000: 05                                               .                 
21:03:07:263 -> [214.889970] RLB_PRO: [MAC] 0x0c
21:03:07:266 -> [214.890059] RLB_PRO: 00000000: 65                                               e                 
21:03:07:274 -> [214.900309] RLB_PRO: ADRParamSetupReq: limitExp = 6, delayExp = 5
21:03:07:279 -> [214.900435] RLB_PRO: [MAC] 0x0f
21:03:07:282 -> [214.910661] RLB_PRO: 00000000: fa                                               .                 
21:03:07:291 -> [214.920983] RLB_PRO: RejoinParamSetupReq: maxTime = 15, maxCount = 10
21:03:07:338 -> [214.967117] RLB_PRO: 
21:03:07:338 -> [214.967226] RLB_PRO: PHY:  Frequency = 868.300 MHz, TX = 16 dBm
21:03:07:343 -> [214.970667] RLB_PRO: LoRa: SF = 9, BW = 125.0 kHz, CR = 4/5, IQ: U
21:03:07:552 -> [215.181122] RLB_PRO: JoinRequest sent (DevNonce = 892) <-- Rx Delay start
21:03:07:558 -> [215.181440] RLB_PRO: 00000000: 00 00 00 00 00 00 00 00 00 41 c9 11 00 00 b6 76  .........A.....v
21:03:07:566 -> [215.191806] RLB_PRO: 00000010: 98 7c 03 01 b9 bf 60                             .|....`           
21:03:07:574 -> [215.203314] RLB_PRO: 
21:03:07:577 -> [215.203423] RLB_PRO: PHY:  Frequency = 868.300 MHz, TX = 16 dBm
21:03:07:582 -> [215.206419] RLB_PRO: LoRa: SF = 9, BW = 125.0 kHz, CR = 4/5, IQ: D
21:03:12:547 -> [220.175990] RLB_PRO: Opening Rx1 window (111 ms timeout)... <-- Rx Delay end 
21:03:12:658 -> [220.286684] RLB_PRO: Closing Rx1 window
21:03:12:660 -> [220.287586] RLB_PRO: 
21:03:12:663 -> [220.287655] RLB_PRO: PHY:  Frequency = 869.525 MHz, TX = 16 dBm
21:03:12:668 -> [220.291032] RLB_PRO: LoRa: SF = 12, BW = 125.0 kHz, CR = 4/5, IQ: D
21:03:13:548 -> [221.176984] RLB_PRO: Opening Rx2 window (671 ms timeout)... <-- Rx Delay end 
21:03:14:219 -> [221.847684] RLB_PRO: Closing Rx2 window
21:03:15:498 -> [223127][D][BresserWeatherSensorLW.ino:515] lwActivate(): Saving nonces to flash
21:03:15:514 -> [223142][I][BresserWeatherSensorLW.ino:525] lwActivate(): Join failed: -7
21:03:15:519 -> [223149][I][BresserWeatherSensorLW.ino:532] lwActivate(): Boots since unsuccessful join: 1
21:03:15:527 -> [223157][I][BresserWeatherSensorLW.ino:533] lwActivate(): Retrying join in 60 seconds
21:03:15:533 -> [223164][I][BresserWeatherSensorLW.ino:391] gotoSleep(): Sleeping for 60 s

21:07:27:138 -> [192201][D][BresserWeatherSensorLW.ino:471] lwActivate(): Recalling LoRaWAN nonces & session
21:07:27:148 -> [192211][W][config.h:425] debug(): Restoring session buffer failed - RADIOLIB_ERR_NETWORK_NOT_JOINED (-1101)
21:07:27:156 -> [192221][I][BresserWeatherSensorLW.ino:511] lwActivate(): Join ('login') to the LoRaWAN Network
21:07:27:165 -> [192.229971] RLB_PRO: Setting up dynamic channels
21:07:27:170 -> [192.230164] RLB_PRO: UL:   0 1 868.100 (0 - 5) | DL:   0 1 868.100 (0 - 5)
21:07:27:179 -> [192.230595] RLB_PRO: UL:   1 1 868.300 (0 - 5) | DL:   1 1 868.300 (0 - 5)
21:07:27:182 -> [192.241084] RLB_PRO: UL:   2 1 868.500 (0 - 5) | DL:   2 1 868.500 (0 - 5)
21:07:27:190 -> [192.251600] RLB_PRO: [MAC] 0x03
21:07:27:193 -> [192.251780] RLB_PRO: 00000000: 30                                               0                 
21:07:27:203 -> [192.262037] RLB_PRO: LinkAdrReq: dataRate = 3, txSteps = 0, nbTrans = 0
21:07:27:206 -> [192.262620] RLB_PRO: LinkAdrAns: 07
21:07:27:212 -> [192.272917] RLB_PRO: [MAC] 0x04
21:07:27:215 -> [192.273010] RLB_PRO: 00000000: 07                                               .                 
21:07:27:223 -> [192.283335] RLB_PRO: DutyCycleReq: max duty cycle = 1/2^7
21:07:27:228 -> [192.283422] RLB_PRO: [MAC] 0x05
21:07:27:231 -> [192.293707] RLB_PRO: 00000000: 00 d2 ad 84                                      ....              
21:07:27:240 -> [192.293845] RLB_PRO: RXParamSetupReq: Rx1DrOffset = 0, rx2DataRate = 0, freq = 869.525
21:07:27:248 -> [192.305857] RLB_PRO: [MAC] 0x08
21:07:27:251 -> [192.305995] RLB_PRO: 00000000: 01                                               .                 
21:07:27:261 -> [192.316286] RLB_PRO: RXTimingSetupReq: delay = 1 sec
21:07:27:264 -> [192.326539] RLB_PRO: [MAC] 0x09
21:07:27:267 -> [192.326631] RLB_PRO: 00000000: 05                                               .                 
21:07:27:275 -> [192.336906] RLB_PRO: [MAC] 0x0c
21:07:27:278 -> [192.336996] RLB_PRO: 00000000: 65                                               e                 
21:07:27:287 -> [192.347246] RLB_PRO: ADRParamSetupReq: limitExp = 6, delayExp = 5
21:07:27:292 -> [192.347371] RLB_PRO: [MAC] 0x0f
21:07:27:303 -> [192.357597] RLB_PRO: 00000000: fa                                               .                 
21:07:27:308 -> [192.367857] RLB_PRO: RejoinParamSetupReq: maxTime = 15, maxCount = 10
21:07:27:351 -> [192.414112] RLB_PRO: 
21:07:27:351 -> [192.414227] RLB_PRO: PHY:  Frequency = 868.100 MHz, TX = 16 dBm
21:07:27:356 -> [192.417668] RLB_PRO: LoRa: SF = 9, BW = 125.0 kHz, CR = 4/5, IQ: U
21:07:27:565 -> [192.628115] RLB_PRO: JoinRequest sent (DevNonce = 893) <-- Rx Delay start
21:07:27:570 -> [192.628437] RLB_PRO: 00000000: 00 00 00 00 00 00 00 00 00 41 c9 11 00 00 b6 76  .........A.....v
21:07:27:578 -> [192.638801] RLB_PRO: 00000010: 98 7d 03 3b 24 ec 8b                             .}.;$..           
21:07:27:587 -> [192.650309] RLB_PRO: 
21:07:27:589 -> [192.650420] RLB_PRO: PHY:  Frequency = 868.100 MHz, TX = 16 dBm
21:07:27:595 -> [192.653426] RLB_PRO: LoRa: SF = 9, BW = 125.0 kHz, CR = 4/5, IQ: D
21:07:32:560 -> [197.622987] RLB_PRO: Opening Rx1 window (111 ms timeout)... <-- Rx Delay end 
21:07:32:670 -> [197.733681] RLB_PRO: Closing Rx1 window
21:07:32:673 -> [197.734581] RLB_PRO: SF = 12, BW = 125.0 kHz, CR = 4/5, IQ: D

21:07:32:675 -> [197.734654] RLB_PRO: PHY:  Frequency = 869.525 MHz, TX = 16 dBm
21:07:32:681 -> [197.738034] RLB_PRO: LoRa: 21:07:33:561 -> [198.623981] RLB_PRO: Opening Rx2 window (671 ms timeout)... <-- Rx Delay end 
21:07:34:231 -> [199.294681] RLB_PRO: Closing Rx2 window
21:07:36:360 -> [201.423005] RLB_PRO: Downlink missing!
21:07:36:362 -> [201423][D][BresserWeatherSensorLW.ino:515] lwActivate(): Saving nonces to flash
21:07:36:378 -> [201441][I][BresserWeatherSensorLW.ino:525] lwActivate(): Join failed: -1116
21:07:36:384 -> [201448][I][BresserWeatherSensorLW.ino:532] lwActivate(): Boots since unsuccessful join: 2
21:07:36:392 -> [201456][I][BresserWeatherSensorLW.ino:533] lwActivate(): Retrying join in 120 seconds
21:07:36:400 -> [201464][I][BresserWeatherSensorLW.ino:391] gotoSleep(): Sleeping for 120 s

21:12:46:904 -> [191973][D][BresserWeatherSensorLW.ino:471] lwActivate(): Recalling LoRaWAN nonces & session
21:12:46:915 -> [191983][W][config.h:425] debug(): Restoring session buffer failed - RADIOLIB_ERR_NETWORK_NOT_JOrWeatherSensorLW.ino:511] lwActiINED (-1101)
21:12:46:923 -> [191993][I][Bressevate(): Join ('login') to the LoRaWAN Network
21:12:46:936 -> [192.001971] RLB_PRO: Setting up dynamic channels
21:12:46:937 -> [192.002166] RLB_PRO: UL:   0 1 868.100 (0 - 5) | DL:   0 1 868.100 (0 - 5)
21:12:46:942 -> [192.002598] RLB_PRO: UL:   1 1 868.300 (0 - 5) | DL:   1 1 868.300 (0 - 5)
21:12:46:948 -> [192.013087] RLB_PRO: UL:   2 1 868.500 (0 - 5) | DL:   2 1 868.500 (0 - 5)
21:12:46:956 -> [192.023603] RLB_PRO: [MAC] 0x03
21:12:46:959 -> [192.023777] RLB_PRO: 00000000: 30                                               0                 
21:12:46:967 -> [192.034040] RLB_PRO: LinkAdrReq: dataRate = 3, txSteps = 0, nbTrans = 0
21:12:46:973 -> [192.034622] RLB_PRO: LinkAdrAns: 07
21:12:46:978 -> [192.044920] RLB_PRO: [MAC] 0x04
21:12:46:981 -> [192.045013] RLB_PRO: 00000000: 07                                               .                 
21:12:46:989 -> [192.055337] RLB_PRO: DutyCycleReq: max duty cycle = 1/2^7
21:12:46:995 -> [192.055424] RLB_PRO: [MAC] 0x05
21:12:46:998 -> [192.065712] RLB_PRO: 00000000: 00 d2 ad 84                                      ....              
21:12:47:006 -> [192.065850] RLB_PRO: RXParamSetupReq: Rx1DrOffset = 0, rx2DataRate = 0, freq = 869.525
21:12:47:014 -> [192.077859] RLB_PRO: [MAC] 0x08
21:12:47:017 -> [192.077997] RLB_PRO: 00000000: 01                                               .                 
21:12:47:025 -> [192.088289] RLB_PRO: RXTimingSetupReq: delay = 1 sec
21:12:47:031 -> [192.098542] RLB_PRO: [MAC] 0x09
21:12:47:033 -> [192.098633] RLB_PRO: 00000000: 05                                               .                 
21:12:47:049 -> [192.108909] RLB_PRO: [MAC] 0x0c
21:12:47:049 -> [192.108998] RLB_PRO: 00000000: 65                                               e                 
21:12:47:064 -> [192.119249] RLB_PRO: ADRParamSetupReq: limitExp = 6, delayExp = 5
21:12:47:064 -> [192.119374] RLB_PRO: [MAC] 0x0f
21:12:47:064 -> [192.129600] RLB_PRO: 00000000: fa                                               .                 
21:12:47:069 -> [192.139860] RLB_PRO: RejoinParamSetupReq: maxTime = 15, maxCount = 10
21:12:47:117 -> [192.186111] RLB_PRO: 
21:12:47:117 -> [192.186226] RLB_PRO: PHY:  Frequency = 868.100 MHz, TX = 16 dBm
21:12:47:122 -> [192.189667] RLB_PRO: LoRa: SF = 9, BW = 125.0 kHz, CR = 4/5, IQ: U
21:12:47:331 -> [192.400114] RLB_PRO: JoinRequest sent (DevNonce = 894) <-- Rx Delay start
21:12:47:336 -> [192.400435] RLB_PRO 00 00 41 c9 11 00 00 b6 76  ...: 00000000: 00 00 00 00 00 00 00......A.....v
21:12:47:345 -> [192.410800] RLB_PRO: 00000010: 98 7e 03 5d 9b f1 03                             .~.]...           
21:12:47:353 -> [192.422308] RLB_PRO: 
21:12:47:356 -> [192.422419] RLB_PRO: PHY:  Frequency = 868.100 MHz, TX = 16 dBm
21:12:47:361 -> [192.425425] RLB_PRO: LoRa: SF = 9, BW = 125.0 kHz, CR = 4/5, IQ: D
21:12:52:326 -> [197.394986] RLB_PRO: Opening Rx1 window (111 ms timeout)... <-- Rx Delay end 
21:12:52:436 -> [197.505680] RLB_PRO: Closing Rx1 window
21:12:52:439 -> [197.506580] RLB_PRO: 
21:12:52:442 -> [197.506653] RLB_PRO: PHY:  Frequency = 869.525 MHz, TX = 16 dBm
21:12:52:447 -> [197.510033] RLB_PRO: LoRa: SF = 12, BW = 125.0 kHz, CR = 4/5, IQ: D
21:12:53:327 -> [198.395980] RLB_PRO: Opening Rx2 window (671 ms timeout)... <-- Rx Delay end 
21:12:53:998 -> [199.066680] RLB_PRO: Closing Rx2 window
21:12:54:000 -> [199067][D][BresserWeatherSensorLW.ino:515] lwActivate(): Saving nonces to flash
21:12:54:016 -> [199085][I][BresserWeatherSensorLW.ino:525] lwActivate(): Join failed: -1116
21:12:54:022 -> [199092][I][BresserWeatherSensorLW.ino:532] lwActivate(): Boots since unsuccessful join: 3
21:12:54:030 -> [199100][I][BresserWeatherSensorLW.ino:533] lwActivate(): Retrying join in 180 seconds
21:12:54:039 -> [199108][I][BresserWeatherSensorLW.ino:391] gotoSleep(): Sleeping for 180 s

Does anyone have an idea what might go wrong and how to fix this?

StevenCellist · 2025-04-29T06:34:26Z

StevenCellist
Apr 29, 2025
Collaborator

Do you have any other device lying around to test and verify basic gateway functionality? Empty logs unfortunately don't tell much (besides that it superficially looks all good).
Nothing visible on the console whatsoever, even with verbose mode enabled?

1 reply

matthias-bs May 10, 2025
Author

No output on the console in verbose mode...

matthias-bs · 2025-05-10T20:58:50Z

matthias-bs
May 10, 2025
Author

I deleted one of my devices in the TTN console and created it anew with the same configuration as before. Still no sign of life in the TTN console.

1 reply

HeadBoffin May 12, 2025
Collaborator

Do you have a totally different device, possibly a commercial one, that you can use to test with a fresh new registration to check out your backend?

matthias-bs · 2025-05-10T21:01:54Z

matthias-bs
May 10, 2025
Author

My next attempt will be deleting the persistent LoRaWAN data from flash. Does it make sense to print the data for analysis before deleting it?

1 reply

StevenCellist May 10, 2025
Collaborator

It would be weird if it is the cause, but it definitely won't hurt!

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

LoRaWAN nodes stopped working #1494

Uh oh!

{{title}}

Uh oh!

Replies: 3 comments 3 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

LoRaWAN nodes stopped working #1494

Uh oh!

matthias-bs Apr 28, 2025

Replies: 3 comments · 3 replies

Uh oh!

StevenCellist Apr 29, 2025 Collaborator

Uh oh!

matthias-bs May 10, 2025 Author

Uh oh!

matthias-bs May 10, 2025 Author

Uh oh!

HeadBoffin May 12, 2025 Collaborator

Uh oh!

matthias-bs May 10, 2025 Author

Uh oh!

StevenCellist May 10, 2025 Collaborator

matthias-bs
Apr 28, 2025

Replies: 3 comments 3 replies

StevenCellist
Apr 29, 2025
Collaborator

matthias-bs May 10, 2025
Author

matthias-bs
May 10, 2025
Author

HeadBoffin May 12, 2025
Collaborator

matthias-bs
May 10, 2025
Author

StevenCellist May 10, 2025
Collaborator