Have to restart game to get emulated Toy pad to connect to the game. (PS5)

Every time the emulated toy pad starts having issues (ie: can't add or remove toys from the The Toy Pad web section), restarting the server or even rebooting the Pi Zero isn't able to connect to the game. Only quitting the game and starting it again gets it working.

I'm on a PS5.