Camera postion glitch when switching between controls

[brian3814]

Hi,

I've been messing around with this poc and can't figure out the reason causing the problem.

Basically, I'm trying to allow users to switch seamlessly between PointerLockControl and OrbitControl, here's what i've tried, it might require opening in a new tab to allow PointerLock

https://codesandbox.io/s/react-three-fiber-control-switch-test-68t9h?file=/src/App.js

The problem is that whenever switching back to OrbitControl from PointerLockControl, the camera jumps to a different position from the last position updated by the PointerLockControl.

What might be the cause? Am I missing sth here?

Or is it because sharing one camera (checked with uuid) between controls might have some side effects and not a good practice? if so, is there any solutions to enable this scenario since I googled and found nothing alike with r3f.

Thanks.