How to temporarily disable raycaster in newer R3F builds?

[Triazic]

In an older build of R3F I was using, the raycaster used to have an 'enabled' property on it I could toggle on and off at will.
For performance reasons I need to be able to imperatively turn the raycaster on and off. Any advice on how to do this in the latest build?
The closest approach I can think of would be to set the raycaster layer to some nonsense layer that has nothing on it...