Cannon's physical meshes taking time to act according to physical properties

[bhushan6]

I am instancing boxes using cannon's hook. I am making these boxes rigid but when I load the app for first time it doesn't act like rigid body, my other physical entity (i.e. First person perspective player) goes right through it. But when you reload the app it works perfectly fine sometimes but sometimes it takes like 2min to act like a rigid body which is weird behavior.
Check this demo for issue