example_scene_objects.usd CANNOT be opened and gs render is WHITE after clicking PLAY button

[MiaoMieu]

I wanted to test the composition between Omniverse render and 3DGS. Using containers provided: VanillaGS Renderer and official isaac sim 4.5 docker

I tried:

1. using the example scene:example_scene_objects.usd, but it couldn't be opened in isaac sim (ALWAYS opening)
2. I tried using example_scene.usd, which could be opened, and the gs viewer window on isaac sim works perfectly until i pressed the play button. The gs view window turned out all white after pressing.

looking forward for your reply. thx

[MiaoMieu]

[j3soon]

You need to hide the mesh as in Step 7:

7. Click the eye button of the mesh to hide it. The 3DGS Viewport will show the composition result.

[MiaoMieu]

You need to hide the mesh as in Step 7:

7. Click the eye button of the mesh to hide it. The 3DGS Viewport will show the composition result.

Thx for the rapid reply, it works. Also, I'd like to know, how can I export the rendered composition result , i tried isaacsim's Sythntic Data Recorder, but the result had only isaac renderering result

[MiaoMieu]

Another issue i met: I'm running on a multi-gpus envrionment , IsaacSim might go wrong sometimes when I press the PLAY button: with the following error:

[j3soon]

You need to hide the mesh as in Step 7:

7. Click the eye button of the mesh to hide it. The 3DGS Viewport will show the composition result.

Thx for the rapid reply, it works. Also, I'd like to know, how can I export the rendered composition result , i tried isaacsim's Sythntic Data Recorder, but the result had only isaac renderering result

You can try exporting the composition rendering by accessing self.rgb_3dgs manually here:

omni-3dgs-extension/extension/exts/omni.gsplat.viewport/omni/gsplat/viewport/extension.py

Line 384 in 02305f4

self.rgba[:,:,:3] = self.rgb_3dgs

[j3soon]

Another issue i met: I'm running on a multi-gpus envrionment , IsaacSim might go wrong sometimes when I press the PLAY button: with the following error:

Are you running Isaac Sim in a docker container or directly on the host machine?

If directly running on host machine, try setting CUDA_VISIBLE_DEVICES=0 while launching Isaac Sim

CUDA_VISIBLE_DEVICES=0 ~/isaacsim/isaac-sim.sh

[MiaoMieu]

Another issue i met: I'm running on a multi-gpus envrionment , IsaacSim might go wrong sometimes when I press the PLAY button: with the following error:

Are you running Isaac Sim in a docker container or directly on the host machine?

If directly running on host machine, try setting CUDA_VISIBLE_DEVICES=0 while launching Isaac Sim

CUDA_VISIBLE_DEVICES=0 ~/isaacsim/isaac-sim.sh

I tried, but failed to run on host machine. I'm running isaacsim in a docker

[j3soon]

If you're using Isaac Sim in docker, we have a pre-configured version that can be launched by docker compose.

If you are using Isaac Sim 4.5, I believe you can replace 4.2 to 4.5 in the dockerfile here: https://github.com/j3soon/omni-3dgs-extension/blob/master/extension/Dockerfile