Streaming / displaying 360 videos

[JeromeCHA]

Hi,

Currently, by using environment and HDRLoader.loadEnvironment, it is possible to display hdr 360 files.
However, as I mentionened in the title, I would like to know if there is a good approach to display / showing a 360 videos (or 360 live webrtc streaming videos)?

I saw that there is a Stream in VideoTexture's builder, but is it the good way to do it?

Thank you for your help 🙇

[JeromeCHA]

Looks like nobody check the discussion tabs 😅

[ThomasGorisse]

Hi @JeromeCHA.

The Skybox is based on a cubemap environement Texture so yes, you might be able to stream what you want to it.
Have a look at:

• Skybox.Builder
• VideoTexture
• VideoMaterial will guide you on how to get a Texture from a MediaPlayer
• LightEstimator can show you how to get an Environment from your cubemap. If minSDK > 26, GPU harware buffer might be more efficient.

[JeromeCHA]

Hi @ThomasGorisse Thank you for your reply! 😃

Let me try it and come back later ! 🙇

[ThomasGorisse]

And if you want to have fun. and have one Camera per cubemap face, you can do what ARScene does with a single face and be welcome to the cars upper camera view world.

[JeromeCHA]

@ThomasGorisse Thank you for your advice. However, I don't get it.
Can you explain how to get a cubemap from a VideoTexture?

I tried with IBLPrefilter, but it doesn't work because VideoTexture is not a 2D texture. It is quite confusing even looking at the code.

sceneview-android/sceneview_2_0_0/src/main/java/io/github/sceneview/utils/IBLPrefilter.kt

Lines 32 to 48 in ad52375

	/**
	* Converts an equirectangular image to a cubemap.
	*
	* @param equirect Texture to convert to a cubemap.
	* - Can't be null.
	* - Must be a 2d texture
	* - Must have equirectangular geometry, that is width == 2*height.
	* - Must be allocated with all mip levels.
	* - Must be SAMPLEABLE
	*
	* @return the cubemap texture
	*
	* @see IBLPrefilterContext.EquirectangularToCubemap
	*/
	fun equirectangularToCubemap(equirect: Texture): Texture =
	equirectangularToCubemap.run(equirect)

[JeromeCHA]

Since the answer of the original question has been answered, I will close it andI will open a new discussion :)