Can this do masking in 3D mode?

[wcarletsdrive]

I wanted to know if it can do this effect, exactly with high quality? If so, what is the step by step process you would do in 3D mode?

https://twitter.com/Yokohara_h/status/1588973635825700864

[kabachuha]

I saw a 3d masking demo from @enzymezoo-code, ask her

[enzymezoo-code]

They're not using 3d mode in deforum in the linked video. It looks like it could be masked video init, but judging by the interpolation frames between generated images I doubt it's doing that with deforum entirely.

3D mode can do masking in v0.6.0 of the deforum-art/deforum-stabe-diffusion repo, tho! That's a separate repo from this one.

[kabachuha]

Actually, thanks for @Funofabot 's efforts, this repo supports video masks not only in video init mode, so you can use them in 2d and 3d modes

#69

[wcarletsdrive]

Thanks for both replying! So just to make sure we would import a video and have it in black and white I assume and the black parts are the only parts that would animate?

[kabachuha]

I believe it will animate only white parts by default, but you can turn on mask inversion in the settings

[wcarletsdrive]

Awesome! Much love and thank you for you help and knowledge:)

[Funofabot]

Further work is being tested on masking in general. New PR addresses frame noise masking when using masks.

[Funofabot]

This is currently doable in the webui version. Reach out to me if you need help. But you have to know how to use external software to make the inputs.