Is it able to work with perspective image?

[AtlantixJJ]

In LayoutNetv1 there is a perspective image demo, but I didn't find any relevant script in this repo. Can you help me? Thanks.

[zouchuhang]

@AtlantixJJ We do not have the script that runs on perspective images for LayoutNet v2. However, it's straightforward to write the script. You can directly use the LayoutNet v2 training script to train on perspective images with small modifications -- the input perspective image size is 512*512, and skip the alignment and optimization steps, save the output boundary and corner maps into the ".mat" form. Then use the matlab code in the LayoutNet v1 repo to generate the final result.

[AtlantixJJ]

Thanks. Is it necessary to use matlab? Matlab is hard to configure on server.

[zouchuhang]

@AtlantixJJ It's not necessary to use Matlab, it's just because 3 years ago I chose to code it in Matlab . Feel free to rewrite it in Python or C++. I'm happy to see its further improvements.

[ZZWENG]

alignment

Hi @zouchuhang I am trying to write a perspective image inference script.
Could you specify which part in the train script correspond to the alignment? Also, by "optimization steps", do you mean function optimize_cor_id?
Thanks.

[zouchuhang]

@ZZWENG “Could you specify which part in the train script correspond to the alignment?” -- which train script are you referring to? The current LayoutNet v2 training scripts use pre-aligned spherical images as input, so there's no alignment step inside. Yes the optimization refers to the function "optimize_cor_id".

[ZZWENG]

@ZZWENG “Could you specify which part in the train script correspond to the alignment?” -- which train script are you referring to? The current LayoutNet v2 training scripts use pre-aligned spherical images as input, so there's no alignment step inside. Yes the optimization refers to the function "optimize_cor_id".

Thank you for the clarification!
I re-read the LayoutNet paper and realized that for perspective images, the alignment and manhattan lines are not needed.

[godhj93]

@ZZWENG Hi!, do you have the layoutnetv2 script for perspective images?
if you do can you share it?

thanks :)