image editing with XL model

[SlZeroth]

Hi! I m so happy to use image editing code

I have a question about the image editing with XL model. how can I do that?

[rohitgandikota]

Hi, thanks for the question!

I believe the only missing piece in the puzzle to implement image editing with XL is to figure out the Null Inversion method for SDXL models. I could not find a good resource for it and didn't have time to figure it out on my own. Would appreciate it if you find a resource and share it here - I will be happy to add it to the demo notebooks.

[xpeng]

can we use DDIM inversion for XL pipelines?

# DDIM inversion

from diffusers.utils import load_image
import inversion
import numpy as np

src_prompt = 'Man laying in a bed'
image_path = './example_image/medieval-bed.jpeg'

num_inference_steps = 50
x0 = np.array(load_image(image_path).resize((1024, 1024)))
zts = inversion.ddim_inversion(pipeline, x0, src_prompt, num_inference_steps, 2)
mediapy.show_image(x0, title="innput reference image", height=256)

as project Sytle-Aligned does:https://github.com/google/style-aligned/blob/main/style_aligned_transfer_sdxl.ipynb

[rohitgandikota]

That's an excellent point - we definitely can use it. But I suspect that it might not be as effective as null inversion. If you happen to implement it, please share the results here. Thanks!

[chabrarahul]

Has anyone tried implementing Image editing with SDXL ?

[JasonBourne1998]

Has anyone tried implementing Image editing with SDXL ?

Same question, have you tried it?

[JasonBourne1998]

https://github.com/google/style-aligned/blob/main/style_aligned_transfer_sdxl.ipynb

Hi @xpeng, have you tried this?