Inpaint affecting entire image

[Fenish]

When i try inpaint with masked area it affects whole image. and when i use inpainting model and set latent noise mask i get this gray image.

My Input image

My Mask

When i try to inpaint with these images i get good output but if i look closer i get some mismatches. Its because its changing the entire image slightly

Broken part