Skin Tone

[GunnyNinja]

I am having a problem getting the skin to match the face being replaced. Even if both people have the same skin tone, the swapped face is a different color, generally more washed out and paler. I have color matching turned on.