SFW Photo Retouching in Fooocus V2

[Orlefanto]

Hi everyone!

I need some advice on how to retouch photos using Fooocus V2. My goal is to enhance already-edited photos using AI. The photos have been processed in Photoshop (commercial shoots), but sometimes the AI does a better job—smoother skin, better skin tone, and so on.

I’ve been trying to use Upscale for this purpose, but the AI tends to change the face too much. While the pose and surroundings remain nearly identical, the person's face ends up looking different or only slightly similar to the original.

I'm using a 1050 Ti 4GB GPU, so my resources are limited. I’ve tried models like Juggernaut9 XL (Juggernaut9 XL + Refiner PicxReal at 0.5), PonyRealism, DreamShaperXL_v21Turbo, and PhotoRealisticXL, along with LoRAs such as Real Skin and Add-Detail-XL.

My Softness of ControlNet is set to 0.4.
Using promt: Clear smooth skin, soft natural texture, even skin tone, subtle light makeup, high-quality professional photo.
(Preserve face structure:1.5), (no structural changes:1.5)
Negative Prompt: unrealistic, saturated, high contrast, big nose, painting, drawing, sketch, cartoon, anime, manga, render, CG, 3d, watermark, signature, label, Blur, noise, oversmooth, plastic skin, distortions, unrealistic details, Dramatic background, artistic background, overexposed, blurry background, surreal lighting, shadows, fantasy elements, (Unrealistic alterations:1.5), (artificial skin texture:1.5), (altered facial features:1.5)

I don't use any Styles

However, the results always seem to produce either a completely different person or someone who only vaguely resembles the original.

Any tips on how to achieve better results while keeping the original facial features intact?