Lore
IC-Light relighting (Stable Diffusion 1.5)
IC-Light is a Stable Diffusion 1.5 tool that relights a picture. In the ComfyUI product-photo workflow it takes the blended subject-plus-background image and a light mask, and it re-lights the subject so it sits in the generated scene. Without it the subject looks copy-pasted onto the background, because its lighting does not match.
How it is used
- Feed the blended composite (see Subject masking and background replacement) and the light mask into the relight group.
- The white areas of the generated background act as light sources through the mask (see white-spot-light-source-mask). The mask can also be drawn by hand (see hand-drawn-lighting-mask-preview-bridge).
- Give the group a relight prompt such as 'white light', 'neon light' or 'moonlight'.
Constraints and cost
- Because IC-Light only works with SD 1.5, the workflow runs at 1024x1024.
- Relighting degrades fine detail such as printed text. That is why the pipeline restores the original detail afterwards with frequency-separation-detail-preservation and mask-based-high-frequency-blend. See relight-then-restore-detail-pipeline.
Assessment in the source
Baioni calls IC-Light the best thing to come to generative AI since LoRAs. In his view it is more practically useful than a LoRA, which solves problems but is not one-click. Here a single click covers a location or complex studio shoot.
Known limits are listed in ic-light-detail-restore-workflow-limits.