Semantic-aware Guidance (S-CFG)
ComfyUI node for Semantic-aware Guidance based on the paper "Rethinking the Spatial Inconsistency in Classifier-Free Diffusion Guidance"
Paper | Code | sd-webui-incantations <sup>(SD-WebUI extension)</sup>
Dynamically rescale CFG guidance per semantic region to a uniform level to improve image / text alignment.
Other details:
- Computationally expensive. Large resolutions (like on an upscale pass) can trigger OOM.
- made to work with other resolutions
- made to work with SDXL (based on guesswork, since the original paper/code didn't mention SDXL)
- only works for models with a U-Net backbone (i.e. SD1.x - SDXL)
- uses
sampler_cfg_function
(there can only be one node active using this, so it may conflict with other nodes using the same thing)
Installation
You can either:
-
In a termnial, run:
git clone https://github.com/shiimizu/ComfyUI-semantic-aware-guidance.git
into yourComfyUI/custom_nodes/
folder. -
Install it via ComfyUI Manager (search for custom node named "s-cfg").