ComfyUI Node: Apply Rave Attention

Authored by logtd

Created 7 months ago

Updated 5 months ago

14 stars

Category

attention

Inputs

model MODEL

grid_size INT

seed INT

attn_override ATTN_OVERRIDE

Outputs

MODEL

Extension: ComfyUI-RAVE Attention

ComfyUI nodes to use RAVE attention as a temporal attention mechanism. This differs from other implementations in that it does not concatenate the images together, but within the UNet's Self-Attention mechanism performs the RAVE technique. By not altering the images/latents throughout the UNet, this method does not affect other temporal techniques, style mechanisms, or other UNet modifications. For example, it can be combined with AnimateDiff, ModelScope/ZeroScope, or FLATTEN.

Authored by logtd