UPDATE: Comfy has added official support so this all is redundant now: https://comfyanonymous.github.io/ComfyUI_examples/video/