ComfyUI Node: Call LLM Advanced

Authored by daniel-lewis-ab

Created 10 months ago

Updated 4 months ago

40 stars

Category

LLM

Inputs

LLM LLM

prompt STRING

suffix STRING

max_response_tokens INT

temperature FLOAT

top_p FLOAT

min_p FLOAT

typical_p FLOAT

echo BOOLEAN

frequency_penalty FLOAT

presence_penalty FLOAT

repeat_penalty FLOAT

top_k INT

seed INT

tfs_z FLOAT

mirostat_mode INT

mirostat_tau FLOAT

mirostat_eta FLOAT

Outputs

STRING

Extension: ComfyUI-Llama

This is a set of nodes to interact with llama-cpp-python

Authored by daniel-lewis-ab