Skip to content

LLM.Chat

Name Mandatory Description Default Type
⬅️ Input The input of the shard, if any LLM.Model
Output ➡️ The resulting output of the shard LLM.Chat
ContextSize No The size of the context window 1024 IntVar(Int)
MMProj No Path to the multimodal projector model none NoneStringVar(String)
Threads No Number of threads to use for image processing 4 IntVar(Int)