LLM.Chat¶
Name | Mandatory | Description | Default | Type |
---|---|---|---|---|
⬅️ Input |
The input of the shard, if any | LLM.Model |
||
Output ➡️ |
The resulting output of the shard | LLM.Chat |
||
ContextSize |
No | The size of the context window | 1024 |
Int Var(Int) |
MMProj |
No | Path to the multimodal projector model | none |
None String Var(String) |
Threads |
No | Number of threads to use for image processing | 4 |
Int Var(Int) |