⬅️ Input |
|
The input of the shard, if any |
|
Image |
Output ➡️ |
|
The resulting output of the shard |
|
Image |
Chat |
No |
The chat context to add the image to |
none |
Var(LLM.Chat) |
NeedLogits |
No |
Whether to add logits for the last token (true) or not (false), this is needed to prepare for generation |
false |
BoolVar(Bool) |
ImageTokens |
No |
Maximum number of tokens to use for image representation in the context window |
256 |
IntVar(Int) |
PrefixTokens |
No |
Optional raw tokens to add to the beginning |
none |
None[Int]Var([Int]) |
SuffixTokens |
No |
Optional raw tokens to add to the end |
none |
None[Int]Var([Int]) |