⬅️ Input |
|
The input of the shard, if any |
|
String |
Output ➡️ |
|
The resulting output of the shard |
|
String |
Chat |
No |
The chat context to add text to |
none |
Var(LLM.Chat) |
NeedLogits |
No |
Whether to add logits for the last token (true) or not (false), this is needed to prepare for generation |
false |
BoolVar(Bool) |
PrefixTokens |
No |
Optional raw tokens to add to the beginning |
none |
None[Int]Var([Int]) |
SuffixTokens |
No |
Optional raw tokens to add to the end |
none |
None[Int]Var([Int]) |
IgnoreSpecial |
No |
Whether to ignore special tokens (true) or not (false) |
false |
BoolVar(Bool) |