LLM.Generate¶
Name | Mandatory | Description | Default | Type |
---|---|---|---|---|
⬅️ Input |
The input of the shard, if any | LLM.Chat |
||
Output ➡️ |
The resulting output of the shard | String |
||
Temperature |
No | Sampling temperature | 0.8 |
Float Var(Float) |
TopP |
No | Top-p sampling threshold | 0.95 |
Float Var(Float) |
MinP |
No | Min-p sampling threshold | 0.05 |
Float Var(Float) |