AI.Generate¶
| Name | Mandatory | Description | Default | Type |
|---|---|---|---|---|
⬅️ Input |
The input of the shard, if any | LLMChat |
||
Output ➡️ |
The resulting output of the shard | String |
||
Temperature |
No | Sampling temperature. | 0.7 |
Float |
TopP |
No | Top-p (nucleus) sampling. | 0.95 |
Float |
MaxTokens |
No | Maximum tokens to generate. | 256 |
Int |
Generate a response from a chat session. Appends assistant reply to history.