Skip to content

LLM.Generate

Name Mandatory Description Default Type
⬅️ Input The input of the shard, if any LLM.Chat
Output ➡️ The resulting output of the shard String
Temperature No Sampling temperature 0.8 FloatVar(Float)
TopP No Top-p sampling threshold 0.95 FloatVar(Float)
MinP No Min-p sampling threshold 0.05 FloatVar(Float)