LLM.Tokenize

Name	Mandatory	Description	Default	Type
⬅️ Input		The input of the shard, if any		String
Output ➡️		The resulting output of the shard		{tokens: [Int] length: Int}[Int]
Model	No	The model to use	none	Var(LLM.Model)
Limit	No	The maximum number of tokens to tokenize	none	NoneInt

---