Concepts

Token

A word/subword unit the model processes. Most models cap at 75-225 tokens per prompt.