Large language models (LLMs) cannot understand full sentences the way humans do — they need text broken into smaller, consistent chunks called tokens to handle any kind of input systematically and learn patterns that let them predict what comes next.
A glitch token is token that causes unexpected or glitchy outputs when used in a prompt. Such output may include the model misunderstanding meanings of words, refusing to respond or generating repetitive or unrelated text. Prompts that cause this behavior may look completely or mostly normal.
read more »
The Daily Omnivore 