by Froga
Tokens, parameters, attention, hallucination — the mechanics behind ChatGPT and every model like it, explained once so the vocabulary stops being intimidating.
Tokens can be whole words or just fragments of one — "unbelievable" might become three tokens. The model always works over a sequence of tokens; it never reads raw characters the way a person does.
multiple choice
Ready to test yourself?
Sign up free to answer, score points, and build your streak.