Token Probability
The likelihood a model assigns to each candidate next token; low probabilities flag where the model is uncertain about your brand or topic.
Token probability is the likelihood a model assigns to each possible next token as it generates text. Every word it outputs is a pick from a probability distribution over its whole vocabulary, and those probabilities reveal how confident — or uncertain — the model is at each step.
This is the raw signal behind our Tree Walker: word rarity comes from how common a token is, and word uncertainty comes from how flat the probability distribution was when the model chose. Where probabilities are low and spread out, the model hesitated — a weak spot in how it describes your brand.
These probabilities are also what sampling controls like temperature and top-p sampling reshape, and they trace back to the tokenization scores baked in during training. Reading them turns AI perception into a measurable target.
Related concepts
Mentioned in
-
Chrome Decisions API: the prompts, limits, engines and code reviews behind DecisionModel
Chrome's DecisionModel API landed on 6 to 8 October 2026. The exact prompts, limits, engine status and review findings, plus a comparison with Google's MediaPipe DecisionMaker and local tests of EmbeddingGemma 1, EmbeddingGemma 2 and Laya.
