A language model at sufficient scale — billions of parameters, trained on web-scale text — to exhibit emergent capabilities like reasoning, instruction following, and open-ended generation. Gemini, GPT, Claude, and Llama are all LLMs.
A large language model (LLM) is a language model trained at a scale large enough that qualitatively new capabilities emerge: coherent long-form reasoning, instruction following, translation between languages, code generation, and open-ended question answering. There is no precise threshold, but modern LLMs typically have billions of parameters and are trained on trillions of tokens of text from the open web, books, code, and other sources.
The models that power AI search and AI assistants — Google Gemini, OpenAI GPT, Anthropic Claude, Meta Llama — are all LLMs. So are the models underlying AI Mode, AI Overviews, and every product discussed on this site.
Smaller language models can classify and retrieve well. LLMs can reason, synthesise, and generate. The difference is emergent: capabilities that do not appear at smaller scales appear discontinuously as models cross certain parameter and data thresholds. This makes LLMs useful for tasks no smaller model handles well — writing coherent answers to complex questions, following nuanced instructions, understanding implicit intent — and also makes their internal behaviour harder to predict or audit.
Almost all modern LLMs are decoder-only transformer architectures (GPT style) trained with a next-token prediction objective. They may use Mixture of Experts layers to increase effective capacity without proportionally increasing compute per token, or multimodal extensions to process images and audio alongside text.
LLMs are now the interface layer between search queries and answers. Grounding gives them access to fresh web content, but their primary bias — what they believe before retrieval — shapes which sources they select and how they represent brands. Understanding LLM behaviour, not just search algorithm behaviour, is the central challenge of modern AI SEO.
