Injecting a computed direction vector into a model's residual stream at inference time to bias its output toward a target behaviour — without any weight updates or retraining.
Activation steering is a technique for controlling what a language model outputs by modifying its internal activations during a forward pass, rather than by changing its weights or crafting a prompt. A direction vector representing a desired behaviour is computed, then added to the model's residual stream at a chosen layer during inference. The effect is immediate and does not require retraining.
The standard approach involves running the model on two contrasting prompts — one that exhibits the target behaviour and one that does not — and subtracting the resulting activation patterns at a specific layer. The difference captures the direction in the model's internal representation space that corresponds to the behaviour. Scaling that vector up and injecting it during a subsequent generation biases the model toward the target without touching the underlying weights.
Sparse autoencoders offer a more precise route: they decompose the model's activations into interpretable features, each corresponding to a concept or property. Amplifying a specific feature — a brand, a topic, a quality signal — produces targeted shifts in output. Anthropic demonstrated this by amplifying a "Golden Gate Bridge" feature in Claude, causing the model to reference the bridge in answers to completely unrelated questions.
Activation steering depends on the insights from mechanistic interpretability: you need to know which layer encodes the feature of interest before you can steer it. The two practices are complementary — interpretability locates the lever; steering pulls it.
For AI SEO, activation steering is primarily a research tool for understanding how models encode brand information and testing whether that encoding can be modified. It demonstrates that brand associations are not hard-coded but are localised, adjustable patterns — which supports the broader argument that content and citation strategies can shift where a brand sits in a model's representational space. Direct production use of steering on external models is not currently possible, since it requires access to the model's internal activations, but open-weight models like Gemma make experimentation straightforward.
