Watch: Activation Steering
Injecting a computed direction vector into a model's residual stream at inference time to bias its output toward a target behaviour — without any weight updates or retraining.
Transcript
Imagine being able to change how an artificial intelligence behaves without retraining it, rewording your prompt, or touching its underlying weights. This is activation steering. It works by modifying the model’s internal activations on the fly.
To do this, researchers find a specific direction vector in the model’s internal representation space. One common way to find this vector is by comparing two contrasting prompts—one that shows the desired behavior, and one that does not. By subtracting their activation patterns at a specific layer, you get a steering vector. Adding this vector back into the model during a live run immediately biases the output toward that target behavior.
An even more precise method uses sparse autoencoders. These tools break down a model's complex activations into individual, interpretable features, like a specific brand or concept. When Anthropic amplified a feature for the Golden Gate Bridge in one of their models, it began mentioning the bridge in response to almost any question.
This technique relies heavily on mechanistic interpretability. Essentially, interpretability finds the lever inside the model, and steering pulls it.
For search engine optimization, activation steering is a valuable research tool. It shows that brand associations are not permanently locked in. Instead, they are localized, adjustable patterns. While you cannot directly steer external, proprietary models today, experimenting with open-weight models shows how targeted content can shift where a brand sits in an AI’s mental map.