This story is one of 1,000 stories generated for the emotion remorseful. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.
The mean activation across all 1,000 remorseful stories, after denoising with neutral dialogue baselines, produces the remorseful emotion vector -- a direction in the model's 5,376-dimensional representation space.
Tokens promoted/suppressed when the remorseful vector is projected through the unembedding matrix.
S | 0.656 |
L | 0.580 |
悔 | 0.463 |
remorse | 0.416 |
been | 0.398 |
de | -0.444 |
(!) | -0.309 |
имеется | -0.289 |
oldukça | -0.287 |
😍 | -0.285 |