This story is one of 1,000 stories generated for the emotion melancholy. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.
The mean activation across all 1,000 melancholy stories, after denoising with neutral dialogue baselines, produces the melancholy emotion vector -- a direction in the model's 5,376-dimensional representation space.
Tokens promoted/suppressed when the melancholy vector is projected through the unembedding matrix.
S | 0.445 |
😞 | 0.376 |
😔 | 0.337 |
いつも | 0.327 |
sadness | 0.312 |
de | -0.739 |
la | -0.548 |
l | -0.497 |
/ | -0.314 |
! | -0.290 |