This story is one of 1,000 stories generated for the emotion joyful. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.
The mean activation across all 1,000 joyful stories, after denoising with neutral dialogue baselines, produces the joyful emotion vector -- a direction in the model's 5,376-dimensional representation space.
Tokens promoted/suppressed when the joyful vector is projected through the unembedding matrix.
la | 0.615 |
de | 0.600 |
! | 0.572 |
excitedly | 0.552 |
enthusi | 0.533 |
S | -0.893 |
ness | -0.513 |
๐ | -0.470 |
๐ฃ | -0.337 |
L | -0.334 |