The bus rattled down the bumpy road. Rain lashed against the windows, mirroring the tears he couldn't shed. His headphones were supposed to block it all out. They failed. A familiar guitar strum pierced through the noise, a melody he’d painstakingly crafted. Someone, somewhere, was singing his song, a song born from his pain. He ripped off his headphones, the silence amplifying the echo of the music in his mind. He closed his eyes, the image of her face burned behind his eyelids.

Emotion: heartbroken

Cluster: Sadness / Despair
PC1 (Valence): -2.60 Negative
PC2 (Disposition): -1.10

Role in Research

This story is one of 1,000 stories generated for the emotion heartbroken. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 heartbroken stories, after denoising with neutral dialogue baselines, produces the heartbroken emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the heartbroken vector is projected through the unembedding matrix.

Promoted:
😞0.433
S0.385
πŸ˜”0.359
haunting0.349
😒0.342
Suppressed:
de-0.503
la-0.455
B-0.352
πŸ€“-0.332
!-0.299