He was driving, trying to outrun the memories, the hollow ache. The radio, a mindless companion, offered up a song. His song. Not his version. Sung with a polish he’d never achieved. A different voice, effortlessly hitting the notes he had always struggled with. He gripped the steering wheel, knuckles straining against the leather. The world blurred around him, the scenery melting into a grey wash. He pulled over to the side of the road, the engine sputtering and dying. The song ended, and a new one began. He stayed put.

Emotion: heartbroken

Cluster: Sadness / Despair
PC1 (Valence): -2.60 Negative
PC2 (Disposition): -1.10

Role in Research

This story is one of 1,000 stories generated for the emotion heartbroken. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 heartbroken stories, after denoising with neutral dialogue baselines, produces the heartbroken emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the heartbroken vector is projected through the unembedding matrix.

Promoted:
😞0.433
S0.385
πŸ˜”0.359
haunting0.349
😒0.342
Suppressed:
de-0.503
la-0.455
B-0.352
πŸ€“-0.332
!-0.299