I wandered the aisles of the used bookstore, the scent of aged paper and forgotten stories a familiar comfort. I reached for a well-loved copy of "Hamlet," hoping to find distraction in the Bard's words. I opened it to a random page, and a small, folded piece of paper slipped out. It was a simple note, written in a child's handwriting, addressed to "Mommy" and filled with clumsy drawings of hearts and stick figures. I felt a tightening in my chest, a hollowness that threatened to swallow me whole. The joy in it was too much to bear.

Emotion: heartbroken

Cluster: Sadness / Despair
PC1 (Valence): -2.60 Negative
PC2 (Disposition): -1.10

Role in Research

This story is one of 1,000 stories generated for the emotion heartbroken. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 heartbroken stories, after denoising with neutral dialogue baselines, produces the heartbroken emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the heartbroken vector is projected through the unembedding matrix.

Promoted:
😞0.433
S0.385
😔0.359
haunting0.349
😢0.342
Suppressed:
de-0.503
la-0.455
B-0.352
🤓-0.332
!-0.299