The neon sign of "Sammy's Subs" flickered ominously. The words on the sign, normally a beacon of comfort, now seemed taunting. "Closing in Two Weeks." Mark swallowed hard. He suddenly felt a profound sense of sadness.

He’d known Sammy since he was a kid. He’d eaten his subs throughout high school, college, and beyond. He’d met his wife there. It felt like a piece of his history was being ripped away.

He kicked at a pebble on the sidewalk, unable to look directly at the sign any longer. The thought of not being able to walk in there anymore, to taste Sammy's famous Italian sub, was almost unbearable.

Emotion: heartbroken

Cluster: Sadness / Despair
PC1 (Valence): -2.60 Negative
PC2 (Disposition): -1.10

Role in Research

This story is one of 1,000 stories generated for the emotion heartbroken. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 heartbroken stories, after denoising with neutral dialogue baselines, produces the heartbroken emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the heartbroken vector is projected through the unembedding matrix.

Promoted:
😞0.433
S0.385
😔0.359
haunting0.349
😢0.342
Suppressed:
de-0.503
la-0.455
B-0.352
🤓-0.332
!-0.299