The photograph lay on the table. A faded image of him and Lily, children, beaming at the camera, their faces smudged with dirt. He’d brought it to her, a gesture of remembrance. He found her at a book reading, a small gathering of people.

"Lily?" he asked, trying to sound casual, confident.

She glanced up, her expression politely curious. "Yes?"

He showed her the picture, pointing at the two small figures. "Do you remember…?" His voice trailed off, the words dissolving into the air.

She studied the photo, her face blank. “I’m sorry, I don’t recognize it.” He felt as if a vital piece of him had been ripped away. The room seemed to tilt slightly, and the sounds around him dimmed. He quietly left the event, his mind reeling.

Emotion: heartbroken

Cluster: Sadness / Despair
PC1 (Valence): -2.60 Negative
PC2 (Disposition): -1.10

Role in Research

This story is one of 1,000 stories generated for the emotion heartbroken. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 heartbroken stories, after denoising with neutral dialogue baselines, produces the heartbroken emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the heartbroken vector is projected through the unembedding matrix.

Promoted:
😞0.433
S0.385
😔0.359
haunting0.349
😢0.342
Suppressed:
de-0.503
la-0.455
B-0.352
🤓-0.332
!-0.299