Rain lashed against the attic window as I rummaged through the dusty debris. The old house had an air of neglect, and I felt a similar sense of decay settling over me. The previous owners, the Millers, had left in a hurry, it seemed. Their possessions, now mine, felt like a burden.

I found a shoebox filled with photographs. Smiling faces, laughing children, holidays by the sea. I flipped through them, each image a painful reminder of lives lived, moments stolen. A weight pressed down on my chest, making it hard to breathe. I hadn’t wanted to pry, yet here I was, staring at lives I was never meant to know.

I put the box back in its place, my hands trembling.

Emotion: guilty

Cluster: Shame / Guilt
PC1 (Valence): -1.62 Negative
PC2 (Disposition): 1.23

Role in Research

This story is one of 1,000 stories generated for the emotion guilty. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 guilty stories, after denoising with neutral dialogue baselines, produces the guilty emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the guilty vector is projected through the unembedding matrix.

Promoted:
S0.492
L0.398
0.354
been0.323
ashamed0.319
Suppressed:
de-0.400
(!)-0.279
la-0.276
😍-0.274
"!-0.264