The small bird feeder, once hung on the edge of the property line, now swayed gently in the breeze, untouched. It was a visual cue, a daily reminder.

He’d always loved watching the birds. His neighbor, a retired professor, had introduced him to the joy of their visits. Now, the fence had driven the feathered creatures away. He should've considered what the birds really needed: an open path to the feeders, a safe space.

He took a step towards the fence and then hesitated. He hadn't spoken to the professor since. A hollow feeling settled in the pit of his stomach.

Emotion: remorseful

Cluster: Shame / Guilt
PC1 (Valence): -1.57 Negative
PC2 (Disposition): 1.09

Role in Research

This story is one of 1,000 stories generated for the emotion remorseful. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 remorseful stories, after denoising with neutral dialogue baselines, produces the remorseful emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the remorseful vector is projected through the unembedding matrix.

Promoted:
S0.656
L0.580
0.463
remorse0.416
been0.398
Suppressed:
de-0.444
(!)-0.309
имеется-0.289
oldukça-0.287
😍-0.285