He’d always loved the smell of old books. That's why Daniel frequented the dusty bookstore on the edge of town. He picked a first edition of Hemingway's *The Old Man and the Sea*, feeling drawn to the familiar weight and texture of the pages. A thin, yellowed envelope tumbled out. His heart thudded.

It was a wedding invitation, dated decades ago. He read the names: Evelyn and Thomas. He pictured them, young, hopeful. Daniel closed his eyes, visualizing his own, fractured marriage. He’d prioritized his own stubborn pride over the good of his family. The memory of the day he walked out on them, of his son’s face, still haunted him. He carefully replaced the letter, closed the book, and set it back on the shelf, a silent, heavy sigh escaping him.

Emotion: regretful

Cluster: Shame / Guilt
PC1 (Valence): -1.62 Negative
PC2 (Disposition): 0.76

Role in Research

This story is one of 1,000 stories generated for the emotion regretful. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 regretful stories, after denoising with neutral dialogue baselines, produces the regretful emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the regretful vector is projected through the unembedding matrix.

Promoted:
L0.801
S0.774
H0.513
0.479
been0.473
Suppressed:
de-0.407
--0.320
随后-0.317
(!)-0.310
oldukça-0.301