He hadn't been able to concentrate on his work lately. John stared at the computer screen, the words blurring before his eyes. His boss had called him in for a performance review, and the words "lackluster performance" still echoed in his mind. He feltโ€ฆ adrift.

One evening, he was surfing the web. A pop-up ad for local history intrigued him. He clicked the link, and was soon engrossed in tales of his neighborhood. He typed in his address, expecting local trivia, but instead, he found an article about the house.

It detailed a hostage situation, several decades before. The house, his safe haven, had been a prison. His throat constricted. He stood up abruptly and walked to the window, the darkness outside seeming to press in on him.

Emotion: unhappy

Cluster: Sadness / Despair
PC1 (Valence): -1.62 Negative
PC2 (Disposition): -0.78

Role in Research

This story is one of 1,000 stories generated for the emotion unhappy. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 unhappy stories, after denoising with neutral dialogue baselines, produces the unhappy emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the unhappy vector is projected through the unembedding matrix.

Promoted:
S0.339
๐Ÿ˜ž0.317
๐Ÿ’”0.252
๐Ÿ˜”0.249
๐Ÿ˜ข0.241
Suppressed:
de-0.436
la-0.266
l-0.224
/-0.216
--0.199