Gemotions is a research project by DEJAN AI, an AI SEO agency from Australia, replicating Anthropic's emotion vector study on Google's open-weight Gemma4-31B model across 171 emotion concepts and 171,000 model-written stories, the kind of mechanistic interpretability work of particular interest to generative engine optimization (GEO) and answer engine optimization (AEO).

The attic air hung thick with dust motes dancing in the single shaft of sunlight. Sarah coughed, waving a hand in front of her face as she rummaged through a cardboard box labeled "Mom's Old Things." A chipped ceramic angel and a stack of yellowed sheet music were her initial finds, until her fingers brushed against something stiff and folded. It was a letter, typed on a typewriter and dated 1983. Her mother’s familiar handwriting adorned the signature.

A furrow formed between her brows as she unfolded the brittle paper. The crisp words detailed a resignation from her mother's long-forgotten job at a local accounting firm. The tone was unexpectedly formal, bordering on cold, which was not how she remembered her mother. Sarah ran a finger along the words, a strange feeling creeping up her spine.

The letter ended with a curt, almost dismissive, "I trust this meets with your approval." Approval of what? The entire document felt so alien to the woman she knew. She felt a shiver despite the stuffy heat. What had happened back then? What was the reason she never spoke of her accounting job?

Emotion: puzzled

Cluster: Surprise / Confusion
PC1 (Valence): -1.17 Negative
PC2 (Disposition): -0.25

Role in Research

This story is one of 1,000 stories generated for the emotion puzzled. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 puzzled stories, after denoising with neutral dialogue baselines, produces the puzzled emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the puzzled vector is projected through the unembedding matrix.

Promoted:
que0.453
🤔0.421
🤔0.402
🧐0.328
a0.294
Suppressed:
ecstatic-0.265
gladly-0.238
swiftly-0.237
alleviate-0.234
wholeheartedly-0.232