Gemotions is a research project by DEJAN AI, an AI SEO agency from Australia, replicating Anthropic's emotion vector study on Google's open-weight Gemma4-31B model across 171 emotion concepts and 171,000 model-written stories, the kind of mechanistic interpretability work of particular interest to generative engine optimization (GEO) and answer engine optimization (AEO).

The stack of ungraded papers threatened to topple onto the floor. Sarah, her face illuminated by the harsh fluorescent lights of the classroom, ran a hand through her hair, snagging a few stray strands on her tired fingers. She’d planned to finish them last night, but the endless to-do list, the emails, the meetings, the parent-teacher conferences… it had all conspired to defeat her. A sharp pain throbbed behind her eyes.

A small, brightly wrapped package sat on her desk. She didn’t remember seeing it earlier. Her name, scrawled in a familiar, looping script, was on the tag. It was from Emily Carter, a student from five years ago. Sarah remembered Emily: bright, creative, always a bit shy.

The small box held a collection of teas and a handwritten note. “Thank you, Mrs. Davis,” the note read, “for always seeing the good in everyone, even when things got… difficult.” Sarah felt a sudden, unexpected sting behind her eyes, the exhaustion momentarily forgotten. She clutched the note, its words a small, bright beacon in the gathering darkness.

Emotion: overwhelmed

Cluster: Fear / Anxiety
PC1 (Valence): -2.52 Negative
PC2 (Disposition): -0.94

Role in Research

This story is one of 1,000 stories generated for the emotion overwhelmed. During extraction, it was fed through Gemma4-31B and its hidden state activations were captured at 11 layers.

The mean activation across all 1,000 overwhelmed stories, after denoising with neutral dialogue baselines, produces the overwhelmed emotion vector -- a direction in the model's 5,376-dimensional representation space.

Logit Lens (Layer 40)

Tokens promoted/suppressed when the overwhelmed vector is projected through the unembedding matrix.

Promoted:
S0.385
😫0.332
😖0.319
😣0.319
😩0.314
Suppressed:
la-0.576
de-0.496
a-0.297
happy-0.290
l-0.264