← back

Introducing eCommerce Optimization Engine

The eCommerce Optimization Engine uses Google's multimodal embedding model to align product text with images to improve search retrieval and SEO performance.

Listen

Search is changing. When modern artificial intelligence assistants and search engines rank your products, they increasingly compare your product images with your product text in a single, shared space. If your titles, captions, and descriptions drift away from what your photos actually show, you lose search visibility. The eCommerce Optimization Engine is designed to solve this by measuring and improving that alignment. Using Google’s multimodal embedding model, the engine places images and text into the same space and calculates a match score. Then, it automatically rewrites and re-scores the text until the wording matches the image as tightly as possible. The system runs in three modes. First, it can simply check the similarity of any image and text combination. Second, it can run an automated rewrite loop, learning from previous attempts to drive the score up. Finally, it allows a human operator to step in and guide the model with specific tips, like pointing out a color or a design feature. Through building this engine, we learned that concrete beats clever. Literal, highly descriptive wording wins every time, while promotional language and keyword stuffing fail. Clean product shots on plain backgrounds produce the strongest alignment. Ultimately, copy that genuinely describes what is in the frame will perform better than copy that relies on adjectives the picture cannot back up. This tool turns that optimization process from guesswork into a repeatable, measurable science.

Search is going multimodal. When an AI assistant or a modern search index decides whether your product answers a shopper's query, it increasingly compares the meaning of your product image against the meaning of your product text in a single shared space. If your title, alt text, and description drift away from what the photo actually shows, you lose alignment, and alignment is a key retrieval signal. The eCommerce Optimization Engine measures that alignment and then improves it.

What it does

Point it at a product image and a piece of text, and it returns a match score: how closely the words and the picture sit together in a multimodal embedding space. Then it goes to work, rewriting the text and re-scoring each version until the wording lines up with the image as tightly as the model allows.

Under the hood it uses Google's multimodal embedding model, which places images and text into the same vector space. The closer the two points, the stronger the match.

How it works

The engine runs in three modes, from hands-off to hands-on.

Similarity check. Score any caption against any image instantly. Tweak a word, test again, and watch the number move. It is a fast way to see which phrasings the model actually rewards.

Rewrite loop. The engine drafts a rewrite, scores it, feeds the result back, and drafts again. Every attempt sees the full history and its scores, so it learns which phrasings raised the match and which dropped it. The score climbs live on a chart as it runs.

Keep going, with a human in the loop. When a run stalls, an operator can extend it by another ten steps and hand the model a tip: "mention the brown gum sole," "lead with the colour." The tip steers the next attempt, then the model explores freely from there. Human intuition and machine search, taking turns.

What we learned

A few findings stood out while building it.

Concrete beats clever. Literal, visual wording wins every time. "Emerald green athletic shoe with three white stripes, white heel, mesh panels, and a brown gum sole" scores far higher than anything abstract or promotional. Comma-spliced keyword lists score worse than plain sentences.

Clean product shots reach the top. A single product on a plain background, described precisely, produced the strongest alignment we recorded. That is exactly the eCommerce case, and the model handles it best.

There is a ceiling, and it is reachable. Most strong matches plateau, but a sharp product photo with a well-built caption pushed past the top of our scale. The gains taper as you approach it, so the engine knows when to stop.

A short human nudge breaks plateaus. When automated rewriting circled the same phrasing, one operator tip was enough to jump the score again.

Why it matters for eCommerce SEO

Product titles, alt text, image captions, and feed attributes are no longer just for human readers or keyword matching. They are the text half of a multimodal comparison that AI search runs against your imagery. Copy that genuinely describes what is in the frame will retrieve better than copy that reaches for adjectives the picture cannot back up.

The engine turns that from guesswork into a measured, repeatable loop: score, rewrite, verify, and keep the version that wins.

See it on your catalogue

We are running this against real product imagery now. If you want to see how your listings score, and how much room there is to improve them, book a call.

Appendix: Actual Run Data

StepTextScoreChange
0Green shoe.47%n/a
1Teal and white athletic shoe with a gum sole.72%+25.1%
2Teal green athletic shoe, white stripes, gum sole, mesh fabric.79%+6.4%
3Green and white athletic shoe with three white stripes and a gum sole.80%+1.4%
4Green and white athletic shoe with three white stripes, mesh panels, and a brown gum sole.84%+4.1%
5Side view of a green and white athletic shoe, with mesh panels and a brown gum sole.83%-0.8%
6Green and white athletic shoe with three white stripes, mesh panels, and a ridged brown gum sole.81%-1.8%
7A single green and white athletic shoe, with mesh panels and a brown gum sole, viewed from the side.81%-0.6%
8Green and white athletic shoe, with three white stripes, mesh sides, and a brown gum sole.83%+2.4%
9Green and white athletic shoe, three white stripes, mesh panels, and a brown gum sole.80%-3.7%
10Emerald green athletic shoe with three white stripes, white heel tab, mesh panels, and a brown gum sole.94%+14.7%
11Emerald green athletic shoe with three white stripes, white heel tab, mesh sides, and a brown gum sole.95%+1.0%
12Emerald green athletic shoe with three white stripes, white heel tab, mesh panels, and a brown gum sole, side view.100%+4.4%
13Emerald green athletic shoe with three white stripes, white heel, mesh panels, and a brown gum sole, side view.100%+1.1%
14Emerald green athletic shoe with three white stripes, white heel tab, mesh panels, and a brown gum sole. repeat of an earlier attempt95%-5.7%
15Emerald green athletic shoe with white stripes, white heel, mesh panels, and a brown gum sole, side view.100%+7.9%
16Emerald green athletic shoe with three white stripes, white heel tab, mesh panels, and a brown gum sole, side view. repeat of an earlier attempt100%-3.3%
17Emerald green athletic shoe with three white stripes, white heel tab, mesh panels, and a brown gum sole, side view. repeat of an earlier attempt100%-0.0%
18Emerald green athletic shoe with three white stripes, white heel, mesh panels, and a brown gum sole, side view. repeat of an earlier attempt100%+1.1%
19Emerald green athletic shoe with three white stripes, white heel tab, mesh panels, brown gum sole, side view.99%-1.7%
20Emerald green athletic shoe with three white stripes, white heel, mesh panels, and a brown gum sole.96%-3.1%

Image Credit: Bstore.


Dan Petrovic · Jul 09, 06:39