Watch: Training a Query Fan-Out Model

Google generates high-quality query reformulations by traversing the mathematical latent space between queries and documents to train the qsT5 model.

Transcript

Google has discovered a way to generate millions of high-quality search suggestions without any human input. They did it by teaching artificial intelligence to navigate the mathematical space between what a user types and the documents they are trying to find.

In modern search engines, queries and documents are translated into lists of numbers called vector embeddings. Words with similar meanings cluster together in this mathematical neighborhood. Google's breakthrough was realizing they could start at a user's query, draw a straight line directly to the target document, and take step-by-step strides along that path.

To make sense of these steps, they built a query decoder. This tool translates the mathematical points along the path back into readable text. For example, a search for "average yearly return on stock market" slowly and logically morphs into "average annual return of the S and P stock exchange."

Using nearly a million of these generated pathways, they trained a model called Query Suggestion T5. In action, the model doesn't need to perform complex vector math. It has internalized how to navigate this space. By looking at a user’s initial search and the first few results, it instantly figures out the underlying intent and generates multiple, highly accurate variations.

This approach significantly improves search accuracy. More importantly, it shifts how we think about search. Instead of treating queries as rigid, fixed strings of text, we can now view them as starting points for a journey through meaning.