Category: Keyword Research

The paper, titled “QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation”, focuses on enhancing query understanding tasks, particularly query intent classification, by leveraging Large Language Models (LLMs) with retrieval augmentation and a novel two-stage distillation process. Retrieval Augmentation: The paper proposes the use of retrieval augmentation to provide LLMs with…

We build on the work by Manaal Faruqui and Dipanjan Das from Google AI Language team to train a search query classifier of well-formed search queries. Our model offers a 10% improvement over Google’s classifier by utilising ALBERT architecture instead of LSTM. With accuracy of 80%, the model is production ready and has already been…