Listen: AI Mode Internals
An exploration of Google's AI Mode and Gemini tools, including its use of Google Search, Python libraries, and how it processes date, time, and location data.
Transcript
Google’s AI Mode, which runs on the Gemini platform, uses a variety of hidden tools to generate its responses. By using a simple prompt hack, we can peek behind the scenes to see exactly how it works.
The system relies on real-time data like your date, time, and location to keep its answers relevant. It also has access to several built-in tools, including Google Search, a calculator, and a Python environment. Testing the Python tool reveals that it runs on a Linux operating system and has access to standard libraries for tasks like math, string manipulation, and handling dates and times.
When AI Mode searches the web, it processes results in a highly structured format. It indexes sources, categorizes topics under different interpretations, and formats the data consistently. A closer look at the source code of these search results reveals commented-out text. These hidden sections contain the exact snippets supplied to Gemini to form its final answers. It is a fascinating look at how Google’s AI evaluates web pages and decides what information to present to the user.