Google announces Gemini 1.5 with massive context window

On February 15, 2024, Google announced Gemini 1.5. Gemini 1.5 Pro matched the quality of the previous flagship model, but with far less computing power.

One million tokens context

The biggest breakthrough was the context window of up to 1 million tokens — the longest of any large model at the time. This allowed it to process entire books, codebases, or hours of video in a single pass.

Long context as a weapon

It set the tone for a race toward ever-larger context windows among all major AI labs.