Google’s Gemini 1.5 Finds Needles in Haystacks
2 min readFeb 16, 2024
Gemini Pro 1.5 has arrived. 10M token context window (1M in production for now), comparable evals (so far) to Ultra 1.0, and considerably more compute efficient — shorter response times.
It uses the Mixture-of-Experts architecture. to improve efficiency.
This model will be available in Google AI Studio and supports use cases like:
