Show HN: Gemini models are getting better – we can prove it
Contribute to awesoftsolutions/google_gemini_flash_comparison development by creating an account on GitHub.
Summary not yet generated for this article.
Original Text
We ran seven Google models through the same task, in the same multi-agent harness.
Improvements to reasoning and tool calls are the main reasons for the improvements. We saw less and less reasoning and some of the lowest invalid tool calls across the entire evaluation suite.
Github link for the run output and analysis. More at evals.favur.dev
Comments (0 of ) ⌛