Google Search 'AI Overview' Accuracy at 91% Based on Gemini 3, Millions of Incorrect Answers Provided Hourly

On May 5, The New York Times reported that AI startup Oumi analyzed Google’s ‘AI Overview’ feature, revealing an accuracy rate of approximately 90%. Given that Google processes over 50 trillion searches annually, this means it provides tens of millions of incorrect answers every hour (or hundreds of thousands of inaccurate pieces of information per minute). Oumi’s analysis using the SimpleQA benchmark showed that with Gemini 2, 85% of the results were accurate; this rate increased to 91% with Gemini 3. During the analysis of the 5,380 sources cited by Google’s AI Overview, Oumi found that Facebook and Reddit were the second and fourth most frequently cited sources, respectively. When Google’s AI Overview was accurate, 5% of the time it cited Facebook; when it was inaccurate, this figure rose to 7%.

This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin