Google's AI Overview Struggles with Basic Spelling
Google's AI Overview, integrated into its search engine, continues to make elementary spelling errors, such as miscounting the number of Ps in "Google" and misspelling "Trump" as "t-r-p-u-m." These mistakes stem from the token-based architecture of large language models (LLMs), which do not read text as humans do but instead convert it into numerical encodings. Researchers like Matthew Guzdial of the University of Alberta and Sheridan Feucht of Northeastern University explain that LLMs lack understanding of individual letters, making spelling a persistent challenge. Despite Google's efforts to patch issues, such as the "disregard" glitch, the company acknowledges the problem and is working on fixes. The errors highlight the limitations of AI, reminding users not to trust outputs blindly.
Key facts
- Google's AI Overview miscounts the number of Ps in 'Google'.
- AI Overview misspells 'Trump' as 't-r-p-u-m'.
- LLMs use token-based architecture, not letter-based reading.
- Matthew Guzdial is an AI researcher at the University of Alberta.
- Sheridan Feucht is a PhD student at Northeastern University.
- Google previously patched an issue with the word 'disregard'.
- Google told TechCrunch it is working to fix spelling issues.
- LLMs cannot reliably spell due to tokenization limitations.
Entities
Institutions
- TechCrunch
- University of Alberta
- Northeastern University
- The Onion