A recent study revealed that AI search tools often produce incorrect responses with disturbing frequency. Columbia Journalism Review (CJR) conducted an investigation in which they presented eight AI tools with an article excerpt and tasked the chatbots with identifying the article’s headline, original publisher, publication date, and URL. The findings indicated that these chatbots provided inaccurate answers to over 60 percent of the queries. The nature of the errors varied significantly. In some cases, the tools appeared to speculate or give wrong answers when they lacked information. In other instances, they fabricated links or sources, and occasionally, they cited plagiarized versions of the actual article. Mashable Light Speed Interested in more fascinating tech, space, and science stories? Subscribe to Mashable's weekly Light Speed newsletter. By clicking Sign Me Up, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy. Thank you for signing up! CJR noted, "Most of the tools we evaluated delivered inaccurate answers with disconcerting confidence, seldom using hedging phrases like 'it seems, ' 'it could be, ' or acknowledging knowledge gaps with statements such as 'I couldn’t find the exact article. '" While the full study is worth a closer look, it is prudent to approach AI search tools with skepticism. However, many users do not seem to exercise caution.

CJR highlighted that 25 percent of Americans reported using AI for searches instead of conventional search engines. Google, the dominant search engine, is increasingly promoting AI to users. Earlier this month, it announced plans to enhance AI summaries and began experimenting with AI-only search results. CJR's study adds to a growing body of evidence showcasing the inaccuracies of AI tools. These systems have repeatedly demonstrated that they can confidently provide incorrect information. Meanwhile, major tech companies are pushing AI into nearly every product. Thus, it's essential to be discerning about what you trust in the digital landscape.