Auto-Filling SEO Website as a Gift

Launch Your AI-Powered Business and get clients!

No advertising investment needed—just results. AI finds, negotiates, and closes deals automatically

March 14, 2025, 10:20 a.m.
174

Study Reveals Accuracy Issues with AI News Search Tools

A recent study by the Columbia Journalism Review's Tow Center for Digital Journalism reveals significant accuracy problems with generative AI models used for news searches. Testing eight AI-driven search tools, researchers found that over 60% of queries yielded incorrect information about news sources. About 25% of Americans currently use these AI models instead of traditional search engines, raising concerns about their reliability. The error rates varied among different tools. For instance, Perplexity made mistakes in 37% of queries, while ChatGPT Search saw a 67% error rate (134 out of 200 queries). Grok 3 had the highest at 94%. To conduct the tests, researchers provided direct excerpts from real news articles and asked the AI tools to identify corresponding details like headlines, publishers, dates, and URLs, totaling 1, 600 queries. A concerning trend noted was that instead of declining to answer when unsure, the models often offered plausible-sounding but erroneous responses, a pattern consistent across all tools tested. Premium versions of these AI tools, like Perplexity Pro ($20/month) and Grok 3's premium service ($40/month), sometimes performed worse, as they frequently provided incorrect answers despite correctly address a higher number of prompts. Their tendency to offer uncertain responses contributed to higher overall error rates. The study also raised issues regarding publishers' control over their content.

Some AI tools ignored the Robot Exclusion Protocols meant to prevent unauthorized access to certain content. For instance, Perplexity’s free version identified excerpts from paywalled National Geographic articles, even though access was explicitly disallowed. Furthermore, when AI tools did cite sources, they often linked to syndicated content on sites like Yahoo News instead of original publishers. A significant problem arose with URL fabrication—over half of the citations from Google's Gemini and Grok 3 led to broken or non-existent pages, with Grok 3 having 154 out of 200 citations result in error pages. This situation places publishers in a difficult position: blocking AI crawlers could eliminate attribution, while allowing access facilitates content reuse without benefiting the original sites. Mark Howard, COO of Time magazine, expressed concerns regarding transparency and control, but also suggested potential for improvement, stating that current AI tools will evolve positively. Howard pointedly criticized users who expect complete accuracy from free AI services, suggesting that skepticism is necessary. OpenAI and Microsoft acknowledged the study's findings but did not directly respond to the issues raised. OpenAI emphasized its commitment to supporting publishers, while Microsoft claimed compliance with Robot Exclusion Protocols. This report builds on earlier findings from November 2024, which similarly highlighted accuracy issues with ChatGPT's handling of news content. For further details, the full report is available on the Columbia Journalism Review's website.



Brief news summary

A recent study from the Tow Center for Digital Journalism, covered by the Columbia Journalism Review, reveals critical accuracy issues with generative AI tools used for news searches. Researchers examined eight AI systems and found that over 60% of news queries returned incorrect information, despite the fact that about 25% of Americans prefer these AI tools over traditional search engines. The error rates varied significantly, with Perplexity at 37%, ChatGPT Search at 67%, and Grok 3 alarming at 94%. Analyzing 1,600 queries, the study showed that AI tools frequently provided plausible but false information, even with limited training. Notably, some premium services, like Grok 3, performed worse than free alternatives. Other concerns included non-compliance with Robot Exclusion Protocols, unauthorized access to paywalled content, and reliance on syndicated sources, resulting in broken links. These issues present major challenges for publishers utilizing free AI tools. Although OpenAI and Microsoft acknowledged the findings, they did not specifically respond to the highlighted problems. For further information, refer to the Columbia Journalism Review’s website.
Business on autopilot

AI-powered Lead Generation in Social Media
and Search Engines

Let AI take control and automatically generate leads for you!

I'm your Content Manager, ready to handle your first test assignment

Language

Learn how AI can help your business.
Let’s talk!

Hot news

July 7, 2025, 2:18 p.m.

Kinexys Launches Carbon Market Blockchain Tokeniz…

Kinexys by J.P. Morgan, the firm’s leading blockchain business unit, is developing an innovative blockchain application on Kinexys Digital Assets, its multi-asset tokenization platform, aimed at tokenizing global carbon credits at the registry level.

July 7, 2025, 2:15 p.m.

Ford CEO Jim Farley warns AI will wipe out half o…

Ford CEO Jim Farley recently emphasized the critical role of the “essential economy” and blue-collar skilled trades while forecasting that artificial intelligence will halve the number of white-collar jobs in the U.S. He has become the latest executive to raise concerns over AI’s impact on workers, joining voices like Amazon’s CEO, who last month announced that the company’s corporate workforce will shrink because of AI.

July 7, 2025, 10:27 a.m.

Cryptocurrency Theft Losses Reach Record High in …

In the first quarter of 2025, the cryptocurrency industry saw a dramatic surge in theft losses, totaling an unprecedented $1.63 billion.

July 7, 2025, 10:15 a.m.

AI in Education: Personalized Learning Experiences

In recent years, the education sector has experienced a notable shift toward integrating artificial intelligence (AI) to enhance learning experiences.

July 7, 2025, 6:46 a.m.

New Push for National AI Rules Likely After State…

A recent effort to impose a decade-long moratorium on state-level artificial intelligence (AI) regulations through the Republican budget bill, led by Senator Ted Cruz and supported by industry groups, has faced significant setbacks, revealing the growing complexities of AI governance in the U.S. The proposal aimed to prevent states from enacting individual AI policies to avoid a fragmented regulatory landscape that could hinder innovation and burden multi-state companies.

July 7, 2025, 6:27 a.m.

Investors Pile into Tokenised Treasury Funds

Crypto companies and investors are increasingly channeling funds into tokenised versions of money market and Treasury bond mutual funds as alternatives to stablecoins for parking excess cash while earning yield.

July 6, 2025, 2:15 p.m.

What is Blockchain? Demystifying the ledger that …

Best known as the technology powering Bitcoin, blockchain is emerging as a trustless, tamper-proof system with the capacity to revolutionize sectors from finance to healthcare.

All news