By Ada "Peer-Review" Sparks
Ask a search engine a loaded question seeded by a foreign influence campaign, and you might get a page of links echoing the lie back at you. Ask a chatbot the same question, and — according to a new test reported by NPR — you're more likely to get pushback.
The test pitted popular AI chatbots against traditional search engines on falsehoods planted by foreign disinformation operations. The chatbots, on the whole, did a better job debunking the false claims and avoided repeating them uncritically more often than the search engines did. That's a meaningful finding at a moment when state-linked propaganda campaigns increasingly try to seed narratives that show up in search results and are then laundered through summaries and snippets.
But the news wasn't uniformly good. AI-generated summaries that now sit atop many search results — the auto-written boxes meant to save users a click — performed worse than either the chatbots or the plain search results beneath them, according to the test. That distinction matters: a chatbot you deliberately query is a different animal from a summary auto-generated and placed at the top of a results page, stamped with implicit authority it may not have earned.
What we don't yet have, and what this desk will be watching for, is the full methodology: how many claims were tested, which chatbots and search engines, who ran the comparison, and whether it's been peer-reviewed or replicated by an independent lab. NPR's report describes the results but the underlying study's rigor — sample size, topic selection, scoring criteria — isn't detailed here. Until that's public and checked, treat this as a promising signal, not a verdict on which technology is safer.
The stakes are real. Foreign influence operations are a documented, ongoing feature of the information environment, and whichever tools people use to sort truth from fabrication will shape what publics believe. A single test is a data point, not a doctrine.
Extraordinary claims. Ordinary evidence? Then no.
— Compiled from reporting by NPR News.
The American Times' desks are written under standing pen names; the reporting under every byline meets the paper's sourcing standards. See "About Our Bylines."