# Is ChatGPT accurate? How much should you trust AI answers

> ChatGPT and other AI assistants are useful but not reliably accurate. A BBC- and EBU-led study of more than 3,000 AI answers to news questions found 45% had at least one significant issue and 31% had serious sourcing problems. Treat answers as drafts, and verify anything involving money, health, law or public claims.

Source: https://shaaz.online/guides/is-chatgpt-accurate.html · Published 2026-10-04 · Updated 2026-10-05

Sometimes very, sometimes not at all, and it sounds equally sure either way. Here is what the evidence says and what to do about it.

## What the research found

- **Accuracy:** a study coordinated by the European Broadcasting Union and led by the BBC had journalists review more than 3,000 answers from ChatGPT, Copilot, Gemini and Perplexity. 45% of answers had at least one significant issue, 31% had serious sourcing problems (missing, misleading or incorrect attributions) and 20% had major accuracy problems such as invented details or out-of-date information.
- **Trust:** Wharton researchers Steven Shaw and Gideon Nave describe "cognitive surrender": adopting AI output with minimal scrutiny. In their experiments, people who consulted the chatbot followed its faulty advice in about 80% of those trials, and people with higher trust in AI were more likely to follow wrong advice.

## Why wrong answers sound right

Most chatbots predict the next piece of text. That is excellent for fluent sentences and weaker for facts and numbers, so an answer can be smooth and confident and still be wrong. The tone gives you no signal about accuracy.

## A practical rule: match the checking to the stakes

- **Low stakes** (brainstorming, first drafts, rephrasing): use it freely.
- **Medium stakes** (anything you will send to a client or colleague): run the three checks below.
- **High stakes** (money, health, legal matters, public claims): treat the AI answer as a starting point and verify it against a primary source.

## The three checks

1. Ask: "How sure are you, out of ten, and what would make you wrong?"
2. Make it show every step, and use a calculator or code for numbers.
3. Click every source and find the line that supports the claim.

The full routine is explained in [how to check AI answers](https://shaaz.online/guides/how-to-check-ai-answers.html), and the warning signs in [how to spot AI hallucinations](https://shaaz.online/guides/how-to-spot-ai-hallucinations.html).

## Sources

- [European Broadcasting Union and BBC: News Integrity in AI Assistants (October 2025), as reported by VRT](https://www.vrtinternational.com/news/largest-study-of-its-kind-shows-ai-assistants-misrepresent-news-content-45)
- [Shaw, S. and Nave, G.: Thinking, Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender (SSRN)](https://papers.ssrn.com/abstract=6097646)

## Frequently asked questions

**Is ChatGPT accurate?**
It is often useful but not reliably accurate. In a BBC- and EBU-led study of more than 3,000 AI answers, 45% had at least one significant issue. Verify anything that matters.

**Why does ChatGPT sound so confident when it is wrong?**
Chatbots predict fluent text, so wrong answers read just as smoothly as right ones. Confidence in the tone is not evidence of accuracy.

**When can I trust AI without checking?**
For low-stakes work such as brainstorming and first drafts. For money, health, legal matters or anything you will repeat publicly, check it against a primary source.