Checking accuracy: hallucinations and verification
Learn why ChatGPT sometimes invents facts and a simple routine for checking sources, numbers and high-stakes answers.
In this lesson you will
- Explain why hallucinations happen
- Judge how much checking an answer needs
- Follow a five-step verification routine
- Write prompts that reduce guessing
About 16 minutes
The confident liar problem
A law student once asked an AI tool for court cases to support an argument. The tool produced six neat citations with case names, dates and quotations. Every one looked real. When someone tried to look them up, none of them existed. The tool had invented them, with perfect confidence. This is the most important thing to understand about ChatGPT: fluent does not mean correct. The good news is that a handful of simple habits protect you almost completely, and they take only a minute.
Why hallucinations happen
ChatGPT builds sentences that fit patterns, and fitting a pattern is not the same as being true. When it does not know something, it does not always say so. A convincing answer is often easier to produce than an honest “I do not know”. Some situations make wrong answers more likely:
- Specific facts: exact dates, statistics, quotes, page numbers, prices.
- Sources and citations: book titles, article names, web addresses, legal cases.
- Obscure topics: small local businesses, niche subjects, little-known people.
- Very recent events, beyond its training cut-off, unless it is searching.
- Multi-step maths and counting done in its head.
- Leading questions: if you assume something false, it may play along.
A quick risk check
| If the answer is about… | Risk if wrong | What to do |
|---|---|---|
| A recipe idea or party theme | Low | Just use it |
| A draft email or social post | Low to medium | Read it, fix details |
| Facts in a school essay or work report | Medium | Verify each fact in a reliable source |
| Health, medicine or mental wellbeing | High | Check with a qualified professional |
| Law, tax or contracts | High | Check with a qualified professional |
| Money and investments | High | Check official sources and an adviser |
| Safety, such as electrical or chemical work | High | Follow official instructions and experts |
The five-step verification routine
- Spot the claims. Underline names, numbers, dates, quotes and anything that sounds surprising.
- Ask for sources, then open them. A real source can be found; an invented one cannot.
- Cross-check one or two key facts in an official or trusted website, a textbook or an expert.
- Ask it to doubt itself: “How confident are you? What might be wrong?”
- Get a second opinion: ask again in a new chat or compare with a different tool.
Prompts that reduce errors
Answer only if you are fairly sure. If you are not sure, say 'I am not sure' instead of guessing. Do not invent sources.
List the main claims in your answer, then mark each one as well-established, debated, or uncertain.
Using only the text I paste below, answer my question. If the answer is not in the text, say so.
[paste text]
What is the strongest argument against what you just told me?
Using web search and citations
In many versions, ChatGPT can search the web and show links to the pages it used. That is a big help for recent information, because you can click through. But even then, open the sources. Check that the page actually says what the answer claims, and that it is a trustworthy site, not an unreliable blog or a copy of another page.
Check the maths
A shop sells 3 pens at Rs 45 each and 2 notebooks at Rs 120 each, with 10 percent discount on the total. Show each step of the calculation and the final price.
Asking for each step lets you check the working yourself. For anything important, double-check on a calculator. Some versions can run code behind the scenes to calculate more accurately, but you should still confirm the result makes sense.
Bias and one-sided answers
ChatGPT learned from human writing, so it can reflect the biases and gaps of that writing. Be careful with questions on politics, culture, people and groups. Ask for several perspectives, ask what evidence exists on each side, and remember that a smooth summary may hide a lively debate.
Give me the strongest arguments on both sides of this debate, fairly, and say where the evidence is strong or weak.
A worked example
You ask: “Give me three statistics about sleep and productivity, with sources.” A careless user copies them into a report. A careful user does this instead:
- Copies each statistic and source name.
- Searches for each source. One report does not exist; one number is different from the original.
- Replaces the false ones with figures from the real pages, and cites those pages.
- Keeps the helpful idea for the paragraph, using verified numbers.
It took five extra minutes and saved them from publishing false information under their name.
Believing a source because it has a real-looking title, author and year. Invented citations look exactly like real ones. Search for the title yourself.
Asking “Are you sure?” and treating a confident “Yes” as proof. It may repeat the same mistake. Check with a source outside the chat.
Do not fact-check a joke or a gift idea. Do check anything that could cost money, hurt someone, embarrass you or mislead other people.
Check what you learned
Five quick questions. Pick an answer and you will see straight away whether it is right and why.
What is a hallucination?
- A very long answer
- A blurred picture
- A confident answer that is wrong or invented
- A typing error
The text sounds right but is not true.
Which items are most likely to be invented?
- Citations, statistics and quotes
- Greetings
- Common words
- Punctuation
Specific facts and sources need checking.
What should you do with a source it gives you?
- Trust it automatically
- Delete it
- Search for it and open it
- Translate it
Real sources can be found; invented ones cannot.
Which topic needs a qualified professional?
- Medical or legal decisions
- Party themes
- Rhyming words
- Colour ideas
High-stakes advice needs expert checking.
A good way to reduce guessing is to…
- Demand an answer at any cost
- Allow it to say ‘I am not sure’
- Hide your question
- Use only capitals
Permission to admit uncertainty reduces made-up answers.
Summary
- Fluent does not mean correct.
- Specific facts, sources and numbers need checking.
- Verify in proportion to the stakes.
- Allow it to say it is unsure and anchor it to your own text.
Questions
Does paying for a better plan stop hallucinations?
Stronger models usually make fewer mistakes, but no version is perfect. You still need to check important facts.
How do I check a source quickly?
Search for the exact title in a search engine or library site, and open the page to see if it says what ChatGPT claimed.
Can I ask ChatGPT to check its own answer?
It can help find weak spots, but it can repeat the same error. Always confirm key facts outside the chat.
