AI hallucinations: why AI makes things up, and how to reduce it

What AI hallucinations are, why language models produce confident errors, and the practical techniques businesses use to keep answers accurate.

By the UK Technology Hub teamPublished 4 minute read

The short answer

An AI hallucination is a confident answer that isn't true or isn't supported by the source material. It happens because language models generate likely-sounding text rather than looking up verified facts. You can't eliminate it completely, but you can reduce it sharply by grounding answers in your own documents, instructing the model to admit uncertainty, requiring citations, testing on real questions and keeping people in the loop.

Ask an AI model about an obscure topic and it may give you a fluent, detailed, completely wrong answer. This is called hallucination. For casual use it's an annoyance; for a business, it can mean misleading customers, citing laws that don't exist or quoting prices you never set.

Why hallucinations happen

Language models are trained to produce plausible continuations of text. When the model has strong patterns to draw on, plausible usually means correct. When it doesn't, plausible can mean invented. Several factors make this worse:

  • Missing information. The answer isn't in the model's training data or the context you provided.
  • Ambiguous questions. The model guesses what you meant.
  • Pressure to answer. Models are trained to be helpful, which can bias them toward giving an answer rather than saying "I don't know."
  • Long or complex reasoning, where small errors compound.
  • Outdated knowledge from a training cut-off.

Our guide to what a large language model is explains the underlying mechanics.

Common types of hallucination

  • Invented facts: dates, statistics, names or prices that don't exist.
  • Fake citations: references to articles, cases or documents that were never written.
  • Misread sources: a summary that says the opposite of the original.
  • Overconfident reasoning: a calculation or conclusion with a hidden mistake.
  • Policy invention: a customer chatbot promising a refund or discount that isn't on offer.

How to reduce hallucinations

1. Ground answers in your own content

Retrieval-augmented generation gives the model the relevant passages from your documents at the moment it answers. With instructions to answer only from that material, the model has far less reason to invent. Our guide to embeddings and vector databases explains how retrieval works.

2. Give permission to say "I don't know"

Tell the model explicitly: "If the answer isn't in the information provided, say you don't know and offer to connect the user with a person." This simple instruction makes a noticeable difference.

3. Require citations

Ask the model to point to the source passage for each claim. Then check that the cited passage actually supports the claim, automatically where possible.

4. Narrow the scope

A chatbot that only answers questions about your delivery policy is far less likely to wander into invention than one that answers anything. Set clear topics and refuse out-of-scope requests politely.

5. Use structured outputs

When the model fills in specific fields, such as product name, price and availability, it's easier to validate each value against your database.

6. Validate automatically

Check numbers against source systems, verify links exist, confirm that quoted text appears in the source and reject answers that fail.

7. Choose the right model and settings

More capable models generally hallucinate less on complex tasks. Lower randomness settings, often called temperature, can make answers more consistent for factual work.

8. Keep humans in the loop

For legal, financial, medical or customer-commitment content, a person should review AI output before it's used.

9. Test before launch, monitor after

Build a test set of real questions, including ones the model shouldn't answer, and measure accuracy. Our guide to AI evaluation and testing shows how. After launch, review conversations regularly and fix gaps in your content.

A quick example

Imagine a travel company's chatbot is asked about baggage rules for a route it has no information on. Without grounding, it might invent a plausible allowance. With grounding and clear instructions, it replies that it doesn't have details for that route, links to the airline's baggage page and offers to pass the question to a member of staff. The second answer is less impressive in the moment, but far more trustworthy.

Spotting hallucinations as a user

  • Be suspicious of very specific details you can't verify.
  • Check any citation before relying on it.
  • Ask the model to show where in a document it found something.
  • Cross-check important facts with an authoritative source.

The business risk

Businesses can be held responsible for what their AI tells customers. Treat an AI assistant like a new employee: give it accurate information, clear rules and supervision. That approach protects both your customers and your reputation.

How we help

Our AI chatbot development team builds assistants that answer from approved content, cite sources and hand over to people when unsure. Our AI solutions team adds validation and testing to AI workflows, and our web app team builds review steps into AI features.

Frequently asked questions

Can AI hallucinations be eliminated completely?

Not completely with current technology, but grounding, clear instructions, validation and human review reduce them dramatically.

Do newer AI models hallucinate less?

Generally, newer and more capable models perform better on many factual tasks, but none are perfect. Always test for your use case.

Why does AI make up citations?

Models learn what citations look like and can generate convincing ones without a real source. Always verify references.

This guide is general information, not legal, tax or financial advice, and details such as prices, features and rules can change. Product and company names mentioned are trademarks of their respective owners and are used only to identify those products; UK Technology Hub is not affiliated with or endorsed by them.

Related guides

All AI & automation guides