AI Hallucinations: Examples, Risks and How to Prevent Them

An AI hallucination occurs when a generative AI system produces information that is false, fabricated, unsupported by reliable evidence, or inconsistent with the source material. Examples include invented facts, nonexistent research papers, inaccurate quotations, and summaries that introduce claims absent from the original document.

AI hallucinations are difficult to detect because incorrect information can appear alongside accurate facts in fluent, professional-sounding language. In the workplace, an unverified claim can affect research, compliance work, financial analysis, customer communication, technical decisions, and organizational reporting.

This guide explains why AI hallucinations occur, how to recognize them, what real-world examples reveal, and how individuals and organizations can verify AI-generated information. It also covers practical controls for reducing hallucination risk without assuming that any AI model or verification technique guarantees accuracy.

Key Takeaways

• AI hallucinations are outputs that appear plausible but contain false, invented, or unsupported information.

• A polished or confident response is not proof that the content is accurate.

• Hallucinations can include fabricated facts, citations, quotations, statistics, names, dates, calculations, and summaries.

• Asking an AI system to check its own answer can help, but it is not independent verification.

• Verification should be proportionate to the potential impact of an error.

• High-impact outputs require authoritative sources, clear human accountability, and documented review.

• Grounding, retrieval, and better prompts can reduce hallucination risk, but they cannot guarantee accuracy.

What Are AI Hallucinations?

AI hallucinations are generated outputs that present false, inaccurate, fabricated, or unsupported information as if it were reliable. The output may be entirely invented, or it may combine accurate information with one incorrect detail. Mixed outputs can be especially difficult to detect because the correct material makes the unsupported part appear credible.

The US National Institute of Standards and Technology uses the term "confabulation" for this risk. In its Generative Artificial Intelligence Profile, NIST describes confabulation as confidently presented erroneous or false content. It also notes that generated output may contradict source material, a prompt, or an earlier response.

A hallucination can take many forms:

• A report, academic paper, or legal case that does not exist

• A genuine source that does not support the statement attributed to it

• An invented quotation assigned to a real person

• An incorrect date, number, name, or product capability

• A summary that adds a conclusion absent from the original document

• An uncertain prediction presented as an established fact

• Code that refers to non-existent functions, libraries, or parameters

The term is useful, but it should not become a label for every undesirable AI output. Bias, outdated information, calculation mistakes, incomplete answers, and failures to follow instructions can overlap with hallucination, but they are not always the same problem. Accuracy and responsible reliance form part of the wider discussion around AI ethics, while hallucination risk requires specific verification controls.

Why Do AI Systems Hallucinate?

Generative AI systems are designed to generate likely sequences of words, images, code, or other content based on patterns learned from data and information available in the current context. Producing a plausible response is not the same as checking every claim against an authoritative database.

For a large language model, text is processed as units called tokens. The model predicts which token is likely to follow the preceding context. This process can produce accurate explanations, but it can also produce statistically plausible wording that is factually wrong.

Research from OpenAI published in 2025 highlights an important evaluation problem: when systems are scored mainly on whether their answers are correct, guessing can sometimes be rewarded more than acknowledging uncertainty. A model may therefore provide a confident answer even when the available evidence is insufficient. This is one contributing factor, not a complete explanation for every AI hallucination.

For workplace use, the practical lesson is to evaluate both answer accuracy and appropriate uncertainty. An AI system should not be considered reliable simply because it produces a complete answer. It should also be able to identify missing evidence, distinguish supported claims from assumptions, and abstain when the task cannot be answered reliably. The OpenAI explanation of why language models hallucinate demonstrates how a model can provide different but equally confident false answers when asked for obscure biographical details.

Several conditions can increase the likelihood of unreliable output.

Missing or Ambiguous Context

If a request lacks important details, the model may infer what the user means. An inference can be useful, but it can also introduce people, dates, requirements, or assumptions that were never provided.

Requests for Unsupported Precision

A prompt that demands an exact quotation, statistic, case, publication, or deadline may encourage a model to produce a specific-looking answer even when dependable information is unavailable. Specificity can make the result appear authoritative without making it correct.

Incomplete, Conflicting, or Outdated Information

A model may not have the information required for a current or specialized question. It may also encounter conflicting patterns in training data or supplied sources. Even systems with web or database access can select the wrong source, misread a passage, or combine conflicting evidence incorrectly.

Weak Grounding

Grounding connects a model's response to defined source material, such as an approved policy library, product database, or retrieved set of documents. Without strong grounding, a system may rely on broad learned patterns rather than the evidence required for the task.

Pressure to Produce an Answer

Users often expect an immediate and complete response. A system that is optimized to answer rather than express uncertainty may generate a plausible completion instead of stating that reliable information is unavailable.

These causes do not mean that every response is unreliable. They explain why output must be assessed according to the task, evidence, and consequences rather than trusted solely for its fluency.

Common Types and Examples of AI Hallucinations

AI hallucinations are not always dramatic. The most dangerous examples are often polished, precise, and partially correct.

Example: Hallucinations in Retrieval-Augmented Generation (RAG)

Retrieval-augmented generation (RAG) connects an AI model to external information, such as company policies, technical documentation, or a knowledge base. It can improve the relevance of generated answers by providing source material, but it does not guarantee that every answer will be accurate.

Consider an internal AI assistant that retrieves an outdated employee policy and summarizes it as the organization's current rule. The summary might accurately reflect the retrieved document while still giving employees incorrect guidance because a newer policy has replaced it.

The problem may arise from retrieving the wrong document, overlooking its effective date, misinterpreting a passage, or generating a conclusion that the source does not support.

To reduce this risk, organizations should verify document versions, maintain approved source repositories, evaluate retrieval quality, and check whether important statements in generated answers are supported by the retrieved passages. Human review remains necessary when incorrect guidance could have significant consequences.

Documented Example: Fabricated Legal Authorities

In Mata v. Avianca, Inc., a US federal court addressed lawyers who submitted filings containing nonexistent judicial authorities and fabricated quotations attributed to judicial opinions. The case illustrates why AI-generated legal research must be checked against the original decisions rather than accepted on the strength of realistic-looking citations. The court's June 2023 sanctions opinion explained that the chatbot generated fake cases when prompted to provide legal authority. The court sanctioned the lawyers after finding that they had abandoned their responsibility to verify the material.

The lesson applies beyond legal work. A professional-looking citation is only a claim about a source until someone confirms that the source exists and supports the statement.

Workplace Example: An Invented Policy Requirement

An employee asks an AI assistant to summarize a regulator's new reporting requirements. The response accurately describes the general subject but invents a 30-day deadline. The employee copies the deadline into an internal procedure without opening the regulation.

This hypothetical example combines accurate context with an unsupported detail. Verification should focus on the exact obligation, effective date, scope, and official text rather than the overall fluency of the summary.

Workplace Example: A Misleading Customer Answer

A customer-service assistant provides an incorrect refund condition that sounds consistent with the company's normal policy. If the answer is sent without checking the approved policy, the organization may cause customer harm, complaints, and inconsistent treatment.

The correct control is not simply to ask the model to try again. The answer should be grounded in the current approved policy, and exceptions should be escalated to an authorized reviewer.

Workplace Example: A Distorted Management Summary

An AI tool summarizes a long operational report and correctly identifies most findings but changes a qualified statement from “may increase risk” to “will cause failure.” The wording shifts a possibility into a certainty and could influence an executive decision.

Important summaries should therefore be checked for omitted qualifications, altered certainty, incorrect causal relationships, and unsupported recommendations.

AI Hallucinations vs Errors, Bias and Misinformation

Related terms are often used interchangeably, but the distinctions matter when selecting controls.

The OWASP Generative AI Security Project identifies misinformation and overreliance as risks for systems that depend on large language model outputs. Hallucination can produce misinformation, but incomplete data, bias, and other failures can also produce misleading results. Understanding these distinctions is an important part of AI ethics in the workplace because each risk may require a different response.

Why Are AI Hallucinations Risky in the Workplace?

The seriousness of an AI hallucination depends on what the output influences, who receives it, and whether the error can be corrected.

Incorrect Decisions

Employees and managers may act on fabricated facts, inaccurate calculations, or unsupported explanations. The risk rises when an AI-generated recommendation affects hiring, safety, compliance, finance, healthcare, access to services, or another consequential decision.

Contaminated Business Records

Once incorrect information enters a report, presentation, policy, knowledge base, or customer record, it can be repeated by colleagues and future systems. The original AI output may become difficult to trace, while the false statement gains credibility through repetition.

Customer and Public Harm

Incorrect information sent to customers, suppliers, regulators, or the public can create confusion, inconsistent treatment, contractual disputes, and reputational damage. External communication usually requires a higher level of review than internal brainstorming.

Compliance and Legal Exposure

AI-generated summaries of laws, contracts, or standards can omit exceptions, confuse jurisdictions, or invent obligations. AI can support research, but qualified professionals must verify the applicable authority and exercise independent judgment.

Security and Technical Failures

Generated code or configuration guidance may contain unsafe commands, invalid dependencies or vulnerable patterns. The OWASP Top 10 for Large Language Model Applications warns that insufficient validation of model outputs can contribute to security vulnerabilities and compromised decision-making.

Loss of Trust and Accountability

Repeated inaccuracies can reduce confidence in both AI-assisted work and the organization using it. Responsibility does not transfer to a tool merely because the tool generated the first draft. A named person or team must remain accountable for consequential output.

Warning Signs That an AI Output May Be Hallucinated

No writing style can prove that an output is false. These warning signs should trigger closer review:

• Highly specific facts are presented without traceable sources.

• A citation cannot be located using the title, author, publisher, or identifier provided.

• A source exists but does not contain the quoted or summarized claim.

• The output gives different factual answers when the question is repeated.

• Quotations are provided without an original document or transcript.

• The answer conflicts with an official source or the material supplied in the prompt.

• The model becomes more specific after being challenged but provides no new evidence.

• An obscure or specialized question receives an immediate, certain answer.

• The output changes qualifications such as “may,” "usually," or “subject to” into absolute statements.

• Names, dates, calculations, or references look plausible but cannot be independently reproduced.

Asking the system to reconsider its answer can expose inconsistency, but it is not verification. The same model may repeat the error, invent a different answer, or provide fabricated support for its original claim. Effective AI transparency and explainability should help users identify the evidence, limitations, and uncertainty behind important outputs, but an explanation still needs independent checking.

How to Verify AI-Generated Information: The CLAIM Method

Verification should match the potential impact of being wrong. The CLAIM method provides a repeatable process for workplace use.

C: Classify the Output and Its Risk

Identify how the output will be used. A brainstorming list, internal draft, and externally published compliance statement do not require the same scrutiny.

Ask:

• Is the content factual, interpretive, or creative?

• Will it influence a person, payment, right, safety control, or business decision?

• Will it be shared outside the organization?

• Would an error be easy to reverse?

The higher the consequence, the stronger the review should be.

L: Locate the Original Evidence

Find the source behind each material claim. Prefer official regulations, regulator guidance, original research, standards bodies, court decisions, approved company records, and source documents over summaries of summaries.

A second AI-generated answer is not an independent source. Search snippets are also insufficient when the precise wording, scope, or qualification matters.

A: Assess Whether the Evidence Supports the Claim

Confirm that the source says what the AI output claims it says. Check the relevant passage in context and look for limitations, exceptions, jurisdiction, dates, and definitions.

A real source can still be used inaccurately. This is known as a citation mismatch, and it is harder to notice than a completely fabricated citation.

I: Inspect High-Risk Details

Review elements that frequently create false confidence:

• Names and job titles

• Dates and deadlines

• Statistics and calculations

• Quotations

• Legal and regulatory citations

• Study titles and authors

• Product capabilities

• Technical commands and dependencies

• Policy exceptions and approval requirements

Recalculate numerical claims from the underlying data rather than trusting a generated total.

M: Maintain Human Accountability

Assign a qualified reviewer when an error could materially affect customers, employees, compliance, finances, safety, systems, or organizational reputation. Record the source and approval where the decision requires an audit trail.

Human review must be substantive. A reviewer who simply reads the output without checking its evidence does not provide an effective control. Evidence-based review is central to ethical AI use at work, especially when generated content may affect people or business decisions.

AI Output Verification Checklist

Before using a consequential AI-generated output, confirm:

• The intended use and risk level are clear.

• Every material factual claim can be traced to a reliable source.

• Each citation exists and supports the exact claim.

• Names, dates, quotations, and statistics have been checked.

• Calculations have been independently reproduced.

• The information is current and applies to the correct jurisdiction or context.

• Important qualifications and exceptions have been preserved.

• The output does not contradict the source material.

• Confidential or restricted information has been handled under organizational rules.

• A qualified person has reviewed high-impact content.

• The final approver and evidence are documented where required.

Can AI Hallucinations Be Prevented?

Hallucination risk can be reduced, but no current generative AI system should be assumed to guarantee factual accuracy in every situation.

Useful risk-reduction measures include:

• Giving the model complete, relevant, and unambiguous context

• Requiring it to distinguish evidence from assumptions

• Allowing it to state when information is unavailable

• Grounding responses in approved documents or databases

• Using retrieval systems that return source passages with the answer

• Restricting the system to appropriate use cases

• Testing performance against representative tasks and known answers

• Monitoring outputs after deployment

• Requiring human review for high-impact uses

Retrieval-augmented generation, web access, and citations can improve reliability, but they do not remove the need for verification. A system can retrieve the wrong document, misinterpret a correct document, or attach a citation that does not support its conclusion.

AI hallucinations remain an unresolved reliability challenge. OpenAI's 2025 research, "Why Language Models Hallucinate," examines how evaluation methods that reward correct answers without adequately accounting for uncertainty can encourage guessing. This finding supports the need to assess whether AI systems know when to answer, when to express uncertainty, and when to abstain. It does not establish that every hallucination results from evaluation incentives.

Organizations should therefore combine model evaluation with source verification, task-specific testing, monitoring, and appropriate human oversight. No single technique should be treated as a guarantee that generated information is accurate. See: Evaluating large language models for accuracy incentivizes hallucinations.

How Organizations Can Reduce AI Hallucination Risk

Organizations should not depend entirely on employees remembering to fact-check. Verification expectations should be built into governance, systems, and everyday workflows.

Define Permitted and Prohibited Uses

An AI acceptable use policy should explain which tools employees may use, what data may be entered, which tasks require verification, and which decisions must not be delegated to generative AI. The rules should reflect the organization's systems, sector, and risk tolerance.

Classify High-Risk Use Cases

Identify uses involving legal analysis, compliance, financial reporting, safety, healthcare, employment, customer commitments, public statements, or automated actions. These activities may require qualified review, approved sources, and documented evidence.

Ground Systems in Approved Information

Where practical, connect workplace AI systems to current, controlled information such as approved policies, product records, or regulatory libraries. Control document ownership, update cycles, and access permissions so grounding material remains reliable.

Establish Verification and Approval Rules

Specify which claims must be checked, which sources are acceptable, and who can approve the final output. A documented workflow is more dependable than a general instruction to “use judgment.”

Test and Monitor AI Systems

Before deployment, test the system with representative tasks, ambiguous prompts, missing information, and requests for precise citations. Continue monitoring for recurring failure patterns, changes in performance, and errors reported by users.

NIST's AI Risk Management Framework organizes AI risk management around the functions of govern, map, measure, and manage. Organizations can use this structure to connect output verification with wider accountability, testing, and risk-management activities.

Train Employees

Employees need more than a warning that “AI can be wrong.” Training should show them how to recognize high-risk claims, find original sources, check citation support, preserve uncertainty, and escalate consequential outputs.

Keep Human Accountability Clear

Every high-impact AI-assisted process should have an identifiable owner. The person approving the output remains responsible for applying professional judgment and confirming that required controls have been completed.

Build Safer Workplace AI Practices

AI reliability depends on how employees prompt, verify, and use generated content. 

Recognizing AI hallucinations is only one part of responsible AI use. Employees also need practical skills for writing effective prompts, checking generated information, identifying potential risks, and using AI within organizational policies.

Explore our Ethical Prompting and Safe Use of Generative AI for Staff training to help employees develop safer, more responsible workplace AI practices.

Conclusion

AI hallucinations occur when generative AI produces information that appears plausible but is false, fabricated, unsupported, or unfaithful to the available evidence. The risk is not limited to obviously absurd answers. A response can be polished, specific, and mostly accurate while still containing one consequential error.

Employees should treat AI as an assistant, not as an unquestionable source. Important facts must be checked against original or authoritative evidence. Citations must be opened, quotations confirmed, calculations reproduced, and source-based summaries compared with the underlying material.

Organizations also need risk-based rules. Clear permitted uses, approved sources, verification requirements, qualified review, and named accountability help prevent unreliable AI output from entering decisions, records, and external communications.

The practical rule is simple: the greater the potential consequence of an error, the stronger the evidence and human review should be.