How AI Gets Things Wrong
AI outputs are wrong more often than most users realize, reliably, in specific ways. Understanding those patterns is the foundation of judgment.
Lesson 1
Predictable patterns, not random errors.
Hallucination: factually incorrect content stated with complete confidence, wrong stats, fake citations, incorrect titles. The model generates plausible continuations; it does not retrieve verified facts.
How AI gets things wrong
Core principles
- Most likely wrong on: specific numbers, dates, percentages, proper nouns, recent events, niche topics, precise citations.
- Confident wrongness: hesitation and "I think" do not apply, verify consequential claims regardless of tone.
- Stale information: training cutoffs and outdated org context, ask if the answer must be current now.
- Bias: training data reflects human gaps, notice narrow perspectives in broad questions.
Related, Getting Started: judgment
Check yourself
What does "hallucination" mean in the context of AI outputs?
Hallucination is not vagueness or hedging, it is confident, plausible-sounding content that is simply wrong. The model generates what continues the pattern, not what is verified. That is why AI tone is not a reliable signal of accuracy.
Do this in Copilot
Pick one claim from your next Copilot output (number, name, date) and verify it independently.
Paste this into Copilot Chat and work through it before moving on.
Surface uncertainty
Summarize this content. For any claim where you are not fully grounded in the provided material, say so explicitly instead of guessing.
- Uncertainty flagging
Did you run this in Copilot? Mark complete when you have tried it.
RecordedNext lesson: A Practical Verification Framework →
Navigate: press j for next lesson, k for previous.