Skip to content
ai fluency · lesson 3 of 9

How generative AI actually works

by paul thomas·13 min·561 wordsCOURSE

You do not need to be technical to use AI well, but a rough mental model helps. It tells you when to trust a tool and when to double-check it, and it explains why AI sometimes sounds completely sure of itself and is still wrong. These two videos give you that model without the maths.

Video: Anthropic’s AI Fluency: Framework & Foundations · CC BY-NC-SA 4.0 · watch on YouTube

The first video covers what these systems are doing when they generate text. The second is the more useful half for most teams: what they can and cannot reliably do.

Video: Anthropic’s AI Fluency: Framework & Foundations · CC BY-NC-SA 4.0 · watch on YouTube

What to take from this

A few things worth holding onto:

  • It predicts, it does not retrieve. Unless it is using a search tool, AI is generating the most plausible next words rather than looking up a fact, which is why it can state something wrong with complete confidence.
  • It has no memory of your business beyond what you put in front of it. Context is something you supply, every time.
  • It is strong with language and weaker on exact figures, fresh information, and anything that needs real certainty.

None of this makes it less useful. It tells you where a person still needs to check the work.

Try this

Next time AI gives you a confident answer that matters, ask it where the information came from, and check one claim yourself before you use it.

Common questions about how generative AI works

How does generative AI work in simple terms?

In simple terms, generative AI predicts rather than retrieves. Unless it is using a tool like web search, it is generating the most plausible next words one after another, based on patterns it learned in training, not looking a fact up in a database. That is why it can sound completely sure of itself and still be wrong. It is strong with language and weaker on exact figures and fresh information, so treat it as a fast first draft you check, not a source of truth.

Why does AI sound confident but get things wrong?

Because it is generating plausible-sounding text rather than retrieving verified facts. The model is making probabilistic decisions about what words should come next, so it can piece together something that reads well and is simply not true. This is what people call a hallucination: the AI stating something that sounds right with complete confidence. The confidence is in the writing, not in the accuracy, so the checking is still your job.

What can generative AI not do reliably?

It is strong with language, but a few limits are worth holding onto:

  • Fresh information: it has a knowledge cutoff and knows nothing that happened after its training unless you give it a tool like web search.
  • Exact facts: it can reproduce inaccuracies from its training data or invent plausible-sounding ones, so figures and claims need checking.
  • Consistency: it is non-deterministic, so the same question can give slightly different answers each time.
  • Long inputs: it can only hold so much at once in its context window, so very large documents or long conversations can fall out of view.
  • Your private data: if it cannot reach a tool or source it needs, it cannot help with that, no matter how capable it seems.
// ai fluency
Get the next lessons as they drop
New lessons land in batches. Subscribe and I'll email you when the next one goes live.