"AI" is not one technology. It is a label that currently covers three different things at once: software that recognises patterns in data, software that generates text or images, and software that takes actions. Sorting out which one someone means removes most of the confusion in a conversation about AI.
This page goes in order — what the words mean, how the learning actually happens, what a language model is doing when it writes, and why the same mechanism that makes it useful also makes it confidently wrong.
1. The short answer
For almost everything you can use today, AI means software that found patterns in examples instead of following rules a person wrote. That is the whole idea. Everything else — chatbots, image generators, recommendation feeds, the assistant in your phone — is an application of it.
What it is not: conscious, aware of you, or in possession of facts stored in a database. Keeping that in mind explains nearly every surprise that follows.
2. Machine learning: rules out, examples in
Traditional programming works one way round. A person writes the rules, and the computer applies them. A tax calculator is rules: if income is above this threshold, multiply by that rate. Every behaviour is traceable to a line someone wrote.
Machine learning inverts it. You supply examples — thousands of photographs labelled "cat" or "not cat" — and the training process adjusts a large collection of internal numbers until the system's outputs match the labels. Nobody writes the rule for "cat". The rule is the numbers, and it is not readable in the way an if-statement is.
Two consequences follow immediately, and both cause real trouble in practice:
- It can only be as good as its examples. A model trained mostly on one kind of face performs worse on others. This is not an edge case; it is the mechanism. Research on this is why regulators now ask device makers for more representative test cohorts.
- It generalises, but only near what it has seen. A model is interpolating within the space its training data covered. Asked to do something genuinely outside that space, it may still answer — fluently, and wrongly.
3. What a language model is actually doing
A language model is a machine-learning system trained on a very large amount of text. Text is chopped into tokens — roughly word-pieces, so "understanding" may become two or three tokens — and the model's training task is monotonously simple: given the tokens so far, predict the next one.
That is it. Do that billions of times over a large enough body of text and the model's internal numbers encode a great deal about grammar, facts, styles and reasoning patterns, because all of those are useful for predicting the next token. But the objective never stops being prediction.
And this is the part most explanations skip: there is no lookup table. The model does not search a store of documents and quote one. It produces the next token from its own compressed statistics about what text like this looks like. A factual answer is reconstructed, not retrieved — which is why it can be right in a way that feels like memory and wrong in a way that feels like lying, with no difference in tone between the two.
4. Why it makes things up
A "hallucination" is not a bug inserted into a working system. It is the prediction mechanism doing exactly its job in a situation where the useful information is not present.
Ask for a citation and the model produces text shaped like a citation — author, journal, year, volume — because that is what follows in the training data. If no real citation is strongly encoded for that question, the most likely-shaped continuation is still a plausible-looking one. The system has no separate step that asks "is this true?" It has a step that asks "what usually comes next?"
Three practical defences follow, and they are all cheap:
- Ask for the thing you can check. "Give me the claim and where to verify it" beats "give me sources".
- Use tools for facts. A model with search can read a page; the model alone is recalling. The difference in reliability is large.
- Treat confidence as style, not evidence. Fluency and certainty are outputs of the same prediction process as the content. They carry no additional information about correctness.
5. What it is good at, and what it is not
Roughly, it is strong where the answer is a matter of form and weak where it is a matter of fact or long-horizon execution.
Strong: rewriting and summarising text you supply; changing tone, length or reading level; translating; generating structured output from unstructured input; explaining a concept at a requested level; drafting a first version of almost anything; producing examples and test cases; writing and explaining code.
Weak: facts it was not strongly trained on, precise arithmetic over many digits, current events without a search tool, anything requiring a guaranteed-correct single answer, and tasks that need many steps to all go right in sequence.
That last weakness is measurable rather than rhetorical. GAIA, a general-assistant benchmark published by Meta AI researchers in 2023 (arXiv 2311.12983), was built so its questions are conceptually easy for people and hard for machines. In the original paper, human respondents scored about 92% while GPT-4 with plugins scored about 15%. The gap is not knowledge — models have more of that than you do — it is the ability to chain a few tool-using steps without losing the thread. Later systems have improved substantially, and the human figure remains the ceiling nobody has passed.
6. The vocabulary you will meet
- Model. The trained system itself — the file of numbers plus the code that runs it. "GPT-4", "Claude", "Gemini" and "Llama" name families of models.
- Parameters. The internal numbers adjusted during training. Larger generally means more capability and more cost; it does not mean more truthful.
- Training vs inference. Training is the expensive one-off process of learning from data. Inference is what happens when you use it. A model does not learn from your chat during inference — it only predicts.
- Prompt. Your input. It sets the context the model predicts from, which is why wording changes results so much: you are changing the condition of the prediction.
- Context window. How much text the model can consider at once. Anything outside it is not being considered, no matter how relevant.
- Fine-tuning. Further training on a narrower set of examples to nudge behaviour. Different from prompting: it changes the model, not just the input.
- RAG (retrieval-augmented generation). Look things up first, then answer with the retrieved text in the context window. This is the standard fix for the facts problem, because it replaces recall with reading.
- Multimodal. Handles more than text — images, audio, sometimes video.
- Agent. A model with tools and a loop, able to act rather than only answer.
- Guardrails. Limits on what the system may do, set by the developer rather than the model.
7. Try each idea yourself, for free
Every concept above is easier to feel than to read. Each of these has a usable free tier.
- Next-token prediction: type a sentence into any chat assistant and watch it continue. Then change only the last three words and watch the direction change. That is the conditioning at work.
- Summarising text you supply: paste a long article you already know and ask for a five-sentence summary. You can judge the output because you know the source — the best way to calibrate your trust.
- Hallucination: ask for a statistic on a niche topic, then ask for the source, then go and check it. Do this once and you will stop treating confident prose as evidence.
- Retrieval: use a search-enabled assistant for a current question, and the same question without search. The difference is the whole argument for RAG.
- Structured output: paste messy notes and ask for a table with fixed columns, or JSON. This is where models save the most time in real work.
- Code: ask for a small script that renames files in a folder, then run it on copies. Reading code you did not write is a legitimate way to learn.
- Image generation: describe the same scene twice with one detail changed and compare — a fast demonstration that these systems build from patterns rather than from a picture library.
8. What to be careful about
- Do not put private data in a system you have not read the terms of. Assume anything you paste may be stored or reviewed unless it says otherwise.
- Verify anything consequential. Names, numbers, dates, legal and medical claims. The failure mode is confident, fluent and wrong.
- Distinguish generation from detection. Detection tools are far less reliable than generation tools. OpenAI withdrew its own AI-text classifier in July 2023 citing low accuracy, and a 2023 study in Patterns found that across seven detectors a mean of 61.22% of human-written TOEFL essays by non-native English speakers were flagged as AI-generated. A detector score is not proof.
- Check the free tier's real limit. Message caps, model downgrades after a threshold, and limits on file size or tool use are what decide whether "free" is usable for your workload.
The one-paragraph version: AI today is pattern-finding software, and language models specifically are next-token predictors whose skill comes from having compressed an enormous amount of text. That makes them superb at shaping language and unreliable at guaranteeing facts, with the gap widest on long chains of steps. Use them where the output is checkable or the stakes are low, add a search or retrieval step when facts matter, and treat fluency as style rather than evidence. That single habit removes most of the disappointment.
FAQ
What is AI in simple words?
Software that learned patterns from examples instead of following rules a person wrote. A traditional program applies rules you give it; a machine-learning system is trained on examples and ends up with internal numbers that produce the behaviour. Chatbots, image generators and recommendation feeds are all applications of that idea.
How does AI actually work?
A model is trained on a lot of data to make predictions — for a language model, predicting the next token of text. Getting that prediction right on a large enough body of text forces the model to encode grammar, facts and reasoning patterns, because all of them help predict what comes next. When you use it, it predicts; it does not look up stored documents.
Why does AI make things up?
Because it is generating the most likely continuation rather than retrieving a fact, and there is no separate step that checks whether the output is true. Ask for a citation and you get text shaped like a citation whether or not one exists. The fix is to verify consequential claims, add search or retrieval so the model reads rather than recalls, and treat fluency as style rather than evidence.
Is AI conscious or does it understand what it says?
There is no evidence for that, and the useful description does not require it. A language model produces the next token from statistics learned during training, with no stored intention and no model of you as a person. That mechanical description explains its capabilities and its errors better than any talk of understanding.
What is the difference between AI, machine learning and deep learning?
AI is the broad label. Machine learning is the subset where behaviour comes from training on examples rather than written rules. Deep learning is machine learning using large multi-layer neural networks, which is what modern language and image models are. In everyday use, "AI" almost always means deep learning.
What are AI hallucinations and can they be prevented?
A hallucination is a fluent output that is not true, produced by the same prediction mechanism that produces correct ones. It cannot be eliminated by asking the model to be careful, but it can be greatly reduced by giving the model the source text to read (retrieval), by having it produce output you can check mechanically, and by verifying anything consequential yourself.
Can AI detectors tell if text was written by AI?
Not reliably enough to base a decision on. OpenAI retired its own AI-text classifier in July 2023 citing a low rate of accuracy, and a 2023 study in Patterns found that across seven detectors a mean of 61.22% of human-written TOEFL essays by non-native English speakers were flagged as AI-generated. A detector score is a weak signal, not proof.
Is AI free to use?
Most major assistants have a genuinely usable free tier, with limits that matter more than the price: message quotas, downgrades to smaller models after a threshold, and caps on file size or tool use. Free tiers are usually enough to learn and to handle occasional tasks, and not enough to run a daily high-volume workflow.
