LLMs Are Probability Engines, Not "Thinkers"

Ajay Walia — Sun, 07 Jun 2026 00:00:00 +0000

@import url('https://fonts.googleapis.com/css2?family=Space+Grotesk:wght@400;500;600;700&family=JetBrains+Mono:wght@400;500&display=swap'); .pe-article { --bg: #070b14; --bg2: #0d1423; --bg3: #111827; --cyan: #00e5ff; --purple: #a855f7; --gold: #fbbf24; --text: #e2e8f0; --muted: #94a3b8; --border: #1e293b; --danger: #f87171; font-family: 'Space Grotesk', system-ui, sans-serif; font-size: 1.08rem; line-height: 1.85; color: var(--text); } /* TOC */ .pe-toc { background: var(--bg2); border: 1px solid var(--border); border-left: 3px solid var(--cyan); border-radius: 10px; padding: 1.25rem 1.75rem; margin: 2rem 0; } .pe-toc h3 { font-size: 0.95rem; letter-spacing: 0.18em; text-transform: uppercase; color: var(--cyan); margin: 0 0 1rem; } .pe-toc ol { padding-left: 1.3rem; margin: 0; } .pe-toc li { margin-bottom: 0.6rem; } .pe-toc a { color: var(--muted); text-decoration: none; font-size: 1.15rem; font-weight: 600; transition: color 0.2s; } .pe-toc a:hover { color: var(--cyan); } /* Video */ .pe-video { margin: 2rem 0; border-radius: 12px; overflow: hidden; border: 1px solid var(--border); background: #000; } .pe-video video { width: 100%; display: block; } .pe-video-header { background: var(--bg2); padding: 1rem 1.4rem; font-size: 1.15rem; font-weight: 600; color: var(--cyan); border-bottom: 1px solid var(--border); line-height: 1.5; } /* Typography */ .pe-article h2 { font-size: 1.75rem; font-weight: 700; color: #fff; margin: 3rem 0 0.9rem; padding-bottom: 0.45rem; border-bottom: 1px solid var(--border); } .pe-sec-num { color: var(--cyan); font-size: 1rem; font-weight: 600; display: block; margin-bottom: 0.2rem; letter-spacing: 0.1em; } .pe-article p { margin-bottom: 1.1rem; } .pe-article strong { color: #fff; } .pe-em { color: var(--gold); } /* Callouts */ .pe-callout { background: var(--bg2); border-left: 4px solid var(--purple); border-radius: 0 8px 8px 0; padding: 1.4rem 1.8rem; margin: 1.5rem 0; font-size: 1.4rem; color: var(--muted); line-height: 1.75; } .pe-callout.cy { border-color: var(--cyan); } .pe-callout.gd { border-color: var(--gold); } .pe-callout strong { color: var(--text); } /* Compare table */ .pe-table { width: 100%; border-collapse: collapse; font-size: 1rem; margin: 1.25rem 0; } .pe-table th { text-align: left; padding: 0.7rem 1rem; background: var(--bg2); color: var(--cyan); font-size: 0.85rem; letter-spacing: 0.08em; text-transform: uppercase; border-bottom: 1px solid var(--border); } .pe-table td { padding: 0.85rem 1rem; border-bottom: 1px solid var(--border); color: var(--muted); vertical-align: top; line-height: 1.6; } .pe-table td:first-child { color: var(--text); font-weight: 500; } .pe-table tr:hover td { background: var(--bg2); } /* Formula boxes */ .pe-box { background: var(--bg2); border: 1px solid var(--border); border-radius: 12px; padding: 1.75rem; margin: 1.75rem 0; } .pe-box-title { font-size: 0.95rem; letter-spacing: 0.15em; text-transform: uppercase; color: var(--purple); margin-bottom: 1rem; } /* Anim 1 — token prediction */ .pe-sentence { font-size: 1.3rem; font-family: 'JetBrains Mono', monospace; color: var(--text); min-height: 2rem; margin-bottom: 1.1rem; } .pe-cursor { display: inline-block; width: 2px; height: 1em; background: var(--cyan); animation: pe-blink 0.8s infinite; vertical-align: middle; margin-left: 2px; } @keyframes pe-blink { 0%,100%{opacity:1} 50%{opacity:0} } .pe-prob-bars { display: flex; flex-direction: column; gap: 0.55rem; } .pe-prob-row { display: flex; align-items: center; gap: 0.8rem; font-size: 1.1rem; } .pe-prob-lbl { width: 80px; text-align: right; color: var(--muted); font-family: 'JetBrains Mono', monospace; flex-shrink: 0; } .pe-prob-track { flex: 1; height: 26px; background: var(--bg3); border-radius: 5px; overflow: hidden; } .pe-prob-fill { height: 100%; background: var(--cyan); border-radius: 5px; transition: width 0.55s cubic-bezier(0.4,0,0.2,1); width: 0; } .pe-prob-fill.win { background: var(--gold); } .pe-prob-pct { width: 50px; font-family: 'JetBrains Mono', monospace; font-size: 1rem; color: var(--muted); } /* Math display */ .pe-math { font-family: 'Georgia', serif; font-size: 1.45rem; color: var(--gold); text-align: center; padding: 1.3rem; background: var(--bg3); border-radius: 8px; margin-bottom: 0.9rem; } .pe-term { display: inline; opacity: 0; transition: opacity 0.4s; cursor: help; position: relative; } .pe-term.on { opacity: 1; } .pe-term:hover::after { content: attr(data-tip); position: absolute; bottom: 115%; left: 50%; transform: translateX(-50%); background: var(--bg); border: 1px solid var(--purple); color: var(--text); padding: 0.4rem 0.85rem; border-radius: 6px; font-family: 'Space Grotesk', sans-serif; font-size: 0.88rem; white-space: nowrap; z-index: 20; } .pe-anns { display: grid; grid-template-columns: 1fr 1fr; gap: 0.6rem; margin-top: 0.8rem; } .pe-ann { background: var(--bg3); border-radius: 6px; padding: 0.55rem 0.85rem; font-size: 0.93rem; opacity: 0; transition: opacity 0.5s; } .pe-ann.on { opacity: 1; } .pe-ann-sym { color: var(--gold); font-family: 'JetBrains Mono', monospace; font-weight: bold; } .pe-ann-desc { color: var(--muted); } /* Softmax */ .pe-sm-demo { display: flex; gap: 1rem; align-items: flex-start; flex-wrap: wrap; } .pe-sm-col { flex: 1; min-width: 160px; } .pe-col-lbl { font-size: 0.82rem; letter-spacing: 0.1em; text-transform: uppercase; color: var(--muted); margin-bottom: 0.75rem; } .pe-logit-row { display: flex; align-items: center; gap: 0.6rem; margin-bottom: 0.55rem; font-size: 0.97rem; font-family: 'JetBrains Mono', monospace; } .pe-logit-w { width: 60px; color: var(--text); } .pe-logit-v { padding: 0.22rem 0.6rem; border-radius: 4px; font-size: 0.92rem; } .pe-logit-v.neg { background: rgba(248,113,113,0.15); color: var(--danger); } .pe-logit-v.pos { background: rgba(0,229,255,0.1); color: var(--cyan); } .pe-sm-bar { height: 22px; border-radius: 4px; background: var(--purple); transition: width 0.75s cubic-bezier(0.4,0,0.2,1); width: 0; display: flex; align-items: center; padding-left: 7px; font-size: 0.86rem; color: #fff; overflow: hidden; white-space: nowrap; } .pe-arrow { display: flex; align-items: center; justify-content: center; padding-top: 1.4rem; font-size: 1.6rem; color: var(--cyan); } /* Loss */ .pe-loss-wrap { display: grid; grid-template-columns: 1fr 1fr; gap: 1rem; align-items: start; } @media(max-width:500px) { .pe-loss-wrap { grid-template-columns: 1fr; } } .pe-loss-num { font-size: 2.8rem; font-weight: 800; font-family: 'JetBrains Mono', monospace; color: var(--danger); transition: color 0.5s; line-height: 1; } .pe-loss-num.good { color: #4ade80; } .pe-loss-lbl { font-size: 0.88rem; color: var(--muted); margin-top: 0.3rem; } .pe-loss-slider label { font-size: 0.92rem; color: var(--muted); display: block; margin: 0.8rem 0 0.3rem; } input[type=range] { width: 100%; accent-color: var(--cyan); } .pe-loss-formula { background: var(--bg3); border-radius: 8px; padding: 1.1rem; font-family: 'JetBrains Mono', monospace; font-size: 1rem; color: var(--text); line-height: 2.1; } .pe-lf-hl { color: var(--gold); } .pe-lf-res { color: var(--cyan); font-weight: bold; } /* Attention */ .pe-attn-words { display: flex; gap: 0.5rem; flex-wrap: wrap; margin-bottom: 0.9rem; } .pe-attn-word { padding: 0.4rem 0.8rem; border-radius: 6px; background: var(--bg3); border: 1px solid var(--border); font-size: 1rem; cursor: pointer; transition: all 0.2s; user-select: none; } .pe-attn-word:hover { border-color: var(--cyan); } .pe-attn-word.sel { background: rgba(0,229,255,0.12); border-color: var(--cyan); color: var(--cyan); } /* Attention formula cards */ .pe-qkv { display: grid; grid-template-columns: 1fr 1fr 1fr; gap: 0.6rem; margin-top: 0.8rem; } @media(max-width:480px) { .pe-qkv { grid-template-columns: 1fr; } } .pe-qkv-card { border-radius: 6px; padding: 0.75rem 0.9rem; font-size: 0.93rem; } /* Temperature */ .pe-temp-row-ctrl { display: flex; align-items: center; gap: 1rem; } .pe-temp-big { font-size: 1.6rem; font-family: 'JetBrains Mono', monospace; font-weight: 700; color: var(--cyan); width: 56px; flex-shrink: 0; } .pe-temp-lbl { font-size: 0.92rem; color: var(--muted); margin-top: 0.2rem; } .pe-tbars { display: flex; flex-direction: column; gap: 0.45rem; margin-top: 0.9rem; } .pe-trow { display: flex; align-items: center; gap: 0.65rem; font-size: 0.95rem; font-family: 'JetBrains Mono', monospace; } .pe-tlbl { width: 64px; color: var(--muted); text-align: right; flex-shrink: 0; } .pe-ttrack { flex: 1; height: 19px; background: var(--bg3); border-radius: 4px; overflow: hidden; } .pe-tfill { height: 100%; border-radius: 4px; background: var(--purple); transition: width 0.5s cubic-bezier(0.4,0,0.2,1); } .pe-tpct { width: 48px; text-align: right; color: var(--muted); } /* Limits */ .pe-limits { display: grid; grid-template-columns: repeat(3, 1fr); gap: 1rem; margin: 1.5rem 0; } @media(max-width:640px) { .pe-limits { grid-template-columns: 1fr; } } .pe-limit-card { background: var(--bg2); border: 1px solid var(--border); border-radius: 12px; padding: 1.5rem 1.6rem; transition: border-color 0.2s; display: flex; flex-direction: column; gap: 0.4rem; } .pe-limit-card:hover { border-color: var(--purple); } .pe-limit-icon { font-size: 2.2rem; line-height: 1; } .pe-limit-title { font-weight: 700; color: var(--text); font-size: 1.35rem; margin: 0; } .pe-limit-desc { font-size: 1.15rem; color: var(--muted); line-height: 1.65; margin: 0; } /* Dual meters */ .pe-meters { display: grid; grid-template-columns: 1fr 1fr; gap: 1rem; margin: 1.25rem 0; } .pe-meter { border-radius: 8px; padding: 1.1rem; text-align: center; } .pe-meter-lbl { font-size: 0.82rem; letter-spacing: 0.1em; text-transform: uppercase; margin-bottom: 0.4rem; } .pe-meter-val { font-size: 2.2rem; font-weight: 800; } /* Buttons */ .pe-btn { margin-top: 0.9rem; background: var(--bg3); border: 1px solid var(--cyan); color: var(--cyan); padding: 0.4rem 1.1rem; border-radius: 6px; cursor: pointer; font-size: 0.82rem; font-family: 'Space Grotesk', sans-serif; transition: background 0.2s; } .pe-btn:hover { background: rgba(0,229,255,0.1); } .pe-btn-pur { border-color: var(--purple); color: var(--purple); } .pe-btn-pur:hover { background: rgba(168,85,247,0.1); } /* Interactive badge */ .pe-interactive-header { display: flex; align-items: center; justify-content: space-between; margin-bottom: 1rem; } .pe-interactive-header .pe-box-title { margin-bottom: 0; } .pe-interactive-badge { display: inline-flex; align-items: center; gap: 0.4rem; background: rgba(0,229,255,0.08); border: 1px solid var(--cyan); color: var(--cyan); font-size: 0.72rem; font-weight: 700; letter-spacing: 0.12em; text-transform: uppercase; padding: 0.3rem 0.75rem; border-radius: 999px; flex-shrink: 0; } .pe-interactive-badge::before { content: ''; width: 7px; height: 7px; border-radius: 50%; background: var(--cyan); animation: pe-pulse 1.6s ease-in-out infinite; flex-shrink: 0; } @keyframes pe-pulse { 0%, 100% { opacity: 1; transform: scale(1); } 50% { opacity: 0.4; transform: scale(0.7); } } .pe-interact-hint { display: flex; align-items: center; gap: 0.6rem; margin-top: 0.9rem; padding: 0.85rem 1.1rem; background: rgba(0,229,255,0.05); border: 1px dashed rgba(0,229,255,0.25); border-radius: 8px; font-size: 1.05rem; color: var(--muted); } .pe-interact-hint span { font-size: 1.25rem; } .pe-divider { border: none; border-top: 1px solid var(--border); margin: 2.5rem 0; } @media(max-width:520px) { .pe-anns { grid-template-columns: 1fr; } .pe-sm-demo { flex-direction: column; } .pe-arrow { transform: rotate(90deg); } }

▶ Full Video Explainer — covering how LLMs work, from next-token prediction to attention, training, and why hallucinations are inevitable

Your browser doesn't support HTML5 video.

You've used ChatGPT. You've heard the word "AI" a thousand times this year. But here's something almost nobody explains clearly: the thing powering these tools isnot intelligent in any human sense. It doesn't think. It doesn't understand. It doesn't have goals.

It is, at its core, avery sophisticated next-word predictor — a probability engine trained on the vast majority of text the internet has ever produced. Once you understand this, everything else — its strengths, its failures, its weirdness — clicks into place.

Interactive animations ahead: Press buttons and move sliders as you go — seeing the math move makes it stick.

01 —What ChatGPT and Claude actually are

The term "Artificial Intelligence" conjures images of something that thinks, reasons, and understands — a mind in a machine. That framing is compelling, but misleading when applied to today's large language models (LLMs).

What you're actually talking to is anautoregressive probabilistic model. Every word it generates is the result of asking one question, over and over again:

"Given everything written so far, what word is most likely to come next?"

That's it. Do that billions of times on internet-scale text, and you get something that looks uncannily like reasoning. But it is, fundamentally, pattern matching at extraordinary scale — not understanding, consciousness, or genuine intelligence.

What you see	What's actually happening	The catch
It "reasons"	Pattern-matches reasoning traces from training data	Breaks on genuinely novel problems
It "knows facts"	Recalls high-frequency statistical associations	Hallucinates on rare edge cases
It's "creative"	Samples from learned creative pattern spaces	Derivative — remixes, doesn't invent
It has "opinions"	Outputs tokens shaped by training + alignment	No actual beliefs internally

02 —The one job every LLM does

Let's make this concrete. Below is a live simulation of next-token prediction. Press"Predict next token" and watch the model pick the next word based on probability scores.

🎯 Next-Token Prediction

Live · Interactive

The cat sat on the

👇 Press the button to watch the model predict — one token at a time.

Notice the bars: each candidate word gets a probability score. The model doesn't "decide" in any human sense — it samples from this distribution. The highest-probability word is chosen most often, but not always. That's where both creativity and errors come from.

03 —The probability formula

Here's the mathematical heart of it.Hover each term for a plain-English tooltip, then press the button to reveal the full breakdown piece by piece.

📐 Probability Formula

Live · Interactive

🖱️ Hover any term for a plain-English tooltip. Press the button to reveal the formula step by step.

P(w_t | w ; θ) = softmax(logits_t)

wₜ —The next token to predict

w —All previous tokens (the context)

θ —Billions of learned parameters

softmax —Converts scores → probabilities (sum = 1)

Plain English:"Given everything typed so far, and everything the model learned during training, what is the probability of each possible next word?" The model scores every word in its vocabulary — 50,000+ words — and softmax turns those raw scores into probabilities that add up to exactly 1.0.

04 —Softmax: raw scores → probabilities

The model internally produces a raw score (called alogit) for every possible next word. Logits can be any number — positive, negative, large, small. They're not probabilities yet. Thesoftmax function converts them into a clean distribution. Press the button to watch the transformation.

⚡ Softmax Transform

Live · Interactive

👇 Press the button to watch raw scores transform into probabilities.

Raw Logits (scores)

→

After Softmax (probabilities)

Notice: even the most negative logit still gets a small non-zero probability after softmax. The model never completely rules anything out — it just makes some words astronomically unlikely. This is partly why LLMs occasionally produce bizarre outputs: a 0.001% token still gets picked sometimes.

05 —How it learns: cross-entropy loss

During training, the model sees a sentence with the last word hidden and makes a prediction. The training algorithm asks:"How wrong were you?" The measure of wrongness iscross-entropy loss.

The formula:ℒ = −log P(correct word). If the model assigns 100% probability to the right word, loss = 0. If it assigns 1%, loss is very high.Drag the slider to see this in action.

📉 Cross-Entropy Loss

Live · Interactive

🎚️ Drag the slider to change the model's confidence and watch the loss recalculate live.

1.47

Loss ℒ = −log(p)

Model's confidence in correct word:23%

Correct word:"lazy"
P("lazy"):0.23

ℒ = −log(0.23)
ℒ =1.47

High loss → big update

06 —The Transformer: the machine inside

The specific architecture that makes modern LLMs work is called theTransformer, introduced in a landmark 2017 Google paper. Every major LLM today — GPT-4, Claude, Gemini, Llama — is built on this design.

A Transformer processes your text through many stacked layers. Each layer has two main components:

Multi-Head Self-Attention — Every word simultaneously looks at every other word, learning which relationships matter. This is the core insight.

Feed-Forward Network — A dense neural network that processes each token's information independently, after attention has been applied.

A large model like GPT-4 stacks around 96 of these layers. With enough layers, parameters, and training data, emergent abilities appear — code generation, translation, basic reasoning — that nobody explicitly programmed. They fall out of the math at scale.

07 —Self-attention: every word watches every word

Before the Transformer, AI models processed text word by word in sequence, making it hard to connect things far apart in a sentence. Self-attention solves this by letting every word simultaneously evaluate its relationship to every other word.Click a word to see its attention weights.

🔍 Self-Attention Weights

Live · Interactive

👆 Click any word above to see how it attends to every other word. Brighter = stronger attention — notice "it" lights up "animal."

📐 The Attention Equation

Attention(Q, K, V) = softmax(QKᵀ /√d_k ) ·V

Q — Query

"What am I looking for?"

K — Key

"What does each word offer?"

V — Value

"What info do I retrieve?"

08 —How text is actually generated

When you press Send in any AI chat app, here is exactly what happens:

Tokenization — Your message splits into tokens (subwords). "unbelievable" → ["un","believ","able"].
Embedding — Each token becomes a high-dimensional vector capturing meaning and position.
Forward pass — Vectors flow through all Transformer layers. Attention and feed-forward happen, repeatedly.
Logits → Probabilities — The final layer scores every vocabulary word. Softmax converts to probabilities.
Sampling — One word is chosen based on those probabilities.
Repeat — That word is appended and the whole process runs again until the response is done.

KV Caching: The model caches Key and Value matrices from previous steps so it doesn't recompute attention from scratch every token — making long responses computationally feasible.

09 —Temperature: controlling randomness

When sampling the next word, you can control how random the selection is with a parameter calledtemperature. Drag the slider to see how it reshapes the probability distribution in real time.

🌡️ Temperature Sampling

Live · Interactive

🎚️ Drag the slider left for predictable outputs, right for creative (or chaotic) ones.

1.0

Balanced

Formula: p'ᵢ = pᵢ^1/T / Σ(pⱼ^1/T)

Low temperature (e.g. 0.2) makes the model deterministic — it almost always picks the top word. High temperature (e.g. 2.0) flattens the distribution, giving unusual words a real chance. Most production systems run between 0.7 and 1.0.

10 —Why it sometimes lies (hallucinations)

One of the most misunderstood LLM behaviors ishallucination — when the model confidently states something false. This isn't a bug to be patched away. It's a direct consequence of the architecture.

The model has no internal truth checker. No access to the real world. It only knows:what sequence of words tends to follow this sequence of words? When asked something rare or obscure, the model fills the gap with statistically plausible text — which may be completely wrong.

Analogy: Imagine someone who has read every book in a library but never left the building. Ask what the weather is like outside — they'll give a confident, well-reasoned answer based on weather descriptions they've read. It might be completely wrong.

Ground Truth Access

NONE

Statistical Plausibility

HIGH

11 —Key limitations to know

Understanding these isn't pessimism — it's how you use these tools well.

📏

Context Window

Fixed memory. Older models: ~4K tokens. Newer: up to 1M+. Anything beyond the window is completely invisible to the model.

🌀

No Persistent Memory

Every conversation starts completely fresh. The model has no memory of past sessions unless you explicitly provide them.

🎲

Stochasticity

Same prompt, potentially different outputs. The sampling process is inherently random, even at low temperatures.

🔓

Jailbreaks

Safety training is pattern-based. Clever prompting can sometimes bypass it because the model is still a pattern matcher at heart.

💭

Hallucinations

Inevitable on low-frequency knowledge. No fact-checker means confident errors are always possible. Verify important claims.

⚡

Quadratic Cost

Attention cost grows quadratically with context length. Techniques like FlashAttention mitigate this, but it's a fundamental constraint.

12 —What's next

The probability-engine core remains — but researchers are building powerful layers on top.RAG (Retrieval-Augmented Generation) gives the model access to real documents at query time, dramatically reducing hallucination on factual tasks.Agentic systems let LLMs use tools, execute code, and iterate on their outputs.Reasoning models generate long internal chains of thought before answering, improving performance on math and logic. Andmultimodal models extend the same probabilistic core to images and audio.

None of these change the fundamental nature of what an LLM is. They all sit on top of the same next-token prediction engine. Understanding that foundation is what makes you a sharper thinker about where this technology is — and isn't — going.

The bottom line: LLMs are extraordinary pattern-recognition engines that have scaled statistical prediction to the point of producing genuinely useful, sometimes astonishing outputs. They are not intelligent in any human sense. Knowing this — really knowing it — is what separates clear thinking about AI from hype.

Video generated with Grok Imagine. Animations built with vanilla JavaScript.