🪟 Glossary July 12, 2026 6 min read

What Is Context Window?

What Is Context Window? Explained Simply

The model's working memory: how much text it can consider at once, measured in tokens. Here is the plain-English deep dive: what it means, why it matters, and how to use the concept in practice.

AIAuraFarm

Start Aura Farming

Top AI money moves delivered every morning - free forever.

The AI Money Farm book cover
📖 New Book

Want to Build a Site Like This One?

The AI Money Farm is the exact step-by-step blueprint behind AIAuraFarm.com.

Get It on Amazon →

What Is Context Window?

The context window is everything a model can see while answering: your conversation so far, uploaded documents, its own previous replies, all measured in tokens. Think of it as working memory. Anything inside the window can influence the answer; anything outside it does not exist. When a long chat starts "forgetting" its beginning, the beginning scrolled out of the window.

Windows exploded in size: from 4,000 tokens in early ChatGPT (a few pages) to 200,000 in Claude's standard tiers (a long novel) to a million and beyond in Gemini's flagship models, ten million in some specialized variants, entire codebases or bookshelves in one gulp. This single dimension quietly redefined what AI can do: whole-repository code review, full-contract analysis, complete-transcript synthesis, all impossible in the small-window era.

Two caveats keep the marketing honest. First, models can technically hold a million tokens while attending unevenly, performance on facts buried mid-document (the "needle in a haystack" problem) has improved dramatically but is not uniformly perfect, so structure still matters: put critical instructions at the start or end. Second, big windows cost money; sending a million tokens per request at frontier prices adds up fast, which is why RAG, retrieving only the relevant slices, remains the standard architecture for large knowledge bases.

Practical rule: for one-off analysis of big documents, use a big-window model and paste everything. For a product serving thousands of queries against the same library, retrieve first and send less.

← Previous: TokenNext: Prompt Engineering →

← Back to the full AI Glossary

AIAuraFarm

Start Aura Farming

Top AI money moves delivered every morning - free forever.

📚 Keep Reading

Doughnuts & Dragons