How AI Remembers: Context Window
Why does AI forget what you said five minutes ago?
AI sees recent words but forgets old ones when memory limit fills.
In simple words
The context window is like a notebook AI can see. It can only read the last few pages, then the older ones disappear.
The real definition
The context window is the maximum number of tokens an AI model can read and remember in one conversation. Once you exceed this limit, the AI forgets earlier messages.
Like… A Basket of Apples
A basket holds only ten apples. When you add an eleventh apple, the oldest apple falls out. Your AI conversation works the same way.
But: Apples are identical, but words have meaning that changes.
You see it every day
Chat on Phone
You send a chatbot five long messages, then ask about your first message. It cannot remember.
Customer Service
A company chatbot helps you for an hour. Then it forgets your account number when space fills up.
Writing Assistant
You ask AI to write a book. After chapter five, it forgets your original style rules.
Step by step
- 1
You Send Text
Your words enter the AI as tokens.
- 2
AI Counts Tokens
Each word or symbol uses up space in the context window.
- 3
Window Fills Up
When tokens reach the limit, old text is deleted automatically.
- 4
AI Responds
The AI only uses text still visible in the window.
- 5
You Lose Memory
Older conversation parts become unavailable forever.
Remember
Memory trick
Think: a sliding window. New text slides in, old text slides out the left side forever.
Words
- Context window KON-text WIN-doh
- Maximum text length AI can remember in one chat.
- Token TOH-kun
- One word or small piece of text that AI counts.
- Model MAH-dul
- A trained program that generates AI responses.
- Conversation kun-ver-SAY-shun
- All the messages between you and the AI.
- Limit LIM-it
- The maximum amount the AI can handle.
- Forget for-GET
- To lose information and no longer have access.
Check yourself
What is the context window?
Hint
Think about what AI can and cannot remember.
Context window is exactly the memory limit for one chat session.
You write ten long messages to an AI chatbot. The window is full. What happens next?
Hint
What happens to old apples in a full basket?
When the context window fills, old text is removed to make room for new text.
If you want AI to remember your style for a whole book, what should you do?
Show a good answer
You can repeat your style rules in new conversations, or split the work into shorter chunks. Some AI tools let you use a larger window for longer projects.
Tell a friend
“AI has a memory limit called a context window. It forgets old messages when space runs out.”
People also ask
How big is a typical context window?
Most popular AI models have windows between 2,000 and 100,000 tokens. Newer models often have larger windows. Check your AI tool's settings to see its exact size.
Can I make the context window bigger?
No. The context window is built into each AI model. You cannot change it. Different AI tools have different sizes. You can choose one with a larger window if you need longer memory.
Does saving a chat stop the AI from forgetting?
Saving a chat stores it for you to read later. In a new conversation, AI starts fresh with an empty context window. It cannot see your old saved chat automatically.