Active Nerds
Back to Glossary Index

Context Window

Maximum token capacity an LLM can digest in a single forward pass, spanning system prompts, history, and responses.

Mechanism & Definition

The maximum total sequence length (in tokens) an LLM can consume in a single forward pass. Bounds the combined length of system instructions, retrieved RAG context, conversation history, and the newly generated output tokens.

Related Terms

Appears In