
Ultimate access to all questions.
Answer-first summary for fast verification
Answer: Short-term working memory
The context window in AI models refers to the amount of text or tokens the model can consider at once when generating responses. This is analogous to short-term working memory in humans because: 1. **Limited capacity**: Both have a fixed maximum size 2. **Temporary storage**: Information is only available during processing 3. **Active processing**: The content is actively used for current tasks 4. **Sliding window**: As new information comes in, older information may be "forgotten" or pushed out Unlike long-term memory which stores information permanently, the context window only holds information temporarily for immediate processing. Neural embedding space refers to how words/concepts are represented mathematically, and batch processing unit refers to hardware/processing optimization techniques.
Author: Jin H
No comments yet.