Find a term
Build a practical understanding of language models, prompts, tokens, and context. Focus on the concepts that affect real applications and engineering workflows.
Terms beginning with A
6 termsAbsolute positional embedding
Absolute positional embedding is a language-model concept about training behavior and measurement. It names a mechanism, representation, training practice, or operational behavior that can change how an AI system processes input and produces output.
LLM fundamentalsActivation
Activation is a language-model concept about training behavior and measurement. It names a mechanism, representation, training practice, or operational behavior that can change how an AI system processes input and produces output.
LLM fundamentalsActivation patching
Activation patching is a language-model concept about serving behavior and operational tradeoffs. It names a mechanism, representation, training practice, or operational behavior that can change how an AI system processes input and produces output.
LLM fundamentalsApproximate nearest neighbor
Approximate nearest neighbor is a language-model concept about generation behavior and sampling. It names a mechanism, representation, prompting pattern, decoding control, or context behavior that can change how an AI system processes input and produces output.
LLM fundamentalsAttention head
Attention head is a language-model concept about training behavior and measurement. It names a mechanism, representation, training practice, or operational behavior that can change how an AI system processes input and produces output.
LLM fundamentalsAutomatic prompt optimization
Automatic prompt optimization is a language-model concept about context selection and limits. It names a mechanism, representation, prompting pattern, decoding control, or context behavior that can change how an AI system processes input and produces output.
LLM fundamentals