Engineering & AI glossary
Understand the metrics, models, and methods behind modern engineering. Clear definitions, practical examples, and a closer look at what the numbers actually mean.
All terms
2,008 termsRequest coalescing
Request coalescing is the serving concept concerned with request coalescing during AI inference.
Inference performanceRequest correlation ID
Request correlation ID is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysRequest normalization
Request normalization is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysRequest priority
Request priority is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysRequest rate
Request rate is the serving concept concerned with request rate during AI inference.
Inference performanceRequest scheduler
Request scheduler is the serving concept concerned with request scheduler during AI inference.
Inference performanceRequested changes
Requested changes is a practical concept in a pull-request workflow that shapes how people examine, discuss, own, or integrate a proposed change.
Code reviewRequired review
Required review is a repository or branch rule that blocks integration until specified review conditions are met.
Code reviewResearch hypothesis
Research hypothesis is a statistical or measurement concept used to describe, compare, or interpret engineering data. Its meaning depends on the unit of analysis, data-generating process, and question being asked.
Measurement and experimentationResidual connection
Residual connection is a language-model concept about serving behavior and operational tradeoffs. It names a mechanism, representation, training practice, or operational behavior that can change how an AI system processes input and produces output.
LLM fundamentalsResilience budget
Resilience budget is a reliability concept used to describe a specific condition, control, or decision in the operation of software services.
Reliability and observabilityResilience debt
Resilience debt is a software maintenance concern describing a condition that can make future changes, verification, operation, or ownership harder. Its practical importance depends on supported behavior, rate of change, and the consequences of delay.
Code quality and technical debtResilience testing
Resilience testing is a software testing or test-design practice used to gather evidence about a defined risk, behavior, boundary, or operating condition. It makes the question under test explicit, identifies the inputs and observations that matter, and gives a team a repeatable basis for deciding whether the result is acceptable.
Code quality and technical debtResource attribute
Resource attribute is metadata identifying the entity that produced telemetry, such as service, host, process, or environment.
Reliability and observabilityResource exhaustion
Resource exhaustion is a reliability concept used to describe a specific condition, control, or decision in the operation of software services.
Reliability and observabilityResponse cache
Response cache is the serving concept concerned with response cache during AI inference.
Inference performanceResponse for a class
A measure of the number of methods potentially executed in response to a message received by a class.
Code quality and technical debtResponse normalization
Response normalization is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysResponse prefilling
Response prefilling is a language-model concept about representation and similarity. It names a mechanism, representation, prompting pattern, decoding control, or context behavior that can change how an AI system processes input and produces output.
LLM fundamentalsRestore validation
Restore validation is a reliability concept used to describe a specific condition, control, or decision in the operation of software services.
Reliability and observabilityRetrieval augmented generation
Retrieval augmented generation, or RAG, is an architecture that retrieves relevant documents or records and supplies them to a language model as context for generating a response. It can ground answers in a changing or private information source without retraining the model for every update.
LLM fundamentalsRetrieval evaluation
Retrieval evaluation is a defined lens for examining AI system behavior with a stated task, evidence, and interpretation rule.
Evaluations and benchmarksRetrospective action
Retrospective action is a way to organize, support, or evaluate software work so that teams can make useful progress with less avoidable friction. It is most valuable when connected to a concrete outcome and the local conditions of the team using it.
Developer productivityRetry amplification
Retry amplification is the serving concept concerned with retry amplification during AI inference.
Inference performanceRetry budget
Retry budget is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysRetry policy
Retry policy is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysRetryable error
Retryable error is a reliability concept used to describe a specific condition, control, or decision in the operation of software services.
Reliability and observabilityRevert review
Revert review is a practical concept in a pull-request workflow that shapes how people examine, discuss, own, or integrate a proposed change.
Code reviewReview abandonment
Review abandonment is a practical concept in a pull-request workflow that shapes how people examine, discuss, own, or integrate a proposed change.
Code reviewReview backlog
A code review backlog is the accumulated set of proposed changes that still require review activity or a final decision.
Code reviewReview bottleneck
A review bottleneck is a constrained person, team, policy, or stage that limits the movement of proposed changes.
Code reviewReview capacity
Review capacity is the effective ability of reviewers to assess eligible changes during a period. It depends on change scope, reviewer context, specialist requirements, interruptions, and the standard of review expected.
Flow and capacity planningReview capacity buffer
A review capacity buffer is deliberately uncommitted reviewer capacity reserved for incoming changes, urgent work, and variation in review difficulty.
Code reviewReview capacity planning
Review capacity planning is the practice of matching expected code review demand with the people, ownership, time, and knowledge needed to provide timely and effective review. It treats review as a delivery capability rather than spare work performed after implementation.
Developer productivityReview comment
Review comment is a practical concept in a pull-request workflow that shapes how people examine, discuss, own, or integrate a proposed change.
Code reviewReview comment density
Review comment density is the number of review comments relative to a chosen unit such as changed lines, files, or pull requests.
Code reviewReview comment resolution
Review comment resolution tracks whether feedback receives a response, code change, explicit rationale, or documented decision.
Code reviewReview coverage
Review coverage describes the share of eligible changes that receive the intended review evidence before integration.
Code reviewReview cycle count
Review cycle count is the number of meaningful feedback and revision cycles a change passes through before its review is complete.
Code reviewReview defect detection
Review defect detection is the practice of finding correctness, security, reliability, or maintainability problems before code reaches later stages.
Code reviewReview depth
Review depth describes how carefully a change is examined across behavior, design, tests, security, and maintainability.
Code reviewReview effectiveness
Review effectiveness is the extent to which a review finds useful problems, improves shared understanding, and supports a safe change.
Code reviewReview finding rate
Review finding rate is the frequency at which a review identifies a defined issue class before a change is integrated.
Code reviewReview handoff
A code review handoff transfers responsibility for understanding and progressing a proposed change from one reviewer or team to another.
Code reviewReview iteration
A review iteration is one cycle of author changes followed by reviewer feedback on the same proposed change.
Code reviewReview iteration count
Review iteration count is a developer productivity concept that helps teams understand review iteration count in the context of software delivery.
Developer productivityReview load distribution
Review load distribution shows how review requests or completed reviews are spread across people, teams, repositories, or change types.
Code reviewReview meeting
Review meeting is a practical concept in a pull-request workflow that shapes how people examine, discuss, own, or integrate a proposed change.
Code reviewReview noise
Review noise is feedback or workflow activity that consumes attention without helping a reviewer or author make a safer, clearer change.
Code reviewReview objective
Review objective is a practical concept in a pull-request workflow that shapes how people examine, discuss, own, or integrate a proposed change.
Code review