A reference from Weave

Model routing and gateways glossary

Learn how applications choose models, manage providers, and recover from failures. Understand the tradeoffs between answer quality, response time, and cost.

All terms

120 terms

  • Model fallback

    Model fallback is the use of an alternate model or provider when the preferred route cannot handle a request or fails a defined condition. A fallback policy can respond to outages, rate limits, unsupported capabilities, timeouts, or application-level checks.

    Model routing and gateways

  • Model gateway

    A model gateway is a service layer that gives applications a common interface to one or more model providers. Depending on its design, it can handle routing, authentication, retries, fallbacks, usage tracking, and request policies.

    Model routing and gateways

  • Model registry

    Model registry is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Model routing

    Model routing is the process of selecting which AI model handles a request or a step in a workflow. A routing policy can consider the task, required capabilities, expected quality, price, latency, and provider availability.

    Model routing and gateways

  • Model version pinning

    Model version pinning is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Multi-region routing

    Multi-region routing is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Policy as code

    Policy as code is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Policy simulation

    Policy simulation is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Policy-based routing

    Policy-based routing is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Priority queue

    Priority queue is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Priority routing

    Priority routing is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider adapter

    Provider adapter is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider allowlist

    Provider allowlist is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider availability

    Provider availability is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider capability matrix

    Provider capability matrix is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider denylist

    Provider denylist is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider health check

    Provider health check is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider health score

    Provider health score is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider metrics

    Provider metrics is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider quota

    Provider quota is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider rate limit

    Provider rate limit is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider registry

    Provider registry is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider routing

    Provider routing selects an infrastructure provider or endpoint for a model request. The policy may consider price, latency, availability, regional requirements, quotas, capabilities, or recent provider performance.

    Model routing and gateways

  • Provider SLA

    Provider SLA is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider trace

    Provider trace is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider version pinning

    Provider version pinning is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider-agnostic API

    Provider-agnostic API is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Provider-agnostic failover

    Provider-agnostic failover is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Random routing

    Random routing is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Rate limit bucket

    Rate limit bucket is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Read timeout

    Read timeout is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Region-aware routing

    Region-aware routing is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Request admission control

    Request admission control is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Request correlation ID

    Request correlation ID is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Request normalization

    Request normalization is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Request priority

    Request priority is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Response normalization

    Response normalization is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Retry budget

    Retry budget is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Retry policy

    Retry policy is a model-routing or gateway concept used to manage reliable request governance for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Round-robin routing

    Round-robin routing is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Route decision

    A route decision is the explicit selection of a model, provider, or execution path for an AI request. It should include the eligible options, the policy inputs, and the selected destination so the outcome can be inspected later.

    Model routing and gateways

  • Route explanation

    Route explanation is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Route reason code

    Route reason code is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Route trace

    Route trace is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Routing audit log

    Routing audit log is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Routing configuration

    Routing configuration is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Routing metrics

    Routing metrics is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Routing policy version

    Routing policy version is a model-routing or gateway concept used to manage policy enforcement for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Routing span

    Routing span is a model-routing or gateway concept used to manage operational visibility for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways

  • Rule-based routing

    Rule-based routing is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.

    Model routing and gateways