Find a term
Learn how applications choose models, manage providers, and recover from failures. Understand the tradeoffs between answer quality, response time, and cost.
Terms beginning with G
6 termsGateway adapter
Gateway adapter is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysGateway configuration
Gateway configuration is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysGateway endpoint
Gateway endpoint is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysGateway metrics
Gateway metrics is a model-routing or gateway concept used to manage interface consistency for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gatewaysGateway request lifecycle
The gateway request lifecycle is the ordered set of stages an AI request passes through before a response reaches the application. It commonly includes authentication, admission, policy evaluation, routing, provider execution, retries or fallback, response handling, and usage recording.
Model routing and gatewaysGraceful degradation
Graceful degradation is a model-routing or gateway concept used to manage traffic selection for AI requests. It describes a distinct decision, control, interface, or observation point between an application and one or more model providers.
Model routing and gateways