Skip to main content

Gateway Providers

Gateway providers aggregate multiple model providers and add features like caching, rate limiting, analytics, and automatic failover. Use gateways when you need observability, cost management, or simplified multi-provider access.

Custom Gateways
Direct link to Custom Gateways

Create custom gateways for private LLM deployments or specialized provider integrations. See Custom Gateways for implementation details.

Built-in Gateways
Direct link to Built-in Gateways

On this page