Native Anthropic SDK Support
Use Anthropic’s official Python and TypeScript SDKs directly with the AI Gateway. The gateway now supports the native/v1/messages API format alongside the OpenAI-compatible format. See the Anthropic SDK guide for setup instructions.Groq Provider Support
Groq is now a built-in provider. Access Llama and Mixtral models running on Groq’s LPU hardware with automatic failover and observability.Expanded Model Catalog
Added new providers to the model catalog: Hyperbolic, InceptionLabs, Inference.net, and OpenRouter. Updated model aliases and provider-specific model IDs for improved compatibility.Early Access Release
Initial Early Access release of the AI Gateway.Features
- OpenAI-compatible API for routing requests to multiple AI providers
- Support for OpenAI, Anthropic, Google, and other providers
- Multi-provider failover across models, providers, and API keys
- Multi-key failover per provider
- CEL-based model selection strategies
- Custom provider support via internal endpoints
- Token counting and usage metrics