AI Gateway API Keys & Credits
You can now authenticate requests to your AI Gateway with AI Gateway API Keys—no provider accounts needed. ngrok manages the provider keys for OpenAI and Anthropic on your behalf. Purchase prepaid credits to fund usage.- AI Gateway API Keys: Create keys to authenticate requests
- Credits: Understand pricing and balance management
- Bring Your Own Keys: Use your own provider keys for additional providers
- Updated Quickstart, Overview, and all SDK guides to use AI Gateway API Keys as the primary path
Native Anthropic SDK Support
Use Anthropic’s official Python and TypeScript SDKs directly with the AI Gateway. The gateway now supports the native/v1/messages API format alongside the OpenAI-compatible format. See the Anthropic SDK guide for setup instructions.Groq Provider Support
Groq is now a built-in provider. Access Llama and Mixtral models running on Groq’s LPU hardware with automatic failover and observability.Expanded Model Catalog
Added new providers to the model catalog: Hyperbolic, InceptionLabs, Inference.net, and OpenRouter. Updated model aliases and provider-specific model IDs for improved compatibility.Early Access Release
Initial Early Access release of the AI Gateway.Features
- OpenAI-compatible API for routing requests to multiple AI providers
- Support for OpenAI, Anthropic, Google, and other providers
- Multi-provider failover across models, providers, and API keys
- Multi-key failover per provider
- CEL-based model selection strategies
- Custom provider support via internal endpoints
- Token counting and usage metrics