> ## Documentation Index
> Fetch the complete documentation index at: https://ngrok.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Providers

> AI providers available in the ngrok AI Gateway.

Providers are the AI services that host and serve models. The AI Gateway routes your requests to providers and handles authentication, failover, and observability.

## Managed providers

These providers are available with [AI Gateway API Keys](/ai-gateway/concepts/api-keys)—no provider accounts needed. ngrok handles authentication automatically.

<CardGroup cols={2}>
  <Card title="OpenAI" icon="robot" href="/ai-gateway/providers/openai">
    GPT and o-series models. Managed keys available.
  </Card>

  <Card title="Anthropic" icon="a" href="/ai-gateway/providers/anthropic">
    Claude models. Managed keys available. Supports both OpenAI and Anthropic SDK formats.
  </Card>
</CardGroup>

## BYOK providers

These providers require you to bring your own key. See each provider's page for setup instructions.

<CardGroup cols={2}>
  <Card title="OpenRouter" icon="shuffle" href="/ai-gateway/providers/openrouter">
    Access hundreds of models from multiple providers through a single API.
  </Card>

  <Card title="Google" icon="google" href="/ai-gateway/providers/google">
    Gemini models from Google AI Studio.
  </Card>

  <Card title="Groq" icon="bolt" href="/ai-gateway/providers/groq">
    LPU-accelerated inference for open-source models (Llama, Mixtral).
  </Card>

  <Card title="DeepSeek" icon="brain" href="/ai-gateway/providers/deepseek">
    High-performance reasoning and chat models.
  </Card>

  <Card title="Hyperbolic" icon="server" href="/ai-gateway/providers/hyperbolic">
    Open-source model hosting with high-performance inference.
  </Card>

  <Card title="InceptionLabs" icon="sparkles" href="/ai-gateway/providers/inceptionlabs">
    Diffusion-based language models for fast text generation.
  </Card>

  <Card title="Inference.net" icon="network-wired" href="/ai-gateway/providers/inference-net">
    Distributed inference network for AI models at scale.
  </Card>
</CardGroup>

## Self-hosted providers

Run open-source models on your own infrastructure and connect them to the gateway.

<CardGroup cols={2}>
  <Card title="Ollama" icon="terminal" href="/ai-gateway/custom-providers/ollama">
    Run open-source models locally with Ollama.
  </Card>

  <Card title="vLLM" icon="bolt" href="/ai-gateway/custom-providers/vllm">
    High-performance inference server.
  </Card>

  <Card title="LM Studio" icon="desktop" href="/ai-gateway/custom-providers/lm-studio">
    Desktop app for local model inference.
  </Card>

  <Card title="Azure OpenAI" icon="microsoft" href="/ai-gateway/custom-providers/azure-openai">
    Microsoft's OpenAI service on Azure.
  </Card>
</CardGroup>

## How provider selection works

When a request arrives, the gateway determines which provider to use:

1. **Explicit provider prefix**: if the model name includes a provider prefix (for example, `openai:gpt-4o` or `openrouter:anthropic/claude-3.5-sonnet`), that provider is used
2. **Catalog lookup**: the gateway looks up the model ID in its [catalog](/ai-gateway/reference/model-catalog) to find the default provider
3. **Selection strategy**: if configured, [model selection strategies](/ai-gateway/guides/model-selection-strategies) can override the default

## Next steps

* [Model Catalog](/ai-gateway/reference/model-catalog): browse all available models by provider
* [Bring Your Own Keys](/ai-gateway/concepts/bring-your-own-keys): manage provider API keys centrally
* [Multi-provider failover](/ai-gateway/examples/multi-provider-failover): automatic failover across providers