Other SDKs

Prerequisite: Complete the Quickstart to get an access key. All requests go to https://gateway.ngrok.ai.

The AI Gateway works with any SDK or HTTP client that supports OpenAI API or Anthropic Claude API format. If your language or framework isn’t covered in the dedicated guides, you can still use the gateway.

Requirements

For any SDK or client to work with the AI Gateway, it must:

Support the OpenAI API or Anthropic Claude API format
Allow customizing the base URL / endpoint
Send requests with proper authorization headers (for OpenAI API, Authorization; for Anthropic Claude API, x-api-key)

Authentication

Pass your access key (ng-xxxxx-g1-xxxxx) as the API key. The AI Gateway injects upstream provider credentials from your access key configuration.

cURL

For testing or shell scripts:

curl https://gateway.ngrok.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer ng-xxxxx-g1-xxxxx" \  # Your access key
  -d '{
    "model": "gpt-4o",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

curl https://gateway.ngrok.ai/v1/messages \
  -H "Content-Type: application/json" \
  -H "x-api-key: ng-xxxxx-g1-xxxxx" \  # Your access key
  -H "anthropic-version: 2023-06-01" \
  -d '{
    "model": "claude-sonnet-4-20250514",
    "max_tokens": 1024,
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

HTTP request format

Any HTTP client can call the AI Gateway:

POST /v1/chat/completions HTTP/1.1
Host: gateway.ngrok.ai
Content-Type: application/json
Authorization: Bearer ng-xxxxx-g1-xxxxx

{
  "model": "gpt-4o",
  "messages": [
    {"role": "user", "content": "Hello!"}
  ]
}

POST /v1/messages HTTP/1.1
Host: gateway.ngrok.ai
Content-Type: application/json
x-api-key: ng-xxxxx-g1-xxxxx
anthropic-version: 2023-06-01

{
  "model": "claude-sonnet-4-20250514",
  "max_tokens": 1024,
  "messages": [
    {"role": "user", "content": "Hello!"}
  ]
}

Using provider prefixes

All clients support routing to specific providers using model prefixes:

# OpenAI
model: "openai:gpt-4o"

# Anthropic
model: "anthropic:claude-3-5-sonnet-latest"

# Self-hosted
model: "ollama:llama3.2"

Supported endpoints

The AI Gateway supports these endpoints:

Endpoint	API Format	Description
`/v1/chat/completions`	OpenAI	Chat completions
`/v1/completions`	OpenAI	Legacy completions
`/v1/embeddings`	OpenAI	Text embeddings
`/v1/models`	OpenAI	List available models
`/v1/messages`	Anthropic	Messages

Next steps

OpenAI SDK - Official Python, TypeScript, Go, Java, and .NET guide
Vercel AI SDK - For Next.js and React applications
LangChain - For LangChain applications
Choose a model
Configure fallback models

Concepts

Getting Started With

SDKs

Guides

Observability

Examples

Reference

API Reference

Requirements

Authentication

cURL

HTTP request format

Using provider prefixes

Supported endpoints

Next steps

​Requirements

​Authentication

​cURL

​HTTP request format

​Using provider prefixes

​Supported endpoints

​Next steps

Requirements

Authentication

cURL

HTTP request format

Using provider prefixes

Supported endpoints

Next steps