Skip to main content
BlogNewsletterRSS
Back to changelog

Manage AI Gateway at app.ngrok.ai and send traffic to one URL

Shipped by Nijiko Yonskai and Brenden Ehlers

AI Gateway used to run inside your own endpoint, as a Traffic Policy action. Now it has its own dashboard and its own URL.

Manage access keys, access key configurations, provider keys, credits, and settings at app.ngrok.ai. Point your apps at https://gateway.ngrok.ai and send an access key. Your provider keys stay on the server, so they never ship inside your app (or turn up in a screenshot in a support ticket).

Provider keys you bring yourself now belong to your account, not to one endpoint. Setup with a Traffic Policy action on your own endpoint is deprecated.

Get started

  1. Create an ngrok account or sign in.
  2. Create an access key.
  3. Buy credits, or attach your own provider keys.
  4. Follow the quickstart and set your SDK’s base URL to https://gateway.ngrok.ai/v1.
  5. Open Logs to see each request’s status, model, provider, usage, and cost.