Trace every retry behind an AI Gateway request
Shipped by mohamed
A request that fails over three times and then succeeds looks exactly like one that succeeded on the first try. Now you can see the whole trip.
Pass the Ngrok-AIG-Request-Id header value to GET https://api.ngrok.ai/usage/requests/<REQUEST_ID>. You get each attempt in order, with its provider, model, status code, and why the gateway moved on.
If a model in your fallback list never ran, for example because your access key can’t call it, the Ngrok-AIG-Rejected-Models header names it. No more wondering why your backup duck never quacked.
Get started
- Send a request with a
modelsfallback list. - Copy its
Ngrok-AIG-Request-Idheader. - Follow Why a request failed over to look up its attempts.