AI Gateway now supports automatic retries at the gateway level. When an upstream provider returns an error, your gateway retries the request based on the retry policy you configure, without requiring any client-side changes.
You can configure the retry count (up to 5 attempts), the delay between retries (from 100ms to 5 seconds), and the backoff strategy (Constant, Linear, or Exponential). These defaults apply to all requests through the gateway, and per-request headers can override them.
This is particularly useful when you do not control the client making the request and cannot implement retry logic on the caller side. For more complex failover scenarios — such as failing across different providers — use Dynamic Routing.
For more information, refer to Manage gateways.
Source: Cloudflare
Latest Posts
- Web Search on AWS Bedrock now supports domain filtering and user location controls
- MC1523076: Microsoft Teams Shifts Loop Meeting Notes Storage to Meeting Organizer’s OneDrive
- MC1523090: Microsoft Teams Adds Side Conversations in Meeting Chat
- MC1523086: Microsoft Teams Adds Alternate Text Support for OneDrive and SharePoint Images
