Amazon Bedrock now supports Global Cross-Region inference for Anthropic Claude Sonnet 4

Amazon Bedrock now supports Global Cross-Region inference for Anthropic Claude Sonnet 4

Anthropic’s Claude Sonnet 4 is now available with Global cross-Region inference in Amazon Bedrock, so you can now use the Global Claude Sonnet 4 inference profile to route your inference requests to any supported commercial AWS Region for processing, optimizing available resources and enabling higher model throughput.

Amazon Bedrock is a comprehensive, secure, and flexible service for building generative AI applications and agents. When using on-demand and batch inference in Amazon Bedrock, your requests may be restricted by service quotas or during peak usage times. Cross-region inference enables you to seamlessly manage unplanned traffic bursts by utilizing compute across different AWS Regions. With cross-region inference, you can distribute traffic across multiple AWS Regions, enabling higher throughput. Previously, you were able to choose cross-region inference profiles tied to a specific geography such as the US, EU, or APAC, which automatically selected the optimal commercial AWS Region within that geography to process your inference requests. For your generative AI use cases that do not require you to choose inference profiles tied to a specific geography, you can now use the Global cross-region inference profile to further increase your model throughput.

To learn more about global cross-Region inference in Amazon Bedrock, you can visit our documentation on increasing throughput with cross-Region inference, see supported Regions and models for inference profiles, and follow the steps mentioned in the Use an inference profile in model invocation page to get started.

Categories: general:products/amazon-bedrock,marketing:marchitecture/artificial-intelligence

Source: Amazon Web Services



Latest Posts

Pass It On
Leave a Comment

Comments

No comments yet. Why don’t you start the discussion?

Leave a Reply

Your email address will not be published. Required fields are marked *