The Count Tokens API is now available in Amazon Bedrock, enabling you to determine the token count for a given prompt or input being sent to a specific model ID prior to performing any inference.
By surfacing a prompt’s token count, the Count Tokens API allows you to more accurately project your costs, and provides you with greater transparency and control over your AI model usage. It allows you to proactively manage your token limits on Amazon Bedrock, helping to optimize your usage and avoid unexpected throttling. It also helps ensure your workloads fit within a model’s context length limit, allowing for more efficient prompt optimization.
At launch, the Count Tokens API will support Claude models, with the functionality available in all regions where these models are supported. For more information about this new feature, including supported models and use cases, visit the Count Tokens API documentation.
Categories: marketing:marchitecture/artificial-intelligence,general:products/amazon-bedrock,general:products/amazon-machine-learning
Source: Amazon Web Services
Latest Posts
- SharePoint site analytics: OneNote usage included in site usage reports [MC1194626]
- Microsoft Excel: Enabling M365 subscribers to use Copilot Chat in locally stored modern workbooks [MC1194615]
- (Updated) Microsoft 365 Copilot: Steer your presentation length, tone, style, and images when creating with Copilot [MC1185911]
- (Updated) Changes to how users install Microsoft 365 apps from the Microsoft 365 Copilot app [MC1062453]
![(Updated) DNS Provisioning Change [MC1048624]](https://mwpro.co.uk/wp-content/uploads/2025/06/pexels-cottonbro-9668883-96x96.webp "(Updated) DNS Provisioning Change [MC1048624] 6")
