The Overview tab is now the default view in AI Crawl Control. The previous default view with controls for individual AI crawlers is available in the Crawlers tab.
What’s new
- Executive summary — Monitor total requests, volume change, most common status code, most popular path, and high-volume activity
- Operator grouping — Track crawlers by their operating companies (OpenAI, Microsoft, Google, ByteDance, Anthropic, Meta)
- Customizable filters — Filter your snapshot by date range, crawler, operator, hostname, or path
Get started
- Log in to the Cloudflare dashboard and select your account and domain.
- Go to AI Crawl Control, where the Overview tab opens by default with your activity snapshot.
- Use filters to customize your view by date range, crawler, operator, hostname, or path.
- Navigate to the Crawlers tab to manage controls for individual crawlers.
Learn more about analyzing AI traffic and managing AI crawlers.
Source: Cloudflare
Latest Posts
- (Updated) Collect Diagnostics change to Get Diagnostics for Outlook Mobile and Mac [MC1308855]
- (Updated) Smart Calendar available in Classic Outlook for Microsoft 365 Copilot users [MC1181279]
- Amazon Bedrock Guardrails announces a new API targeting agentic AI workflows
- Amazon FSx for Lustre Intelligent-Tiering storage class is now available in 13 additional AWS Regions
