AI Crawl Control – New AI Crawl Control Overview tab

AI Crawl Control – New AI Crawl Control Overview tab

The Overview tab is now the default view in AI Crawl Control. The previous default view with controls for individual AI crawlers is available in the Crawlers tab.

What’s new

  • Executive summary — Monitor total requests, volume change, most common status code, most popular path, and high-volume activity
  • Operator grouping — Track crawlers by their operating companies (OpenAI, Microsoft, Google, ByteDance, Anthropic, Meta)
  • Customizable filters — Filter your snapshot by date range, crawler, operator, hostname, or path
AI Crawl Control Overview tab showing executive summary, metrics, and crawler groups

Get started

  1. Log in to the Cloudflare dashboard and select your account and domain.
  2. Go to AI Crawl Control, where the Overview tab opens by default with your activity snapshot.
  3. Use filters to customize your view by date range, crawler, operator, hostname, or path.
  4. Navigate to the Crawlers tab to manage controls for individual crawlers.

Learn more about analyzing AI traffic and managing AI crawlers.

Source: Cloudflare



Latest Posts

Pass It On
Leave a Comment

Comments

No comments yet. Why don’t you start the discussion?

Leave a Reply