New reference documentation is now available for AI Crawl Control:
- GraphQL API reference — Query examples for crawler requests, top paths, referral traffic, and data transfer. Includes key filters for detection IDs, user agents, and referrer domains.
- Bot reference — Detection IDs and user agents for major AI crawlers from OpenAI, Anthropic, Google, Meta, and others.
- Worker templates — Deploy the x402 Payment-Gated Proxy to monetize crawler access or charge bots while letting humans through free.
Source: Cloudflare
Latest Posts
- AWS Lambda MicroVMs is now available in 5 additional AWS regions
- AWS IAM now supports 20 managed policies per role by default
- Web Search in Amazon Bedrock AgentCore adds domain and published date filtering, expands to Europe and Asia Pacific
- MC1323266: Microsoft 365 Copilot Gets Power BI Data Grounding for Answering User Questions
