New reference documentation is now available for AI Crawl Control:
- GraphQL API reference — Query examples for crawler requests, top paths, referral traffic, and data transfer. Includes key filters for detection IDs, user agents, and referrer domains.
- Bot reference — Detection IDs and user agents for major AI crawlers from OpenAI, Anthropic, Google, Meta, and others.
- Worker templates — Deploy the x402 Payment-Gated Proxy to monetize crawler access or charge bots while letting humans through free.
Source: Cloudflare
Latest Posts
- Amazon MSK Express brokers now delivers Apache Kafka data to Amazon S3
- OpenAI GPT-5.6 Terra and GPT-5.6 Luna pricing update on Amazon Bedrock
- Amazon MSK Express brokers now deliver data to streaming tables for Apache Iceberg
- Grok 4.3 from xAI is now available on Amazon Bedrock in AWS GovCloud (US-West)
