Skip to content

Changelog

New updates and improvements at Cloudflare.

View RSS feeds Subscribe to RSS
Back to all posts

New reference documentation

AI Crawl Control
View as MarkdownAgent setup

New reference documentation is now available for AI Crawl Control:

  • GraphQL API reference — Query examples for crawler requests, top paths, referral traffic, and data transfer. Includes key filters for detection IDs, user agents, and referrer domains.
  • Bot reference — Detection IDs and user agents for major AI crawlers from OpenAI, Anthropic, Google, Meta, and others.
  • Worker templates — Deploy the x402 Payment-Gated Proxy to monetize crawler access or charge bots while letting humans through free.