---
title: AI Audit
---
[Skip to content](#_top)
[API Reference](https://developers.cloudflare.com/api)
Copy Markdown
Open in **Claude**Open in **ChatGPT**Open in **Cursor**
---
**Copy Markdown****View as Markdown**
# AI Audit
#### AI AuditRobots
##### [Get robots.txt rules](https://developers.cloudflare.com/api/resources/ai_audit/subresources/robots/methods/get)
GET/zones/{zone\_id}/ai-audit/robots
##### [Bulk get robots.txt rules](https://developers.cloudflare.com/api/resources/ai_audit/subresources/robots/methods/bulk_get)
POST/zones/{zone\_id}/ai-audit/robots/bulk
##### ModelsExpand Collapse
RobotGetResponse object {userAgents, sitemaps, status }
Parsed robots.txt rules for a single domain.
userAgents: map\[object {allow, disallow, contentSignals, crawlDelay } ]
Map of user-agent string to its parsed rules.
allow: array of string
List of allowed path patterns.
Link to this property
disallow: array of string
List of disallowed path patterns.
Link to this property
contentSignals: optional object {"ai-input", "ai-train", search }
Content signal directives from robots.txt.
"ai-input": optional "yes"or "no"
Whether AI input usage is permitted.
One of the following:
"yes"
Link to this property
"no"
Link to this property
Link to this property
"ai-train": optional "yes"or "no"
Whether AI training is permitted.
One of the following:
"yes"
Link to this property
"no"
Link to this property
Link to this property
search: optional "yes"or "no"
Whether search indexing is permitted.
One of the following:
"yes"
Link to this property
"no"
Link to this property
Link to this property
Link to this property
crawlDelay: optional number
Crawl delay in seconds.
Link to this property
Link to this property
sitemaps: optional array of string
List of sitemap URLs found in robots.txt.
Link to this property
status: optional number
HTTP status code from fetching the robots.txt file.
Link to this property
[Link to this property](<#(resource)%20ai_audit.robots%20%3E%20(model)%20robot_get_response%20%3E%20(schema)>)
RobotBulkGetResponse = map\[object {userAgents, sitemaps, status } ]
Map of hostname to parsed robots.txt rules.
userAgents: map\[object {allow, disallow, contentSignals, crawlDelay } ]
Map of user-agent string to its parsed rules.
allow: array of string
List of allowed path patterns.
Link to this property
disallow: array of string
List of disallowed path patterns.
Link to this property
contentSignals: optional object {"ai-input", "ai-train", search }
Content signal directives from robots.txt.
"ai-input": optional "yes"or "no"
Whether AI input usage is permitted.
One of the following:
"yes"
Link to this property
"no"
Link to this property
Link to this property
"ai-train": optional "yes"or "no"
Whether AI training is permitted.
One of the following:
"yes"
Link to this property
"no"
Link to this property
Link to this property
search: optional "yes"or "no"
Whether search indexing is permitted.
One of the following:
"yes"
Link to this property
"no"
Link to this property
Link to this property
Link to this property
crawlDelay: optional number
Crawl delay in seconds.
Link to this property
Link to this property
sitemaps: optional array of string
List of sitemap URLs found in robots.txt.
Link to this property
status: optional number
HTTP status code from fetching the robots.txt file.
Link to this property
[Link to this property](<#(resource)%20ai_audit.robots%20%3E%20(model)%20robot_bulk_get_response%20%3E%20(schema)>)