Context
Documented by Cloudflare. Requires robots.txt as a route handler — Next's MetadataRoute.Robots doesn't support custom directives.
Why it matters for agent readiness
AR-DISC-01 MUST. Content-Signal separates 'can you train on this?' (ai-train) from 'can you show in search?' (search) and 'can you use as RAG input?' (ai-input). Value today is contractual/signalling, not ranking.
What to do today
- Audit robots.txt and add Content-Signal if you don't want training.
- Publish one answer-first definition per key concept (this template).
- Validate with POST to isitagentready.com/api/scan for belmon.tech.
Doubts about this term? miguel@belmon.tech · Back to glossary