BotConsent starter docs.
Practical guidance for adding AI bot consent policies to websites, publishing discovery files, and preparing Cloudflare deployment.
Policy: https://botconsent.com/policies/example.com AI-Training: disallow Assistant-Retrieval: allow_with_attribution Commercial-Scraping: manual_review
Start with the policy model, then connect the website.
These starter docs are written for non-technical site owners and developers who need implementation details.
What is BotConsent?
A practical introduction to AI bot consent and how BotConsent helps websites publish machine-readable preferences.
May 6, 2026How to add BotConsent to a website
Add a generated AI bot consent policy, connect your domain, and publish discovery files.
May 6, 2026How AI bot consent policies work
Understand category-level preferences, bot-specific overrides, hosted policy pages, and enforcement signals.
May 6, 2026robots.txt vs llms.txt vs BotConsent policy
Compare traditional crawler instructions, AI-oriented context files, and richer consent policies.
May 6, 2026API overview
A starter overview for the BotConsent API shape, designed for hosted policies and developer integrations.
May 6, 2026Cloudflare deployment notes
Deploy BotConsent to Cloudflare Pages with a static build and Pages Functions for form handling.