Ensure Your Website is Visible to AI: Fix Cloudflare BlocksEnsure Your Website is Visible to AI: Fix Cloudflare Blocks
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Your business website is probably invisible to AI.
Cloudflare silently injects a managed robots.txt that blocks ClaudeBot, GPTBot, and Google-Extended. The "AI bot protection" toggle in the dashboard doesn't actually disable it. You also have to flip `is_robots_txt_managed` to false via the API.
Until you do: • Buyers asking ChatGPT "who builds X" won't find you • Your work doesn't show up in Google's AI Overviews • Any agent (yours or a customer's) reading your site gets a 403
Curl tells you in 5 seconds:
`curl -A "ClaudeBot" https://yoursite.com/robots.txt`
If there are Disallow lines you didn't write, that's Cloudflare. Fix is one API call. Or have an agent do it.
I've checked roughly ten sites since I noticed this. Eight were quietly blocked.
Anyone here actually checked whether their site shows up in AI search yet? What did the curl tell you?
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started