Decide which AI bots get to read your site.
Pick a stance, adjust any bot, and copy a finished robots.txt. Nothing is uploaded and there is nothing to sign up for.
# AI training: blockedUser-agent: GPTBotUser-agent: ClaudeBotUser-agent: Google-ExtendedDisallow: /# Everyone elseUser-agent: *Allow: /
Everything you need to write the file
One list of AI crawlers, clear switches, and a finished file you can copy.
Every major AI bot
OpenAI, Anthropic, Google, Apple, Meta, Perplexity, Amazon and more, each with a plain note on what it does.
Three kinds, set separately
Training crawlers, AI search crawlers and user-request fetchers each have their own switch, or flip a whole group at once.
Presets that fit
Opt out of training in one click, block every AI bot, or allow them all. Adjust from there.
Paths and exceptions
Block the whole site or only certain folders, and keep pages like /press/ open to everyone.
Import your current file
Paste your existing robots.txt. Bots you block are picked up, and your other rules and sitemap lines stay.
Private by design
Everything runs in your browser. Nothing you type leaves this page.
Three steps, about two minutes
Bots from the companies that matter
Before you publish
Will this hurt my Google rankings?
No. Google-Extended and Applebot-Extended only control AI use. Googlebot and Bingbot are not in this list and keep crawling for search. Blocking AI search bots such as OAI-SearchBot can make you appear less often in those AI products.
Does blocking remove my content from AI models?
No. A block applies from the next visit. Content a crawler already collected stays with its operator.
Do all bots follow robots.txt?
Major operators say their crawlers do. User-request fetchers may not, and some crawlers ignore it. For a hard block, add firewall or CDN rules for the same user agents.
Is anything sent or stored?
Nothing you enter is uploaded. The page builds your file in your browser and remembers your choices only in that browser. The one exception is optional alerts on the live site: if you turn them on, your browser's push address is stored so alerts can be sent.
Ready to write your file?
Pick a preset and you will have a finished robots.txt in a minute.
Need a tool built, or your marketing run?
BotBouncer is made by Meenox, a studio that builds AI-automated systems, websites and business software, and runs digital marketing for businesses of every size.
Choose which AI bots to allow or block
Pick a stance
A starting point. You can change any bot in the next step.
Or start from your site type
Already have a robots.txt? Import it
Bots you already block switch to Block. Rules for other crawlers and your sitemap lines are kept.
Fine-tune each bot
Tap a card to flip it between Allow and Block.
Set the rules for your robots.txt
Set the boundaries
Decide what blocked bots can't read, and what stays open.
One per line. / blocks the whole site. /private/ blocks one folder.
Blocked bots may still read these.
Paths should start with / or *. Crawlers ignore lines that don't.
Common patterns
/- Block the whole site
/private/- Block one folder and everything in it
/*.pdf$- Block every PDF
/press/- As an exception, keep one folder open
Finish the file
Rules for everyone else, your sitemap, and how the file reads.
Written after the AI rules. Google, Bing and other search engines follow this group unless a more specific one applies to them.
Copy your robots.txt file
Copy your file
Save it as robots.txt in the root folder of your site.
https://your-domain/robots.txt, then open that address to confirm it loads as plain text.Check your robots.txt for AI bots
Check your robots.txt
Paste a robots.txt to see which AI bots it blocks, what is wrong with it, and whether a path is open to a crawler.
Test a path
Results
Paste a file and choose Check file. You will see how many AI bots it blocks, a list of problems with line numbers, and the status of each bot.
robots.txt guide for AI crawlers
How robots.txt works
A robots.txt file sits at the root of your domain and tells crawlers which parts of your site they may visit. Each rule names a crawler by its User-agent and lists the paths it should leave alone with Disallow.
AI companies run three kinds of bots. Training crawlers collect pages to build models and datasets. Search crawlers index pages so an AI product can cite them. User fetchers open a single page because someone asked an assistant about it. This tool lets you set each bot on its own.
Putting the file on your site
- Save it as plain text. Name it exactly
robots.txt, in lowercase. - Upload it to the root. It must load at
https://your-domain/robots.txt. Rules in a subfolder are ignored. On a hosted site builder or CMS, look for a robots.txt editor in the SEO settings. - Open that address. Check that your rules appear as plain text.
- Check it again after site changes. New sections, redirects or a new host can replace the file.
Bot-list alerts
Get a notification when the bot list or its rules change. Only that, and only if you turn it on. Your browser gives us a push address so we can reach you, and turning alerts off deletes it.
Changelog
- 2026-11-03 Hard-block rules, file checker, bot pages
- Added Nginx, Apache and Cloudflare rules next to robots.txt.
- Added the Check page: paste any robots.txt and test a path.
- Added site-type starting points and a Download button.
- Added an AI bot directory with one page per bot.
- Phone layout: bottom menu bar, 44px touch targets, no zoom on form fields.
- Optional bot-list alerts (push notifications) and a privacy page.