Robots.txt Generator Robots.txt Generator Build, preview and download a robots.txt file with per-agent rules, sitemaps, and crawl-delay. Quick-Start Template — Start from scratch — WordPress (recommended) WooCommerce Block all bots Allow all bots Load Template + Add User-Agent Block Sitemap URLs + Add Sitemap URL Host Directive (optional) Generate robots.txt Generated robots.txt Copy ↓ Download * (All bots) Googlebot Googlebot-News Googlebot-Image Bingbot Baiduspider YandexBot AhrefsBot SemrushBot Custom… ✕ Remove + Add Rule Disallow Allow ✕
