Robots.txt Generator

Sitemap URL

Allow all robots (recommended)

Block /admin/

Block /api/

Block /dashboard/

Additional disallow paths (one per line)

Additional allow paths (one per line)

Crawl delay (seconds, 0 = none)

Block specific bots

Ahrefs Bot SEMrush Bot Majestic Bot OpenSiteExplorer Bot

⬇ Download

added removed unchanged

Original: → Result: saved

Generated slugs

rows, columns