Robots.txt Generator

Optimize your website's crawlability with custom robots rules.

Global Configuration

Sitemap URL

Crawl Delay (seconds)

User Agent Groups

Live Preview

# robots.txt generated by Robots.txt Generator

SEO Quick Tips

The asterisk (*) matches any user agent.
List the sitemap at the end of the file.
Use crawl delay sparingly as most modern bots handle it automatically.