Robots
Gen
Download robots.txt
robots.txt
Rule Tester
User-Agent
URL Path
Allowed
Implicitly allowed by default.
User Agents (comma separated)
Add Rule
Allow
Disallow