Visually build a robots.txt file for your website. Add user-agents, allow/disallow rules, crawl-delay, and sitemap URLs. Preview the output in real time, then copy it with one click.
Presets
User Agents & Rules
Crawl Delay
seconds (optional). Applied to * user-agent or individual agents.