Control how search engines crawl and index your website
Basic Settings
Help search engines discover your content
Time bots should wait between requests
Quick Blocks
Custom Disallow Rules
Specific User-Agents
Generated robots.txt
# robots.txt for your website
# Generated by Prism.Tools
User-agent: *
Allow: /
💡 Quick Guide: The robots.txt file tells search engine bots which pages they can and cannot access. Place it at the root of your website (e.g., example.com/robots.txt). Use "Disallow" to block paths and "Allow" to explicitly permit them. Remember: this is a guideline, not enforcement—malicious bots may ignore it.