Crawl control
Use focused disallow paths for admin/private areas while keeping public assets crawlable.
Generate robots.txt crawler directives with allow/disallow rules and sitemap entries.
Updated
Quick start
Configure inputs and generate output.
Enter required fields.
Create output instantly.
Copy and apply in your workflow.
In-depth guide
Create crawler directives with allow/disallow rules and sitemap pointers for clean indexing control.
Use focused disallow paths for admin/private areas while keeping public assets crawlable.
Pair robots rules with accurate sitemap declarations and canonical tags for stable indexing.
Use this tool for quick browser-based work when you need an answer or output immediately. Use a dedicated application or automated workflow when you need bulk processing, approvals, or repeatable production rules.
Browser-first by design. The tool page explains any exception before you use it.
Your input is handled in the browser wherever the tool can process it locally. EpitomeTool does not add an upload step unless a tool page explicitly says so.
Yes, provide a sitemap URL and the tool appends Sitemap line.
You can input wildcard patterns as plain lines for crawler interpretation.
Yes, copy output directly into robots.txt.
Keep exploring
Hand-picked utilities that pair well with the one you're on — all free, client-side, and zero-signup.
Generate a deduplicated .gitignore by combining language, framework, OS and editor templates.
Convert URL lists into valid sitemap.xml output with optional lastmod, changefreq and priority fields.
Generate SEO, Open Graph and Twitter tags from page metadata fields.
Shrink PDF file size without uploading to a server.
Body Mass Index with metric / imperial inputs and WHO category bands.
Combine multiple PDFs into one in your browser.
Split a PDF by pages or page ranges, download as zip.