Robots.txt & Sitemap Generator

Primary Domain (no trailing slash)

Default Sitemap URL

Crawl-delay (seconds)

Environment

User‑agent (one per line)

Disallow paths (one per line)

Allow paths (one per line)

Extra directives (optional)

# robots.txt will appear here

URLs (one per line)

Lastmod (ISO 8601 or 'auto') Changefreq Priority (0.0–1.0 or blank) Split size

Idle.

Tip Use absolute URLs (https://…) in sitemaps.

Tip Put robots.txt at /robots.txt and reference your sitemap.

Tip Staging should be noindex or blocked.

Tip Max 50,000 URLs or 50MB per sitemap file. Use indexes for more.