robots.txt Generator

Site owners and content creators can use this before publishing a page or preparing it for sharing. Create a robots.txt file with a sitemap.

Create a robots.txt file with a sitemap. The result appears instantly in your browser, ready to copy, with no account, upload or storage involved.

How to use

Enter the base address of your site, without a page path, to indicate the domain to use.
Run the generation action to create robots.txt content that includes rules and the sitemap location.
Read the generated text and confirm that the domain and sitemap path match your actual site.
Copy the result into a file named robots.txt, then place it at the root of your website.

Example

The sample uses a simple domain address. After generation, check that the sitemap line reflects that domain and that the directives do not block pages you want indexed.

Input

https://example.com

Output

User-agent: *
Allow: /

Sitemap: https://example.com/sitemap.xml

Limits and formats

The generated file must be published at the domain root to be read by search engine crawlers.
A mistake in the domain produces a sitemap that points to the wrong site and may hinder crawling.
A robots.txt file does not prevent a page already known to a search engine from being indexed and does not replace a noindex tag.
The generated rules are broad; adjust them if you manage several subdomains or need rules for specific crawlers.

Where processing happens

The robots.txt content is generated inside your browser. The address you enter does not leave your device, nothing is stored by the tool, and the text is ready to copy from the page.

Frequently asked questions

Where should I put the robots.txt file?

It needs to be reachable at the root of your domain, at the usual robots.txt address. A file placed in a subfolder will not be treated as the main robots.txt file by crawlers.

Does the tool create the sitemap automatically?

It generates a line that points to the sitemap location based on the domain you enter. It does not build the sitemap file itself. You still need a valid sitemap available at the address you announce.

Can I block an entire site with this generator?

The generated file contains general directives. If you want to block the whole site, you must add the matching rule to the file or edit the result. Always review the content before publishing it.