Indexing & Sitemap

This page offers five tools around indexing and site plans. Robots.txt tester checks whether an address is allowed by your rules. Verify robots.txt and Verify the sitemap check file availability. XML Sitemap Input generates a valid entry, and Redirection Plan turns a list into Apache 301 redirects. Useful before going live. Free and no account.

Start with the check that blocks everything else. If a page should not be crawled, Robots.txt tester shows how the rules apply. Verify robots.txt and Verify the sitemap then give an availability status. When you need to declare an address, XML Sitemap Input helps build the entry. To move addresses, Redirection Plan prepares a source-target list.

How to use

  1. Start with Robots.txt tester: test a precise address and check whether your rules allow it before looking for another cause.
  2. Then check availability with Verify robots.txt and Verify the sitemap: these tools confirm that the main files are reachable before declaration.
  3. To declare an address, use XML Sitemap Input: build a complete and valid entry from the requested information.
  4. If you move addresses, finish with Redirection Plan: turn a source-target list into Apache 301 redirects, then review each pair before going live.

Frequently asked questions

Is Robots.txt tester enough to know if a page will be indexed?

No. It only checks whether the address is allowed by the rules tested. Other elements can affect crawling and indexing.

Why verify a sitemap?

To confirm that the main file is available before declaring it. The tool checks availability, without analyzing all its content.

What is Redirection Plan for?

It turns a source-target list into Apache 301 redirects. It helps prepare an address move in a readable and checkable way.

Do Robots.txt tester and Verify robots.txt have the same role?

No. Robots.txt tester checks the effect of rules on a given address. Verify robots.txt checks file availability instead. Use the first for a precise page, the second to confirm that the file can be reached.

When should I use Redirection Plan with XML Sitemap Input?

When addresses change. XML Sitemap Input declares an address in a site plan. Redirection Plan prepares the match between old and new addresses. Check both lists to avoid a declared address without a redirect.

Tools in the same category