NitiRank

Robots.txt and Sitemap Checker

Read a site's robots.txt and sitemap, find mistakes, and test whether a crawler may fetch a given page.

More free tools