Crawlability Test

Parses your robots.txt and lets you enter a URL to a page on your website. Displays whether or not that page can be crawled and/or indexed by Google and Bing.

Enter a website above to get started.