Free Tool
Robots.txt Checker
See exactly what search engines are allowed to crawl - and catch the one stray Disallow rule that can hide your whole site from Google.
Runs from our servers with polite, robots-respecting requests. Part of the full Site Scanner.
Not sure what your robots.txt should say?
I am Trent Tompkins, a custom software and web systems developer in Pittsburgh. I set up clean, correct robots and sitemaps on every site I build - and fix broken ones fast. Book a free consultation.
Request a free consultation