SEO Tools

YUSIHK / SEO Tools

robots.txt Checker

Read crawl rules for a public domain, or paste a robots.txt file to analyse it in your browser.

robots.txt Checker

Paste robots.txt content, or read it from a public website.

Enter a public URL to begin. Live reads require a security check. Results are an initial review, not a ranking or inclusion guarantee.

What this result can tell you

robots.txt controls crawling; it does not guarantee indexing or remove an indexed URL. Check page directives separately.

Pasted robots.txt and manual snippet drafts are analysed in this browser. Live reads send the target URL to YUSIHK to fetch public signals. Do not enter private, signed-in or sensitive URLs.

FAQ

What this result can tell you

Why can a public URL fail to load?

The site may block automated requests, require sign-in or exceed a response limit. A failed read alone does not prove that Googlebot is blocked. Compare with your server logs or Search Console.

Does a green result mean the page will rank?

No. These checks cover selected technical signals. They do not measure rankings, confirm indexing or guarantee an AI citation.