A worked example
Disallow: /private/ blocks /private/a, while Allow: /private/public/ allows its more specific path.
Robots tester
Paste robots.txt and test a URL path against a selected crawler token.
YOUR LITTLE WORKBENCH
ON YOUR DEVICE ✦Robots tester
Work from supplied text and URLs. Example.com is a sample; replace it with your own real addresses. Nothing is fetched, uploaded or submitted.
Allowed
Selected groups: *
allow: /private/public/ · line 3
This is a local rule test, not a live crawl or indexing result.
These tools do not submit to Google or predict rankings. robots.txt controls crawling, not access security; the preview does not reproduce every search display or snippet rewrite.
THE METHOD / 01
A clear wayfrom start to finish.
The most specific matching user-agent groups are merged. Longest matching path wins; Allow wins equal-length ties. Supports * and trailing $.
Keep the assumptions clear
Tests pasted rules only, not live website access. Unrecognized directives are reported; network responses, headers and indexing are not evaluated.
A FEW USEFUL ANSWERS
Good to know.
Are my inputs uploaded?
No. Processing runs locally in your browser. The host still receives normal requests for website pages and assets.
Can I keep my result?
Use the download controls for the current tool or print from your browser. Seating plans, flashcards and document drafts autosave in this browser; see the privacy page.
Do I need an account?
No sign-up, paid API or subscription is required. Both languages use the same tools. English always opens at the root address.
INDEXKIND / TOOLKIT
A little help for every step.
02
Sitemap builder
Turn a supplied list of same-origin page URLs into an escaped XML sitemap.
Open tool03
Language tags
Create reciprocal hreflang tag blocks for supplied language and page-URL pairs.
Open tool04
Search preview
Preview an entered title, URL and description, with character counts and HTML metadata export.
Open tool