Loading...

Robots.txt support

Robots.txt support

Robots.txt directive Supported
Allow Yes
Disallow Yes
Crawl-delay Yes
Host No
Clean-param No
Request-rate No
Visit-time No
Indexpage No
Sitemap No

Allow Findxbot (example)

User-agent: Findxbot
Allow: /

Don't want your website in our new search engine?

If you don't want your pages indexed by us, then please indicate this in robots.txt or block the IP addresses listed above.

Disallow Findxbot (example)

User-agent: Findxbot
Disallow: /



Page Tools