Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain robots.txt

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by Thumbshots

User-agent: *

Disallow: /dev/
Disallow: /files/documents/resources/Coalesse_Akira_Stop_Shipment_10.08.2015.pdf
Disallow: /files/documents/resources/

Tuesday, 21 May 2019