Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain robots.txt

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by ShrinkTheWeb

# Robot Exclusion Protocol for TOMEN

User-Agent: Googlebot-Image
Disallow: /*.jpg$
Disallow: /*.png$
Disallow: /*.gif$

User-agent: *
Disallow: /_music

User-Agent: Googlebot-Image
Disallow: / 
Wednesday, 22 May 2019