Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain

brw.ru robots.txt

brw.ru
Site: brw.ru

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by Thumbshots



User-agent: *
Disallow: /*stvorchatye1/catalog
Disallow: /*stvorchatye2/catalog
Disallow: /upload/resumes
Disallow: /*arrFilter
Disallow: /*?q=
Disallow: /*/cart
Disallow: /*.php
Disallow: /*?city_code=
Disallow: /*?id=kr
Disallow: /*?id=at
Disallow: /*?action*
Disallow: /*?utm
Disallow: *?mode*
Disallow: *?color*
Disallow: /1.txt
Host: www.brw.ru
Sitemap: http://www.brw.ru/sitemap.xml
              
Thursday, 13 December 2018