Site Search

Find sitemap.xml, robots.txt, ads.txt, app-ads.txt and sellers.json - Real-Time Search

Not http https www subdomain

klenmarket.ru robots.txt

klenmarket.ru
Site: klenmarket.ru

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by ShrinkTheWeb



User-agent: Yandex
Allow: /upload/
Disallow: *?*
Disallow: *&*
Disallow: */search/
Disallow: */cart/
Disallow: */windows/
Disallow: *region_chose.php
Disallow: */add-to-cart/
Disallow: /index.php
Disallow: /?user*
Disallow: /admin*
Disallow: */pdf/ 
Disallow: */scripts/
Disallow: */css/
Disallow: /*_openstat
Disallow: /*from=adwords
Disallow: /*gclid=
Disallow: /*utm
Disallow: /catalog/
Disallow: /images/
Disallow: /news/
Disallow: /shop/solutions/
Disallow: *services/complex*
Disallow: *services/laying*
Disallow: */static/
Allow: /services/complex*
Host: https://www.klenmarket.ru

User-agent: Googlebot
Allow: /upload/
Disallow: *?*
Disallow: *&*
Disallow: */search/
Disallow: */cart/
Disallow: */windows/
Disallow: *region_chose.php
Disallow: */add-to-cart/
Disallow: /index.php
Disallow: /admin*
Disallow: */pdf/ 
Disallow: /*_openstat
Disallow: /*from=adwords
Disallow: /*gclid=
Disallow: /*utm
Disallow: /catalog/
Disallow: /images/
Disallow: /news/
Disallow: /shop/solutions/
Disallow: *services/complex*
Disallow: *services/laying*
Disallow: */static/
Allow: /services/complex*

User-agent: *
Allow: /upload/
Disallow: *?*
Disallow: *&*
Disallow: /admin
Disallow: /index.php
Disallow: /catalog/
Disallow: /images/
Disallow: /news/
Disallow: /shop/solutions/
Disallow: *services/complex*
Disallow: *services/laying*
Disallow: */static/
Allow: /services/complex*

Sitemap: https://www.klenmarket.ru/sitemap_ru.xml
Sitemap: https://www.klenmarket.ru/images_map.xml
              
Wednesday, 13 November 2019