Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain

tdpv.ru robots.txt

tdpv.ru
Site: tdpv.ru

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by Thumbshots



User-Agent: *
Disallow: /cgi-bin
Disallow: /?sort
Disallow: /*?sort
Disallow: /index.php
Disallow: /apply/
Disallow: /?
Disallow: /*.shtml
Disallow: /*.php
Disallow: /*.html
Disallow: /*?id
Disallow: /*?PAGEN
Disallow: /*?arrFilter
Disallow: */filter
Disallow: */store/
Disallow: */login/
Disallow: */personal/
Disallow: */bitrix/
Disallow: /cart/
Sitemap: https://tdpv.ru/sitemap.xml

User-Agent: Yandex
Disallow: /cgi-bin
Disallow: /?sort
Disallow: /*?sort
Disallow: /index.php
Disallow: /apply/
Disallow: /?
Disallow: /*.shtml
Disallow: /*.php
Disallow: /*.html
Disallow: /*?id
Disallow: /*?PAGEN
Disallow: /*?arrFilter
Disallow: */filter
Disallow: */store/
Disallow: */login/
Disallow: */personal/
Disallow: */bitrix/
Disallow: /cart/
Clean-param: gclid&yclid&ymclid&_openstat&frommarket&utm_source&utm_medium&utm_campaign&utm_content&utm_term&utm_email&utm_nooverride&utm_referrer&from&
Sitemap: https://tdpv.ru/sitemap.xml
Host: https://tdpv.ru/
              
Thursday, 27 June 2019