Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain

2012god.ru robots.txt

2012god.ru
Site: 2012god.ru

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by ShrinkTheWeb



User-agent: * 
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /ext/
Disallow: /rek/
Disallow: /?pmaction=viewinpm&pms=1
Disallow: /?profile=user
Disallow: /wp-login.php
Disallow: /wp-login2.php
              
Tuesday, 21 May 2019