Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain

da-baby.ru robots.txt

da-baby.ru
Site: da-baby.ru

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by ShrinkTheWeb



User-Agent: Googlebot 
Allow: /*.css 
Allow: /*.js 
Allow: /*.jpg 
Allow: /*.png 
Allow: /*.gif 
Disallow: /*/?age=* 
Disallow: /price-from= 
Disallow: /price-to= 
Disallow: /checked= 
Disallow: /sex= 
Disallow: /*manuf= 
Disallow: /material= 
Disallow: /path= 
Disallow: /subpath= 
Disallow: /country= 
Disallow: /discount= 
Disallow: /present=Y 
Disallow: /age-all-checked= 
Disallow: /?q= 
Disallow: /backurl= 
Disallow: /forgot_password= 
Disallow: /register= 
Disallow: /manuf= 
Disallow: /personal 
Disallow: /*/?clear_cache=Y 
Disallow: /catalog/index.php?sphrase_id= 
Disallow: /*/?*utm 
Disallow: /search/? 
Disallow: /bitrix/ 
Disallow: /*/?bitrix_include_areas=* 
Disallow: /auth/? 
Disallow: /index.php 
Disallow: /auth/
Disallow: /*?logout*
Disallow: /*?back_url*



Sitemap: http://www.da-baby.ru/sitemap.xml 



User-Agent: * 
Disallow: /*/?age=* 
Disallow: /price-from= 
Disallow: /price-to= 
Disallow: /checked= 
Disallow: /sex= 
Disallow: /*manuf= 
Disallow: /material= 
Disallow: /path= 
Disallow: /subpath= 
Disallow: /country= 
Disallow: /discount= 
Disallow: /present=Y 
Disallow: /age-all-checked= 
Disallow: /?q= 
Disallow: /backurl= 
Disallow: /forgot_password= 
Disallow: /register= 
Disallow: /manuf= 
Disallow: /personal 
Disallow: /*/?clear_cache=Y 
Disallow: /catalog/index.php?sphrase_id= 
Disallow: /*/?*utm 
Disallow: /search/? 
Disallow: /bitrix/ 
Disallow: /*/?bitrix_include_areas=* 
Disallow: /auth/? 
Disallow: /index.php 
Disallow: /auth/
Disallow: /*?logout*
Disallow: /*?back_url* 
Host: www.da-baby.ru 
Sitemap: http://www.da-baby.ru/sitemap.xml 
              
Thursday, 13 December 2018