Site Search

Find sitemap.xml, robots.txt, ads.txt, app-ads.txt and sellers.json - Real-Time Search

Not http https www subdomain

italicarentals.com robots.txt

italicarentals.com
Site: italicarentals.com

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by ShrinkTheWeb



#****************************************************************************
# robots.txt
#     : Robots, spiders, and search engines use this file to determine which 
#       content they should *not* crawl while indexing your website.
#     : This system is called "The Standard Robots Exclusion."
#****************************************************************************

User-agent:  *
Disallow: /cgi-bin/
Disallow: /renters/login.html?
Disallow: /renters/password_reminder.html
Disallow: /renters/response_login.html
Disallow: /owners/login.html?
Disallow: /owners/response_login.html
Disallow: /owners/password_reminder.html


User-agent: Googlebot
Allow: /

User-agent: NinjaBot
Allow: /

User-agent: Mediapartners-Google
Allow: /

User-agent: Googlebot-Image
Allow: /

User-agent: Adsbot-Google
Allow: /
  
User-agent: Googlebot-Mobile
Allow: /



Sitemap: https://www.italicarentals.com/sitemap.xml

Sitemap: https://www.italicarentals.com/sitemap_images.xml





              
Sunday, 22 September 2019