Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain

parkavebmw.com robots.txt

parkavebmw.com
Site: parkavebmw.com

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by Thumbshots



		
	User-agent: ImageWalker
	Disallow: /

	User-agent: gsa-crawler
	Disallow: /

	User-agent: OmniExplorer_Bot
	Disallow: /

	User-agent: Baiduspider
	Disallow: /

	User-agent: Yandex
	Disallow: /

	User-agent: trovitBot
	Disallow: /

	User-agent: RealSpider
	Disallow: /

	User-agent: Updownerbot
	Disallow: /

	
	User-Agent: MJ12bot
	Crawl-Delay: 20
	Disallow: /tcd/
	Disallow: /microsite/
	Disallow: /*ajax.htm$
	Disallow: /*fragment.htm
	Disallow: /image/viewer.htm
	Disallow: /apis/mycars/
	Disallow: /mycars/
	Disallow: /reserve-it-now/form.htm
	Disallow: /contact-form.htm
	Disallow: /specials/trims.htm
	Disallow: /inventory-detail/print.htm
	Disallow: /blog/tags/*
	
	Sitemap: http://www.parkavebmw.com/sitemap.xml

			Sitemap: http://www.parkavebmw.com/videositemap.xml
	
	User-agent: Slurp
	Crawl-Delay: 10
	Disallow: /tcd/
	Disallow: /microsite/
	Disallow: /*ajax.htm$
	Disallow: /*fragment.htm
	Disallow: /image/viewer.htm
	Disallow: /apis/mycars/
	Disallow: /mycars/
	Disallow: /reserve-it-now/form.htm
	Disallow: /contact-form.htm
	Disallow: /specials/trims.htm
	Disallow: /inventory-detail/print.htm
	Disallow: /blog/tags/*
	
	User-agent: *
	Crawl-Delay: 3
	Disallow: /tcd/
	Disallow: /microsite/
	Disallow: /*ajax.htm$
	Disallow: /*fragment.htm
	Disallow: /image/viewer.htm
	Disallow: /apis/mycars/
	Disallow: /mycars/
	Disallow: /reserve-it-now/form.htm
	Disallow: /contact-form.htm
	Disallow: /specials/trims.htm
	Disallow: /inventory-detail/print.htm
	Disallow: /blog/tags/*
	
              
Thursday, 27 June 2019