Find sitemap.xml, robots.txt, ads.txt, app-ads.txt and sellers.json - Real-Time Search
The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.
# The use of robots, crawlers, spiders, rovers, scrapers or other automated
# means to access or mine data from any Boats Group hosted web sites
# (including, but not limited to, boats.com, yachtworld.com, boatwizard.com,
# and soldboats.com) without the express written permission of Boats Group
# is strictly prohibited.
# Boats Group may permit access to Boats Group hosted web sites for the
# limited purpose of including content in publicly available search engines,
# but only if those search engines are not specific to the marine industry
# and do not frame or otherwise obscure any Boats Group hosted web sites.
# Please read our Terms of Use at
# https://www.boatsgroup.com/terms-of-use/ for more information.
User-agent: *
Disallow: /adb/
Disallow: /252108799/
Disallow: /bateaux/trier-modifie:decroiss/
Allow: /
Sitemap: https://www.annoncesbateau.com/sitemap-index-fr.xml
