Site Search

Find sitemap.xml, robots.txt and ads.txt - Real-Time Search

Not http https www subdomain robots.txt

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by Thumbshots

User-agent: *
Disallow: contact.php
Disallow: /javascript/
Disallow: searchengine_sitemap_celebrities.php
Disallow: searchengine_sitemap_coas.php
Disallow: searchengine_sitemap_menu.php
Disallow: searchengine_sitemap_movie_props.php
Disallow: searchengine_sitemap_movies.php
Disallow: searchengine_sitemap_users.php
Disallow: searchengine_sitemap_index.php
Wednesday, 26 June 2019