Find sitemap.xml, robots.txt, ads.txt, app-ads.txt and sellers.json - Real-Time Search
The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.
#
# ____ _ _ _ _ _
# / ___|| |_ __ _ ___| | __ / \ __| | __ _ _ __ | |_
# \___ \| __/ _` |/ __| |/ / / _ \ / _` |/ _` | '_ \| __|
# ___) | || (_| | (__| < / ___ \ (_| | (_| | |_) | |_
# |____/ \__\__,_|\___|_|\_\/_/ \_\__,_|\__,_| .__/ \__|
# ______________ |_|
#
# TO FEARLESSLY PREVENT THE ROBOT UPRISING
#
User-agent: *
Disallow:
Sitemap: https://www.stackadapt.com/sitemap.xml
