Site Search

Find sitemap.xml, robots.txt, ads.txt, app-ads.txt and sellers.json - Real-Time Search

Not http https www subdomain

sweetandmaxwell.co.uk robots.txt

sweetandmaxwell.co.uk
Site: sweetandmaxwell.co.uk

The robots.txt file is a file at the root a domain indicates parts of the site should not be accessed by search engine crawlers.

(*) Thumbnail Screenshots by Thumbshots



User-agent: *
Disallow: /smgtestpages/
Disallow: */SignIn.aspx 
Disallow: */westonefederatedidetity.aspx
Disallow: /Catalogue/Results.aspx?*Nty
Disallow: /Error/
Disallow: /UserControls/
Disallow: /checkout/
# addressing broken links
Disallow: /Catalogue/Results.aspx*
Disallow: /Catalogue/ProductDetail.aspx?prodid=*
Disallow: /catalogue/productsearch.aspx?freetext=*
Disallow: /Catalogue/JournalDetail.aspx?*
Sitemap: http://www.sweetandmaxwell.co.uk/sitemap.xml
              
Saturday, 14 December 2019