# This robots.txt file controls crawling of URLs under the respective site where this file is placed. #Any search crawler can crawl our site User-agent: * #all urls allowed to be indexed Allow: / Disallow: /content/dam/invocare/invocare-corp/pdfs/site-information/wa* #Crawl all sitemaps mentioned below (only production/live urls) Sitemap: https://www.lesterandson.com.au/sitemap.xml