User-agent: * Allow: *?p= Allow: *?page= Disallow: /*.php$ Disallow: /pkginfo/ Disallow: /report/ Disallow: /var/ Disallow: /catalog/ Disallow: /sendfriend/ Disallow: /review/ Disallow: /*SID= Disallow: /news/ Disallow: /search/ Disallow: /index.php/ Disallow: /wishlist/ Disallow: /review/product/ Disallow: /sendfriend/ Disallow: /enable-cookies/ Disallow: /LICENSE.txt Disallow: /LICENSE.html Disallow: /skin/ Disallow: /js/ Disallow: /directory/ #Stop crawling user account and checkout pages by search engine robot: Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /customer/ Disallow: /customer/account/ Disallow: /customer/account/login/ #Blocking native catalog and search pages: Disallow: /catalogsearch/ Disallow: /catalogsearch/result/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ #Sometimes Webmasters block pages with filters.. Disallow: /*?dir* Disallow: /*?dir=desc Disallow: /*?dir=asc Disallow: /*?limit=all Disallow: /*?mode* Disallow: /*price= Disallow: /*cat= Disallow: /*color= Disallow: /*sendfriend #Added to stop extra facets from being crawled Disallow: /*?brand= Disallow: /*?colour= Disallow: /*?in-stock= Disallow: /*?stock= Disallow: /*?size= Disallow: /*?refine_search_capacity= Disallow: /*?refine_search_size= Disallow: /*?refine_search_boot_size_uk= Disallow: /*?refine_search_boot_size_us= Disallow: /*?refine_search_boot_size_eu= #Blocking CMS directories. Disallow: /app/ Disallow: /bin/ Disallow: /dev/ Disallow: /lib/ Disallow: /phpserver/ #Blocking duplicate content: Disallow: /tag/ Disallow: /review/ #blocking swatch calls Disallow: /variants/index/index/product_id/ #allowing Googlebot-image to index images: User-agent: Googlebot-Image Disallow: Sitemap: https://www.military1st.eu/feeds/sitemap_eu.xml