# /seller-agreement and /aml-policy are crawlable on purpose so noindex can be seen. Do not Disallow them. User-agent: * Allow: /cashback/ Allow: /coupons/ Allow: /blog/ Disallow: /press/download/ Disallow: /sitemap_original.xml Disallow: /cashback-activation-web/ Disallow: /cashback-activation-extension/ Disallow: /activate/c/ Disallow: /activate/coupon/ Disallow: /activate/amazon-deal/ Disallow: /coupon-activation-web/ Disallow: /coupon-activation-extension/ Disallow: /track-click Disallow: /track-activity Disallow: /coupon-vote Disallow: /dummyData/ Disallow: /trackingData/ Disallow: /log-store-search Disallow: /admin/ Disallow: /auth/ Disallow: /api/ Disallow: /user/ Disallow: /extension-user/ Disallow: /islogin # Every store/coupon page links a unique ?from=&return= variant; crawlers walk them all. Disallow: /signup? Disallow: /login? Disallow: /logout Disallow: /blogsignup/ Disallow: /user/active_account/ Disallow: /user/verify-email Disallow: /user/unsubscribe Disallow: /autopayment Disallow: /postpaymentaction/ Disallow: /postautopaymentaction/ Disallow: /giftcardpay Disallow: /retailer-suggest Disallow: /store-directory-index.json Disallow: /storesearchautocomplete Disallow: /searchbyletter Disallow: /searchbyname Disallow: /categories-wise-sorting Disallow: /vendorlist/ Disallow: /all-stores/details/ Disallow: /coming-soon Disallow: /coming-soon-new-features Disallow: /public/backend/ Disallow: /administrator/ Disallow: /backup/ Disallow: /blog/wp-admin/ Allow: /blog/wp-admin/admin-ajax.php Disallow: /blog/wp-login.php Allow: /blog/wp-includes/*.css Allow: /blog/wp-includes/*.js Allow: /blog/wp-content/plugins/*.css Allow: /blog/wp-content/plugins/*.js Disallow: /blog/wp-includes/ Disallow: /blog/wp-content/plugins/ Disallow: /blog/wp-json/ Disallow: /blog/xmlrpc.php Disallow: /wp-admin/ Disallow: /wp-login.php Allow: /wp-includes/*.css Allow: /wp-includes/*.js Disallow: /wp-includes/ Disallow: /xmlrpc.php User-agent: SemrushBot Allow: /cashback/ Allow: /coupons/ Allow: /blog/ Disallow: /cashback-activation-web/ Disallow: /cashback-activation-extension/ Disallow: /activate/c/ Disallow: /activate/coupon/ Disallow: /activate/amazon-deal/ Disallow: /coupon-activation-web/ Disallow: /coupon-activation-extension/ Disallow: /admin/ Disallow: /auth/ Disallow: /api/ Disallow: /user/ Disallow: /track-click Disallow: /track-activity User-agent: AhrefsBot Allow: /cashback/ Allow: /coupons/ Allow: /blog/ Disallow: /cashback-activation-web/ Disallow: /cashback-activation-extension/ Disallow: /activate/c/ Disallow: /activate/coupon/ Disallow: /activate/amazon-deal/ Disallow: /coupon-activation-web/ Disallow: /coupon-activation-extension/ Disallow: /admin/ Disallow: /auth/ Disallow: /api/ Disallow: /user/ Disallow: /track-click Disallow: /track-activity User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / # US-only site; Baidu sends no shoppers and its renderer also crawls with a stock Chrome UA. User-agent: Baiduspider Disallow: / User-agent: DataForSeoBot Disallow: / Sitemap: https://www.checkoutsaver.com/sitemap.xml