Customize robots.txt rules by domain

Published

This summary was written by ShopDigest AI from Shopify Changelog’s report. Read the full story ↗

If you’re using multiple domains to target different audiences in Shopify Markets, you can now create custom crawling rules for each domain using t…

Overview

Shopify now lets merchants using Shopify Markets create custom robots.txt rules per domain. This is done by using the request.host object in the robots.txt.liquid template. The update gives more control over how search engines crawl content across different markets.

Key Details

  • Custom crawling rules can be set for each domain in Shopify Markets.
  • Use the request.host object in robots.txt.liquid to target specific domains.
  • Example: disallow crawling of /en/ folder for example.fr while allowing it for other domains.
  • Full documentation is available in the Shopify Dev Docs.

About this story

Topics covered
Published
25 Mar 2025
Originally published at