# Disallow all crawlers access to certain pages in tw.mall.yahoo.com User-agent: * Disallow: /store/post Disallow: /search? Sitemap: https://tw.mall.yahoo.com/sitemap/sitemap_index.xml