Crawl-Delay: Googlebot-Image User-agent: bingbot Crawl-Delay: 240 User-agent: facebookexternalhit User-agent: Twitterbot User-agent: fyyd-poll Crawl-Delay: 240 User-agent: Amazonbot Crawl-Delay: 420 User-agent: DotBot User-agent: R6_FeedFetcher Crawl-Delay: 600 User-agent: MetaURI User-agent: mediawords User-agent: exabot User-agent: Exabot User-agent: MojeekBot User-agent: Bytespider User-agent: Baiduspider User-agent: trendictionbot User-agent: Mediatoolkitbot Crawl-Delay: 900 User-agent: gigabot User-agent: MegaIndex.ru User-agent: MegaIndex User-agent: CCBot User-agent: DotBot User-agent: amazonbot Crawl-Delay: 3000 User-agent: SeznamBot User-agent: JobboerseBot User-agent: AhrefsBot User-agent: AspiegelBot User-agent: rogerbot User-agent: MJ12bot User-agent: spbot User-agent: SimplePie User-agent: seoscanners.net User-agent: DotBot User-agent: YandexBot User-agent: SemanticScholarBot User-agent: semantic-visions.com crawler User-agent: semantic-visions* User-agent: Sogou web spider User-agent: Sogou* User-agent: Jobkicks User-agent: PetalBot Crawl-Delay: 5000 User-agent: Adsbot User-agent: Vagabondo User-agent: Kraken User-agent: SemrushBot User-agent: BLEXBot User-agent: BUbiNG User-agent: PaperLiBot User-agent: ClaudeBot User-agent: Neticle Crawler User-agent: Sogou web spider User-agent: Paqlebot Crawl-Delay: 20000 User-agent: * Crawl-Delay: 1200 Disallow: /*manage$ Disallow: /*preview$ Disallow: /*manage_* Disallow: /zmsshop/ Allow: / Sitemap: /sitemap.xml