#FuW robots.txt 06.03.2018 User-agent: * Disallow: /extern_templates/emulations/ Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-includes/ Allow: /wp-includes/js/ Disallow: /*?*preview=true Disallow: /wp-login.php Disallow: /wp-login.php* Disallow: /wp-content/plugins/piwik/external/jsonapi.php* Disallow: /suchresultate Disallow: /article/$ User-agent: Yahoo! Slurp Crawl-delay: 10 User-agent: bingbot Crawl-delay: 20 User-agent: CCBot Crawl-delay: 60 User-agent: msnbot Crawl-delay: 10 User-agent: Nutch Disallow: / User-agent: Qwantify Disallow: / User-agent: trendkite-akashic-crawler Disallow: / User-agent: JamesBOT Disallow: / User-agent: BUbiNG Disallow: / User-agent: SemrushBot Disallow: / User-agent: dotbot Disallow: / User-agent: AhrefsBot Disallow:/ User-agent: Cliqzbot Disallow:/ User-agent: spbot Disallow:/ User-agent: MJ12bot Disallow: / User-agent: NTENTbot Disallow: / User-agent: SocialRankIOBot Disallow: / User-agent: Mediatoolkitbot Disallow: / User-agent: Companybook Crawler Disallow: / User-agent: Domain Re-Animator Bot Disallow: / User-agent: Mail.RU_Bot Disallow: / Sitemap: https://www.fuw.ch/?feed=xml_googlenews