User-agent: * Allow: / Sitemap: https://dw.zilo-project.com/sitemap.xml # Crawl-delay for polite bots Crawl-delay: 1 # Block AI bots/crawlers that might overload the server User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: /