User-agent: * Allow: / # /privacy, /terms, /subprocessors are prerendered for SEO by # generate_legal_pages.mjs and listed in /sitemap.xml. Indexing them # satisfies brand queries like "knack privacy policy" and rounds out # the trust trio. (Earlier disallow on /privacy and /terms predated the # prerender pipeline and was producing "Blocked by robots.txt" warnings # in GSC against URLs the sitemap actively advertised.) Disallow: /app/ Disallow: /choose Disallow: /genesis Disallow: /artifacts Disallow: /intuition Disallow: /compile Disallow: /refine Disallow: /publish Disallow: /video Disallow: /cli-auth # AI training crawlers — explicit allowlist so Knack content is discoverable # when people ask agents about agent-skill tooling. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://getknack.ai/sitemap.xml