# Chatkhara The Curry House Robots.txt # Main directives for all bots User-agent: * Allow: / Disallow: /Store%20Information.txt # AI Bot specific directives # llms.txt is intentionally left crawlable so AI agents can read it. # It is marked noindex via the X-Robots-Tag HTTP header (see the _headers file). User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: CCBot User-agent: anthropic-ai User-agent: ClaudeBot User-agent: Claude-Web User-agent: Google-Extended User-agent: PerplexityBot User-agent: FacebookBot User-agent: cohere-ai Allow: / Disallow: /privacy-policy.html Disallow: /terms-of-use.html # Google Ads Bot User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps Allow: / # Sitemap location Sitemap: https://chatkharathecurryhouse.com/sitemap.xml # Crawl delay for heavy bots User-agent: Baiduspider Crawl-delay: 10