# Allow all major LLM crawlers User-Agent: GPTBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ChatGPT Allow: / User-Agent: ClaudeBot Allow: / User-Agent: anthropic-ai Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Gemini Allow: / User-Agent: Google-Extended Allow: / User-Agent: CCbot Allow: / User-Agent: NeevaBot Allow: / User-Agent: cohere-ai Allow: / User-Agent: ai-llm Allow: / # Disallow sensitive paths for all crawlers User-Agent: * Disallow: /wp-admin/ Disallow: /wp-login.php Disallow: /checkout/ Disallow: /cart/ Disallow: /account/ Allow: / # General LLM guidance llm: allow # Metadata for crawlers contact: info@landclearingnearme.contractors policy: https://landclearingnearme.contractors/about/ sitemap: https://landclearingnearme.contractors/sitemap_index.xml sitemap: https://landclearingnearme.contractors/post-sitemap.xml sitemap: https://landclearingnearme.contractors/page-sitemap.xml sitemap: https://landclearingnearme.contractors/category-sitemap.xml sitemap: https://landclearingnearme.contractors/local-sitemap.xml