# MetaSnap — AI / LLM crawler policy
# https://metasnap.vercel.app/ai.txt
#
# This site explicitly permits AI training and retrieval crawling.
# A curated index for LLMs is available at /llms.txt and /llms-full.txt.

User-Agent: *
Allow: /
Disallow: /api/

# Training & retrieval crawlers — explicitly allowed
Allow: GPTBot
Allow: ChatGPT-User
Allow: OAI-SearchBot
Allow: ClaudeBot
Allow: Claude-Web
Allow: anthropic-ai
Allow: PerplexityBot
Allow: Google-Extended
Allow: CCBot
Allow: Applebot-Extended
Allow: Amazonbot
Allow: Bytespider
Allow: cohere-ai

Sitemap: https://metasnap.vercel.app/sitemap.xml
Llms-Index: https://metasnap.vercel.app/llms.txt
Llms-Full: https://metasnap.vercel.app/llms-full.txt
Contact: devgurjar9897@gmail.com