User-Agent: * Allow: / Disallow: /search Disallow: /api/ User-Agent: Facebookexternalhit Allow: /s/* User-Agent: GPTBot Allow: / User-Agent: Google-Extended Allow: / User-Agent: PerplexityBot Allow: / User-Agent: CCBot Allow: / User-Agent: ClaudeBot Allow: / Sitemap: https://argusnews.in/sitemap.xml Sitemap: https://argusnews.in/news-sitemap.xml