# 1. Benarkan Google & Enjin Carian Utama (Sekat folder misc & lite sahaja) User-agent: * Disallow: /misc/ Disallow: /lite/ Crawl-delay: 1 # 2. Halang Bot AI / Scraper Agresif (Ringankan Beban Server) User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / User-agent: Anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Diffbot Disallow: / # 3. Pautan Sitemap Utama & Google News Sitemap: https://www.bernama.com/sitemap.xml Sitemap: https://www.bernama.com/news-sitemap.xml