# Googlebot User-agent: Googlebot Allow: / # Googlebot-News User-agent: Googlebot-News Allow: / # Google-Extended User-agent: Google-Extended Disallow: / # OAI-SearchBot User-agent: OAI-SearchBot Allow: / # ChatGPT-User User-agent: ChatGPT-User Allow: / # GPTBot User-agent: GPTBot Disallow: / # Claude-SearchBot User-agent: Claude-SearchBot Allow: / # Claude-User User-agent: Claude-User Allow: / # ClaudeBot User-agent: ClaudeBot Disallow: / # * User-agent: * Allow: / Disallow: /admin/* # Host Host: http://localhost:3000 # Sitemaps Sitemap: http://localhost:3000/sitemap.xml Sitemap: http://localhost:3000/pages-sitemap.xml Sitemap: http://localhost:3000/posts-sitemap.xml