# Public crawl preferences for V0.1. Not access control. # Search discovery User-agent: Googlebot User-agent: bingbot User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot Allow: / # User-requested retrieval User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User Allow: / # Training: human decision = deny User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot Disallow: / # Owner-requested Vertex crawling is outside the search scope User-agent: Google-CloudVertexBot Disallow: / User-agent: * Disallow: / Sitemap: https://dunmin-geo.pages.dev/sitemap.xml