User-Agent: * Allow: / Allow: /api/ Allow: /about Allow: /bot Allow: /catalog Allow: /privacy Allow: /terms Allow: /trust Allow: /screenshots/ Allow: /en/ Allow: /zh/ Allow: /ja/ Allow: /es/ Allow: /pt-BR/ Allow: /de/ Allow: /zh/privacy Allow: /ja/privacy Allow: /es/privacy Allow: /pt-BR/privacy Allow: /de/privacy Allow: /zh/terms Allow: /ja/terms Allow: /es/terms Allow: /pt-BR/terms Allow: /de/terms Allow: /zh/trust Allow: /ja/trust Allow: /es/trust Allow: /pt-BR/trust Allow: /de/trust Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /_next/ Disallow: /_next/static/ Disallow: /api/*/health Disallow: /search Disallow: /en/search Disallow: /zh/search Disallow: /ja/search Disallow: /es/search Disallow: /pt-BR/search Disallow: /de/search Disallow: /admin/ Disallow: /*.json$ Disallow: /api/v1/ Crawl-delay: 1 User-Agent: Googlebot Allow: / Allow: /screenshots/ Allow: /opengraph-image Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /_next/ Disallow: /admin/ Disallow: /api/v1/ User-Agent: Googlebot-Image Allow: /screenshots/ Allow: /opengraph-image Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /_next/static/ User-Agent: Bingbot Allow: / Allow: /screenshots/ Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /_next/ Disallow: /admin/ Disallow: /api/v1/ Crawl-delay: 2 User-Agent: GPTBot Allow: / Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /admin/ Disallow: /api/v1/ User-Agent: Google-Extended Allow: / Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /admin/ Disallow: /api/v1/ User-Agent: Claude-Web Allow: / Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /admin/ Disallow: /api/v1/ User-Agent: Anthropic-AI Allow: / Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Disallow: /admin/ Disallow: /api/v1/ User-Agent: AhrefsBot Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Crawl-delay: 10 User-Agent: SemrushBot Disallow: /*?*auth= Disallow: /*?*cors= Disallow: /*?*healthStatus= Disallow: /*?*https= Crawl-delay: 10 Host: https://public-api.org Sitemap: https://public-api.org/sitemap-index.xml Sitemap: https://public-api.org/sitemap.xml Sitemap: https://public-api.org/sitemap-images.xml