# Funny Animals Club # AI crawlers (GPTBot, ClaudeBot, PerplexityBot, ...) are welcome on purpose: # AI answers are a growing traffic source and we want to be citable there. User-agent: * Disallow: /login Disallow: /about Disallow: /contact Disallow: /privacy Disallow: /tos Disallow: /delete-request # The AdSense crawler gets everything: its review checks that the privacy # policy and terms exist, and it obeys robots.txt, so with the utility pages # disallowed above it cannot see them and the site reads as missing them. # Mediapartners-Google is not a search indexer, so this does not affect SEO. User-agent: Mediapartners-Google Disallow: # Same reasoning for the ads.txt fetcher: keep /ads.txt reachable no matter # what lands in the Disallow list above. User-agent: Google-Adstxt Allow: /ads.txt Sitemap: https://funnyanimalsclub.com/sitemap.xml