# FinWiz24 AI Agent Policy # Standard: draft-airo-ai-txt-02 (April 2026 revision) # Mirror of runtime policy expressed in /robots.txt and /llms.txt. # Spec mirror (read-only): https://finwiz24.com/.well-known/ai.txt User-Agent: * Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes Owner-Contact: mailto:ai-policy@finwiz24.com Policy-URL: https://finwiz24.com/llms.txt Acknowledgments-URL: https://finwiz24.com/security/acknowledgments # Disallow crawlers that have, in the past, ignored the global # robots.txt opt-in and exceeded polite rate limits. Mirrors # robots.txt BLOCKED_BOTS. User-Agent: AhrefsBot User-Agent: SemrushBot User-Agent: MJ12bot User-Agent: DotBot User-Agent: BLEXBot User-Agent: PetalBot User-Agent: AspiegelBot User-Agent: YisouSpider User-Agent: DataForSeoBot User-Agent: SeekportBot User-Agent: SogouPicSpider User-Agent: YandexImages Disallow: / Train-Usage: no Inference-Usage: no User-Agent: GPTBot User-Agent: OAI-SearchBot Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes User-Agent: ClaudeBot User-Agent: Claude-Web User-Agent: Claude-User Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes User-Agent: PerplexityBot User-Agent: Perplexity-User Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes User-Agent: Google-Extended Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes User-Agent: Applebot-Extended Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes User-Agent: CCBot User-Agent: Cohere-AI User-Agent: Amazonbot Allow: / Train-Usage: yes Inference-Usage: yes Cite-With-URL: yes