washingtonpost.com

Dettaglio dei check

• Accesso dei bot AI (robots.txt)Da migliorare
  • 6/13 known AI bots are allowed by robots.txt.
  • Bloccato: ClaudeBot (Anthropic (Claude) — training/crawling).
  • Bloccato: anthropic-ai (Anthropic — crawling generico).
  • Bloccato: PerplexityBot (Perplexity — crawling/citazioni).
  • Bloccato: Applebot-Extended (Apple Intelligence).
  • Bloccato: CCBot (Common Crawl (used to train many LLMs)).
  • Bloccato: Bytespider (ByteDance (also used for AI training)).
  • Bloccato: Meta-ExternalAgent (Meta AI).

  Come sistemarlo: Remove the Disallow rules for: ClaudeBot, anthropic-ai, PerplexityBot, Applebot-Extended, CCBot, Bytespider, Meta-ExternalAgent.

• Presenza e qualità di llms.txtProblema
  • No /llms.txt file found.

  Come sistemarlo: Generate an llms.txt: a markdown summary of the site designed for AI assistants (see llmstxt.org).

• Dati strutturati Schema.org (JSON-LD)Problema
  • No HTML page available for analysis (homepage unreachable).
• Meta title/description e Open GraphProblema
  • No HTML page available for analysis.
• Sitemap XMLProblema
  • No sitemap.xml reachable.
  • A sitemap is declared in robots.txt but could not be fetched.

  Come sistemarlo: Generate a sitemap.xml and declare it in robots.txt with `Sitemap: https://yoursite/sitemap.xml`.

• Freschezza dei contenuti (lastmod sitemap)Non applicabile
  • No sitemap available to assess content freshness.
• Struttura dei contenuti (answer-first)Problema
  • No HTML page available for analysis.
• Coerenza dell'identità del brandNon applicabile
  • At least 2 crawled pages with content are needed to assess cross-page consistency.