wsj.com

Detalle de las comprobaciones

• Acceso de bots de IA (robots.txt)Problema
  • 4/13 known AI bots are allowed by robots.txt.
  • Bloccato: ClaudeBot (Anthropic (Claude) — training/crawling).
  • Bloccato: anthropic-ai (Anthropic — crawling generico).
  • Bloccato: Claude-User (Anthropic — browsing live in Claude).
  • Bloccato: PerplexityBot (Perplexity — crawling/citazioni).
  • Bloccato: Perplexity-User (Perplexity — browsing live).
  • Bloccato: Google-Extended (Google — training Gemini/AI Overviews).
  • Bloccato: CCBot (Common Crawl (used to train many LLMs)).
  • Bloccato: Bytespider (ByteDance (also used for AI training)).
  • Bloccato: Meta-ExternalAgent (Meta AI).

  Cómo arreglarlo: Remove the Disallow rules for: ClaudeBot, anthropic-ai, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, CCBot, Bytespider, Meta-ExternalAgent.

• Presencia y calidad de llms.txtProblema
  • No /llms.txt file found.

  Cómo arreglarlo: Generate an llms.txt: a markdown summary of the site designed for AI assistants (see llmstxt.org).

• Datos estructurados Schema.org (JSON-LD)Problema
  • No HTML page available for analysis (homepage unreachable).
• Meta title/description y Open GraphProblema
  • No HTML page available for analysis.
• Sitemap XMLOK
  • Sitemap reachable with 224 URLs.
  • Dichiarata correttamente in robots.txt.
• Frescura del contenido (lastmod del sitemap)OK
  • 224 URLs with a valid <lastmod>; the most recent is 0 days old.
• Estructura del contenido (answer-first)Problema
  • No HTML page available for analysis.
• Coherencia de la identidad de marcaNo aplica
  • At least 2 crawled pages with content are needed to assess cross-page consistency.