theguardian.com

Detalle de las comprobaciones

• Acceso de bots de IA (robots.txt)Problema
  • 5/13 known AI bots are allowed by robots.txt.
  • Bloccato: ClaudeBot (Anthropic (Claude) — training/crawling).
  • Bloccato: anthropic-ai (Anthropic — crawling generico).
  • Bloccato: Claude-User (Anthropic — browsing live in Claude).
  • Bloccato: PerplexityBot (Perplexity — crawling/citazioni).
  • Bloccato: Applebot-Extended (Apple Intelligence).
  • Bloccato: CCBot (Common Crawl (used to train many LLMs)).
  • Bloccato: Bytespider (ByteDance (also used for AI training)).
  • Bloccato: Meta-ExternalAgent (Meta AI).

  Cómo arreglarlo: Remove the Disallow rules for: ClaudeBot, anthropic-ai, Claude-User, PerplexityBot, Applebot-Extended, CCBot, Bytespider, Meta-ExternalAgent.

• Presencia y calidad de llms.txtProblema
  • No /llms.txt file found.

  Cómo arreglarlo: Generate an llms.txt: a markdown summary of the site designed for AI assistants (see llmstxt.org).

• Datos estructurados Schema.org (JSON-LD)Problema
  • No JSON-LD block found on the homepage.

  Cómo arreglarlo: Add at least one Organization or WebSite JSON-LD block in the homepage head.

• Meta title/description y Open GraphPor mejorar
  • <title> present with a good length (48 characters).
  • meta description present with a good length (112 characters).
  • og:title missing.
  • og:description missing.
  • og:image missing.

  Cómo arreglarlo: Add: og:title, og:description, og:image.

• Sitemap XMLOK
  • Sitemap reachable with 418 URLs.
  • Dichiarata correttamente in robots.txt.
• Frescura del contenido (lastmod del sitemap)OK
  • 418 URLs with a valid <lastmod>; the most recent is 0 days old.
• Estructura del contenido (answer-first)No aplica
  • LLM call failed: Google Gemini API 429: [{ "error": { "code": 429, "message": "You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 20, model: gemini-3.6-flash\nPlease retry in 52.117558699s.", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Learn more about Gemini API quotas", "url": "https://ai.google.dev/gemini-api/docs/rate-limits" } ] }, { "@type": "type.googleapis.com/google.rpc.QuotaFailure", "violations": [ { "quotaMetric": "generativelanguage.googleapis.com/generate_content_free_tier_requests", "quotaId": "GenerateRequestsPerDayPerProjectPerModel-FreeTier", "quotaDimensions": { "model": "gemini-3.6-flash", "location": "global" }, "quotaValue": "20" } ] }, { "@type": "type.googleapis.com/google.rpc.RetryInfo", "retryDelay": "52s" } ] } } ].
• Coherencia de la identidad de marcaNo aplica
  • LLM call failed: Google Gemini API 429: [{ "error": { "code": 429, "message": "You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 20, model: gemini-3.6-flash\nPlease retry in 41.9424277s.", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Learn more about Gemini API quotas", "url": "https://ai.google.dev/gemini-api/docs/rate-limits" } ] }, { "@type": "type.googleapis.com/google.rpc.QuotaFailure", "violations": [ { "quotaMetric": "generativelanguage.googleapis.com/generate_content_free_tier_requests", "quotaId": "GenerateRequestsPerDayPerProjectPerModel-FreeTier", "quotaDimensions": { "location": "global", "model": "gemini-3.6-flash" }, "quotaValue": "20" } ] }, { "@type": "type.googleapis.com/google.rpc.RetryInfo", "retryDelay": "41s" } ] } } ].