dailymail.co.uk

Check breakdown

• AI bot access (robots.txt)Issue
  • 0/13 known AI bots are allowed by robots.txt.
  • Bloccato: GPTBot (OpenAI (ChatGPT) — training).
  • Bloccato: OAI-SearchBot (OpenAI — ricerca/citazioni ChatGPT).
  • Bloccato: ChatGPT-User (OpenAI — browsing live in ChatGPT).
  • Bloccato: ClaudeBot (Anthropic (Claude) — training/crawling).
  • Bloccato: anthropic-ai (Anthropic — crawling generico).
  • Bloccato: Claude-User (Anthropic — browsing live in Claude).
  • Bloccato: PerplexityBot (Perplexity — crawling/citazioni).
  • Bloccato: Perplexity-User (Perplexity — browsing live).
  • Bloccato: Google-Extended (Google — training Gemini/AI Overviews).
  • Bloccato: Applebot-Extended (Apple Intelligence).
  • Bloccato: CCBot (Common Crawl (used to train many LLMs)).
  • Bloccato: Bytespider (ByteDance (also used for AI training)).
  • Bloccato: Meta-ExternalAgent (Meta AI).

  How to fix it: Remove the Disallow rules for: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, anthropic-ai, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, CCBot, Bytespider, Meta-ExternalAgent.

• llms.txt presence and qualityNeeds work
  • /llms.txt found (1198923 characters).
  • Missing an H1 title at the top of the file.
  • Contains 2 markdown links to site resources.

  How to fix it: Improve llms.txt: an H1 with the site name, sections per topic area, markdown links to key pages.

• Structured data (Schema.org JSON-LD)Needs work
  • 4 JSON-LD blocks found (4 valid, 0 with parse errors).
  • Tipi rilevati: WebSite, CollectionPage.

  How to fix it: Add/fix schema for: Organization, LocalBusiness, Product.

• Meta title/description and Open GraphOK
  • <title> present with a good length (27 characters).
  • meta description present but not an ideal length (175 characters, ideal 50-160).
  • og:title present.
  • og:description present.
  • og:image present.
• XML sitemapOK
  • Sitemap reachable with 610 URLs.
  • Dichiarata correttamente in robots.txt.
• Content freshness (sitemap lastmod)Not applicable
  • The sitemap has no <lastmod> tags: freshness cannot be assessed.

  How to fix it: Add <lastmod> to every sitemap URL to signal the update date.

• Content structure (answer-first)Not applicable
  • LLM call failed: Google Gemini API 429: [{ "error": { "code": 429, "message": "You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 20, model: gemini-3.6-flash\nPlease retry in 30.092719641s.", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Learn more about Gemini API quotas", "url": "https://ai.google.dev/gemini-api/docs/rate-limits" } ] }, { "@type": "type.googleapis.com/google.rpc.QuotaFailure", "violations": [ { "quotaMetric": "generativelanguage.googleapis.com/generate_content_free_tier_requests", "quotaId": "GenerateRequestsPerDayPerProjectPerModel-FreeTier", "quotaDimensions": { "location": "global", "model": "gemini-3.6-flash" }, "quotaValue": "20" } ] }, { "@type": "type.googleapis.com/google.rpc.RetryInfo", "retryDelay": "30s" } ] } } ].
• Brand identity consistencyNot applicable
  • LLM call failed: Google Gemini API 429: [{ "error": { "code": 429, "message": "You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 20, model: gemini-3.6-flash\nPlease retry in 26.384206942s.", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Learn more about Gemini API quotas", "url": "https://ai.google.dev/gemini-api/docs/rate-limits" } ] }, { "@type": "type.googleapis.com/google.rpc.QuotaFailure", "violations": [ { "quotaMetric": "generativelanguage.googleapis.com/generate_content_free_tier_requests", "quotaId": "GenerateRequestsPerDayPerProjectPerModel-FreeTier", "quotaDimensions": { "location": "global", "model": "gemini-3.6-flash" }, "quotaValue": "20" } ] }, { "@type": "type.googleapis.com/google.rpc.RetryInfo", "retryDelay": "26s" } ] } } ].

• lomi.africaA97/100
• pipedrive.comA96/100
• cohere.comA91/100
• corrieredellosport.itB89/100
• foxnews.comB89/100
• engadget.comB84/100