dw.com

Check breakdown

• AI bot access (robots.txt)Issue
  • 1/13 known AI bots are allowed by robots.txt.
  • Bloccato: GPTBot (OpenAI (ChatGPT) — training).
  • Bloccato: OAI-SearchBot (OpenAI — ricerca/citazioni ChatGPT).
  • Bloccato: ChatGPT-User (OpenAI — browsing live in ChatGPT).
  • Bloccato: ClaudeBot (Anthropic (Claude) — training/crawling).
  • Bloccato: anthropic-ai (Anthropic — crawling generico).
  • Bloccato: PerplexityBot (Perplexity — crawling/citazioni).
  • Bloccato: Perplexity-User (Perplexity — browsing live).
  • Bloccato: Google-Extended (Google — training Gemini/AI Overviews).
  • Bloccato: Applebot-Extended (Apple Intelligence).
  • Bloccato: CCBot (Common Crawl (used to train many LLMs)).
  • Bloccato: Bytespider (ByteDance (also used for AI training)).
  • Bloccato: Meta-ExternalAgent (Meta AI).

  How to fix it: Remove the Disallow rules for: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, anthropic-ai, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, CCBot, Bytespider, Meta-ExternalAgent.

• llms.txt presence and qualityIssue
  • No /llms.txt file found.

  How to fix it: Generate an llms.txt: a markdown summary of the site designed for AI assistants (see llmstxt.org).

• Structured data (Schema.org JSON-LD)Issue
  • No JSON-LD block found on the homepage.

  How to fix it: Add at least one Organization or WebSite JSON-LD block in the homepage head.

• Meta title/description and Open GraphIssue
  • <title> missing.
  • meta description missing.
  • og:title missing.
  • og:description missing.
  • og:image missing.

  How to fix it: Add: title, meta description, og:title, og:description, og:image.

• XML sitemapOK
  • Sitemap reachable with 1456 URLs.
  • Dichiarata correttamente in robots.txt.
• Content freshness (sitemap lastmod)OK
  • 1431 URLs with a valid <lastmod>; the most recent is 0 days old.
• Content structure (answer-first)Needs work
  • The text extracted from the homepage is too sparse for a reliable assessment.
• Brand identity consistencyNot applicable
  • At least 2 crawled pages with content are needed to assess cross-page consistency.

• siliconflorist.comB80/100
• worldbank.orgB80/100
• esselunga.itB79/100
• nerdwallet.comB79/100
• omnistrate.comB79/100
• walmart.comB79/100