Infrastructure
· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.CIPv6 ReadinessActionNo IPv6 supportREVIEW
IPv6 support is increasingly important for global accessibility. About 40% of internet users have IPv6 connectivity.
No AAAA records — same impact as 'no IPv6 (AAAA) records'; IPv6-preferring clients pay extra latency falling back to IPv4.
Source: Google IPv6 stats
BCrawlabilityrobots.txt present, sitemap with 0 URLsREVIEW
Search engines may not be able to parse the sitemap. Fix XML validation errors.
An unparseable sitemap is silently ignored by Google — the URLs it advertises are never queued for crawl.
Learn more ▾ ▴
Google's sitemap parser is strict about XML validity. A single unescaped `&` or unclosed tag invalidates the whole file. Run your sitemap through a validator (Search Console's Sitemaps report flags it) and fix the offending entry. Most generators escape correctly; mistakes usually come from manually-written entries.
Source: sitemaps.org / Google Search Central
An empty sitemap provides no value. Add <url> entries for your pages.
An empty sitemap signals 'no content to index' to Google — actively harmful versus having no sitemap at all.
Learn more ▾ ▴
Google compares URLs in the sitemap against URLs it has crawled. An empty sitemap on a site with thousands of pages signals abandonment. Either populate it correctly (most CMSes auto-generate) or delete the file and let Google crawl normally.
Source: Google Search Central / sitemaps.org
# Production Robots.txt file
User-agent: *
#Special parameters
Disallow: /etc.clientlibs/settings/wcm/designs/telegraph/core/clientlibs/save-article.
Disallow: /etc.clientlibs/settings/wcm/designs/telegraph/core/clientlibs/page-refresh.
Disallow: /*?mobile=true
Disallow: /*?mobile=basic
Disallow: /*?ModPagespeed=noscript
Disallow: /*_jcr_content*
Disallow: /*?source=rss
Disallow: /puzzles/puzzle/*?source=
# Internal Search
Disallow: /search/
Allow: /search/$
# Special areas
Disallow: /news/main.jhtml
Disallow: /p/*/embed/
Disallow: /secure/login/*
Disallow: /content/telegraph/
Disallow: /customer/secure/checkout/tesco/
Disallow: /customer/secure/reset-password/
Disallow: /telegraph/*
Disallow: /news-app/*
Disallow: /amp$
Disallow: */application/*
Disallow: */ixale/
Disallow: /core/Content/
Disallow: /promotions/emails/
Disallow: /r/
Disallow: /sponsored/travel/msc-cruises/
Disallow: /travel/8711559/The-Telegraph-Travel-Awards-2011.html
Disallow: /travel/hotel/e/*
Disallow: /sponsored/staging/
Disallow: /sponsored/business/lloyds-tsb-enterprise-awards/
Disallow: /sponsored/earth/statoil/
Disallow: /sponsored/motoring/alfa-romeo-cars/
Disallow: /sponsored/motoring/vw-up/
Disallow: /sponsored/property/all-saints-eastbourne/
Disallow: /sponsored/supplement-portfolio/
Disallow: /sponsored/travel/cunard-cruises/
Disallow: /sponsored/travel/cruise-holidays/
Disallow: /sponsored/travel/macau/macaumap/
Disallow: /sponsored/travel/telegraph-cottages/
Disallow: /sponsored/finance/spread-betting/
Disallow: /sponsored/finance/retirement-annuity/
Disallow: /sponsored/travel/hidden-britain/
Disallow: /sponsored/business/sme-business-essentials/
Disallow: /sponsored/in-the-know/london-cultural-attractions
Disallow: /sponsored/in-the-know/london-dining
Disallow: /sponsored/in-the-know/london-entertainment
Disallow: /sponsored/in-the-know/london-lifestyle
Disallow: /sponsored/in-the-know/london-nightlife
Disallow: /sponsored/in-the-know/london-shopping
Disallow: /sponsored/in-the-know/london-sport-activities
Disallow: /sponsored/in-the-know/london-transport-accommodation
Disallow: /sponsored/in-the-know/london-video-guides
Disallow: /sponsored/motoring/suzuki-motorbikes/
Disallow: /sponsored/technology/cool-list/
Disallow: /travel/hotels/hotel-finder/
Disallow: /podcasts-more/
Disallow: /secure/register/
Allow: /travel/hotels/hotel-finder/$
Disallow: /martech/js/
Disallow: /martech/css/
Disallow: /martech-content/
Disallow: /bin/telegraph/recombee-config
Disallow: /*&p=
Disallow: /customer/subscription/*?
#Bots which make unnecessary bot traffic
User-Agent: endeca
Disallow: /archive/
Disallow: /search/*
User-agent: AI2Bot
Disallow: /
User-agent: Ai2Bot-Dolma
Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Applebot-Extended
Disallow: /
User-agent: bedrockbot
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ChatGLM-Spider
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: Claude-SearchBot
Disallow: /
User-agent: Claude-User
Disallow: /
User-agent: Claude-Web
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: cohere-ai
Disallow: /
User-agent: Cotoyogi
Disallow: /
User-agent: DeepSeekBot
Disallow: /
User-agent: Diffbot
Disallow: /
User-agent: DuckAssistBot
Disallow: /
User-agent: FacebookBot
Disallow: /
User-agent: FriendlyCrawler
Disallow: /
User-agent: Google-CloudVertexBot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: GoogleOther
Disallow: /
User-agent: GoogleOther-Image
Disallow: /
User-agent: GoogleOther-Video
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: Grok
Disallow: /
User-agent: iaskspider/2.0
Disallow: /
User-agent: ICC-Crawler
Disallow: /
User-agent: ImagesiftBot
Disallow: /
User-agent: img2dataset
Disallow: /
User-agent: ISSCyberRiskCrawler
Disallow: /
User-agent: Kangaroo Bot
Disallow: /
User-agent: KunatoCrawler
Disallow: /
User-agent: Meltwater
Disallow: /
User-agent: Meta-ExternalAgent
Disallow: /
User-agent: Meta-ExternalFetcher
Disallow: /
User-agent: MistralAI-User
Disallow: /
User-agent: OAI-Operator
Disallow: /
User-agent: OAI-SearchBot
Disallow: /
User-agent: omgili
Disallow: /
User-agent: omgilibot
Disallow: /
User-agent: PanguBot
Disallow: /
User-agent: Perplexity-User
Disallow: /
User-agent: PerplexityBot
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: QualifiedBot
Disallow: /
User-agent: Scrapy
Disallow: /
User-agent: Seekr
Disallow: /
User-agent: Sidetrade indexer bot
Disallow: /
User-agent: TikTokSpider
Disallow: /
User-agent: Timpibot
Disallow: /
User-agent: VelenPublicWebCrawler
Disallow: /
User-agent: WARDBot
Disallow: /
User-agent: Webzio-Extended
Disallow: /
User-agent: WRTNBot
Disallow: /
#Sitemap URLs
Sitemap: https://www.telegraph.co.uk/sitemap.xml
Sitemap: https://www.telegraph.co.uk/custom/authors/sitemap.xml
Sitemap: https://www.telegraph.co.uk/custom/main-pages/sitemap.xml
Sitemap: https://www.telegraph.co.uk/custom/daily-news/sitemap.xml
Sitemap: https://www.telegraph.co.uk/vouchercodes/sitemap.xml
Sitemap: https://www.telegraph.co.uk/custom/author-pages/sitemap.xml
BURL Variantswww/non-www, trailing slash, HTTP→HTTPSREVIEW
www / non-www
Inconsistent — duplicate content risk
HTTP → HTTPS
Consistent
BTLS Certificate Expiry & Recommendations216 days until leaf cert expires — 3 issues to addressREVIEW
Certificate validity
Recommended actions
- Enable HSTS: Strict-Transport-Security: max-age=31536000; includeSubDomains
- Enable DNSSEC on your domain for DNS spoofing protection
- Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
A+DNS Records4 A records, 79 ms lookupPASS
| A | 13.249.228.68, 13.249.228.56, 13.249.228.63, 13.249.228.109 |
| AAAA | — |
| CNAME | — |
| NS | ns-654.awsdns-17.net, ns-1323.awsdns-37.org, ns-1917.awsdns-47.co.uk, ns-17.awsdns-02.com |
| MX | 1 aspmx.l.google.com 5 alt2.aspmx.l.google.com 5 alt1.aspmx.l.google.com 10 alt3.aspmx.l.google.com 10 alt4.aspmx.l.google.com |
| TXT | CKO=cli_uugfgisni7leroxsr3oxeqk6g4 e2ma-verification=rmc3 9A5E-5479-92CD-BDB9-363F-DBC3-B73E-FAD5 MS=ms27293801 globalsign-domain-verification=4912c6f6617f49fd849ee96d55373abc google-site-verification=seEXglnGTvHqVcJ0lNMUHHRSVLxQFdQ5fbCBH42tdcg tollbit-domain-verification=6563e9ce7006eb396bfba0acc55d5cdc32263bf39a869c73bbeb... globalsign-domain-verification=4B45EB3587B84070B433AEA2FB8436F9 apple-domain-verification=e9WiroqCcOpsd3Gi google-site-verification=VJ4FpapbPtJUxGUoVbu_Al1x6b3D7JwDajV7RpRz0iY docker-verification=ea0466af-4045-428b-9632-5000d8e28265 onetrust-domain-verification=644f8eaea5474790be8e807bc3cbde93 ahrefs-site-verification_48766bf29e3b4f7e35c7056ac32490aa6dbda277328eff2ac165829... SPF v=spf1 include:_u.telegraph.co.uk._spf.smart.ondmarc.com ~all _globalsign-domain-verification=LbLpzJYGfeJslD6Gx67hlqv7w0WBkyhOG1H-vpQ_6m google-site-verification=3mCuyDRVD6118MldJ68t9jfagaTFTarbsDhFEaZmQkk google-site-verification=DEWbT7aHyM4Qmah-xGBcZsFYfMnUsTAMVxJavkahxnM globalsign-domain-verification=04e2636792bbdb054e366f54200dae45 yw2vqjz30d2614b3dkn0jfsyfdnccmhq MS=ms90821322 CKO=cli_ngzgfza5x3vexih67qoz3xezpa adobe-idp-site-verification=bcbd2ffcc31fe8466714532be859d0aa45942b9c11f3ee0c250a... google-site-verification=jU9uOgvVJfrW_FNJw96XBHGFRnQAEem67Z-7oITYs60 google-site-verification=HutNNVGQFKdgIuOS7R2F9zqxmrWxxfmdBennQkPF6hA google-site-verification=zHBE_An0f_qfkknSrhMHaYSlovt1HzeEsUEIhRD_Fxg mongodb-site-verification=yXefl5Vn2tkOZ2EBOPjKVBkIPQnZmXus _rimffo8umxnji9opm79mhss0zgux7qt atlassian-domain-verification=r3ZfWHRyy5QaC8kltkIWjwkzx8BUcxNgpipJKO/PVDmY/G7ctU... google-site-verification=V-xjA5Bvf-N5GxtgQioEqlHjAhLienBh-15Ijx9wyVc |
| CAA | Lookup not available with standard resolver |
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.
ARedirect Chain1 redirect(s), 290 ms totalPASS
https://telegraph.co.uk
53 ms · HTTP/1.1
https://www.telegraph.co.uk/
236 ms · HTTP/1.1 FINAL
| # | URL | Status | Time | Protocol | Server |
|---|---|---|---|---|---|
| 1 | https://telegraph.co.uk | 301 | 53 ms | HTTP/1.1 | AmazonS3 |
| 2 | https://www.telegraph.co.uk/ | 200 | 236 ms | HTTP/1.1 |
See the visual redirect chain in the HTTP Probe tab →
A+Domain Intelligencetelegraph.co.uk — via Markmonitor Inc., 31 years, 1 months old, hosted on AWSPASS
16 days
July 29, 2026
216 days
Issued by Amazon
31 years, 1 months
Registered July 29, 1995
Not enabled
Protects against DNS spoofing
AWS
ASN AS16509
13.249.228.56
Markmonitor Inc.
Expiry timeline
Recommended actions
- Renew the domain or enable auto-renewal to prevent accidental expiry
- Enable DNSSEC to protect visitors from DNS spoofing
- Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers
DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.
Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.
Learn more ▾ ▴
DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.
Source: ICANN / RFC 4033
The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.
Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.
Learn more ▾ ▴
Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.
Source: ICANN / domain-security best practice