Skip to content
https://news24.com

Infrastructure

· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.
SCORE
90
GRADE
A
FIX
0
REVIEW
4
PASS
5
INFO
0
Probed from Amsterdam, Netherlands
302 Found
Checks
9
5 PASS 4 REVIEW
B
Crawlability
robots.txt present, sitemap with 2745 URLs
REVIEW
robots.txt present, sitemap with 2745 URLs
Info::
robots.txt is present
Got: 2123 bytes
Info::
sitemap.xml is present
Warning::
sitemap.xml contains invalid XML
Search engines may not be able to parse the sitemap. Fix XML validation errors.
Info::
sitemap.xml contains 2745 entries
Info::
Sitemap index with 2745 child sitemaps
Info::
robots.txt references sitemap

Search engines may not be able to parse the sitemap. Fix XML validation errors.

Why this matters

An unparseable sitemap is silently ignored by Google — the URLs it advertises are never queued for crawl.

Learn more

Google's sitemap parser is strict about XML validity. A single unescaped `&` or unclosed tag invalidates the whole file. Run your sitemap through a validator (Search Console's Sitemaps report flags it) and fix the offending entry. Most generators escape correctly; mistakes usually come from manually-written entries.

Source: sitemaps.org / Google Search Central

robots.txt 200 OK
Size 2123 B Sitemaps referenced 1 User-agents google-extended, httrack, offline-explorer, linkdexbot, Twitterbot, 008, blexbot, dataforseobot, semrushbot-ba, semrushbot-si, semrushbot-swa, zoombot, chatgpt-user, bytespider, diffbot, facebookbot, applebot, dataprovider-com, hypestat, semrushbot, gptbot, claudebot, Bytespider, dcrawl, barkrowler, domainstatsbot, semrushbot-ct, cohere-ai, scrapy, ia_archiver, MauiBot, youbot, metainspector, newspaper, nutch, httrack-3-0, *, ccbot, dotbot, anthropic-ai, claude-web, omgili, amazonbot, perplexitybot, ahrefsbot, mj12bot, screaming-frog-seo-spider, serpstatbot Blocking No — crawling allowed
user-agent: *
Allow: /
Allow: */cricket/test/
Allow: */cricketworldcup2019/Test/
Disallow: /toets/
Disallow: */toets/*
Disallow: /test/
Disallow: */_test/*
Disallow: */testpolar/*
Disallow: */test/*
Disallow: /xArchive/Archive/Illegal-liquor-export-20010319
Disallow: /.well-known/
Disallow: /assetlinks.json
User-agent: Twitterbot
Allow: /
User-agent: ia_archiver
Disallow: /BreakingNewsSms
User-Agent: MauiBot
Disallow: /

 # AI Assistants
User-agent: chatgpt-user
Disallow: /

 # AI Data Scrapers
User-agent: bytespider
Disallow: /
User-agent: ccbot
Disallow: /
User-agent: diffbot
Disallow: /
User-agent: facebookbot
Disallow: /
User-agent: google-extended
Disallow: /
User-agent: gptbot
Disallow: /
User-agent: omgili
Disallow: /

 # AI Search Crawlers
User-agent: amazonbot
Disallow: /
User-agent: applebot
Disallow: /
User-agent: perplexitybot
Disallow: /
User-agent: youbot
Disallow: /

 # Scrapers
User-agent: 008
Disallow: /
User-agent: dataprovider-com
Disallow: /
User-agent: dcrawl
Disallow: /
User-agent: httrack
Disallow: /
User-agent: httrack-3-0
Disallow: /
User-agent: metainspector
Disallow: /
User-agent: newspaper
Disallow: /
User-agent: nutch
Disallow: /
User-agent: offline-explorer
Disallow: /
User-agent: scrapy
Disallow: /

 # SEO Crawlers
User-agent: ahrefsbot
Disallow: /
User-agent: barkrowler
Disallow: /
User-agent: blexbot
Disallow: /
User-agent: dataforseobot
Disallow: /
User-agent: domainstatsbot
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: hypestat
Disallow: /
User-agent: linkdexbot
Disallow: /
User-agent: mj12bot
Disallow: /
User-agent: screaming-frog-seo-spider
Disallow: /
User-agent: semrushbot
Disallow: /
User-agent: semrushbot-ba
Disallow: /
User-agent: semrushbot-ct
Disallow: /
User-agent: semrushbot-si
Disallow: /
User-agent: semrushbot-swa
Disallow: /
User-agent: serpstatbot
Disallow: /
User-agent: zoombot
Disallow: /

 # Undocumented AI Agents
User-agent: anthropic-ai
Disallow: /
User-agent: claude-web
Disallow: /
User-agent: claudebot
Disallow: /
User-agent: cohere-ai
Disallow: /
User-agent: Bytespider
Disallow: /
Sitemap: https://www.news24.com/sitemap

sitemap.xml 200 OK
Type Sitemap Index URLs 2745 entries Valid XML No
Child Sitemaps:
B
URL Variants
www/non-www, trailing slash, HTTP→HTTPS
REVIEW
www/non-www, trailing slash, HTTP→HTTPS
Critical::
HTTP version does not redirect to HTTPS
Got: HTTP 403 Expected: 301 redirect to HTTPS

www / non-www

403https://www.news24.com/
200https://news24.com/

HTTP → HTTPS

403http://news24.com/

HTTP version does not redirect to HTTPS

B
TLS Certificate Expiry & Recommendations
77 days until leaf cert expires — 3 issues to address
REVIEW

Certificate validity

77
days left
0d 30d 60d 90d+

Recommended actions

  • Enable HSTS: Strict-Transport-Security: max-age=31536000; includeSubDomains
  • Enable DNSSEC on your domain for DNS spoofing protection
  • Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
B
CDN & Delivery
Cloudflare
REVIEW
Cloudflare
Info::
Site is served via Cloudflare CDN (edge: AMS)
Got: cf-ray: 9eff7f9b9c02560e-AMS
CDN Detected: Cloudflare
Provider Cloudflare Evidence cf-ray: 9eff7f9b9c02560e-AMS
A+
DNS Records
2 A records, 13 ms lookup
PASS
2 A records, 13 ms lookup
Info::
Resolves to 2 IPv4 address(es)
Got: 104.17.251.6, 104.17.250.6
Info::
Has 2 IPv6 (AAAA) record(s)
Got: 2606:4700::6811:fb06, 2606:4700::6811:fa06
Info::
2 nameserver(s) configured
Got: hope.ns.cloudflare.com, jobs.ns.cloudflare.com
Info::
2 mail exchanger(s) configured
Info::
CAA records not checked
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Info::
SPF record present in TXT
Info::
DNS resolution time: 13 ms
Got: 13 ms
A104.17.251.6, 104.17.250.6
AAAA2606:4700::6811:fb06, 2606:4700::6811:fa06
CNAME
NShope.ns.cloudflare.com, jobs.ns.cloudflare.com
MX
0 news24-com.mail.protection.outlook.com
1 news24-com.mail.protection.outlook.com
TXT
+nEOwSMfaczHdmAzIYcKAF9xR6LmQu1qVVGN03hCrYm7DaEg6Yz+ifZQkPDsqbhErqN4XBlue771oJYD...
MS=ms29953490
MS=ms74745599
Nh3NkDaWsArUrOoWJAAsYbroTRbGHirUcO2JToQanwvNtll6pdvzqlmYLrxyztpM+kH/VtjFeTLslSiY...
XfCiedChZ/3rrm+EKLNn99vuw7TjWvvWVRCybzXXWDorqSkI63BhELPC4XYZsMQ0cxJLRz1McSHKKHUM...
Z5PfpAsgByWhVq01CV6GXPXN5T7RKF9SlxpFAHI8h5k+GiwY/CZd/ttGidkqKYHyX5yixBF6TOJOOQ4j...
facebook-domain-verification=2cqnt5m1o6v8sofheq47rmfijqjr0o
firebase=twentyfour-english-dev
firebase=twentyfour-english-live
google-site-verification=3NtlWVEBG97KUvmyu8HDnYe33fcQ4nBzQciopefQ6V0
google-site-verification=tF5ao3c0g6n89az94INUKA0KNZDxdkZqr2ArYgCQBK4
SPF v=spf1 ip4:69.63.146.128/26 ip4:69.63.158.32/28 ip4:68.169.14.0/24 ip4:154.0.13....
CAALookup not available with standard resolver
Resolved in 13 ms

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

Why this matters

Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.

A
Redirect Chain
1 redirect(s), 104 ms total
PASS
1 redirect(s), 104 ms total
Info::
Single redirect
Got: https://news24.com → https://www.news24.com/ (302)
Info::
WWW normalization redirect
Info::
Uses 302 (temporary) redirect
If permanent, use 301 instead.
Got: https://news24.com

https://news24.com

34 ms · HTTP/1.1

302

https://www.news24.com/

70 ms · HTTP/1.1 FINAL

#URLStatusTimeProtocolServer
1https://news24.com30234 msHTTP/1.1cloudflare
2https://www.news24.com/20070 msHTTP/1.1cloudflare

See the visual redirect chain in the HTTP Probe tab →

If permanent, use 301 instead.

Why this matters

302 (Found) is for genuinely temporary redirects — if this redirect is permanent, switch to 301 to preserve SEO equity.

Learn more

Search engines treat 302 as temporary, keeping the original URL indexed and not transferring full link equity to the destination. Use 301 (Moved Permanently) for permanent redirects (HTTP→HTTPS, www-vs-non-www, URL restructures).

Source: Google Search Central

A+
IPv6 Readiness
IPv6 reachable (2 ms)
PASS
IPv6 reachable (2 ms)
Info::
IPv6 is configured and reachable at 2606:4700::6811:fb06, 2606:4700::6811:fa06
Got: 2 ms connect
IPv6 Ready
AAAA Records 2606:4700::6811:fb06, 2606:4700::6811:fa06 Connection Reachable (2 ms)
A+
Domain Intelligence
news24.com — via Lexsynergy Limited, 28 years, 10 months old
PASS
news24.com — via Lexsynergy Limited, 28 years, 10 months old
Info::
Domain registered until Oct 29, 2026 (6 months remaining)
Info::
DNSSEC is not enabled
DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.
Info::
Registrar: Lexsynergy Limited
Warning::
Registrar lock is NOT enabled
The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.
Domain expiry

103 days

October 29, 2026

SSL certificate

77 days

Issued by Google Trust Services

Domain age

28 years, 10 months

Registered October 30, 1997

DNSSEC

Not enabled

Protects against DNS spoofing

Hosting

Unknown

2606:4700::6811:fb06

Registrar

Lexsynergy Limited

Unlocked 2 NS records
Expiry timeline
Today
+1 year
Domain expiry SSL expiry Danger zone (≤30 days)
Recommended actions
  • Enable DNSSEC to protect visitors from DNS spoofing
  • Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers
Registrar Lexsynergy Limited
Created October 30, 1997 (28 years, 10 months ago)
Expires October 29, 2026 (6 months)
Last Updated June 20, 2025
Name Servers hope.ns.cloudflare.com, jobs.ns.cloudflare.com
DNSSEC Not enabled
Hosting
IP Address 2606:4700::6811:fb06
Data source: rdap (0.1s)

DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.

Why this matters

Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.

Learn more

DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.

Source: ICANN / RFC 4033

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Why this matters

Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.

Learn more

Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.

Source: ICANN / domain-security best practice

A+
HTTP Probe Timing
Total 30 ms — DNS, TCP, TLS, TTFB, content transfer breakdown
PASS
DNS Lookup DNS Lookup — time to resolve the domain name to an IP address.
4 ms
TCP Connect TCP Connect — time to establish a TCP connection to the server.
1 ms
TLS Handshake TLS Handshake — time to complete the HTTPS encryption handshake.
9 ms
Time to First Byte Time to First Byte — how long the server takes to respond with the first byte of data.
30 ms
Total Time Total request time from DNS lookup through full response.
30 ms

Connection waterfall

DNS Lookup 4 ms TCP Connect 1 ms TLS Handshake 9 ms Server Processing 16 ms Content Transfer 0 ms
All checks on this page are automated. Results are estimates - run targeted manual reviews when the score affects a release decision.

Send Feedback