Skip to content
https://screamingfrog.co.uk

Infrastructure

· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.
SCORE
93
GRADE
A
FIX
0
REVIEW
2
PASS
7
INFO
0
Probed from Madrid, Spain
301 Moved Permanently
Checks
9
7 PASS 2 REVIEW
B
URL Variants
www/non-www, trailing slash, HTTP→HTTPS
REVIEW
www/non-www, trailing slash, HTTP→HTTPS
Critical::
Both www and non-www versions serve content
Got: Both variants return 200 Expected: One variant 301-redirects to the other
Info::
HTTP correctly 301-redirects to HTTPS

www / non-www

200https://www.screamingfrog.co.uk/
200https://screamingfrog.co.uk/

Inconsistent — duplicate content risk

HTTP → HTTPS

301http://screamingfrog.co.uk/ → https://screamingfrog.co.uk/

Consistent

B
TLS Certificate Expiry & Recommendations
77 days until leaf cert expires — 4 issues to address
REVIEW

Certificate validity

77
days left
0d 30d 60d 90d+

Recommended actions

  • Extend HSTS max-age to at least 31536000 (1 year) to meet the preload list criteria
  • Add the preload directive and submit to hstspreload.org once max-age + includeSubDomains are in place
  • Enable DNSSEC on your domain for DNS spoofing protection
  • Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
A+
DNS Records
3 A records, 41 ms lookup
PASS
3 A records, 41 ms lookup
Info::
Resolves to 3 IPv4 address(es)
Got: 104.26.3.186, 104.26.2.186, 172.67.68.36
Info::
Has 3 IPv6 (AAAA) record(s)
Got: 2606:4700:20::ac43:4424, 2606:4700:20::681a:2ba, 2606:4700:20::681a:3ba
Info::
2 nameserver(s) configured
Got: kanye.ns.cloudflare.com, raegan.ns.cloudflare.com
Info::
1 mail exchanger(s) configured
Info::
CAA records not checked
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Info::
SPF record present in TXT
Info::
DNS resolution time: 41 ms
Got: 41 ms
A104.26.3.186, 104.26.2.186, 172.67.68.36
AAAA2606:4700:20::ac43:4424, 2606:4700:20::681a:2ba, 2606:4700:20::681a:3ba
CNAME—
NSkanye.ns.cloudflare.com, raegan.ns.cloudflare.com
MX
0 screamingfrog-co-uk.mail.protection.outlook.com
TXT
facebook-domain-verification=29b6vyw5xade7jvk4do3tok941b83c
google-site-verification=PTsM84ZxtGX4KH8T2PzmTR1t79jtu9RwyOijqzxy0cU
google-site-verification=ZAi7CdojHbZzh6hRqQ0V16B7PYRMP9g4GIeIPJQmdN8
SPF v=spf1 mx a include:spf.protection.outlook.com include:relay.kinstamailservice.c...
google-site-verification=l6yaXAdYTwKQ-nxZXQxTHy9JjkTduZyPh7vZWi6eqOY
google-site-verification=a_n5VN10Poldqs7SIzuGiIJ312urNygHIvucwyebd6U
ca3-54b22a4c4d19429d86760245f8d1af65
ca3-1c382b05e2614053b8d80fe629a18030
CAALookup not available with standard resolver
Resolved in 41 ms

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

Why this matters

Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.

A
Redirect Chain
1 redirect(s), 234 ms total
PASS
1 redirect(s), 234 ms total
Info::
Single redirect
Got: https://screamingfrog.co.uk → https://www.screamingfrog.co.uk/ (301)
Info::
WWW normalization redirect

https://screamingfrog.co.uk

109 ms · HTTP/1.1

301

https://www.screamingfrog.co.uk/

125 ms · HTTP/1.1 FINAL

#URLStatusTimeProtocolServer
1https://screamingfrog.co.uk301109 msHTTP/1.1cloudflare
2https://www.screamingfrog.co.uk/200125 msHTTP/1.1cloudflare

See the visual redirect chain in the HTTP Probe tab →

A+
IPv6 Readiness
IPv6 reachable (16 ms)
PASS
IPv6 reachable (16 ms)
Info::
IPv6 is configured and reachable at 2606:4700:20::ac43:4424, 2606:4700:20::681a:2ba, 2606:4700:20::681a:3ba
Got: 16 ms connect
IPv6 Ready
AAAA Records 2606:4700:20::ac43:4424, 2606:4700:20::681a:2ba, 2606:4700:20::681a:3ba Connection Reachable (16 ms)
A+
Crawlability
robots.txt present, sitemap with 617 URLs
PASS
robots.txt present, sitemap with 617 URLs
Info::
robots.txt is present
Got: 1883 bytes
Info::
sitemap.xml is present
Info::
sitemap.xml is valid XML
Info::
sitemap.xml contains 617 entries
Info::
robots.txt does not reference a sitemap
Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.

Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.

Why this matters

robots.txt omits Sitemap: directive — crawlers must fetch /sitemap.xml by convention; reliable but missing the explicit hint.

Source: sitemaps.org

robots.txt 200 OK
Size 1883 B Sitemaps referenced 0 User-agents recruitment agencies, *, pesticides, toads, common salt, the french Blocking No — crawling allowed
User-agent: *

Disallow: /products/

Disallow: /?s=*

Disallow: /*?post_type*

Disallow: /search/

Disallow: /wp-content/themes/screamingfrog/inc/download-modal.php

Disallow: /wp-content/themes/screamingfrog/inc/download-modal-lfa.php


# Protection of frog team


User-agent: pesticides

Disallow: /frogs/


User-agent: toads

Disallow: /frogs/


User-agent: common salt

Disallow: /frogs/


User-agent: the french

Disallow: /frogs/legs/


# Protection of frog teams sanity


User-agent: recruitment agencies

Disallow: /frogs/phones/


# Screaming Frog - Search Engine Marketing


# If you're looking at our robots.txt then you might well be interested in our current SEO vacancies :-) 


# https://www.screamingfrog.co.uk/careers/


........?$$$M$$$$$$$$$$$$$$$$$$.........
..  ..$$$MM$$M$M$$$$$$$$$N$$$$$$$. . .. 
....$$$$$$7MMM.M.......MMMMM$$$$$$$.....
...$$$$$$.  MMMM   ...MMMMMMMMMM$$$$=.. 
..$$$$$..    MMM    MMMMMMMMMMM.$$$$$I..
.$$$$$...    MMM$MMMMMMMMMMMMM. .$$$$$..
$$$$$....  .$$MMMOMMMMMMMMMM .. ..$$$$$.
$$$$..... $$$$8MMMMMMMMMMMM........$$$$.
$$$$.. ..$$$$$$.MMMMMMMMMMM....... $$$$,
$$MM .M .$$$$= IMMMMMMMM$$M ...M..MM$$$7
$$$$MM7M?MMM$  MMMMMMMM$$$MM...M.M~$$$$7
$MMMMMMMIMMMM  MMMMMMMZ$$$.MMMMMMMMMMM$$
$$$$..MMMMMMMMMMMMMMMM$$$$. MMMMMMM$$$$$
$$$$. .MMMMMMMMMMMMMM.$$$$.   .  ..$$$$7
$$$$....MMMMMMMMMMMM .$$$$..   . . $$$$7
$$$$.... MMMMMMMMM  .$$$$$. . . . .$$$$$
$$$$......MMMMMMMMM$$$$$$$$$=====7$$$$$7
$$$$$   ..MODMMMMMMMM.$$$$$$$$$$$$$$$$$.
=$$$$........$$$MMMMMMM$$$$$$$$$$$$$$$. 
.$$$$$7............MMMMMM .    . .. .   
..$$$$$$........ ..  ..MMM     .  .     
...$$$$$$$,........ ..MMMM  . .. ..   . 
.....$$$$$$$$$$$$$$$MMMM$$$$$MM.  . . . 
.......$$$$$$$$$$$$MMMMM$$M$MM$. .  ... 
....     .+$$$$$$DMMM$M8MMMMM$$.........
....     . .. . .MMMMMMMMMMMMMMM. . ..  
....         .   .   ...+. .    ... ....
sitemap.xml 200 OK
Type URL Set URLs 617 entries Valid XML Yes
Sample URLs:
A+
Domain Intelligence
screamingfrog.co.uk — via One.com A/S [Tag = TJNF-DK], 19 years, 4 months old
PASS
screamingfrog.co.uk — via One.com A/S [Tag = TJNF-DK], 19 years, 4 months old
Info::
Domain registered until Mar 22, 2027 (11 months remaining)
Info::
Registrar: One.com A/S [Tag = TJNF-DK]
Warning::
Registrar lock is NOT enabled
The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.
Domain expiry

279 days

March 22, 2027

SSL certificate

77 days

Issued by Google Trust Services

Domain age

19 years, 4 months

Registered March 22, 2007

DNSSEC

Status unknown

Protects against DNS spoofing

Hosting

Unknown

2606:4700:20::ac43:4424

Registrar

One.com A/S [Tag = TJNF-DK]

Unlocked 2 NS records
Expiry timeline
Today
+1 year
Domain expiry SSL expiry Danger zone (≤30 days)
Recommended actions
  • Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers
Registrar One.com A/S [Tag = TJNF-DK]
Created March 22, 2007 (19 years, 4 months ago)
Expires March 22, 2027 (11 months)
Last Updated February 20, 2026
Name Servers kanye.ns.cloudflare.com, raegan.ns.cloudflare.com
Hosting
IP Address 2606:4700:20::ac43:4424
Data source: whois (0.6s)

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Why this matters

Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.

Learn more ▾

Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.

Source: ICANN / domain-security best practice

A+
HTTP Probe Timing
Total 168 ms — DNS, TCP, TLS, TTFB, content transfer breakdown
PASS
DNS Lookup DNS Lookup — time to resolve the domain name to an IP address.
41 ms
TCP Connect TCP Connect — time to establish a TCP connection to the server.
17 ms
TLS Handshake TLS Handshake — time to complete the HTTPS encryption handshake.
21 ms
Time to First Byte Time to First Byte — how long the server takes to respond with the first byte of data.
168 ms
Total Time Total request time from DNS lookup through full response.
168 ms

Connection waterfall

DNS Lookup 41 ms TCP Connect 17 ms TLS Handshake 21 ms Server Processing 90 ms Content Transfer 0 ms
A
CDN & Delivery
Cloudflare (MISS)
PASS
Cloudflare (MISS)
Info::
Site is served via Cloudflare CDN (edge: CDG)
Got: cf-ray: 9f07edc26de48cf9-CDG
Info::
CDN cache status: MISS
CDN Detected: Cloudflare
Provider Cloudflare Cache Status MISS Evidence cf-ray: 9f07edc26de48cf9-CDG
All checks on this page are automated. Results are estimates - run targeted manual reviews when the score affects a release decision.

Send Feedback