Skip to content
https://unicode.org

Infrastructure

· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.
SCORE
81
GRADE
B
FIX
2
REVIEW
1
PASS
6
INFO
0
Probed from Madrid, Spain
200 OK
Checks
9
6 PASS 1 REVIEW 2 FIX
D
Crawlability
Action
robots.txt present, no sitemap
FIX
robots.txt present, no sitemap
Info::
robots.txt is present
Got: 10240 bytes
Critical::
robots.txt blocks all crawlers
Disallow: / for all user-agents prevents search engines from indexing any page. This will remove the site from search results.
Info::
No sitemap.xml found
A sitemap helps search engines discover and index your pages more efficiently.
Info::
robots.txt does not reference a sitemap
Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.

Disallow: / for all user-agents prevents search engines from indexing any page. This will remove the site from search results.

Why this matters

Disallow: / in robots.txt blocks every search crawler — the site becomes invisible in organic search.

Learn more ▾

Common deployment mistake: a staging robots.txt with `User-agent: * / Disallow: /` ships to prod. The site falls out of search results within days. Verify your robots.txt is the production-intended version. If this is intentional (private site), no action needed.

Source: Google Search Central

A sitemap helps search engines discover and index your pages more efficiently.

Why this matters

No sitemap.xml — Google relies on crawl-graph discovery alone, slowing indexing of deep or fresh URLs.

Learn more ▾

A sitemap accelerates Google's discovery of new and updated content. Most CMSes auto-generate one; static-site frameworks need a build-step plugin. Reference it from robots.txt and submit in Search Console to confirm Google can fetch it.

Source: sitemaps.org / Google Search Central

Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.

Why this matters

robots.txt omits Sitemap: directive — crawlers must fetch /sitemap.xml by convention; reliable but missing the explicit hint.

Source: sitemaps.org

robots.txt 200 OK
Size 10240 B Sitemaps referenced 0 User-agents * Blocking Yes — all crawlers blocked
User-agent: *
Disallow: /draft/	# not official even if visible


# Begin updates for 2025 - Release 17.0
Disallow: /Public/16.0.0/    # obsolete data
Disallow: /charts/PDF/Unicode-16.0    # obsolete version
Disallow: /reports/tr46/tr46-33.html
Disallow: /reports/tr14/tr14-53.html
Disallow: /reports/tr15/tr15-56.html
Disallow: /reports/tr9/tr9-50.html
Disallow: /reports/tr51/tr51-27.html
Disallow: /reports/tr34/tr34-31.html
Disallow: /reports/tr35/tr35-74/    # obsolete version
Disallow: /reports/tr25/tr25-14.pdf
# End updates for 2025 - Release 17.0

Disallow: /Public/1.1-Update/	# obsolete data
Disallow: /Public/2.1-Update2/	# obsolete data
Disallow: /Public/3.0-Update/	# obsolete data
Disallow: /Public/3.0-Update/	# obsolete data
Disallow: /Public/2.1-Update3/	# obsolete data
Disallow: /Public/2.1-Update/	# obsolete data
Disallow: /Public/2.1-Update4/	# obsolete data
Disallow: /Public/3.0-Update1/ # obsolete data
Disallow: /Public/3.1-Update/  # obsolete data
Disallow: /Public/3.1-Update1/ # obsolete data
Disallow: /Public/3.2-Update/ # obsolete data
Disallow: /Public/4.0-Update/ # obsolete data
Disallow: /Public/4.0-Update1/ # obsolete data
Disallow: /Public/4.1.0/	# obsolete data
Disallow: /Public/5.0.0/	# obsolete data
Disallow: /Public/5.1.0/	# obsolete data
Disallow: /Public/5.2.0/	# obsolete data
Disallow: /Public/6.0.0/	# obsolete data
Disallow: /Public/6.1.0/	# obsolete data
Disallow: /Public/6.2.0/	# obsolete data
Disallow: /Public/6.3.0/	# obsolete data
Disallow: /Public/7.0.0/	# obsolete data
Disallow: /Public/8.0.0/	# obsolete data
Disallow: /Public/9.0.0/	# obsolete data
Disallow: /Public/10.0.0/	# obsolete data
Disallow: /Public/11.0.0/	# obsolete data
Disallow: /Public/12.0.0/	# obsolete data
Disallow: /Public/13.0.0/	# obsolete data
Disallow: /Public/14.0.0/	# obsolete data
Disallow: /Public/15.0.0/	# obsolete data
Disallow: /Public/15.1.0/	# obsolete data
Disallow: /fr/			# obsolete pages and charts
Disallow: /versions/Unicode2.0.0/	# obsolete version
Disallow: /versions/Unicode2.1.0/	# obsolete version
Disallow: /versions/Unicode3.0.0/	# obsolete version
Disallow: /versions/Unicode3.0.1/	# obsolete version
Disallow: /versions/Unicode3.1.0/	# obsolete version
Disallow: /versions/Unicode3.1.1/	# obsolete version
Disallow: /versions/Unicode3.2.0/	# obsolete version
Disallow: /versions/Unicode4.0.0/	# obsolete version
Disallow: /versions/Unicode4.0.1/	# obsolete version
Disallow: /versions/Unicode4.1.0/	# obsolete version
Disallow: /versions/Unicode5.0.0/	# obsolete version
Disallow: /versions/Unicode5.1.0/	# obsolete version
Disallow: /versions/Unicode5.2.0/	# obsolete version
Disallow: /versions/Unicode6.0.0/	# obsolete version
Disallow: /versions/Unicode6.1.0/	# obsolete version
Disallow: /versions/Unicode6.2.0/	# obsolete version
Disallow: /versions/Unicode6.3.0/	# obsolete version
Disallow: /versions/Unicode7.0.0/	# obsolete version
Disallow: /versions/Unicode8.0.0/	# obsolete version
Disallow: /versions/Unicode9.0.0/	# obsolete version
Disallow: /versions/Unicode10.0.0/	# obsolete version
Disallow: /versions/Unicode11.0.0/	# obsolete version
Disallow: /versions/Unicode12.0.0/	# obsolete version
Disallow: /versions/Unicode13.0.0/	# obsolete version
Disallow: /versions/Unicode14.0.0/	# obsolete version
Disallow: /versions/Unicode15.0.0/	# obsolete version
Disallow: /versions/Unicode15.1.0/	# obsolete version
Disallow: /charts/PDF/Unicode-3.1	# obsolete version
Disallow: /charts/PDF/Unicode-3.2	# obsolete version
Disallow: /charts/PDF/Unicode-4.0	# obsolete version
Disallow: /charts/PDF/Unicode-4.1	# obsolete version
Disallow: /charts/PDF/Unicode-5.0	# obsolete version
Disallow: /charts/PDF/Unicode-5.1	# obsolete version
Disallow: /charts/PDF/Unicode-5.2	# obsolete version
Disallow: /charts/PDF/Unicode-6.0	# obsolete version
Disallow: /charts/PDF/Unicode-6.1	# obsolete version
Disallow: /charts/PDF/Unicode-6.2	# obsolete version
Disallow: /charts/PDF/Unicode-6.3	# obsolete version
Disallow: /charts/PDF/Unicode-7.0	# obsolete version
Disallow: /charts/PDF/Unicode-8.0	# obsolete version
Disallow: /charts/PDF/Unicode-9.0	# obsolete version
Disallow: /charts/PDF/Unicode-10.0	# obsolete version
Disallow: /charts/PDF/Unicode-11.0	# obsolete version
Disallow: /charts/PDF/Unicode-12.0	# obsolete version
Disallow: /charts/PDF/Unicode-13.0	# obsolete version
Disallow: /charts/PDF/Unicode-14.0	# obsolete version
Disallow: /charts/PDF/Unicode-15.0	# obsolete version
Disallow: /charts/PDF/Unicode-15.1	# obsolete version
Disallow: /charts/beta/			# not permanent content
Disallow: /reports/tr1.html	# obsolete TR
Disallow: /reports/tr2.html	# obsolete TR
Disallow: /reports/tr3.html	# obsolete TR
Disallow: /reports/tr6-10.html	# obsolete TR draft
Disallow: /reports/tr1/	# obsolete TR
Disallow: /reports/tr2/	# obsolete TR
Disallow: /reports/tr3/	# obsolete TR
Disallow: /reports/tr7/	# obsolete TR
Disallow: /reports/tr12/	# obsolete TR
Disallow: /reports/tr13/	# obsolete TR
Disallow: /reports/tr19/	# obsolete TR
Disallow: /reports/tr21/	# obsolete TR
Disallow: /reports/tr30/	# obsolete TR
Disallow: /reports/tr32/	# obsolete TR
Disallow: /reports/tr40/	# obsolete TR
Disallow: /reports/tr47/	# obsolete TR
Disallow: /reports/tr49/	# obsolete TR
Disallow: /reports/tr52/	# obsolete TR
Disallow: /anon-ftp/	# same as Public, different path
Disallow: /Public/MAPPINGS/OBSOLETE/ # obsolete data
Disallow: /unicode/members/
Disallow: /members/
Disallow: /repository/	# dynamic
Disallow: /cldr/repository/	# dynamic
Disallow: /cldr/utility/	# dynamic
Disallow: /cgi-bin/	# dynamic
Disallow: /cldr/data/diff/	# dynamic
Disallow: /cldr/trac/	# dynamic
Disallow: /edcom/bugtrack/	# dynamic
Disallow: /uli/trac/	# dynamic
Disallow: /~srloomis/ut/trac/	#dynamic
Disallow: /repos/	# dynamic
Disallow: /repos/cldr-tmp/	# dynamic
Disallow: /utility/trac/	# dynamic
Disallow: /utility/	# dynamic
Disallow: /forum/	# dynamic
Disallow: /forum/viewtopic.php	# dynamic, discontinued
Allow: /cldr/data/common/
Allow: /cldr/data/docs/
Allow: /cldr/data/tools/
Disallow: /cldr/data/   # everything else
Disallow: /cldr/dropbox/	# not really public
Disallow: /~ecartis	# not really public
Disallow: /unibook/oldversions/	# obsolete data
Disallow: /reports/tr46/tr46-1.html
Disallow: /reports/tr46/tr46-2.html
Disallow: /reports/tr46/tr46-3.html
Disallow: /reports/tr46/tr46-4.html
Disallow: /reports/tr46/tr46-5.html
Disallow: /reports/tr46/tr46-6.html
Disallow: /reports/tr46/tr46-7.html
Disallow: /reports/tr46/tr46-8.html
Disallow: /reports/tr46/tr46-9.html
Disallow: /reports/tr46/tr46-10.html
Disallow: /reports/tr46/tr46-11.html
Disallow: /reports/tr46/tr46-12.html
Disallow: /reports/tr46/tr46-13.html
Disallow: /reports/tr46/tr46-14.html
Disallow: /reports/tr46/tr46-15.html
Disallow: /reports/tr46/tr46-16.html
Disallow: /reports/tr46/tr46-17.html
Disallow: /reports/tr46/tr46-18.html
Disallow: /reports/tr46/tr46-19.html
Disallow: /reports/tr46/tr46-20.html
Disallow: /reports/tr46/tr46-21.html
Disallow: /reports/tr46/tr46-22.html
Disallow: /reports/tr46/tr46-23.html
Disallow: /reports/tr46/tr46-24.html
Disallow: /reports/tr46/tr46-25.html
Disallow: /reports/tr46/tr46-26.html
Disallow: /reports/tr46/tr46-27.html
Disallow: /reports/tr46/tr46-28.html
Disallow: /reports/tr46/tr46-29.html
Disallow: /reports/tr46/tr46-30.html
Disallow: /reports/tr46/tr46-31.html
Disallow: /reports/tr46/tr46-32.html
Disallow: /reports/tr15/tr15-7.html
Disallow: /reports/tr15/tr15-8.html
Disallow: /reports/tr15/tr15-9.html
Disallow: /reports/tr15/tr15-10.html
Disallow: /reports/tr15/tr15-11.html
Disallow: /reports/tr15/tr15-12.html
Disallow: /reports/tr15/tr15-13.html
Disallow: /reports/tr15/tr15-14.html
Disallow: /reports/tr15/tr15-15.html
Disallow: /reports/tr15/tr15-16.html
Disallow: /reports/tr15/tr15-17.html
Disallow: /reports/tr15/tr15-18.html
Disallow: /reports/tr15/tr15-19.html
Disallow: /reports/tr15/tr15-20.html
Disallow: /reports/tr15/tr15-21.html
Disallow: /reports/tr15/tr15-22.html
Disallow: /reports/tr15/tr15-23.html
Disallow: /reports/tr15/tr15-24.html
Disallow: /reports/tr15/tr15-25.html
Disallow: /reports/tr15/tr15-26.html
Disallow: /reports/tr15/tr15-20.html
Disallow: /reports/tr15/tr15-21.html
Disallow: /reports/tr15/tr15-22.html
Disallow: /reports/tr15/tr15-23.html
Disallow: /reports/tr15/tr15-24.html
Disallow: /reports/tr15/tr15-25.html
Disallow: /reports/tr15/tr15-26.html
Disallow: /reports/tr15/tr15-27.html
Disallow: /reports/tr15/tr15-28.html
Disallow: /reports/tr15/tr15-29.html
Disallow: /reports/tr15/tr15-30.html
Disallow: /reports/tr15/tr15-31.html
Disallow: /reports/tr15/tr15-32.html
Disallow: /reports/tr15/tr15-33.html
Disallow: /reports/tr15/tr15-34.html
Disallow: /reports/tr15/tr15-35.html
Disallow: /reports/tr15/tr15-36.html
Disallow: /reports/tr15/tr15-37.html
Disallow: /reports/tr15/tr15-38.html
Disallow: /reports/tr15/tr15-39.html
Disallow: /reports/tr15/tr15-40.html
Disallow: /reports/tr15/tr15-40.html
Disallow: /reports/tr15/tr15-41.html
Disallow: /reports/tr15/tr15-42.html
Disallow: /reports/tr15/tr15-43.html
Disallow: /reports/tr15/tr15-44.html
Disallow: /reports/tr15/tr15-45.html
Disallow: /reports/tr15/tr15-46.html
Disallow: /reports/tr15/tr15-47.html
Disallow: /reports/tr15/tr15-48.html
Disallow: /reports/tr15/tr15-49.html
Disallow: /reports/tr15/tr15-50.html
Disallow: /reports/tr15/tr15-51.html
Disallow: /reports/tr15/tr15-52.html
Disallow: /reports/tr15/tr15-53.html
Disallow: /reports/tr15/tr15-54.html
Disallow: /reports/tr15/tr15-55.html
Disallow: /reports/tr14/tr14-15.html
Disallow: /reports/dtr14-03.html
Disallow: /reports/tr14-4/index.html
Disallow: /reports/tr14-5/index.html
Disallow: /reports/tr9/tr9-10.html
Disallow: /reports/tr9/tr9-11.html
Disallow: /reports/tr9/tr9-12.html
Disallow: /reports/tr9/tr9-13.html
Disallow: /reports/tr9/tr9-14.html
Disallow: /reports/tr9/tr9-15.html
Disallow: /reports/tr9/tr9-16.html
Disallow: /reports/tr9/tr9-17.html
Disallow: /reports/tr9/tr9-18.html
Disallow: /reports/tr9/tr9-19.html
Disallow: /reports/tr9/tr9-20.html
Disallow: /reports/tr9/tr9-21.html
Disallow: /reports/tr9/tr9-22.html
Disallow: /reports/tr9/tr9-23.html
Disallow: /reports/tr9/tr9-24.html
Disallow: /reports/tr9/tr9-25.html
Disallow: /reports/tr9/tr9-26.html
Disallow: /
sitemap.xml No sitemap found

No sitemap found

Adding a sitemap helps search engines discover your pages.

D
URL Variants
Action
www/non-www, trailing slash, HTTP→HTTPS
FIX
www/non-www, trailing slash, HTTP→HTTPS
Critical::
Both www and non-www versions serve content
Got: Both variants return 200 Expected: One variant 301-redirects to the other
Critical::
HTTP version does not redirect to HTTPS
Got: HTTP 200 Expected: 301 redirect to HTTPS

www / non-www

200https://www.unicode.org/
200https://unicode.org/

Inconsistent — duplicate content risk

HTTP → HTTPS

200http://unicode.org/

HTTP version does not redirect to HTTPS

B
TLS Certificate Expiry & Recommendations
89 days until leaf cert expires — 3 issues to address
REVIEW

Certificate validity

89
days left
0d 30d 60d 90d+

Recommended actions

  • Enable HSTS: Strict-Transport-Security: max-age=31536000; includeSubDomains
  • Enable DNSSEC on your domain for DNS spoofing protection
  • Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
A+
DNS Records
3 A records, 44 ms lookup
PASS
3 A records, 44 ms lookup
Info::
Resolves to 3 IPv4 address(es)
Got: 104.26.10.47, 172.67.74.23, 104.26.11.47
Info::
Has 3 IPv6 (AAAA) record(s)
Got: 2606:4700:20::681a:a2f, 2606:4700:20::681a:b2f, 2606:4700:20::ac43:4a17
Info::
2 nameserver(s) configured
Got: seamus.ns.cloudflare.com, shubhi.ns.cloudflare.com
Info::
5 mail exchanger(s) configured
Info::
CAA records not checked
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Info::
SPF record present in TXT
Info::
DNS resolution time: 44 ms
Got: 44 ms
A104.26.10.47, 172.67.74.23, 104.26.11.47
AAAA2606:4700:20::681a:a2f, 2606:4700:20::681a:b2f, 2606:4700:20::ac43:4a17
CNAME—
NSseamus.ns.cloudflare.com, shubhi.ns.cloudflare.com
MX
1 aspmx.l.google.com
5 alt1.aspmx.l.google.com
5 alt2.aspmx.l.google.com
10 alt3.aspmx.l.google.com
10 alt4.aspmx.l.google.com
TXT
google-site-verification=deQZw4BxV5l0nLkQe1NoFStRv0BX54DvYg3_8OQYnXg
SPF v=spf1 include:_spf.google.com ~all
google-site-verification=0OobJg1teswBFIkadaBFwYl7osN6W-L4k9v7OXvOAT4
google-site-verification=YGl4OXFVW0oRXV_dV3MsBtsU8yyN-jUcEPoNHqUgnSw
CAALookup not available with standard resolver
Resolved in 44 ms

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

Why this matters

Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.

A+
Redirect Chain
No redirects — direct access
PASS
No redirects — direct access
Info::
No redirects — direct access
Got: https://unicode.org

https://unicode.org

287 ms · HTTP/1.1 FINAL

#URLStatusTimeProtocolServer
1https://unicode.org200287 msHTTP/1.1cloudflare
A+
IPv6 Readiness
IPv6 reachable (16 ms)
PASS
IPv6 reachable (16 ms)
Info::
IPv6 is configured and reachable at 2606:4700:20::681a:a2f, 2606:4700:20::681a:b2f, 2606:4700:20::ac43:4a17
Got: 16 ms connect
IPv6 Ready
AAAA Records 2606:4700:20::681a:a2f, 2606:4700:20::681a:b2f, 2606:4700:20::ac43:4a17 Connection Reachable (16 ms)
A+
Domain Intelligence
unicode.org — via NameCheap, Inc., 34 years, 2 months old
PASS
unicode.org — via NameCheap, Inc., 34 years, 2 months old
Info::
Domain registered until Jul 23, 2029 (3 years, 3 months remaining)
Info::
DNSSEC is not enabled
DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.
Info::
Registrar: NameCheap, Inc.
Warning::
Registrar lock is NOT enabled
The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.
Domain expiry

1103 days

July 23, 2029

SSL certificate

89 days

Issued by Google Trust Services

Domain age

34 years, 2 months

Registered July 24, 1992

DNSSEC

Not enabled

Protects against DNS spoofing

Hosting

Unknown

2606:4700:20::681a:a2f

Registrar

NameCheap, Inc.

Unlocked 2 NS records
Expiry timeline
Today
+1 year
Domain expiry SSL expiry Danger zone (≤30 days)
Recommended actions
  • Enable DNSSEC to protect visitors from DNS spoofing
  • Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers
Registrar NameCheap, Inc.
Created July 24, 1992 (34 years, 2 months ago)
Expires July 23, 2029 (3 years, 3 months)
Last Updated April 12, 2025
Name Servers seamus.ns.cloudflare.com, shubhi.ns.cloudflare.com
DNSSEC Not enabled
Hosting
IP Address 2606:4700:20::681a:a2f
Data source: rdap (0.6s)

DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.

Why this matters

Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.

Learn more ▾

DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.

Source: ICANN / RFC 4033

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Why this matters

Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.

Learn more ▾

Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.

Source: ICANN / domain-security best practice

A+
HTTP Probe Timing
Total 318 ms — DNS, TCP, TLS, TTFB, content transfer breakdown
PASS
DNS Lookup DNS Lookup — time to resolve the domain name to an IP address.
32 ms
TCP Connect TCP Connect — time to establish a TCP connection to the server.
17 ms
TLS Handshake TLS Handshake — time to complete the HTTPS encryption handshake.
26 ms
Time to First Byte Time to First Byte — how long the server takes to respond with the first byte of data.
318 ms
Total Time Total request time from DNS lookup through full response.
319 ms

Connection waterfall

DNS Lookup 32 ms TCP Connect 17 ms TLS Handshake 26 ms Server Processing 244 ms Content Transfer 0 ms
A
CDN & Delivery
Cloudflare (DYNAMIC)
PASS
Cloudflare (DYNAMIC)
Info::
Site is served via Cloudflare CDN (edge: CDG)
Got: cf-ray: 9eff16383e232a12-CDG
Info::
CDN cache status: DYNAMIC
CDN Detected: Cloudflare
Provider Cloudflare Cache Status DYNAMIC Evidence cf-ray: 9eff16383e232a12-CDG
All checks on this page are automated. Results are estimates - run targeted manual reviews when the score affects a release decision.

Send Feedback