Infrastructure

· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.

SCORE

GRADE

FIX

REVIEW

PASS

INFO

Probed from Madrid, Spain

200 OK

Checks

6 PASS 3 REVIEW

IPv6 Readiness

Action

No IPv6 support

REVIEW

No IPv6 support

No IPv6 (AAAA) records found

IPv6 support is increasingly important for global accessibility. About 40% of internet users have IPv6 connectivity.

No IPv6 Support

About 40% of internet users have IPv6. Consider adding AAAA records.

IPv6 support is increasingly important for global accessibility. About 40% of internet users have IPv6 connectivity.

Why this matters

No AAAA records — same impact as 'no IPv6 (AAAA) records'; IPv6-preferring clients pay extra latency falling back to IPv4.

Source: Google IPv6 stats

Crawlability

robots.txt present, no sitemap

REVIEW

robots.txt present, no sitemap

robots.txt is present

Got: 5854 bytes

No sitemap.xml found

A sitemap helps search engines discover and index your pages more efficiently.

robots.txt does not reference a sitemap

Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.

A sitemap helps search engines discover and index your pages more efficiently.

Why this matters

No sitemap.xml — Google relies on crawl-graph discovery alone, slowing indexing of deep or fresh URLs.

Learn more ▾

A sitemap accelerates Google's discovery of new and updated content. Most CMSes auto-generate one; static-site frameworks need a build-step plugin. Reference it from robots.txt and submit in Search Console to confirm Google can fetch it.

Source: sitemaps.org / Google Search Central

Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.

Why this matters

robots.txt omits Sitemap: directive — crawlers must fetch /sitemap.xml by convention; reliable but missing the explicit hint.

Source: sitemaps.org

robots.txt 200 OK

Size 5854 B Sitemaps referenced 0 User-agents YandexBot, Applebot, SemrushBot, *, Baiduspider, ToutiaoSpider, Googlebot, Yahoo! Slurp, bingbot, SQUID_configured_as_described_at_/help/faq/cache Blocking No — crawling allowed

# robots.txt for http://arxiv.org/ and mirror sites http://*.arxiv.org/
# Indiscriminate automated downloads from this site are not permitted
# See also: http://arxiv.org/help/robots

User-agent: *
Crawl-delay: 15
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search
Disallow: /set_author_id
Disallow: /show-email

User-agent: Googlebot
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: Yahoo! Slurp
Crawl-delay: 1
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: bingbot
# 2021-10-14 - removed crawl-delay for Bingbot. Needs to be re-added if there are any problems.
# 2021-10-26 - added back
Crawl-delay: 1
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: Baiduspider
Crawl-delay: 10
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: ToutiaoSpider
Crawl-delay: 10
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: SQUID_configured_as_described_at_/help/faq/cache
Crawl-delay: 10
Allow: /list
Allow: /abs
Allow: /pdf
Disallow: /archive
Disallow: /year
Disallow: /html
Disallow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: YandexBot
Crawl-delay: 1
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /e-print/
Disallow: /src/
Disallow: /ps/
Disallow: /psfigs/
Disallow: /dvi/
Disallow: /cookies/
Disallow: /form/
Disallow: /find/
Disallow: /view/
Disallow: /ftp/
Disallow: /refs/
Disallow: /cits/
Disallow: /format/
Disallow: /register
Disallow: /submit
Disallow: /replace
Disallow: /cross
Disallow: /jref
Disallow: /paper_passwd/
Disallow: /PS_cache/
Disallow: /Stats/
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /uploads
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: Applebot
Crawl-delay: 1
Allow: /archive
Allow: /year
Allow: /list
Allow: /abs
Allow: /pdf
Allow: /html
Allow: /catchup
Disallow: /user
Disallow: /e-print
Disallow: /src
Disallow: /ps
Disallow: /dvi
Disallow: /cookies
Disallow: /form
Disallow: /find
Disallow: /view
Disallow: /ftp
Disallow: /refs
Disallow: /cits
Disallow: /format
Disallow: /PS_cache
Disallow: /Stats
Disallow: /seek-and-destroy
Disallow: /IgnoreMe
Disallow: /oai2
Disallow: /auth
Disallow: /tb
Disallow: /tb/recent
Disallow: /tb-recent
Disallow: /trackback
Disallow: /prevnext
Disallow: /ct
Disallow: /api
Disallow: /search

User-agent: SemrushBot
Disallow: /

sitemap.xml No sitemap found

No sitemap found

Adding a sitemap helps search engines discover your pages.

TLS Certificate Expiry & Recommendations

Action

21 days until leaf cert expires — 4 issues to address

REVIEW

Certificate validity

days left

0d 30d 60d 90d+

Renew soon — under 30 days remaining

Recommended actions

Renew certificate — 21 days remaining
Enable HSTS: Strict-Transport-Security: max-age=31536000; includeSubDomains
Enable DNSSEC on your domain for DNS spoofing protection
Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy

A+

DNS Records

4 A records, 24 ms lookup

PASS

4 A records, 24 ms lookup

Resolves to 4 IPv4 address(es)

Got: 151.101.67.42, 151.101.195.42, 151.101.3.42, 151.101.131.42

No IPv6 (AAAA) records

4 nameserver(s) configured

Got: ns-cloud-d3.googledomains.com, ns-cloud-d4.googledomains.com, ns-cloud-d1.googledomains.com, ns-cloud-d2.googledomains.com

5 mail exchanger(s) configured

CAA records not checked

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

SPF record present in TXT

DNS resolution time: 24 ms

Got: 24 ms

A	151.101.67.42, 151.101.195.42, 151.101.3.42, 151.101.131.42
AAAA	—
CNAME	—
NS	ns-cloud-d3.googledomains.com, ns-cloud-d4.googledomains.com, ns-cloud-d1.googledomains.com, ns-cloud-d2.googledomains.com
MX	1 aspmx.l.google.com 5 alt2.aspmx.l.google.com 5 alt1.aspmx.l.google.com 10 alt3.aspmx.l.google.com 10 alt4.aspmx.l.google.com
TXT	fastly-domain-delegation-hovohwxbihnxkhgs7qud-710479-2023-10-30 SPF v=spf1 ip4:128.84.4.0/24 ip4:166.84.7.27 ip6:2602:f977:800:0::/64 include:salsal... fastly-domain-delegation-rggipjvqntxvyhcubc49-709999-2023-10-27
CAA	Lookup not available with standard resolver

Resolved in 24 ms

CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.

Why this matters

Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.

A+

Redirect Chain

No redirects — direct access

PASS

No redirects — direct access

Got: https://arxiv.org

https://arxiv.org

4 ms · HTTP/1.1 FINAL

#	URL	Status	Time	Protocol	Server
1	https://arxiv.org	200	4 ms	HTTP/1.1	Google Frontend

A+

URL Variants

www/non-www, trailing slash, HTTP→HTTPS

PASS

www/non-www, trailing slash, HTTP→HTTPS

www/non-www redirect configured correctly (preferred: non-www)

HTTP correctly 301-redirects to HTTPS

www / non-www

301https://www.arxiv.org/

200https://arxiv.org/

Preferred variant: non-www

HTTP → HTTPS

301http://arxiv.org/ → https://arxiv.org/

Consistent

A+

Domain Intelligence

arxiv.org — via Network Solutions, LLC, 27 years, 8 months old, hosted on Fastly

PASS

arxiv.org — via Network Solutions, LLC, 27 years, 8 months old, hosted on Fastly

Domain registered until Dec 28, 2029 (3 years, 9 months remaining)

DNSSEC is not enabled

DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.

Registrar: Network Solutions, LLC

Registrar lock is NOT enabled

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Hosting: Fastly

Got: AS54113

Domain expiry

1263 days

December 28, 2029

SSL certificate

21 days

Issued by Certainly

Domain age

27 years, 8 months

Registered December 28, 1998

DNSSEC

Not enabled

Protects against DNS spoofing

Hosting

Fastly

ASN AS54113

151.101.67.42

Registrar

Network Solutions, LLC

Unlocked 4 NS records

Expiry timeline

Today

+1 year

Domain expiry SSL expiry Danger zone (≤30 days)

Recommended actions

Renew the TLS certificate or verify auto-renewal is working
Enable DNSSEC to protect visitors from DNS spoofing
Enable registrar lock (clientTransferProhibited) to block unauthorized domain transfers

Registrar Network Solutions, LLC

Created December 28, 1998 (27 years, 8 months ago)

Expires December 28, 2029 (3 years, 9 months)

Last Updated August 3, 2022

Name Servers ns-cloud-d4.googledomains.com, ns-cloud-d1.googledomains.com, ns-cloud-d3.googledomains.com, ns-cloud-d2.googledomains.com

DNSSEC Not enabled

Hosting

IP Address 151.101.67.42

ASN AS54113 (FASTLY - Fastly, Inc., US)

Provider Fastly

Data source: rdap (0.7s)

DNSSEC protects against DNS spoofing attacks. While not required, enabling DNSSEC adds an additional layer of security. Contact your DNS provider to enable it.

Why this matters

Without DNSSEC, an attacker who can poison your DNS can hijack your domain — and SSL certs alone don't stop them.

Learn more ▾

DNSSEC adds cryptographic signatures to DNS records, preventing forged responses from poisoning resolver caches. Without it, an attacker who controls the network path can redirect your domain to a malicious server before any HTTPS handshake happens. Most modern registrars (Cloudflare, Google Domains, Route 53) enable it with one toggle.

Source: ICANN / RFC 4033

The domain can be transferred without an unlock step. Enable registrar lock (clientTransferProhibited) in your registrar's control panel to protect against unauthorized or accidental transfers.

Why this matters

Without registrar lock, an attacker who phishes your registrar credentials can transfer the domain in minutes — total brand hijack.

Learn more ▾

Registrar lock (clientTransferProhibited, clientUpdateProhibited, clientDeleteProhibited) requires extra verification before any transfer/update/delete. Every major registrar offers it free. Combined with 2FA on your registrar account, it's the strongest defense against domain hijacking.

Source: ICANN / domain-security best practice

A+

HTTP Probe Timing

Total 21 ms — DNS, TCP, TLS, TTFB, content transfer breakdown

PASS

DNS Lookup

18 ms

TCP Connect

0 ms

TLS Handshake

2 ms

Time to First Byte

21 ms

Total Time

22 ms

Connection waterfall

DNS Lookup 18 ms TCP Connect 0 ms TLS Handshake 2 ms Server Processing 1 ms Content Transfer 1 ms

A+

CDN & Delivery

Fastly (MISS, HIT, HIT)

PASS

Fastly (MISS, HIT, HIT)

Site is served via Fastly CDN

Got: x-served-by: cache-lga21956-LGA, cache-lga21980-LGA, cache-toj-leto2350046-TOJ

CDN cache status: MISS, HIT, HIT

CDN Detected: Fastly

Provider Fastly Cache Status MISS, HIT, HIT Evidence x-served-by: cache-lga21956-LGA, cache-lga21980-LGA, cache-toj-leto2350046-TOJ

All checks on this page are automated. Results are estimates - run targeted manual reviews when the score affects a release decision.