Infrastructure
· 9 checks — DNS, redirects, IPv6, crawlability, URL variants, and domain intelligence rolled into one auditable list.DCDN & DeliveryActionNo CDN detectedFIX
Consider using a CDN to improve global delivery speed and reduce origin load.
BCrawlabilityrobots.txt present, no sitemapREVIEW
A sitemap helps search engines discover and index your pages more efficiently.
No sitemap.xml — Google relies on crawl-graph discovery alone, slowing indexing of deep or fresh URLs.
Learn more ▾ ▴
A sitemap accelerates Google's discovery of new and updated content. Most CMSes auto-generate one; static-site frameworks need a build-step plugin. Reference it from robots.txt and submit in Search Console to confirm Google can fetch it.
Source: sitemaps.org / Google Search Central
Add a 'Sitemap:' directive to robots.txt so search engines can discover your sitemap.
robots.txt omits Sitemap: directive — crawlers must fetch /sitemap.xml by convention; reliable but missing the explicit hint.
Source: sitemaps.org
# Robots file listing html directories NOT to search on www.ibiblio.org
User-agent: *
Crawl-delay: 2
Disallow: /dbarberi/wiki/
Disallow: /designerunits/images/
Disallow: /designerunits/image*/
Disallow: /footy/tools/
Disallow: /herbmed/getit.php
Disallow: /mcmahon/emusic-l/
Disallow: /ncdarts/bcdl/search/
Disallow: /rtpnet/archives/
Disallow: /schools/fpg/
Disallow: /ser/cvs/
User-agent: ia_archiver
Disallow: /fred/
Disallow: /herbmed/
Disallow: /swsbm/
Disallow: /designerunits/
User-agent: Googlebot-Image
Disallow: /designerunits/
User-agent: Googlebot-News
Disallow: /designerunits/
User-agent: Mediapartners-Google
Disallow: /designerunits/
User-agent: psbot
Disallow: /designerunits/
No sitemap found
Adding a sitemap helps search engines discover your pages.
BURL Variantswww/non-www, trailing slash, HTTP→HTTPSREVIEW
www / non-www
Inconsistent — duplicate content risk
HTTP → HTTPS
Consistent
BTLS Certificate Expiry & Recommendations193 days until leaf cert expires — 3 issues to addressREVIEW
Certificate validity
Recommended actions
- Enable HSTS: Strict-Transport-Security: max-age=31536000; includeSubDomains
- Enable DNSSEC on your domain for DNS spoofing protection
- Enable OCSP stapling on your TLS server to remove a CA roundtrip and protect user privacy
A+DNS Records1 A records, 114 ms lookupPASS
| A | 152.19.134.40 |
| AAAA | 2606:f640:6000:321:0:bad:cafe:23 |
| CNAME | — |
| NS | ns.unc.edu, ns2.unc.edu |
| MX | 10 aspmx.l.google.com 20 alt2.aspmx.l.google.com 20 alt1.aspmx.l.google.com 30 aspmx3.googlemail.com 30 aspmx2.googlemail.com 30 aspmx5.googlemail.com 30 aspmx4.googlemail.com |
| TXT | SPF v=spf1 include:_spf.google.com ~all |
| CAA | Lookup not available with standard resolver |
Multiple A records provide failover if one server goes down.
Single A record means a single point of failure — if that IP goes down, your site is unreachable until DNS TTL expires.
Learn more ▾ ▴
Add multiple A records for round-robin failover, or use a managed DNS provider with health-checked failover (Route 53, Cloudflare, NS1). Short TTL (60-300s) lets clients recover faster on outages.
Source: SRE practice / DNS architecture
CAA record lookup requires a specialized DNS resolver. This check will be available in a future update.
Informational: CAA (Certification Authority Authorization) records weren't checked in this scan.
A+Redirect ChainNo redirects — direct accessPASS
https://ibiblio.org
343 ms · HTTP/1.1 FINAL
| # | URL | Status | Time | Protocol | Server |
|---|---|---|---|---|---|
| 1 | https://ibiblio.org | 200 | 343 ms | HTTP/1.1 |
A+IPv6 ReadinessIPv6 reachable (104 ms)PASS
AHTTP Probe TimingTotal 452 ms — DNS, TCP, TLS, TTFB, content transfer breakdownPASS
Connection waterfall
Domain IntelligenceDomain intelligence data not availableINFO
RDAP and WHOIS lookup both failed